[2025-09-05T18:00:01.678478] [INFO ] [MAIN ] Using last completed trading day: 2025-09-05 [2025-09-05T18:00:01.679048] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-05T18:00:01.679343] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-05T18:00:03.771677] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-05T18:00:03.771986] [INFO ] [MAIN ] Filtered out 60 blacklisted symbols. [2025-09-05T18:00:03.772874] [INFO ] [LOCAL ] Symbols cache updated with 2363 symbols. [2025-09-05T18:00:03.772927] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-05T18:00:03.772958] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-05T18:00:03.773016] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-05T18:00:03.773108] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-05T18:00:03.773522] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-05T18:00:03.773704] [INFO ] [MAIN ] Including 60 blacklisted symbols for pruning. [2025-09-05T18:00:03.773741] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2363 valid symbols. [2025-09-05T18:00:03.773772] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-05T18:00:03.822043] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-09-05T18:00:03.822232] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-05T18:00:03.822271] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-05T18:00:03.822301] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-05T18:00:03.822590] [WARN ] [STATE ] State set to: RUNNING [2025-09-05T18:00:03.822747] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-05T18:00:03.823160] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-05T18:00:03.823198] [INFO ] [MAIN ] Starting incremental update for 2363 symbols. [2025-09-05T18:00:03.823228] [INFO ] [MAIN ] Running in parallel mode [2025-09-05T18:00:03.823442] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2363 symbols [2025-09-05T18:00:04.485758] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:04.490097] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:04.521057] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:04.542526] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-05T18:00:04.595204] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:04.595424] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-05T18:00:04.596968] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-05T18:00:04.597568] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-05T18:00:04.645359] [INFO ] [MAIN ] AACT: Loaded 5391 existing records. [2025-09-05T18:00:05.027324] [INFO ] [MAIN ] AA: Loaded 40363 existing records. [2025-09-05T18:00:05.092603] [INFO ] [MAIN ] A: Loaded 23927 existing records. [2025-09-05T18:00:05.351366] [INFO ] [MAIN ] AACT: Found 1 missing trading days. [2025-09-05T18:00:05.447369] [INFO ] [MAIN ] AACT: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:05.442143] [INFO ] [REMOTE ] AAM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:00:05.463344] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-05T18:00:05.487342] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-05T18:00:05.657012] [INFO ] [MAIN ] A: Found 1 missing trading days. [2025-09-05T18:00:05.671157] [INFO ] [MAIN ] AA: Found 1 missing trading days. [2025-09-05T18:00:05.671384] [INFO ] [MAIN ] AA: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:05.671849] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-05T18:00:05.671466] [INFO ] [MAIN ] A: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:05.672156] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-05T18:00:05.979382] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-05T18:00:05.980683] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-05T18:00:06.271582] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:00:06.326558] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:00:06.344307] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-05T18:00:06.357930] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-05T18:00:06.446338] [INFO ] [MAIN ] AACT: Adding 68 new records, updating 0 existing records. [2025-09-05T18:00:06.491556] [INFO ] [MAIN ] AA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:00:06.494130] [INFO ] [MAIN ] AACT: Combined dataset has 5459 total records. [2025-09-05T18:00:06.550550] [INFO ] [MAIN ] AA: Combined dataset has 40363 total records. [2025-09-05T18:00:06.566952] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:00:06.580689] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:00:06.589124] [FATAL] [MAIN ] AA: Combined data validation failed. [2025-09-05T18:00:06.652672] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:00:06.702421] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-05T18:00:06.724273] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-05T18:00:06.800911] [INFO ] [MAIN ] Update Progress: 1/2363 symbols completed. AA took 2.9s. Estimated remaining: 1h 57m 13s. Rate: 20.2 symbols/min [2025-09-05T18:00:06.834680] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-05T18:00:06.880166] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-05T18:00:06.873561] [WARN ] [VALIDATOR ] AACT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:06.978260] [INFO ] [MAIN ] A: Adding 379 new records, updating 0 existing records. [2025-09-05T18:00:07.250672] [INFO ] [MAIN ] A: Combined dataset has 24306 total records. [2025-09-05T18:00:07.309220] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:07.447761] [INFO ] [MAIN ] AAMI: Loaded 18564 existing records. [2025-09-05T18:00:07.463048] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-05T18:00:07.546273] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-05T18:00:07.619844] [WARN ] [VALIDATOR ] A: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:07.856474] [INFO ] [MAIN ] AAMI: Found 1 missing trading days. [2025-09-05T18:00:07.856907] [INFO ] [MAIN ] AAMI: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:07.857259] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-05T18:00:07.961534] [WARN ] [VALIDATOR ] AACT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:07.961844] [INFO ] [MAIN ] AACT: Combined data validation passed. [2025-09-05T18:00:07.961447] [WARN ] [VALIDATOR ] A: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:07.961991] [INFO ] [MAIN ] A: Combined data validation passed. [2025-09-05T18:00:08.096037] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-05T18:00:08.098013] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-05T18:00:08.112580] [INFO ] [MAIN ] AACT: Update completed successfully. [2025-09-05T18:00:08.115400] [INFO ] [MAIN ] Update Progress: 2/2363 symbols completed. AACT took 4.3s. Estimated remaining: 1h 24m 27s. Rate: 28.0 symbols/min [2025-09-05T18:00:08.318385] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:08.352372] [INFO ] [MAIN ] A: Update completed successfully. [2025-09-05T18:00:08.356397] [INFO ] [MAIN ] Update Progress: 3/2363 symbols completed. A took 4.5s. Estimated remaining: 59m 26s. Rate: 39.7 symbols/min [2025-09-05T18:00:08.538844] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:08.548157] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-05T18:00:08.549692] [INFO ] [MAIN ] AAP: Loaded 24872 existing records. [2025-09-05T18:00:08.549284] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-05T18:00:08.548250] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-09-05T18:00:08.595119] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-05T18:00:08.655607] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-05T18:00:08.659074] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-05T18:00:08.838452] [INFO ] [MAIN ] AAP: Found 1 missing trading days. [2025-09-05T18:00:08.859377] [INFO ] [MAIN ] AAP: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:08.888583] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-05T18:00:08.958141] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-05T18:00:09.000450] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-05T18:00:09.110899] [INFO ] [REMOTE ] AAT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:00:09.111349] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-05T18:00:09.273973] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:00:09.373954] [INFO ] [MAIN ] AAMI: Adding 317 new records, updating 0 existing records. [2025-09-05T18:00:09.377904] [INFO ] [MAIN ] AAMI: Combined dataset has 18881 total records. [2025-09-05T18:00:09.456765] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-05T18:00:09.485919] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-05T18:00:09.564852] [WARN ] [VALIDATOR ] AAMI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:00:09.762532] [WARN ] [VALIDATOR ] AAMI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:00:09.762804] [INFO ] [MAIN ] AAMI: Combined data validation passed. [2025-09-05T18:00:09.865046] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:00:09.967311] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:00:09.980586] [INFO ] [REMOTE ] AAM: Full fetch complete (726 records). [2025-09-05T18:00:10.216219] [INFO ] [MAIN ] AAP: Adding 330 new records, updating 0 existing records. [2025-09-05T18:00:10.341316] [INFO ] [MAIN ] AAP: Combined dataset has 25202 total records. [2025-09-05T18:00:10.339353] [INFO ] [MAIN ] AAMI: Update completed successfully. [2025-09-05T18:00:10.351295] [INFO ] [MAIN ] Update Progress: 4/2363 symbols completed. AAMI took 3.5s. Estimated remaining: 1h 4m 10s. Rate: 36.8 symbols/min [2025-09-05T18:00:10.804676] [WARN ] [VALIDATOR ] AAP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:10.961933] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:11.035264] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-05T18:00:11.052190] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-05T18:00:11.121707] [INFO ] [MAIN ] AAUC: Loaded 5362 existing records. [2025-09-05T18:00:11.314046] [INFO ] [MAIN ] AAUC: Found 1 missing trading days. [2025-09-05T18:00:11.314809] [INFO ] [MAIN ] AAUC: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:11.315256] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-05T18:00:11.330272] [WARN ] [VALIDATOR ] AAM: Missing days changed. Total missing: 11 New missing: 2025-06-04, 2025-06-18, 2025-06-27, 2025-07-10 No longer missing: 2025-01-29, 2025-01-30, 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-04-15, 2025-04-22, 2025-04-23, 2025-05-09, 2025-06-04, 2025-06-18, 2025-06-27, 2025-07-10, 2025-07-21, 2025-07-22, 2025-07-29 [2025-09-05T18:00:11.330334] [WARN ] [VALIDATOR ] AAP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:11.330580] [INFO ] [MAIN ] AAM: Fetched primary data is valid. [2025-09-05T18:00:11.330695] [INFO ] [MAIN ] AAP: Combined data validation passed. [2025-09-05T18:00:11.335732] [INFO ] [MAIN ] AAM: Full history saved. [2025-09-05T18:00:11.336053] [INFO ] [MAIN ] Update Progress: 5/2363 symbols completed. AAM took 7.5s. Estimated remaining: 59m 3s. Rate: 39.9 symbols/min [2025-09-05T18:00:11.615613] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:11.622421] [INFO ] [MAIN ] AB: Loaded 1410 existing records. [2025-09-05T18:00:11.811462] [INFO ] [MAIN ] AB: Found 1 missing trading days. [2025-09-05T18:00:11.812284] [INFO ] [MAIN ] AB: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:11.813075] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-05T18:00:11.865879] [INFO ] [MAIN ] AAP: Update completed successfully. [2025-09-05T18:00:11.869130] [INFO ] [MAIN ] Update Progress: 6/2363 symbols completed. AAP took 3.8s. Estimated remaining: 52m 41s. Rate: 44.7 symbols/min [2025-09-05T18:00:12.047590] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:12.072083] [INFO ] [MAIN ] ABBV: Loaded 25686 existing records. [2025-09-05T18:00:12.267186] [INFO ] [MAIN ] ABBV: Found 1 missing trading days. [2025-09-05T18:00:12.267351] [INFO ] [MAIN ] ABBV: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:12.267566] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-05T18:00:12.389143] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:00:12.431463] [INFO ] [MAIN ] AAUC: Adding 156 new records, updating 0 existing records. [2025-09-05T18:00:12.434580] [INFO ] [MAIN ] AAUC: Combined dataset has 5518 total records. [2025-09-05T18:00:12.556926] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:00:12.685993] [WARN ] [VALIDATOR ] AAUC: Not fatal, but first date in data (2025-06-09) does not match expected start date (2025-01-31) [2025-09-05T18:00:12.716030] [INFO ] [MAIN ] AB: Adding 151 new records, updating 0 existing records. [2025-09-05T18:00:12.775906] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-05T18:00:12.819794] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-05T18:00:12.836828] [INFO ] [MAIN ] AB: Combined dataset has 1561 total records. [2025-09-05T18:00:13.034285] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:00:13.197015] [WARN ] [VALIDATOR ] AB: Not fatal, but first date in data (2025-08-21) does not match expected start date (2025-01-31) [2025-09-05T18:00:13.433716] [INFO ] [MAIN ] ABBV: Adding 389 new records, updating 0 existing records. [2025-09-05T18:00:13.505143] [INFO ] [MAIN ] ABBV: Combined dataset has 26075 total records. [2025-09-05T18:00:13.708421] [WARN ] [VALIDATOR ] ABBV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:13.831111] [WARN ] [VALIDATOR ] AAUC: Missing days changed. Total missing: 88 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06 [2025-09-05T18:00:13.831243] [WARN ] [VALIDATOR ] AB: Missing days changed. Total missing: 139 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12, 2025-08-13, 2025-08-14, 2025-08-15, 2025-08-18, 2025-08-19, 2025-08-20 [2025-09-05T18:00:13.836744] [INFO ] [MAIN ] AAUC: Combined data validation passed. [2025-09-05T18:00:13.841990] [INFO ] [MAIN ] AB: Combined data validation passed. [2025-09-05T18:00:13.958357] [INFO ] [MAIN ] AB: Update completed successfully. [2025-09-05T18:00:13.959331] [INFO ] [MAIN ] Update Progress: 7/2363 symbols completed. AB took 2.6s. Estimated remaining: 56m 52s. Rate: 41.4 symbols/min [2025-09-05T18:00:14.107443] [INFO ] [MAIN ] AAUC: Update completed successfully. [2025-09-05T18:00:14.132704] [INFO ] [MAIN ] Update Progress: 8/2363 symbols completed. AAUC took 3.8s. Estimated remaining: 50m 35s. Rate: 46.6 symbols/min [2025-09-05T18:00:14.166258] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:14.294894] [INFO ] [MAIN ] ABCB: Loaded 13807 existing records. [2025-09-05T18:00:14.452581] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:14.558667] [INFO ] [MAIN ] ABCB: Found 1 missing trading days. [2025-09-05T18:00:14.559260] [INFO ] [MAIN ] ABCB: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:14.566336] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-05T18:00:14.594902] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-05T18:00:14.604099] [INFO ] [MAIN ] ABEV: Loaded 25408 existing records. [2025-09-05T18:00:14.627521] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-05T18:00:14.802948] [INFO ] [MAIN ] ABEV: Found 1 missing trading days. [2025-09-05T18:00:14.803392] [INFO ] [MAIN ] ABEV: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:14.803674] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-05T18:00:14.805507] [WARN ] [VALIDATOR ] ABBV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:14.805932] [INFO ] [MAIN ] ABBV: Combined data validation passed. [2025-09-05T18:00:14.979493] [INFO ] [MAIN ] ABBV: Update completed successfully. [2025-09-05T18:00:14.983620] [INFO ] [MAIN ] Update Progress: 9/2363 symbols completed. ABBV took 3.1s. Estimated remaining: 48m 39s. Rate: 48.4 symbols/min [2025-09-05T18:00:15.157168] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:15.166397] [INFO ] [MAIN ] ABG: Loaded 8650 existing records. [2025-09-05T18:00:15.340573] [INFO ] [MAIN ] ABG: Found 1 missing trading days. [2025-09-05T18:00:15.346001] [INFO ] [MAIN ] ABG: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:15.346555] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-05T18:00:15.346194] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:00:15.425869] [INFO ] [MAIN ] ABCB: Adding 280 new records, updating 0 existing records. [2025-09-05T18:00:15.429708] [INFO ] [MAIN ] ABCB: Combined dataset has 14087 total records. [2025-09-05T18:00:15.613163] [WARN ] [VALIDATOR ] ABCB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:15.715589] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:00:15.971260] [INFO ] [MAIN ] ABEV: Adding 389 new records, updating 0 existing records. [2025-09-05T18:00:15.979877] [INFO ] [MAIN ] ABEV: Combined dataset has 25797 total records. [2025-09-05T18:00:16.096182] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:00:16.168333] [INFO ] [MAIN ] ABG: Adding 138 new records, updating 0 existing records. [2025-09-05T18:00:16.226868] [WARN ] [VALIDATOR ] ABEV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:16.238452] [WARN ] [VALIDATOR ] ABCB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:16.257006] [INFO ] [MAIN ] ABCB: Combined data validation passed. [2025-09-05T18:00:16.290603] [INFO ] [MAIN ] ABG: Combined dataset has 8788 total records. [2025-09-05T18:00:16.520324] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-05T18:00:16.620764] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-05T18:00:16.713031] [WARN ] [VALIDATOR ] ABG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:16.934325] [INFO ] [MAIN ] ABCB: Update completed successfully. [2025-09-05T18:00:16.936821] [INFO ] [MAIN ] Update Progress: 10/2363 symbols completed. ABCB took 3.0s. Estimated remaining: 51m 26s. Rate: 45.8 symbols/min [2025-09-05T18:00:17.044982] [WARN ] [VALIDATOR ] ABEV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:17.044835] [WARN ] [VALIDATOR ] ABG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:17.061261] [INFO ] [MAIN ] ABEV: Combined data validation passed. [2025-09-05T18:00:17.100233] [INFO ] [MAIN ] ABG: Combined data validation passed. [2025-09-05T18:00:17.118997] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:17.303540] [INFO ] [MAIN ] ABG: Update completed successfully. [2025-09-05T18:00:17.328011] [INFO ] [MAIN ] Update Progress: 11/2363 symbols completed. ABG took 2.3s. Estimated remaining: 48m 8s. Rate: 48.9 symbols/min [2025-09-05T18:00:17.329097] [INFO ] [MAIN ] ABM: Loaded 23633 existing records. [2025-09-05T18:00:17.723148] [INFO ] [MAIN ] ABM: Found 1 missing trading days. [2025-09-05T18:00:17.716952] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:17.723586] [INFO ] [MAIN ] ABM: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:17.724111] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-05T18:00:17.728805] [INFO ] [MAIN ] ABEV: Update completed successfully. [2025-09-05T18:00:17.732178] [INFO ] [MAIN ] Update Progress: 12/2363 symbols completed. ABEV took 3.6s. Estimated remaining: 45m 25s. Rate: 51.8 symbols/min [2025-09-05T18:00:17.918547] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:17.927282] [INFO ] [MAIN ] ABR: Loaded 24697 existing records. [2025-09-05T18:00:18.117077] [INFO ] [MAIN ] ABR: Found 1 missing trading days. [2025-09-05T18:00:18.117231] [INFO ] [MAIN ] ABR: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:18.117469] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-05T18:00:18.135988] [INFO ] [MAIN ] ABT: Loaded 40374 existing records. [2025-09-05T18:00:18.323193] [INFO ] [MAIN ] ABT: Found 1 missing trading days. [2025-09-05T18:00:18.323630] [INFO ] [MAIN ] ABT: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:18.324215] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-05T18:00:18.342989] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-05T18:00:18.350090] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-05T18:00:18.417704] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:00:18.539038] [INFO ] [MAIN ] ABM: Adding 381 new records, updating 0 existing records. [2025-09-05T18:00:18.542292] [INFO ] [MAIN ] ABM: Combined dataset has 24014 total records. [2025-09-05T18:00:18.722317] [WARN ] [VALIDATOR ] ABM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:00:18.903472] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:00:19.063714] [INFO ] [MAIN ] ABR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:00:19.064121] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:00:19.105781] [INFO ] [MAIN ] ABR: Combined dataset has 24697 total records. [2025-09-05T18:00:19.126158] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:00:19.141853] [FATAL] [MAIN ] ABR: Combined data validation failed. [2025-09-05T18:00:19.179063] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:00:19.200093] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-05T18:00:19.221427] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-09-05T18:00:19.248090] [INFO ] [MAIN ] ABT: Adding 389 new records, updating 0 existing records. [2025-09-05T18:00:19.252992] [INFO ] [MAIN ] Update Progress: 13/2363 symbols completed. ABR took 1.9s. Estimated remaining: 46m 29s. Rate: 50.6 symbols/min [2025-09-05T18:00:19.390572] [INFO ] [MAIN ] ABT: Combined dataset has 40763 total records. [2025-09-05T18:00:19.405867] [WARN ] [VALIDATOR ] ABM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:00:19.406592] [INFO ] [MAIN ] ABM: Combined data validation passed. [2025-09-05T18:00:19.471250] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:19.666783] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-05T18:00:19.704172] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-05T18:00:19.760235] [WARN ] [VALIDATOR ] ABT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:00:19.766965] [INFO ] [MAIN ] ACA: Loaded 10818 existing records. [2025-09-05T18:00:20.227876] [INFO ] [MAIN ] ACA: Found 1 missing trading days. [2025-09-05T18:00:20.229828] [INFO ] [MAIN ] ACA: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:20.231095] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-05T18:00:20.277190] [INFO ] [MAIN ] ABM: Update completed successfully. [2025-09-05T18:00:20.280138] [INFO ] [MAIN ] Update Progress: 14/2363 symbols completed. ABM took 3.3s. Estimated remaining: 46m 1s. Rate: 51.0 symbols/min [2025-09-05T18:00:20.456093] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:20.460510] [WARN ] [VALIDATOR ] ABT: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:00:20.460848] [INFO ] [MAIN ] ABT: Combined data validation passed. [2025-09-05T18:00:20.474577] [INFO ] [MAIN ] ACCO: Loaded 17623 existing records. [2025-09-05T18:00:20.759601] [INFO ] [MAIN ] ACCO: Found 1 missing trading days. [2025-09-05T18:00:20.760454] [INFO ] [MAIN ] ACCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:20.760831] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-05T18:00:20.886672] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:00:20.965123] [INFO ] [MAIN ] ACA: Adding 140 new records, updating 0 existing records. [2025-09-05T18:00:20.972956] [INFO ] [MAIN ] ACA: Combined dataset has 10958 total records. [2025-09-05T18:00:21.175480] [WARN ] [VALIDATOR ] ACA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:21.274811] [INFO ] [MAIN ] ABT: Update completed successfully. [2025-09-05T18:00:21.295944] [INFO ] [MAIN ] Update Progress: 15/2363 symbols completed. ABT took 3.6s. Estimated remaining: 45m 35s. Rate: 51.5 symbols/min [2025-09-05T18:00:21.322802] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:00:21.554521] [INFO ] [MAIN ] ACCO: Adding 206 new records, updating 0 existing records. [2025-09-05T18:00:21.662949] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:21.663625] [INFO ] [MAIN ] ACCO: Combined dataset has 17829 total records. [2025-09-05T18:00:21.663489] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-09-05T18:00:21.726295] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-05T18:00:21.733092] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-05T18:00:21.751538] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-05T18:00:21.800816] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-05T18:00:21.785752] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-05T18:00:21.990823] [WARN ] [VALIDATOR ] ACCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:22.492557] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:00:22.493220] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-05T18:00:22.511915] [WARN ] [VALIDATOR ] ACA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:22.512239] [INFO ] [MAIN ] ACA: Combined data validation passed. [2025-09-05T18:00:22.511989] [WARN ] [VALIDATOR ] ACCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:22.512679] [INFO ] [MAIN ] ACCO: Combined data validation passed. [2025-09-05T18:00:22.668010] [INFO ] [MAIN ] ACA: Update completed successfully. [2025-09-05T18:00:22.669847] [INFO ] [MAIN ] Update Progress: 16/2363 symbols completed. ACA took 3.4s. Estimated remaining: 46m 5s. Rate: 50.9 symbols/min [2025-09-05T18:00:22.845452] [INFO ] [MAIN ] ACCO: Update completed successfully. [2025-09-05T18:00:22.862825] [INFO ] [MAIN ] Update Progress: 17/2363 symbols completed. ACCO took 2.6s. Estimated remaining: 43m 47s. Rate: 53.6 symbols/min [2025-09-05T18:00:22.866245] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:23.048995] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:23.078668] [INFO ] [MAIN ] ACHR: Loaded 40558 existing records. [2025-09-05T18:00:23.292075] [INFO ] [MAIN ] ACI: Loaded 40094 existing records. [2025-09-05T18:00:23.291070] [INFO ] [MAIN ] ACHR: Found 1 missing trading days. [2025-09-05T18:00:23.328637] [INFO ] [MAIN ] ACHR: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:23.335824] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-05T18:00:23.479276] [INFO ] [MAIN ] ACI: Found 1 missing trading days. [2025-09-05T18:00:23.479481] [INFO ] [MAIN ] ACI: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:23.493474] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-05T18:00:23.497251] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-05T18:00:23.503891] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-05T18:00:23.822358] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:00:23.824814] [INFO ] [REMOTE ] AAT: Full fetch complete (32798 records). [2025-09-05T18:00:23.825724] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:00:23.825838] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:00:23.825906] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:00:23.825981] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-05T18:00:23.826080] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-05T18:00:23.826222] [INFO ] [MAIN ] Update Progress: 18/2363 symbols completed. AAT took 15.5s. Estimated remaining: 43m 26s. Rate: 54.0 symbols/min [2025-09-05T18:00:24.019352] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:24.034945] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-05T18:00:24.040113] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-05T18:00:24.060828] [INFO ] [MAIN ] ACM: Loaded 19995 existing records. [2025-09-05T18:00:24.223273] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:00:24.255290] [INFO ] [MAIN ] ACM: Found 1 missing trading days. [2025-09-05T18:00:24.283495] [INFO ] [MAIN ] ACM: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:24.301781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-05T18:00:24.321513] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:00:24.533432] [INFO ] [MAIN ] ACHR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:00:24.610390] [INFO ] [MAIN ] ACI: Adding 384 new records, updating 0 existing records. [2025-09-05T18:00:24.613783] [INFO ] [MAIN ] ACHR: Combined dataset has 40948 total records. [2025-09-05T18:00:24.679591] [INFO ] [MAIN ] ACI: Combined dataset has 40478 total records. [2025-09-05T18:00:24.901585] [WARN ] [VALIDATOR ] ACHR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:00:25.076661] [WARN ] [VALIDATOR ] ACI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:00:25.121021] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:00:25.424535] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-05T18:00:25.545861] [INFO ] [MAIN ] ACM: Adding 331 new records, updating 0 existing records. [2025-09-05T18:00:25.579307] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-05T18:00:25.595567] [INFO ] [MAIN ] ACM: Combined dataset has 20326 total records. [2025-09-05T18:00:25.793913] [WARN ] [VALIDATOR ] ACM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:25.915262] [WARN ] [VALIDATOR ] ACHR: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:00:25.920688] [INFO ] [MAIN ] ACHR: Combined data validation passed. [2025-09-05T18:00:25.931347] [WARN ] [VALIDATOR ] ACI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:00:25.988876] [INFO ] [MAIN ] ACI: Combined data validation passed. [2025-09-05T18:00:26.237885] [WARN ] [VALIDATOR ] ACM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:26.241253] [INFO ] [MAIN ] ACM: Combined data validation passed. [2025-09-05T18:00:26.511929] [INFO ] [MAIN ] ACM: Update completed successfully. [2025-09-05T18:00:26.517821] [INFO ] [MAIN ] Update Progress: 19/2363 symbols completed. ACM took 2.7s. Estimated remaining: 46m 40s. Rate: 50.2 symbols/min [2025-09-05T18:00:26.799494] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:26.856712] [INFO ] [MAIN ] ACI: Update completed successfully. [2025-09-05T18:00:26.865618] [INFO ] [MAIN ] Update Progress: 20/2363 symbols completed. ACI took 4.0s. Estimated remaining: 44m 59s. Rate: 52.1 symbols/min [2025-09-05T18:00:26.867743] [INFO ] [MAIN ] ACN: Loaded 40190 existing records. [2025-09-05T18:00:27.090323] [INFO ] [MAIN ] ACHR: Update completed successfully. [2025-09-05T18:00:27.119386] [INFO ] [MAIN ] Update Progress: 21/2363 symbols completed. ACHR took 4.4s. Estimated remaining: 43m 18s. Rate: 54.1 symbols/min [2025-09-05T18:00:27.243069] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:27.321832] [INFO ] [MAIN ] ACN: Found 1 missing trading days. [2025-09-05T18:00:27.357458] [INFO ] [MAIN ] ACN: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:27.358499] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-05T18:00:27.436677] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:27.452903] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-09-05T18:00:27.454103] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-05T18:00:27.466161] [INFO ] [MAIN ] ACP: Loaded 14484 existing records. [2025-09-05T18:00:27.487970] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-05T18:00:27.460358] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-05T18:00:27.511526] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-05T18:00:27.545238] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-05T18:00:27.826878] [INFO ] [MAIN ] ACP: Found 1 missing trading days. [2025-09-05T18:00:27.872743] [INFO ] [MAIN ] ACP: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:27.905369] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-05T18:00:28.014531] [INFO ] [REMOTE ] ACR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:00:28.014895] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-05T18:00:28.084148] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:00:28.249183] [INFO ] [MAIN ] ACN: Adding 388 new records, updating 0 existing records. [2025-09-05T18:00:28.253400] [INFO ] [MAIN ] ACN: Combined dataset has 40578 total records. [2025-09-05T18:00:28.432666] [WARN ] [VALIDATOR ] ACN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:00:28.626596] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-05T18:00:28.628023] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-05T18:00:28.638026] [WARN ] [VALIDATOR ] ACN: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:00:28.638246] [INFO ] [MAIN ] ACN: Combined data validation passed. [2025-09-05T18:00:28.887626] [INFO ] [MAIN ] ACN: Update completed successfully. [2025-09-05T18:00:28.894142] [INFO ] [MAIN ] Update Progress: 22/2363 symbols completed. ACN took 2.3s. Estimated remaining: 44m 28s. Rate: 52.7 symbols/min [2025-09-05T18:00:29.067064] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:29.084070] [INFO ] [MAIN ] ACRE: Loaded 15826 existing records. [2025-09-05T18:00:29.275093] [INFO ] [MAIN ] ACRE: Found 1 missing trading days. [2025-09-05T18:00:29.275597] [INFO ] [MAIN ] ACRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:29.276001] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-05T18:00:29.287562] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T18:00:29.290419] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-05T18:00:29.300737] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-05T18:00:29.397893] [INFO ] [MAIN ] ACP: Adding 165 new records, updating 0 existing records. [2025-09-05T18:00:29.400152] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-05T18:00:29.408617] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-05T18:00:29.410030] [INFO ] [MAIN ] ACP: Combined dataset has 14649 total records. [2025-09-05T18:00:29.596936] [WARN ] [VALIDATOR ] ACP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:29.722528] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:00:29.883409] [INFO ] [MAIN ] ACRE: Adding 233 new records, updating 0 existing records. [2025-09-05T18:00:29.888857] [INFO ] [MAIN ] ACRE: Combined dataset has 16059 total records. [2025-09-05T18:00:30.071370] [WARN ] [VALIDATOR ] ACRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:30.266604] [WARN ] [VALIDATOR ] ACP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:30.266922] [INFO ] [MAIN ] ACP: Combined data validation passed. [2025-09-05T18:00:30.269006] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-05T18:00:30.274887] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-05T18:00:30.361060] [INFO ] [MAIN ] ACP: Update completed successfully. [2025-09-05T18:00:30.363101] [INFO ] [MAIN ] Update Progress: 23/2363 symbols completed. ACP took 3.5s. Estimated remaining: 45m 0s. Rate: 52.0 symbols/min [2025-09-05T18:00:30.537146] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:30.541918] [INFO ] [MAIN ] ACV: Loaded 2699 existing records. [2025-09-05T18:00:30.713849] [INFO ] [MAIN ] ACV: Found 1 missing trading days. [2025-09-05T18:00:30.714111] [INFO ] [MAIN ] ACV: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:30.714374] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-05T18:00:30.718000] [WARN ] [VALIDATOR ] ACRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:30.718141] [INFO ] [MAIN ] ACRE: Combined data validation passed. [2025-09-05T18:00:30.817676] [INFO ] [MAIN ] ACRE: Update completed successfully. [2025-09-05T18:00:30.819612] [INFO ] [MAIN ] Update Progress: 24/2363 symbols completed. ACRE took 1.9s. Estimated remaining: 43m 51s. Rate: 53.3 symbols/min [2025-09-05T18:00:31.000873] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:31.026476] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-05T18:00:31.033187] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-05T18:00:31.054101] [INFO ] [MAIN ] ACVA: Loaded 22853 existing records. [2025-09-05T18:00:31.241074] [INFO ] [MAIN ] ACVA: Found 1 missing trading days. [2025-09-05T18:00:31.241258] [INFO ] [MAIN ] ACVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:31.241555] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-05T18:00:31.302223] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-05T18:00:31.304404] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-05T18:00:31.681947] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:00:31.778995] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:00:31.835556] [INFO ] [MAIN ] ACV: Adding 51 new records, updating 0 existing records. [2025-09-05T18:00:31.874524] [INFO ] [MAIN ] ACVA: Adding 372 new records, updating 0 existing records. [2025-09-05T18:00:31.875725] [INFO ] [MAIN ] ACV: Combined dataset has 2750 total records. [2025-09-05T18:00:32.042385] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-05T18:00:32.032124] [INFO ] [MAIN ] ACVA: Combined dataset has 23225 total records. [2025-09-05T18:00:32.081874] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-05T18:00:32.097423] [WARN ] [VALIDATOR ] ACV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:32.429564] [WARN ] [VALIDATOR ] ACVA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:32.631080] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-05T18:00:32.662276] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-05T18:00:32.683990] [WARN ] [VALIDATOR ] ACV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:32.684680] [INFO ] [MAIN ] ACV: Combined data validation passed. [2025-09-05T18:00:32.691229] [WARN ] [VALIDATOR ] ACVA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:32.691776] [INFO ] [MAIN ] ACVA: Combined data validation passed. [2025-09-05T18:00:32.709697] [INFO ] [MAIN ] ACV: Update completed successfully. [2025-09-05T18:00:32.710271] [INFO ] [MAIN ] Update Progress: 25/2363 symbols completed. ACV took 2.3s. Estimated remaining: 45m 2s. Rate: 51.9 symbols/min [2025-09-05T18:00:33.004898] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:33.015069] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-05T18:00:33.021964] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-05T18:00:33.022040] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-05T18:00:33.022381] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-05T18:00:33.090699] [INFO ] [MAIN ] ACVA: Update completed successfully. [2025-09-05T18:00:33.112997] [INFO ] [MAIN ] Update Progress: 26/2363 symbols completed. ACVA took 2.3s. Estimated remaining: 43m 53s. Rate: 53.3 symbols/min [2025-09-05T18:00:33.145469] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-05T18:00:33.195861] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-05T18:00:33.523041] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:33.602964] [INFO ] [REMOTE ] AD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:00:33.603301] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-05T18:00:33.619853] [INFO ] [MAIN ] ADC: Loaded 21754 existing records. [2025-09-05T18:00:33.819944] [INFO ] [MAIN ] ADC: Found 1 missing trading days. [2025-09-05T18:00:33.820659] [INFO ] [MAIN ] ADC: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:33.820922] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-05T18:00:33.862935] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-05T18:00:33.863466] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-05T18:00:33.927266] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-05T18:00:33.933563] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-05T18:00:34.090797] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-05T18:00:34.091284] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-05T18:00:34.131147] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-05T18:00:34.133147] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-05T18:00:34.320081] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-05T18:00:34.320660] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-05T18:00:34.435152] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:00:34.560484] [INFO ] [MAIN ] ADC: Adding 368 new records, updating 0 existing records. [2025-09-05T18:00:34.563972] [INFO ] [MAIN ] ADC: Combined dataset has 22122 total records. [2025-09-05T18:00:34.708631] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-05T18:00:34.727199] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-05T18:00:34.748006] [WARN ] [VALIDATOR ] ADC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:34.817290] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-05T18:00:34.831868] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-05T18:00:34.954365] [WARN ] [VALIDATOR ] ADC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:34.954582] [INFO ] [MAIN ] ADC: Combined data validation passed. [2025-09-05T18:00:35.049462] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-05T18:00:35.052355] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-05T18:00:35.081418] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-05T18:00:35.089007] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-05T18:00:35.127486] [INFO ] [MAIN ] ADC: Update completed successfully. [2025-09-05T18:00:35.130373] [INFO ] [MAIN ] Update Progress: 27/2363 symbols completed. ADC took 2.0s. Estimated remaining: 45m 9s. Rate: 51.7 symbols/min [2025-09-05T18:00:35.302313] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:35.302395] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-05T18:00:35.302777] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-05T18:00:35.320974] [INFO ] [MAIN ] ADCT: Loaded 17859 existing records. [2025-09-05T18:00:35.426368] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:00:35.485189] [INFO ] [REMOTE ] ACR: Full fetch complete (7202 records). [2025-09-05T18:00:35.566902] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-05T18:00:35.582626] [INFO ] [MAIN ] ADCT: Found 1 missing trading days. [2025-09-05T18:00:35.583015] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-05T18:00:35.583102] [INFO ] [MAIN ] ADCT: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:35.589285] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-05T18:00:35.773904] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:00:35.834421] [INFO ] [REMOTE ] ACEL: Full fetch complete (30351 records). [2025-09-05T18:00:36.018141] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-05T18:00:36.120443] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-05T18:00:36.122718] [INFO ] [MAIN ] Update Progress: 28/2363 symbols completed. ACR took 9.0s. Estimated remaining: 44m 54s. Rate: 52.0 symbols/min [2025-09-05T18:00:36.456597] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:36.491944] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-05T18:00:36.498846] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:00:36.707159] [INFO ] [MAIN ] ADCT: Adding 319 new records, updating 0 existing records. [2025-09-05T18:00:36.747877] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-05T18:00:36.749176] [INFO ] [MAIN ] Update Progress: 29/2363 symbols completed. ACEL took 15.4s. Estimated remaining: 44m 10s. Rate: 52.8 symbols/min [2025-09-05T18:00:36.750175] [INFO ] [MAIN ] ADM: Loaded 40184 existing records. [2025-09-05T18:00:36.795749] [INFO ] [MAIN ] ADCT: Combined dataset has 18178 total records. [2025-09-05T18:00:37.146940] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-05T18:00:37.198126] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-05T18:00:37.215859] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:37.371498] [WARN ] [VALIDATOR ] ADCT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:37.416594] [INFO ] [MAIN ] ADM: Found 1 missing trading days. [2025-09-05T18:00:37.440284] [INFO ] [MAIN ] ADM: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:37.472869] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-05T18:00:37.553575] [INFO ] [MAIN ] ADNT: Loaded 22599 existing records. [2025-09-05T18:00:37.792964] [INFO ] [MAIN ] ADNT: Found 1 missing trading days. [2025-09-05T18:00:37.793230] [INFO ] [MAIN ] ADNT: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:37.793530] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-05T18:00:37.803922] [WARN ] [VALIDATOR ] ADCT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:37.804178] [INFO ] [MAIN ] ADCT: Combined data validation passed. [2025-09-05T18:00:37.910715] [INFO ] [MAIN ] ADCT: Update completed successfully. [2025-09-05T18:00:37.913456] [INFO ] [MAIN ] Update Progress: 30/2363 symbols completed. ADCT took 2.8s. Estimated remaining: 44m 11s. Rate: 52.8 symbols/min [2025-09-05T18:00:38.093437] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:38.118091] [INFO ] [MAIN ] ADT: Loaded 25542 existing records. [2025-09-05T18:00:38.312696] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:00:38.314436] [INFO ] [MAIN ] ADT: Found 1 missing trading days. [2025-09-05T18:00:38.324109] [INFO ] [MAIN ] ADT: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:38.342876] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-05T18:00:38.486495] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:00:38.486253] [INFO ] [MAIN ] ADM: Adding 390 new records, updating 0 existing records. [2025-09-05T18:00:38.526744] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T18:00:38.549858] [INFO ] [REMOTE ] AD: Full fetch complete (3677 records). [2025-09-05T18:00:38.571181] [FATAL] [VALIDATOR ] AD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:00:38.602408] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:00:38.617942] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:00:38.632169] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-05T18:00:38.632104] [INFO ] [MAIN ] ADNT: Adding 298 new records, updating 0 existing records. [2025-09-05T18:00:38.632555] [INFO ] [MAIN ] ADM: Combined dataset has 40574 total records. [2025-09-05T18:00:38.632479] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-05T18:00:38.633261] [INFO ] [MAIN ] Update Progress: 31/2363 symbols completed. AD took 5.9s. Estimated remaining: 43m 39s. Rate: 53.4 symbols/min [2025-09-05T18:00:38.798148] [INFO ] [MAIN ] ADNT: Combined dataset has 22897 total records. [2025-09-05T18:00:39.088753] [WARN ] [VALIDATOR ] ADM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:00:39.058147] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:39.154142] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:00:39.310865] [WARN ] [VALIDATOR ] ADNT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:39.502432] [INFO ] [MAIN ] ADX: Loaded 13884 existing records. [2025-09-05T18:00:39.674428] [INFO ] [MAIN ] ADT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:00:39.793574] [INFO ] [MAIN ] ADT: Combined dataset has 25542 total records. [2025-09-05T18:00:39.831489] [FATAL] [VALIDATOR ] ADT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:00:39.858311] [FATAL] [MAIN ] ADT: Combined data validation failed. [2025-09-05T18:00:39.884316] [WARN ] [MAIN ] ADT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:00:39.887236] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-05T18:00:39.908479] [INFO ] [MAIN ] ADX: Found 1 missing trading days. [2025-09-05T18:00:39.909296] [INFO ] [MAIN ] ADX: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:39.909669] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-05T18:00:39.910875] [INFO ] [LOCAL ] ADT: Starting deletion of derivative data. [2025-09-05T18:00:39.914469] [INFO ] [MAIN ] Update Progress: 32/2363 symbols completed. ADT took 2.0s. Estimated remaining: 43m 49s. Rate: 53.2 symbols/min [2025-09-05T18:00:40.087308] [WARN ] [VALIDATOR ] ADNT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:40.095555] [WARN ] [VALIDATOR ] ADM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:00:40.114325] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:40.114776] [INFO ] [MAIN ] ADM: Combined data validation passed. [2025-09-05T18:00:40.114877] [INFO ] [MAIN ] ADNT: Combined data validation passed. [2025-09-05T18:00:40.362175] [INFO ] [MAIN ] AEE: Loaded 23949 existing records. [2025-09-05T18:00:40.375914] [INFO ] [MAIN ] ADNT: Update completed successfully. [2025-09-05T18:00:40.400409] [INFO ] [MAIN ] Update Progress: 33/2363 symbols completed. ADNT took 3.7s. Estimated remaining: 43m 3s. Rate: 54.1 symbols/min [2025-09-05T18:00:40.671449] [INFO ] [MAIN ] AEE: Found 1 missing trading days. [2025-09-05T18:00:40.696714] [INFO ] [MAIN ] AEE: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:40.727157] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:40.727415] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-05T18:00:40.738835] [INFO ] [MAIN ] AEFC: Loaded 3549 existing records. [2025-09-05T18:00:40.919690] [INFO ] [MAIN ] AEFC: Found 1 missing trading days. [2025-09-05T18:00:40.920493] [INFO ] [MAIN ] AEFC: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:40.921039] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-05T18:00:41.044956] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:00:41.060718] [INFO ] [MAIN ] ADM: Update completed successfully. [2025-09-05T18:00:41.082380] [INFO ] [MAIN ] Update Progress: 34/2363 symbols completed. ADM took 4.9s. Estimated remaining: 42m 32s. Rate: 54.8 symbols/min [2025-09-05T18:00:41.253935] [INFO ] [MAIN ] ADX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:00:41.296890] [INFO ] [MAIN ] ADX: Combined dataset has 13884 total records. [2025-09-05T18:00:41.311481] [FATAL] [VALIDATOR ] ADX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:00:41.328938] [FATAL] [MAIN ] ADX: Combined data validation failed. [2025-09-05T18:00:41.330607] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:41.330742] [WARN ] [MAIN ] ADX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:00:41.331272] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-05T18:00:41.331747] [INFO ] [LOCAL ] ADX: Starting deletion of derivative data. [2025-09-05T18:00:41.333776] [INFO ] [MAIN ] Update Progress: 35/2363 symbols completed. ADX took 2.7s. Estimated remaining: 41m 35s. Rate: 56.0 symbols/min [2025-09-05T18:00:41.506028] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:00:41.536605] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:41.604950] [INFO ] [MAIN ] AEG: Loaded 23518 existing records. [2025-09-05T18:00:41.752625] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:00:41.839936] [INFO ] [MAIN ] AEE: Adding 364 new records, updating 0 existing records. [2025-09-05T18:00:41.824993] [INFO ] [MAIN ] AEFC: Adding 47 new records, updating 0 existing records. [2025-09-05T18:00:41.841900] [INFO ] [MAIN ] AEM: Loaded 25513 existing records. [2025-09-05T18:00:41.924840] [INFO ] [MAIN ] AEFC: Combined dataset has 3596 total records. [2025-09-05T18:00:42.014882] [INFO ] [MAIN ] AEG: Found 1 missing trading days. [2025-09-05T18:00:42.075367] [INFO ] [MAIN ] AEG: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:42.092210] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-05T18:00:42.119986] [INFO ] [MAIN ] AEE: Combined dataset has 24313 total records. [2025-09-05T18:00:42.283776] [INFO ] [MAIN ] AEM: Found 1 missing trading days. [2025-09-05T18:00:42.362872] [INFO ] [MAIN ] AEM: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:42.398295] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-05T18:00:42.384475] [WARN ] [VALIDATOR ] AEFC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:42.584082] [WARN ] [VALIDATOR ] AEE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:42.739507] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:00:43.088775] [INFO ] [MAIN ] AEG: Adding 370 new records, updating 727 existing records. [2025-09-05T18:00:43.112877] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:00:43.115455] [INFO ] [MAIN ] AEG: Combined dataset has 23888 total records. [2025-09-05T18:00:43.234483] [WARN ] [VALIDATOR ] AEFC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:43.257630] [WARN ] [VALIDATOR ] AEE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:43.273188] [INFO ] [MAIN ] AEFC: Combined data validation passed. [2025-09-05T18:00:43.290202] [INFO ] [MAIN ] AEE: Combined data validation passed. [2025-09-05T18:00:43.494240] [INFO ] [MAIN ] AEM: Adding 390 new records, updating 0 existing records. [2025-09-05T18:00:43.488232] [WARN ] [VALIDATOR ] AEG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:43.631274] [INFO ] [MAIN ] AEFC: Update completed successfully. [2025-09-05T18:00:43.673348] [INFO ] [MAIN ] Update Progress: 36/2363 symbols completed. AEFC took 3.3s. Estimated remaining: 42m 56s. Rate: 54.2 symbols/min [2025-09-05T18:00:43.790170] [INFO ] [MAIN ] AEM: Combined dataset has 25903 total records. [2025-09-05T18:00:44.140560] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:44.162859] [WARN ] [VALIDATOR ] AEM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:44.414339] [INFO ] [MAIN ] AEE: Update completed successfully. [2025-09-05T18:00:44.418863] [INFO ] [MAIN ] Update Progress: 37/2363 symbols completed. AEE took 4.5s. Estimated remaining: 42m 32s. Rate: 54.7 symbols/min [2025-09-05T18:00:44.419749] [INFO ] [MAIN ] AEO: Loaded 25588 existing records. [2025-09-05T18:00:44.470610] [WARN ] [VALIDATOR ] AEG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:44.481356] [INFO ] [MAIN ] AEG: Combined data validation passed. [2025-09-05T18:00:44.720863] [INFO ] [MAIN ] AEO: Found 1 missing trading days. [2025-09-05T18:00:44.722210] [INFO ] [MAIN ] AEO: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:44.726849] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-05T18:00:44.784971] [INFO ] [MAIN ] AEG: Update completed successfully. [2025-09-05T18:00:44.788309] [INFO ] [MAIN ] Update Progress: 38/2363 symbols completed. AEG took 3.7s. Estimated remaining: 41m 46s. Rate: 55.7 symbols/min [2025-09-05T18:00:44.791378] [WARN ] [VALIDATOR ] AEM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:44.791622] [INFO ] [MAIN ] AEM: Combined data validation passed. [2025-09-05T18:00:44.958288] [INFO ] [MAIN ] AEM: Update completed successfully. [2025-09-05T18:00:44.961590] [INFO ] [MAIN ] Update Progress: 39/2363 symbols completed. AEM took 3.6s. Estimated remaining: 40m 51s. Rate: 56.9 symbols/min [2025-09-05T18:00:45.581093] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:00:45.742548] [INFO ] [MAIN ] AEO: Adding 390 new records, updating 0 existing records. [2025-09-05T18:00:45.745991] [INFO ] [MAIN ] AEO: Combined dataset has 25978 total records. [2025-09-05T18:00:45.930659] [WARN ] [VALIDATOR ] AEO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:46.132576] [WARN ] [VALIDATOR ] AEO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:46.132864] [INFO ] [MAIN ] AEO: Combined data validation passed. [2025-09-05T18:00:46.290054] [INFO ] [MAIN ] AEO: Update completed successfully. [2025-09-05T18:00:46.293154] [INFO ] [MAIN ] Update Progress: 40/2363 symbols completed. AEO took 2.6s. Estimated remaining: 41m 6s. Rate: 56.5 symbols/min [2025-09-05T18:00:46.952962] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:47.007124] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:47.051766] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:47.053012] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:47.053093] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-09-05T18:00:47.053688] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-05T18:00:47.053908] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-05T18:00:47.054095] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-05T18:00:47.117168] [INFO ] [MAIN ] AES: Loaded 3894 existing records. [2025-09-05T18:00:47.146809] [INFO ] [MAIN ] AESI: Loaded 3442 existing records. [2025-09-05T18:00:47.515035] [INFO ] [MAIN ] AER: Loaded 22765 existing records. [2025-09-05T18:00:47.815800] [INFO ] [MAIN ] AESI: Found 1 missing trading days. [2025-09-05T18:00:47.871494] [INFO ] [MAIN ] AESI: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:47.834882] [INFO ] [MAIN ] AES: Found 1 missing trading days. [2025-09-05T18:00:47.886218] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-05T18:00:47.898506] [INFO ] [MAIN ] AES: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:47.909762] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-05T18:00:47.947938] [INFO ] [REMOTE ] AFB: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:00:47.969134] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-05T18:00:48.005851] [INFO ] [MAIN ] AER: Found 1 missing trading days. [2025-09-05T18:00:48.005983] [INFO ] [MAIN ] AER: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:48.006213] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-05T18:00:48.597079] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:00:48.878130] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:00:48.891580] [INFO ] [MAIN ] AES: Adding 389 new records, updating 0 existing records. [2025-09-05T18:00:49.009978] [INFO ] [MAIN ] AES: Combined dataset has 4283 total records. [2025-09-05T18:00:49.245854] [INFO ] [MAIN ] AER: Adding 339 new records, updating 0 existing records. [2025-09-05T18:00:49.380326] [WARN ] [VALIDATOR ] AES: Not fatal, but first date in data (2025-08-21) does not match expected start date (2025-01-31) [2025-09-05T18:00:49.343993] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-05T18:00:49.396180] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-05T18:00:49.424398] [INFO ] [MAIN ] AER: Combined dataset has 23104 total records. [2025-09-05T18:00:49.750883] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-05T18:00:49.818087] [WARN ] [VALIDATOR ] AER: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:50.079602] [INFO ] [MAIN ] AESI: Adding 384 new records, updating 0 existing records. [2025-09-05T18:00:50.128071] [INFO ] [MAIN ] AESI: Combined dataset has 3826 total records. [2025-09-05T18:00:50.262935] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-05T18:00:50.321780] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-05T18:00:50.327211] [WARN ] [VALIDATOR ] AESI: Not fatal, but first date in data (2025-08-21) does not match expected start date (2025-01-31) [2025-09-05T18:00:50.525912] [WARN ] [VALIDATOR ] AES: Missing days changed. Total missing: 139 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12, 2025-08-13, 2025-08-14, 2025-08-15, 2025-08-18, 2025-08-19, 2025-08-20 [2025-09-05T18:00:50.526582] [INFO ] [MAIN ] AES: Combined data validation passed. [2025-09-05T18:00:50.526091] [WARN ] [VALIDATOR ] AER: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:50.527006] [INFO ] [MAIN ] AER: Combined data validation passed. [2025-09-05T18:00:50.653052] [INFO ] [MAIN ] AES: Update completed successfully. [2025-09-05T18:00:50.654632] [INFO ] [MAIN ] Update Progress: 41/2363 symbols completed. AES took 4.4s. Estimated remaining: 44m 12s. Rate: 52.5 symbols/min [2025-09-05T18:00:50.851786] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:50.884918] [INFO ] [MAIN ] AER: Update completed successfully. [2025-09-05T18:00:50.893659] [INFO ] [MAIN ] Update Progress: 42/2363 symbols completed. AER took 4.6s. Estimated remaining: 43m 21s. Rate: 53.5 symbols/min [2025-09-05T18:00:50.915084] [INFO ] [MAIN ] AFG: Loaded 15682 existing records. [2025-09-05T18:00:51.222208] [INFO ] [MAIN ] AFG: Found 1 missing trading days. [2025-09-05T18:00:51.223348] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-05T18:00:51.229823] [INFO ] [MAIN ] AFG: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:51.232800] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-05T18:00:51.237272] [WARN ] [VALIDATOR ] AESI: Missing days changed. Total missing: 139 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12, 2025-08-13, 2025-08-14, 2025-08-15, 2025-08-18, 2025-08-19, 2025-08-20 [2025-09-05T18:00:51.259788] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:51.261079] [INFO ] [MAIN ] AESI: Combined data validation passed. [2025-09-05T18:00:51.261479] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-05T18:00:51.275823] [INFO ] [MAIN ] AFGB: Loaded 1093 existing records. [2025-09-05T18:00:51.438722] [INFO ] [MAIN ] AESI: Update completed successfully. [2025-09-05T18:00:51.462124] [INFO ] [MAIN ] AFGB: Found 1 missing trading days. [2025-09-05T18:00:51.462765] [INFO ] [MAIN ] Update Progress: 43/2363 symbols completed. AESI took 5.2s. Estimated remaining: 42m 50s. Rate: 54.2 symbols/min [2025-09-05T18:00:51.462980] [INFO ] [MAIN ] AFGB: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:51.463296] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-05T18:00:51.636413] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:51.636582] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-09-05T18:00:51.636729] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-05T18:00:51.636771] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-05T18:00:51.636817] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-05T18:00:51.996677] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:00:52.000832] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-05T18:00:52.002202] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:00:52.026952] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:00:52.058540] [INFO ] [MAIN ] AFGB: Adding 16 new records, updating 0 existing records. [2025-09-05T18:00:52.085472] [INFO ] [MAIN ] AFGB: Combined dataset has 1109 total records. [2025-09-05T18:00:52.144464] [INFO ] [MAIN ] AFG: Adding 212 new records, updating 0 existing records. [2025-09-05T18:00:52.244976] [INFO ] [MAIN ] AFG: Combined dataset has 15894 total records. [2025-09-05T18:00:52.328025] [WARN ] [VALIDATOR ] AFGB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:52.479944] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-05T18:00:52.559805] [WARN ] [VALIDATOR ] AFG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:52.582093] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-05T18:00:52.592758] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-05T18:00:52.591460] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-05T18:00:52.871193] [WARN ] [VALIDATOR ] AFG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:52.871280] [WARN ] [VALIDATOR ] AFGB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:52.871486] [INFO ] [MAIN ] AFG: Combined data validation passed. [2025-09-05T18:00:52.872065] [INFO ] [MAIN ] AFGB: Combined data validation passed. [2025-09-05T18:00:52.931906] [INFO ] [MAIN ] AFGB: Update completed successfully. [2025-09-05T18:00:52.932556] [INFO ] [MAIN ] Update Progress: 44/2363 symbols completed. AFGB took 2.0s. Estimated remaining: 43m 8s. Rate: 53.8 symbols/min [2025-09-05T18:00:53.081747] [INFO ] [MAIN ] AFG: Update completed successfully. [2025-09-05T18:00:53.096484] [INFO ] [MAIN ] Update Progress: 45/2363 symbols completed. AFG took 2.4s. Estimated remaining: 42m 18s. Rate: 54.8 symbols/min [2025-09-05T18:00:53.282480] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-05T18:00:53.282289] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:53.284147] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-05T18:00:53.328078] [INFO ] [MAIN ] AFGD: Loaded 815 existing records. [2025-09-05T18:00:53.364879] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:53.477048] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-05T18:00:53.470602] [INFO ] [MAIN ] AFGE: Loaded 1361 existing records. [2025-09-05T18:00:53.516870] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-05T18:00:53.633767] [INFO ] [MAIN ] AFGD: Found 1 missing trading days. [2025-09-05T18:00:53.654312] [INFO ] [MAIN ] AFGD: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:53.654810] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-05T18:00:53.654247] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-05T18:00:53.667799] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-05T18:00:53.732136] [INFO ] [MAIN ] AFGE: Found 1 missing trading days. [2025-09-05T18:00:53.732265] [INFO ] [MAIN ] AFGE: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:53.732477] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-05T18:00:54.149867] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-05T18:00:54.151083] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-05T18:00:54.320135] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:00:54.327725] [INFO ] [MAIN ] AFGE: Adding 13 new records, updating 0 existing records. [2025-09-05T18:00:54.329045] [INFO ] [MAIN ] AFGE: Combined dataset has 1374 total records. [2025-09-05T18:00:54.440976] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:00:54.450170] [INFO ] [MAIN ] AFGD: Adding 33 new records, updating 0 existing records. [2025-09-05T18:00:54.508035] [INFO ] [MAIN ] AFGD: Combined dataset has 848 total records. [2025-09-05T18:00:54.532749] [WARN ] [VALIDATOR ] AFGE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:54.678965] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-05T18:00:54.734753] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-05T18:00:54.749908] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-05T18:00:54.756382] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-05T18:00:54.919113] [WARN ] [VALIDATOR ] AFGD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:55.116422] [WARN ] [VALIDATOR ] AFGE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:55.116488] [WARN ] [VALIDATOR ] AFGD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:55.116746] [INFO ] [MAIN ] AFGE: Combined data validation passed. [2025-09-05T18:00:55.116864] [INFO ] [MAIN ] AFGD: Combined data validation passed. [2025-09-05T18:00:55.131814] [INFO ] [MAIN ] AFGE: Update completed successfully. [2025-09-05T18:00:55.132583] [INFO ] [MAIN ] Update Progress: 46/2363 symbols completed. AFGE took 2.0s. Estimated remaining: 43m 4s. Rate: 53.8 symbols/min [2025-09-05T18:00:55.132657] [INFO ] [MAIN ] AFGD: Update completed successfully. [2025-09-05T18:00:55.132990] [INFO ] [MAIN ] Update Progress: 47/2363 symbols completed. AFGD took 2.2s. Estimated remaining: 42m 8s. Rate: 55.0 symbols/min [2025-09-05T18:00:55.346906] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-05T18:00:55.387429] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-05T18:00:55.444153] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:55.493753] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:55.501140] [INFO ] [MAIN ] AG: Loaded 3894 existing records. [2025-09-05T18:00:55.686477] [INFO ] [MAIN ] AG: Found 1 missing trading days. [2025-09-05T18:00:55.687464] [INFO ] [MAIN ] AFL: Loaded 25323 existing records. [2025-09-05T18:00:55.687603] [INFO ] [MAIN ] AG: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:55.720269] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-05T18:00:55.801014] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-05T18:00:55.814797] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-05T18:00:55.890147] [INFO ] [MAIN ] AFL: Found 1 missing trading days. [2025-09-05T18:00:55.890389] [INFO ] [MAIN ] AFL: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:55.890908] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-05T18:00:56.073772] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-05T18:00:56.075845] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-05T18:00:56.222576] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-05T18:00:56.379016] [INFO ] [MAIN ] AFL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:00:56.386550] [INFO ] [MAIN ] AFL: Combined dataset has 25713 total records. [2025-09-05T18:00:56.514913] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-05T18:00:56.522166] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-05T18:00:56.529978] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-05T18:00:56.615377] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-05T18:00:56.614986] [WARN ] [VALIDATOR ] AFL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:00:56.617729] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:00:56.918384] [INFO ] [MAIN ] AG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:00:56.951612] [INFO ] [MAIN ] AG: Combined dataset has 4284 total records. [2025-09-05T18:00:57.068129] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:00:57.090821] [INFO ] [REMOTE ] AFGC: Full fetch complete (2735 records). [2025-09-05T18:00:57.224227] [WARN ] [VALIDATOR ] AG: Not fatal, but first date in data (2025-08-21) does not match expected start date (2025-01-31) [2025-09-05T18:00:57.484609] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:00:57.496798] [INFO ] [REMOTE ] AFB: Full fetch complete (12428 records). [2025-09-05T18:00:57.860213] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-05T18:00:57.950970] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-05T18:00:57.965484] [INFO ] [MAIN ] Update Progress: 48/2363 symbols completed. AFGC took 6.5s. Estimated remaining: 43m 31s. Rate: 53.2 symbols/min [2025-09-05T18:00:58.276924] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-05T18:00:58.326519] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:58.326674] [WARN ] [VALIDATOR ] AG: Missing days changed. Total missing: 139 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12, 2025-08-13, 2025-08-14, 2025-08-15, 2025-08-18, 2025-08-19, 2025-08-20 [2025-09-05T18:00:58.328320] [INFO ] [MAIN ] AG: Combined data validation passed. [2025-09-05T18:00:58.328067] [WARN ] [VALIDATOR ] AFL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:00:58.329623] [INFO ] [MAIN ] AFL: Combined data validation passed. [2025-09-05T18:00:58.397488] [INFO ] [MAIN ] AGCO: Loaded 2926 existing records. [2025-09-05T18:00:58.397556] [INFO ] [MAIN ] AG: Update completed successfully. [2025-09-05T18:00:58.399302] [INFO ] [MAIN ] Update Progress: 49/2363 symbols completed. AG took 3.2s. Estimated remaining: 42m 57s. Rate: 53.9 symbols/min [2025-09-05T18:00:58.745147] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-05T18:00:58.801046] [INFO ] [MAIN ] Update Progress: 50/2363 symbols completed. AFB took 12.5s. Estimated remaining: 42m 23s. Rate: 54.6 symbols/min [2025-09-05T18:00:58.803314] [INFO ] [MAIN ] AGCO: Found 1 missing trading days. [2025-09-05T18:00:58.841736] [INFO ] [MAIN ] AGCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:58.854581] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-05T18:00:58.915686] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:58.989579] [INFO ] [MAIN ] AGD: Loaded 1497 existing records. [2025-09-05T18:00:59.130370] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:59.241210] [INFO ] [MAIN ] AGD: Found 1 missing trading days. [2025-09-05T18:00:59.244209] [INFO ] [MAIN ] AGD: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:59.250817] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-05T18:00:59.292277] [INFO ] [MAIN ] AGI: Loaded 25495 existing records. [2025-09-05T18:00:59.481836] [INFO ] [MAIN ] AGI: Found 1 missing trading days. [2025-09-05T18:00:59.482958] [INFO ] [MAIN ] AGI: Need to fetch 1 months: 2025-09 [2025-09-05T18:00:59.483415] [INFO ] [MAIN ] AFL: Update completed successfully. [2025-09-05T18:00:59.486459] [INFO ] [MAIN ] Update Progress: 51/2363 symbols completed. AFL took 4.4s. Estimated remaining: 42m 3s. Rate: 55.0 symbols/min [2025-09-05T18:00:59.483340] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-05T18:00:59.644102] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:00:59.674513] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:00:59.787071] [INFO ] [MAIN ] AGCO: Adding 314 new records, updating 0 existing records. [2025-09-05T18:00:59.797337] [INFO ] [MAIN ] AGCO: Combined dataset has 3240 total records. [2025-09-05T18:00:59.797276] [INFO ] [MAIN ] AGL: Loaded 24886 existing records. [2025-09-05T18:01:00.142468] [WARN ] [VALIDATOR ] AGCO: Not fatal, but first date in data (2025-08-21) does not match expected start date (2025-01-31) [2025-09-05T18:01:00.172955] [INFO ] [MAIN ] AGL: Found 1 missing trading days. [2025-09-05T18:01:00.196940] [INFO ] [MAIN ] AGL: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:00.223608] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-05T18:01:00.224316] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:01:00.379127] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:01:00.376933] [INFO ] [MAIN ] AGD: Adding 144 new records, updating 0 existing records. [2025-09-05T18:01:00.434791] [INFO ] [MAIN ] AGD: Combined dataset has 1641 total records. [2025-09-05T18:01:00.674630] [INFO ] [MAIN ] AGI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:01:00.738462] [WARN ] [VALIDATOR ] AGD: Not fatal, but first date in data (2025-08-21) does not match expected start date (2025-01-31) [2025-09-05T18:01:00.850263] [INFO ] [MAIN ] AGI: Combined dataset has 25885 total records. [2025-09-05T18:01:00.856814] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:01:01.338694] [INFO ] [MAIN ] AGL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:01:01.337400] [WARN ] [VALIDATOR ] AGI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:01.440607] [INFO ] [MAIN ] AGL: Combined dataset has 25276 total records. [2025-09-05T18:01:01.655775] [WARN ] [VALIDATOR ] AGCO: Missing days changed. Total missing: 139 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12, 2025-08-13, 2025-08-14, 2025-08-15, 2025-08-18, 2025-08-19, 2025-08-20 [2025-09-05T18:01:01.655696] [WARN ] [VALIDATOR ] AGD: Missing days changed. Total missing: 139 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12, 2025-08-13, 2025-08-14, 2025-08-15, 2025-08-18, 2025-08-19, 2025-08-20 [2025-09-05T18:01:01.671578] [INFO ] [MAIN ] AGCO: Combined data validation passed. [2025-09-05T18:01:01.682309] [INFO ] [MAIN ] AGD: Combined data validation passed. [2025-09-05T18:01:01.740466] [WARN ] [VALIDATOR ] AGL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:01.842378] [INFO ] [MAIN ] AGCO: Update completed successfully. [2025-09-05T18:01:01.864153] [INFO ] [MAIN ] Update Progress: 52/2363 symbols completed. AGCO took 3.9s. Estimated remaining: 42m 59s. Rate: 53.8 symbols/min [2025-09-05T18:01:01.875619] [INFO ] [MAIN ] AGD: Update completed successfully. [2025-09-05T18:01:01.915321] [INFO ] [MAIN ] Update Progress: 53/2363 symbols completed. AGD took 3.4s. Estimated remaining: 42m 12s. Rate: 54.7 symbols/min [2025-09-05T18:01:02.352472] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:02.358800] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:02.376807] [INFO ] [MAIN ] AGM: Loaded 6394 existing records. [2025-09-05T18:01:02.438997] [INFO ] [MAIN ] AGO: Loaded 13134 existing records. [2025-09-05T18:01:02.725287] [WARN ] [VALIDATOR ] AGI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:02.730727] [INFO ] [MAIN ] AGI: Combined data validation passed. [2025-09-05T18:01:02.737902] [INFO ] [MAIN ] AGM: Found 1 missing trading days. [2025-09-05T18:01:02.730607] [WARN ] [VALIDATOR ] AGL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:02.766740] [INFO ] [MAIN ] AGM: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:02.787757] [INFO ] [MAIN ] AGL: Combined data validation passed. [2025-09-05T18:01:02.791184] [INFO ] [MAIN ] AGO: Found 1 missing trading days. [2025-09-05T18:01:02.792030] [INFO ] [MAIN ] AGO: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:02.792959] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-05T18:01:02.791543] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-05T18:01:03.032282] [INFO ] [MAIN ] AGL: Update completed successfully. [2025-09-05T18:01:03.035900] [INFO ] [MAIN ] Update Progress: 54/2363 symbols completed. AGL took 3.5s. Estimated remaining: 42m 12s. Rate: 54.7 symbols/min [2025-09-05T18:01:03.220980] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:03.239562] [INFO ] [MAIN ] AGRO: Loaded 14128 existing records. [2025-09-05T18:01:03.360507] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:01:03.436335] [INFO ] [MAIN ] AGRO: Found 1 missing trading days. [2025-09-05T18:01:03.442928] [INFO ] [MAIN ] AGRO: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:03.455176] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-05T18:01:03.486300] [INFO ] [MAIN ] AGM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:01:03.499004] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:01:03.526511] [INFO ] [MAIN ] AGI: Update completed successfully. [2025-09-05T18:01:03.526375] [INFO ] [MAIN ] AGM: Combined dataset has 6394 total records. [2025-09-05T18:01:03.558283] [FATAL] [VALIDATOR ] AGM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:01:03.561461] [INFO ] [MAIN ] Update Progress: 55/2363 symbols completed. AGI took 4.7s. Estimated remaining: 41m 47s. Rate: 55.2 symbols/min [2025-09-05T18:01:03.571926] [FATAL] [MAIN ] AGM: Combined data validation failed. [2025-09-05T18:01:03.575612] [INFO ] [MAIN ] AGO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:01:03.572030] [WARN ] [MAIN ] AGM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:01:03.588388] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-05T18:01:03.622160] [INFO ] [MAIN ] AGO: Combined dataset has 13134 total records. [2025-09-05T18:01:03.627663] [INFO ] [LOCAL ] AGM: Starting deletion of derivative data. [2025-09-05T18:01:03.644697] [FATAL] [VALIDATOR ] AGO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:01:03.656753] [FATAL] [MAIN ] AGO: Combined data validation failed. [2025-09-05T18:01:03.663061] [WARN ] [MAIN ] AGO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:01:03.662989] [INFO ] [MAIN ] Update Progress: 56/2363 symbols completed. AGM took 1.8s. Estimated remaining: 41m 5s. Rate: 56.2 symbols/min [2025-09-05T18:01:03.682072] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-05T18:01:03.721727] [INFO ] [LOCAL ] AGO: Starting deletion of derivative data. [2025-09-05T18:01:03.773516] [INFO ] [MAIN ] Update Progress: 57/2363 symbols completed. AGO took 1.8s. Estimated remaining: 40m 25s. Rate: 57.0 symbols/min [2025-09-05T18:01:03.890615] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:03.926076] [WARN ] [MAIN ] AGX: No existing data found, performing full refresh instead. [2025-09-05T18:01:03.951977] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-05T18:01:03.976091] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-05T18:01:03.989664] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-05T18:01:04.131334] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:04.147760] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:01:04.152957] [WARN ] [MAIN ] AHH: No existing data found, performing full refresh instead. [2025-09-05T18:01:04.233862] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-05T18:01:04.247972] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:04.283996] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-05T18:01:04.349596] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-05T18:01:04.378503] [INFO ] [MAIN ] AGRO: Adding 216 new records, updating 0 existing records. [2025-09-05T18:01:04.538460] [INFO ] [MAIN ] AHL: Loaded 10748 existing records. [2025-09-05T18:01:04.788395] [INFO ] [MAIN ] AGRO: Combined dataset has 14344 total records. [2025-09-05T18:01:04.977839] [INFO ] [REMOTE ] AGX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:05.066091] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-05T18:01:05.148186] [INFO ] [MAIN ] AHL: Found 1 missing trading days. [2025-09-05T18:01:05.189582] [INFO ] [MAIN ] AHL: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:05.206178] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-05T18:01:05.367903] [INFO ] [REMOTE ] AHH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:05.368213] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-05T18:01:05.364387] [WARN ] [VALIDATOR ] AGRO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:05.559698] [WARN ] [VALIDATOR ] AGRO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:05.559927] [INFO ] [MAIN ] AGRO: Combined data validation passed. [2025-09-05T18:01:05.642004] [INFO ] [MAIN ] AGRO: Update completed successfully. [2025-09-05T18:01:05.643901] [INFO ] [MAIN ] Update Progress: 58/2363 symbols completed. AGRO took 2.6s. Estimated remaining: 40m 57s. Rate: 56.3 symbols/min [2025-09-05T18:01:05.812750] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:05.812977] [WARN ] [MAIN ] AHR: No existing data found, performing full refresh instead. [2025-09-05T18:01:05.813113] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-05T18:01:05.813166] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-05T18:01:05.813230] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-05T18:01:06.169525] [INFO ] [REMOTE ] AHR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:06.170279] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-05T18:01:06.701281] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-05T18:01:06.800514] [INFO ] [MAIN ] AHL: Adding 239 new records, updating 0 existing records. [2025-09-05T18:01:06.803002] [INFO ] [MAIN ] AHL: Combined dataset has 10987 total records. [2025-09-05T18:01:06.980318] [WARN ] [VALIDATOR ] AHL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:07.190061] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-05T18:01:07.198615] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-05T18:01:07.205045] [WARN ] [VALIDATOR ] AHL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:07.205213] [INFO ] [MAIN ] AHL: Combined data validation passed. [2025-09-05T18:01:07.292430] [INFO ] [MAIN ] AHL: Update completed successfully. [2025-09-05T18:01:07.294470] [INFO ] [MAIN ] Update Progress: 59/2363 symbols completed. AHL took 3.5s. Estimated remaining: 41m 19s. Rate: 55.8 symbols/min [2025-09-05T18:01:07.295340] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-05T18:01:07.315124] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-05T18:01:07.479419] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:07.484330] [INFO ] [MAIN ] AHT: Loaded 3236 existing records. [2025-09-05T18:01:07.656835] [INFO ] [MAIN ] AHT: Found 1 missing trading days. [2025-09-05T18:01:07.657046] [INFO ] [MAIN ] AHT: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:07.657405] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-05T18:01:07.691482] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-05T18:01:07.700752] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-05T18:01:07.940080] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-05T18:01:07.956408] [INFO ] [MAIN ] AHT: Adding 80 new records, updating 0 existing records. [2025-09-05T18:01:07.957942] [INFO ] [MAIN ] AHT: Combined dataset has 3316 total records. [2025-09-05T18:01:08.134786] [WARN ] [VALIDATOR ] AHT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:08.333593] [WARN ] [VALIDATOR ] AHT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:08.333858] [INFO ] [MAIN ] AHT: Combined data validation passed. [2025-09-05T18:01:08.354588] [INFO ] [MAIN ] AHT: Update completed successfully. [2025-09-05T18:01:08.355279] [INFO ] [MAIN ] Update Progress: 60/2363 symbols completed. AHT took 1.1s. Estimated remaining: 41m 17s. Rate: 55.8 symbols/min [2025-09-05T18:01:08.545900] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:08.575223] [INFO ] [MAIN ] AI: Loaded 25768 existing records. [2025-09-05T18:01:08.757196] [INFO ] [MAIN ] AI: Found 1 missing trading days. [2025-09-05T18:01:08.772558] [INFO ] [MAIN ] AI: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:08.775052] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-05T18:01:08.777756] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-05T18:01:08.785010] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-05T18:01:08.974614] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-05T18:01:08.982431] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-05T18:01:09.103526] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-05T18:01:09.267352] [INFO ] [MAIN ] AI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:01:09.298443] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-05T18:01:09.308400] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-05T18:01:09.310425] [INFO ] [MAIN ] AI: Combined dataset has 26158 total records. [2025-09-05T18:01:09.495791] [WARN ] [VALIDATOR ] AI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:09.695264] [WARN ] [VALIDATOR ] AI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:09.695496] [INFO ] [MAIN ] AI: Combined data validation passed. [2025-09-05T18:01:09.859258] [INFO ] [MAIN ] AI: Update completed successfully. [2025-09-05T18:01:09.862610] [INFO ] [MAIN ] Update Progress: 61/2363 symbols completed. AI took 1.5s. Estimated remaining: 41m 32s. Rate: 55.4 symbols/min [2025-09-05T18:01:10.037922] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:10.038106] [WARN ] [MAIN ] AIG: No existing data found, performing full refresh instead. [2025-09-05T18:01:10.038237] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-05T18:01:10.038279] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-05T18:01:10.038358] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-05T18:01:10.394157] [INFO ] [REMOTE ] AIG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:10.394608] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-05T18:01:10.420296] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-05T18:01:10.427830] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-05T18:01:10.463427] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-05T18:01:10.473555] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-05T18:01:11.265081] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-05T18:01:11.275375] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-05T18:01:12.201363] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-05T18:01:12.209088] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-05T18:01:12.374038] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-05T18:01:12.383899] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-05T18:01:12.432136] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-05T18:01:12.442964] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-05T18:01:12.909212] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-05T18:01:12.919845] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-05T18:01:13.764690] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-05T18:01:13.771971] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-05T18:01:13.926239] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-05T18:01:13.935790] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-05T18:01:14.455864] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-05T18:01:14.466301] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-05T18:01:15.160432] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-05T18:01:15.170814] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-05T18:01:15.326295] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-05T18:01:15.335279] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-05T18:01:15.549522] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-05T18:01:15.557803] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-05T18:01:16.476560] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-05T18:01:16.488485] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-05T18:01:16.944679] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-05T18:01:16.956781] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-05T18:01:17.061617] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-05T18:01:17.072745] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-05T18:01:17.603289] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-05T18:01:17.611433] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-05T18:01:18.486071] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-05T18:01:18.497303] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-05T18:01:18.602936] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-05T18:01:18.613829] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-05T18:01:19.158518] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-05T18:01:19.165271] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-05T18:01:19.236055] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:01:19.237924] [INFO ] [REMOTE ] AHH: Full fetch complete (45176 records). [2025-09-05T18:01:19.238682] [FATAL] [VALIDATOR ] AHH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:01:19.238775] [FATAL] [MAIN ] AHH: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:01:19.238812] [WARN ] [MAIN ] AHH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:01:19.238856] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-05T18:01:19.238927] [INFO ] [LOCAL ] AHH: Starting deletion of derivative data. [2025-09-05T18:01:19.239030] [INFO ] [MAIN ] Update Progress: 62/2363 symbols completed. AHH took 15.6s. Estimated remaining: 46m 39s. Rate: 49.3 symbols/min [2025-09-05T18:01:19.411978] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:19.422064] [INFO ] [MAIN ] AII: Loaded 6683 existing records. [2025-09-05T18:01:19.593260] [INFO ] [MAIN ] AII: Found 1 missing trading days. [2025-09-05T18:01:19.593458] [INFO ] [MAIN ] AII: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:19.593759] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-05T18:01:19.784183] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:01:19.786423] [INFO ] [REMOTE ] AGX: Full fetch complete (36885 records). [2025-09-05T18:01:20.151108] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-05T18:01:20.180056] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-09-05T18:01:20.191030] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-05T18:01:20.356389] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-05T18:01:20.356856] [INFO ] [MAIN ] Update Progress: 63/2363 symbols completed. AGX took 16.8s. Estimated remaining: 46m 34s. Rate: 49.4 symbols/min [2025-09-05T18:01:20.498235] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-05T18:01:20.558174] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-05T18:01:20.576571] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:20.590076] [INFO ] [MAIN ] AIN: Loaded 11858 existing records. [2025-09-05T18:01:20.700491] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:01:20.792389] [INFO ] [MAIN ] AII: Adding 134 new records, updating 0 existing records. [2025-09-05T18:01:20.815966] [INFO ] [MAIN ] AIN: Found 1 missing trading days. [2025-09-05T18:01:20.817577] [INFO ] [MAIN ] AIN: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:20.817897] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-05T18:01:20.819295] [INFO ] [MAIN ] AII: Combined dataset has 6817 total records. [2025-09-05T18:01:21.006091] [WARN ] [VALIDATOR ] AII: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:21.198455] [WARN ] [VALIDATOR ] AII: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:21.198744] [INFO ] [MAIN ] AII: Combined data validation passed. [2025-09-05T18:01:21.241337] [INFO ] [MAIN ] AII: Update completed successfully. [2025-09-05T18:01:21.243338] [INFO ] [MAIN ] Update Progress: 64/2363 symbols completed. AII took 2.0s. Estimated remaining: 46m 21s. Rate: 49.6 symbols/min [2025-09-05T18:01:21.424431] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:21.425287] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:01:21.425403] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-09-05T18:01:21.427084] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-05T18:01:21.438326] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-05T18:01:21.438406] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-05T18:01:21.583581] [INFO ] [MAIN ] AIN: Adding 144 new records, updating 0 existing records. [2025-09-05T18:01:21.645299] [INFO ] [MAIN ] AIN: Combined dataset has 12002 total records. [2025-09-05T18:01:22.076556] [WARN ] [VALIDATOR ] AIN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:22.081958] [INFO ] [REMOTE ] AIO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:22.102867] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-05T18:01:22.305886] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-05T18:01:22.318564] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-05T18:01:22.327088] [WARN ] [VALIDATOR ] AIN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:22.327296] [INFO ] [MAIN ] AIN: Combined data validation passed. [2025-09-05T18:01:22.401879] [INFO ] [MAIN ] AIN: Update completed successfully. [2025-09-05T18:01:22.403511] [INFO ] [MAIN ] Update Progress: 65/2363 symbols completed. AIN took 2.0s. Estimated remaining: 46m 18s. Rate: 49.6 symbols/min [2025-09-05T18:01:22.554892] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-05T18:01:22.610212] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-05T18:01:22.631133] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:22.650405] [INFO ] [MAIN ] AIR: Loaded 20071 existing records. [2025-09-05T18:01:22.828599] [INFO ] [MAIN ] AIR: Found 1 missing trading days. [2025-09-05T18:01:22.828756] [INFO ] [MAIN ] AIR: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:22.828967] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-05T18:01:22.921587] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-05T18:01:22.925767] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-05T18:01:23.358198] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:01:23.438914] [INFO ] [MAIN ] AIR: Adding 232 new records, updating 0 existing records. [2025-09-05T18:01:23.441720] [INFO ] [MAIN ] AIR: Combined dataset has 20303 total records. [2025-09-05T18:01:23.620315] [WARN ] [VALIDATOR ] AIR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:23.814843] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-05T18:01:23.820570] [INFO ] [REMOTE ] AHR: Full fetch complete (53606 records). [2025-09-05T18:01:24.239004] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-05T18:01:24.244110] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-05T18:01:24.244432] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-05T18:01:24.351516] [WARN ] [VALIDATOR ] AIR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:24.373155] [INFO ] [MAIN ] AIR: Combined data validation passed. [2025-09-05T18:01:24.391697] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-05T18:01:24.410477] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-05T18:01:24.638021] [INFO ] [MAIN ] AIR: Update completed successfully. [2025-09-05T18:01:24.640477] [INFO ] [MAIN ] Update Progress: 66/2363 symbols completed. AIR took 2.2s. Estimated remaining: 46m 53s. Rate: 49.0 symbols/min [2025-09-05T18:01:24.826174] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:24.830060] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-05T18:01:24.830407] [INFO ] [MAIN ] Update Progress: 67/2363 symbols completed. AHR took 19.2s. Estimated remaining: 46m 16s. Rate: 49.6 symbols/min [2025-09-05T18:01:25.035762] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:25.036517] [INFO ] [MAIN ] AIT: Loaded 21651 existing records. [2025-09-05T18:01:25.223176] [INFO ] [MAIN ] AIT: Found 1 missing trading days. [2025-09-05T18:01:25.232285] [INFO ] [MAIN ] AIT: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:25.232514] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-05T18:01:25.233726] [INFO ] [MAIN ] AIV: Loaded 30208 existing records. [2025-09-05T18:01:25.410110] [INFO ] [MAIN ] AIV: Found 1 missing trading days. [2025-09-05T18:01:25.410373] [INFO ] [MAIN ] AIV: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:25.410693] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-05T18:01:25.420914] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-05T18:01:25.424504] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-05T18:01:25.767149] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:01:25.812058] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:01:25.869985] [INFO ] [MAIN ] AIT: Adding 143 new records, updating 0 existing records. [2025-09-05T18:01:25.979223] [INFO ] [MAIN ] AIV: Adding 314 new records, updating 0 existing records. [2025-09-05T18:01:25.979514] [INFO ] [MAIN ] AIT: Combined dataset has 21794 total records. [2025-09-05T18:01:26.164919] [INFO ] [MAIN ] AIV: Combined dataset has 30522 total records. [2025-09-05T18:01:26.170784] [WARN ] [VALIDATOR ] AIT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:26.539744] [WARN ] [VALIDATOR ] AIV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:26.744633] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-05T18:01:26.753458] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-05T18:01:26.789662] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-05T18:01:26.803403] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-05T18:01:26.817181] [WARN ] [VALIDATOR ] AIT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:26.817424] [INFO ] [MAIN ] AIT: Combined data validation passed. [2025-09-05T18:01:26.816949] [WARN ] [VALIDATOR ] AIV: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:26.818670] [INFO ] [MAIN ] AIV: Combined data validation passed. [2025-09-05T18:01:27.129005] [INFO ] [MAIN ] AIT: Update completed successfully. [2025-09-05T18:01:27.132980] [INFO ] [MAIN ] Update Progress: 68/2363 symbols completed. AIT took 2.5s. Estimated remaining: 46m 52s. Rate: 49.0 symbols/min [2025-09-05T18:01:27.244599] [INFO ] [MAIN ] AIV: Update completed successfully. [2025-09-05T18:01:27.250754] [INFO ] [MAIN ] Update Progress: 69/2363 symbols completed. AIV took 2.4s. Estimated remaining: 46m 14s. Rate: 49.6 symbols/min [2025-09-05T18:01:27.429162] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:27.505583] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:27.513029] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:01:27.521435] [INFO ] [REMOTE ] AIG: Full fetch complete (58138 records). [2025-09-05T18:01:27.521884] [INFO ] [MAIN ] AIZ: Loaded 13995 existing records. [2025-09-05T18:01:27.689070] [INFO ] [MAIN ] AIZN: Loaded 1863 existing records. [2025-09-05T18:01:28.116562] [INFO ] [MAIN ] AIZ: Found 1 missing trading days. [2025-09-05T18:01:28.186219] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-05T18:01:28.174432] [INFO ] [MAIN ] AIZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:28.217832] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-05T18:01:28.223209] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-05T18:01:28.222857] [INFO ] [MAIN ] AIZN: Found 1 missing trading days. [2025-09-05T18:01:28.230699] [INFO ] [MAIN ] AIZN: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:28.231002] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-05T18:01:28.319809] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-05T18:01:28.562929] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-05T18:01:28.563077] [INFO ] [MAIN ] Update Progress: 70/2363 symbols completed. AIG took 18.7s. Estimated remaining: 46m 16s. Rate: 49.6 symbols/min [2025-09-05T18:01:28.737832] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:28.767262] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:01:28.841208] [INFO ] [MAIN ] AJG: Loaded 35099 existing records. [2025-09-05T18:01:28.912301] [INFO ] [MAIN ] AIZ: Adding 214 new records, updating 0 existing records. [2025-09-05T18:01:28.942507] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:01:28.984043] [INFO ] [MAIN ] AIZN: Adding 10 new records, updating 0 existing records. [2025-09-05T18:01:28.999922] [INFO ] [MAIN ] AIZ: Combined dataset has 14209 total records. [2025-09-05T18:01:29.056857] [INFO ] [MAIN ] AIZN: Combined dataset has 1873 total records. [2025-09-05T18:01:29.067687] [INFO ] [MAIN ] AJG: Found 1 missing trading days. [2025-09-05T18:01:29.084125] [INFO ] [MAIN ] AJG: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:29.134393] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-05T18:01:29.422047] [WARN ] [VALIDATOR ] AIZN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:29.425225] [WARN ] [VALIDATOR ] AIZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:29.640266] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-05T18:01:29.731216] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-05T18:01:29.848695] [WARN ] [VALIDATOR ] AIZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:29.848816] [WARN ] [VALIDATOR ] AIZN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:29.851609] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:01:29.851373] [INFO ] [MAIN ] AIZ: Combined data validation passed. [2025-09-05T18:01:29.851867] [INFO ] [MAIN ] AIZN: Combined data validation passed. [2025-09-05T18:01:30.028087] [INFO ] [MAIN ] AIZN: Update completed successfully. [2025-09-05T18:01:30.044307] [INFO ] [MAIN ] Update Progress: 71/2363 symbols completed. AIZN took 2.8s. Estimated remaining: 46m 23s. Rate: 49.4 symbols/min [2025-09-05T18:01:30.130592] [INFO ] [MAIN ] AJG: Adding 341 new records, updating 0 existing records. [2025-09-05T18:01:30.270970] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:30.272350] [INFO ] [MAIN ] AJG: Combined dataset has 35440 total records. [2025-09-05T18:01:30.272823] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-05T18:01:30.317180] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-05T18:01:30.345288] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-05T18:01:30.377689] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-05T18:01:30.534441] [WARN ] [VALIDATOR ] AJG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:30.626230] [INFO ] [MAIN ] AIZ: Update completed successfully. [2025-09-05T18:01:30.642638] [INFO ] [MAIN ] Update Progress: 72/2363 symbols completed. AIZ took 3.5s. Estimated remaining: 46m 3s. Rate: 49.8 symbols/min [2025-09-05T18:01:31.053810] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-05T18:01:31.085507] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-05T18:01:31.198945] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:31.259456] [INFO ] [REMOTE ] AKA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:31.259939] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-05T18:01:31.281872] [INFO ] [MAIN ] AKR: Loaded 22434 existing records. [2025-09-05T18:01:31.451406] [WARN ] [VALIDATOR ] AJG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:31.459757] [INFO ] [MAIN ] AJG: Combined data validation passed. [2025-09-05T18:01:31.459577] [INFO ] [MAIN ] AKR: Found 1 missing trading days. [2025-09-05T18:01:31.459908] [INFO ] [MAIN ] AKR: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:31.460383] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-05T18:01:31.683575] [INFO ] [MAIN ] AJG: Update completed successfully. [2025-09-05T18:01:31.689528] [INFO ] [MAIN ] Update Progress: 73/2363 symbols completed. AJG took 3.1s. Estimated remaining: 45m 56s. Rate: 49.8 symbols/min [2025-09-05T18:01:31.875119] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:31.897492] [INFO ] [MAIN ] AL: Loaded 19956 existing records. [2025-09-05T18:01:31.991742] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-05T18:01:32.019735] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-05T18:01:32.098719] [INFO ] [MAIN ] AL: Found 1 missing trading days. [2025-09-05T18:01:32.107194] [INFO ] [MAIN ] AL: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:32.107493] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-05T18:01:32.109045] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-05T18:01:32.113014] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-05T18:01:32.169468] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:01:32.291680] [INFO ] [MAIN ] AKR: Adding 330 new records, updating 0 existing records. [2025-09-05T18:01:32.295412] [INFO ] [MAIN ] AKR: Combined dataset has 22764 total records. [2025-09-05T18:01:32.501460] [WARN ] [VALIDATOR ] AKR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:32.564748] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:01:32.633295] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-05T18:01:32.687363] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-05T18:01:32.871154] [INFO ] [MAIN ] AL: Adding 386 new records, updating 0 existing records. [2025-09-05T18:01:32.875574] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:01:32.878341] [INFO ] [REMOTE ] AIO: Full fetch complete (14892 records). [2025-09-05T18:01:32.926414] [INFO ] [MAIN ] AL: Combined dataset has 20342 total records. [2025-09-05T18:01:33.281911] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-05T18:01:33.314800] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-05T18:01:33.364834] [WARN ] [VALIDATOR ] AL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:33.553072] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-05T18:01:33.723911] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-05T18:01:33.725744] [INFO ] [MAIN ] Update Progress: 74/2363 symbols completed. AIO took 12.5s. Estimated remaining: 46m 21s. Rate: 49.4 symbols/min [2025-09-05T18:01:33.737674] [WARN ] [VALIDATOR ] AKR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:33.737577] [WARN ] [VALIDATOR ] AL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:33.763056] [INFO ] [MAIN ] AL: Combined data validation passed. [2025-09-05T18:01:33.770138] [INFO ] [MAIN ] AKR: Combined data validation passed. [2025-09-05T18:01:34.004681] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-05T18:01:34.006684] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-05T18:01:34.089587] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:34.144941] [INFO ] [MAIN ] ALB: Loaded 25524 existing records. [2025-09-05T18:01:34.227337] [INFO ] [MAIN ] AL: Update completed successfully. [2025-09-05T18:01:34.253797] [INFO ] [MAIN ] Update Progress: 75/2363 symbols completed. AL took 2.6s. Estimated remaining: 45m 59s. Rate: 49.8 symbols/min [2025-09-05T18:01:34.407103] [INFO ] [MAIN ] ALB: Found 1 missing trading days. [2025-09-05T18:01:34.423829] [INFO ] [MAIN ] ALB: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:34.429531] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-05T18:01:34.504029] [INFO ] [MAIN ] AKR: Update completed successfully. [2025-09-05T18:01:34.522573] [INFO ] [MAIN ] Update Progress: 76/2363 symbols completed. AKR took 3.9s. Estimated remaining: 45m 29s. Rate: 50.3 symbols/min [2025-09-05T18:01:34.690666] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:34.761885] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:34.765729] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-05T18:01:34.767399] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-05T18:01:34.791221] [INFO ] [MAIN ] ALE: Loaded 15364 existing records. [2025-09-05T18:01:34.905995] [INFO ] [MAIN ] ALC: Loaded 38229 existing records. [2025-09-05T18:01:35.156839] [INFO ] [MAIN ] ALE: Found 1 missing trading days. [2025-09-05T18:01:35.157037] [INFO ] [MAIN ] ALE: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:35.157633] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-05T18:01:35.240468] [INFO ] [MAIN ] ALC: Found 1 missing trading days. [2025-09-05T18:01:35.241233] [INFO ] [MAIN ] ALC: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:35.241156] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-05T18:01:35.241535] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-05T18:01:35.242827] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-05T18:01:35.297158] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:01:35.440814] [INFO ] [MAIN ] ALB: Adding 385 new records, updating 0 existing records. [2025-09-05T18:01:35.444214] [INFO ] [MAIN ] ALB: Combined dataset has 25909 total records. [2025-09-05T18:01:35.583892] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:01:35.653261] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-05T18:01:35.667412] [WARN ] [VALIDATOR ] ALB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:35.684125] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-05T18:01:35.849418] [INFO ] [MAIN ] ALE: Adding 263 new records, updating 0 existing records. [2025-09-05T18:01:35.941690] [INFO ] [MAIN ] ALE: Combined dataset has 15627 total records. [2025-09-05T18:01:36.031362] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:01:36.217417] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-05T18:01:36.231248] [WARN ] [VALIDATOR ] ALE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:36.227960] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-05T18:01:36.413811] [INFO ] [MAIN ] ALC: Adding 385 new records, updating 0 existing records. [2025-09-05T18:01:36.501462] [INFO ] [MAIN ] ALC: Combined dataset has 38614 total records. [2025-09-05T18:01:36.614988] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:01:36.626197] [INFO ] [REMOTE ] AKA: Full fetch complete (1798 records). [2025-09-05T18:01:36.632568] [FATAL] [VALIDATOR ] AKA: Data is stale - most recent date (2025-09-03) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:01:36.652333] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:01:36.661849] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:01:36.662115] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-05T18:01:36.662467] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-05T18:01:36.670253] [INFO ] [MAIN ] Update Progress: 77/2363 symbols completed. AKA took 6.6s. Estimated remaining: 45m 56s. Rate: 49.8 symbols/min [2025-09-05T18:01:36.695264] [WARN ] [VALIDATOR ] ALC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:36.900636] [WARN ] [VALIDATOR ] ALB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:36.900939] [WARN ] [VALIDATOR ] ALE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:36.901678] [INFO ] [MAIN ] ALB: Combined data validation passed. [2025-09-05T18:01:36.901913] [INFO ] [MAIN ] ALE: Combined data validation passed. [2025-09-05T18:01:37.100868] [WARN ] [VALIDATOR ] ALC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:37.107492] [INFO ] [MAIN ] ALC: Combined data validation passed. [2025-09-05T18:01:37.164715] [INFO ] [MAIN ] ALE: Update completed successfully. [2025-09-05T18:01:37.234367] [INFO ] [MAIN ] Update Progress: 78/2363 symbols completed. ALE took 2.7s. Estimated remaining: 45m 36s. Rate: 50.1 symbols/min [2025-09-05T18:01:37.305744] [INFO ] [MAIN ] ALB: Update completed successfully. [2025-09-05T18:01:37.309626] [INFO ] [MAIN ] Update Progress: 79/2363 symbols completed. ALB took 3.6s. Estimated remaining: 45m 3s. Rate: 50.7 symbols/min [2025-09-05T18:01:37.420751] [INFO ] [MAIN ] ALC: Update completed successfully. [2025-09-05T18:01:37.424689] [INFO ] [MAIN ] Update Progress: 80/2363 symbols completed. ALC took 3.2s. Estimated remaining: 44m 31s. Rate: 51.3 symbols/min [2025-09-05T18:01:37.968227] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:37.999377] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:38.148719] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:38.150357] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:38.150759] [WARN ] [MAIN ] ALEX: No existing data found, performing full refresh instead. [2025-09-05T18:01:38.162879] [INFO ] [MAIN ] ALG: Loaded 7817 existing records. [2025-09-05T18:01:38.163953] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-05T18:01:38.169370] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-05T18:01:38.181244] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-05T18:01:38.215335] [INFO ] [MAIN ] ALIT: Loaded 25104 existing records. [2025-09-05T18:01:38.581741] [INFO ] [MAIN ] ALK: Loaded 25181 existing records. [2025-09-05T18:01:38.693674] [INFO ] [MAIN ] ALG: Found 1 missing trading days. [2025-09-05T18:01:38.740284] [INFO ] [MAIN ] ALG: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:38.773988] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-05T18:01:38.947318] [INFO ] [MAIN ] ALIT: Found 1 missing trading days. [2025-09-05T18:01:38.958046] [INFO ] [MAIN ] ALIT: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:39.017464] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-05T18:01:39.068201] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:39.079538] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-05T18:01:39.105158] [INFO ] [MAIN ] ALK: Found 1 missing trading days. [2025-09-05T18:01:39.105233] [INFO ] [MAIN ] ALK: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:39.105473] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-05T18:01:39.517172] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:01:39.596487] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:01:39.671383] [INFO ] [MAIN ] ALG: Adding 49 new records, updating 0 existing records. [2025-09-05T18:01:39.691979] [INFO ] [MAIN ] ALIT: Adding 384 new records, updating 0 existing records. [2025-09-05T18:01:39.692849] [INFO ] [MAIN ] ALG: Combined dataset has 7866 total records. [2025-09-05T18:01:39.807158] [INFO ] [MAIN ] ALIT: Combined dataset has 25488 total records. [2025-09-05T18:01:39.918084] [WARN ] [VALIDATOR ] ALG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:40.140117] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:01:40.173555] [WARN ] [VALIDATOR ] ALIT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:40.619670] [INFO ] [MAIN ] ALK: Adding 389 new records, updating 0 existing records. [2025-09-05T18:01:40.647412] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-05T18:01:40.654184] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-05T18:01:40.647961] [INFO ] [MAIN ] ALK: Combined dataset has 25570 total records. [2025-09-05T18:01:40.851485] [WARN ] [VALIDATOR ] ALK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:41.045722] [WARN ] [VALIDATOR ] ALIT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:41.045803] [WARN ] [VALIDATOR ] ALG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:41.045970] [INFO ] [MAIN ] ALIT: Combined data validation passed. [2025-09-05T18:01:41.046247] [INFO ] [MAIN ] ALG: Combined data validation passed. [2025-09-05T18:01:41.191667] [INFO ] [MAIN ] ALG: Update completed successfully. [2025-09-05T18:01:41.198821] [INFO ] [MAIN ] Update Progress: 81/2363 symbols completed. ALG took 3.8s. Estimated remaining: 45m 43s. Rate: 49.9 symbols/min [2025-09-05T18:01:41.296093] [INFO ] [MAIN ] ALIT: Update completed successfully. [2025-09-05T18:01:41.320794] [INFO ] [MAIN ] Update Progress: 82/2363 symbols completed. ALIT took 3.9s. Estimated remaining: 45m 12s. Rate: 50.5 symbols/min [2025-09-05T18:01:41.544158] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:41.619454] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:41.621428] [WARN ] [VALIDATOR ] ALK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:41.621576] [INFO ] [MAIN ] ALK: Combined data validation passed. [2025-09-05T18:01:41.778705] [INFO ] [MAIN ] ALL: Loaded 23968 existing records. [2025-09-05T18:01:41.880192] [INFO ] [MAIN ] ALK: Update completed successfully. [2025-09-05T18:01:41.896106] [INFO ] [MAIN ] ALLE: Loaded 33825 existing records. [2025-09-05T18:01:41.918362] [INFO ] [MAIN ] Update Progress: 83/2363 symbols completed. ALK took 4.5s. Estimated remaining: 44m 55s. Rate: 50.8 symbols/min [2025-09-05T18:01:42.161142] [INFO ] [MAIN ] ALL: Found 1 missing trading days. [2025-09-05T18:01:42.178136] [INFO ] [MAIN ] ALL: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:42.191865] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-05T18:01:42.332233] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:42.328469] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-05T18:01:42.353940] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-05T18:01:42.362185] [INFO ] [MAIN ] ALLE: Found 1 missing trading days. [2025-09-05T18:01:42.362498] [INFO ] [MAIN ] ALLE: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:42.363422] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-05T18:01:42.402219] [INFO ] [MAIN ] ALLY: Loaded 40016 existing records. [2025-09-05T18:01:42.581077] [INFO ] [MAIN ] ALLY: Found 1 missing trading days. [2025-09-05T18:01:42.581233] [INFO ] [MAIN ] ALLY: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:42.581440] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-05T18:01:42.767606] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:01:42.893561] [INFO ] [MAIN ] ALLE: Adding 270 new records, updating 0 existing records. [2025-09-05T18:01:42.897417] [INFO ] [MAIN ] ALLE: Combined dataset has 34095 total records. [2025-09-05T18:01:43.082588] [WARN ] [VALIDATOR ] ALLE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:43.083274] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:01:43.382394] [INFO ] [MAIN ] ALL: Adding 370 new records, updating 0 existing records. [2025-09-05T18:01:43.416209] [INFO ] [MAIN ] ALL: Combined dataset has 24338 total records. [2025-09-05T18:01:43.553256] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:01:43.662421] [WARN ] [VALIDATOR ] ALL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:43.857272] [INFO ] [MAIN ] ALLY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:01:43.951591] [INFO ] [MAIN ] ALLY: Combined dataset has 40016 total records. [2025-09-05T18:01:43.959554] [FATAL] [VALIDATOR ] ALLY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:01:43.959902] [FATAL] [MAIN ] ALLY: Combined data validation failed. [2025-09-05T18:01:43.959976] [WARN ] [MAIN ] ALLY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:01:43.960024] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-05T18:01:43.960907] [INFO ] [LOCAL ] ALLY: Starting deletion of derivative data. [2025-09-05T18:01:43.980682] [INFO ] [MAIN ] Update Progress: 84/2363 symbols completed. ALLY took 2.0s. Estimated remaining: 45m 17s. Rate: 50.3 symbols/min [2025-09-05T18:01:43.962155] [WARN ] [VALIDATOR ] ALLE: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:43.997974] [INFO ] [MAIN ] ALLE: Combined data validation passed. [2025-09-05T18:01:44.058414] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-05T18:01:44.114319] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-05T18:01:44.283838] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:44.407937] [INFO ] [MAIN ] ALSN: Loaded 32336 existing records. [2025-09-05T18:01:44.532752] [WARN ] [VALIDATOR ] ALL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:44.554404] [INFO ] [MAIN ] ALL: Combined data validation passed. [2025-09-05T18:01:44.617452] [INFO ] [MAIN ] ALSN: Found 1 missing trading days. [2025-09-05T18:01:44.618771] [INFO ] [MAIN ] ALSN: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:44.619738] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-05T18:01:44.728920] [INFO ] [MAIN ] ALLE: Update completed successfully. [2025-09-05T18:01:44.736429] [INFO ] [MAIN ] Update Progress: 85/2363 symbols completed. ALLE took 3.4s. Estimated remaining: 45m 4s. Rate: 50.5 symbols/min [2025-09-05T18:01:44.931520] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:44.957932] [INFO ] [MAIN ] ALTG: Loaded 17469 existing records. [2025-09-05T18:01:45.185149] [INFO ] [MAIN ] ALTG: Found 1 missing trading days. [2025-09-05T18:01:45.185586] [INFO ] [MAIN ] ALTG: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:45.186118] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-05T18:01:45.191544] [INFO ] [MAIN ] ALL: Update completed successfully. [2025-09-05T18:01:45.194789] [INFO ] [MAIN ] Update Progress: 86/2363 symbols completed. ALL took 4.0s. Estimated remaining: 44m 44s. Rate: 50.9 symbols/min [2025-09-05T18:01:45.369176] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:45.378264] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:01:45.424303] [INFO ] [MAIN ] ALUR: Loaded 7780 existing records. [2025-09-05T18:01:45.682349] [INFO ] [MAIN ] ALSN: Adding 360 new records, updating 0 existing records. [2025-09-05T18:01:45.714490] [INFO ] [MAIN ] ALUR: Found 1 missing trading days. [2025-09-05T18:01:45.715274] [INFO ] [MAIN ] ALUR: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:45.717126] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-05T18:01:45.720165] [INFO ] [MAIN ] ALSN: Combined dataset has 32696 total records. [2025-09-05T18:01:45.832325] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-05T18:01:45.870763] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-05T18:01:45.954173] [WARN ] [VALIDATOR ] ALSN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:45.957944] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:01:46.152188] [INFO ] [MAIN ] ALTG: Adding 180 new records, updating 0 existing records. [2025-09-05T18:01:46.231984] [INFO ] [MAIN ] ALTG: Combined dataset has 17649 total records. [2025-09-05T18:01:46.437086] [WARN ] [VALIDATOR ] ALTG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:46.689297] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:01:46.711857] [INFO ] [MAIN ] ALUR: Adding 42 new records, updating 0 existing records. [2025-09-05T18:01:46.715352] [INFO ] [MAIN ] ALUR: Combined dataset has 7822 total records. [2025-09-05T18:01:46.903979] [WARN ] [VALIDATOR ] ALUR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:47.113755] [WARN ] [VALIDATOR ] ALSN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:47.113978] [INFO ] [MAIN ] ALSN: Combined data validation passed. [2025-09-05T18:01:47.113654] [WARN ] [VALIDATOR ] ALTG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:47.114366] [INFO ] [MAIN ] ALTG: Combined data validation passed. [2025-09-05T18:01:47.294528] [WARN ] [VALIDATOR ] ALUR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:47.301855] [INFO ] [MAIN ] ALUR: Combined data validation passed. [2025-09-05T18:01:47.361725] [INFO ] [MAIN ] ALUR: Update completed successfully. [2025-09-05T18:01:47.365400] [INFO ] [MAIN ] Update Progress: 87/2363 symbols completed. ALUR took 2.2s. Estimated remaining: 45m 9s. Rate: 50.4 symbols/min [2025-09-05T18:01:47.391180] [INFO ] [MAIN ] ALTG: Update completed successfully. [2025-09-05T18:01:47.404397] [INFO ] [MAIN ] Update Progress: 88/2363 symbols completed. ALTG took 2.7s. Estimated remaining: 44m 38s. Rate: 51.0 symbols/min [2025-09-05T18:01:47.725504] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:47.776222] [WARN ] [MAIN ] ALV: No existing data found, performing full refresh instead. [2025-09-05T18:01:47.780596] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-05T18:01:47.778706] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-05T18:01:47.772547] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:47.791352] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-05T18:01:47.794741] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-05T18:01:47.808439] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-05T18:01:47.887170] [INFO ] [MAIN ] ALX: Loaded 4220 existing records. [2025-09-05T18:01:48.341557] [INFO ] [MAIN ] ALX: Found 1 missing trading days. [2025-09-05T18:01:48.358808] [INFO ] [MAIN ] ALX: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:48.384285] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-05T18:01:48.474610] [INFO ] [REMOTE ] ALV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:48.476669] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-05T18:01:48.495549] [INFO ] [MAIN ] ALSN: Update completed successfully. [2025-09-05T18:01:48.499430] [INFO ] [MAIN ] Update Progress: 89/2363 symbols completed. ALSN took 4.5s. Estimated remaining: 44m 35s. Rate: 51.0 symbols/min [2025-09-05T18:01:48.670956] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:48.711010] [INFO ] [MAIN ] AM: Loaded 39121 existing records. [2025-09-05T18:01:48.897359] [INFO ] [MAIN ] AM: Found 1 missing trading days. [2025-09-05T18:01:48.897631] [INFO ] [MAIN ] AM: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:48.904319] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-05T18:01:48.916096] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-05T18:01:48.922665] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-05T18:01:49.275024] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:01:49.294983] [INFO ] [MAIN ] ALX: Adding 51 new records, updating 0 existing records. [2025-09-05T18:01:49.296491] [INFO ] [MAIN ] ALX: Combined dataset has 4271 total records. [2025-09-05T18:01:49.474249] [WARN ] [VALIDATOR ] ALX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:49.683880] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:01:49.855873] [INFO ] [MAIN ] AM: Adding 386 new records, updating 0 existing records. [2025-09-05T18:01:49.861729] [INFO ] [MAIN ] AM: Combined dataset has 39507 total records. [2025-09-05T18:01:50.050335] [WARN ] [VALIDATOR ] AM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:50.254378] [WARN ] [VALIDATOR ] ALX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:50.254541] [INFO ] [MAIN ] ALX: Combined data validation passed. [2025-09-05T18:01:50.333909] [INFO ] [MAIN ] ALX: Update completed successfully. [2025-09-05T18:01:50.333778] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-05T18:01:50.335238] [INFO ] [MAIN ] Update Progress: 90/2363 symbols completed. ALX took 2.9s. Estimated remaining: 44m 50s. Rate: 50.7 symbols/min [2025-09-05T18:01:50.343328] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-05T18:01:50.351991] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-05T18:01:50.387876] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-05T18:01:50.539044] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:50.545189] [WARN ] [VALIDATOR ] AM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:50.545426] [INFO ] [MAIN ] AM: Combined data validation passed. [2025-09-05T18:01:50.667289] [INFO ] [MAIN ] AMBC: Loaded 27764 existing records. [2025-09-05T18:01:50.861686] [INFO ] [MAIN ] AMBC: Found 1 missing trading days. [2025-09-05T18:01:50.865735] [INFO ] [MAIN ] AMBC: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:50.868410] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-05T18:01:50.986606] [INFO ] [MAIN ] AM: Update completed successfully. [2025-09-05T18:01:50.992077] [INFO ] [MAIN ] Update Progress: 91/2363 symbols completed. AM took 2.5s. Estimated remaining: 44m 36s. Rate: 50.9 symbols/min [2025-09-05T18:01:51.163213] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:51.184718] [INFO ] [MAIN ] AMBP: Loaded 21419 existing records. [2025-09-05T18:01:51.363094] [INFO ] [MAIN ] AMBP: Found 1 missing trading days. [2025-09-05T18:01:51.363240] [INFO ] [MAIN ] AMBP: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:51.363495] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-05T18:01:51.544560] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:01:51.644936] [INFO ] [MAIN ] AMBC: Adding 233 new records, updating 0 existing records. [2025-09-05T18:01:51.647899] [INFO ] [MAIN ] AMBC: Combined dataset has 27997 total records. [2025-09-05T18:01:51.832390] [WARN ] [VALIDATOR ] AMBC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:52.072926] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-05T18:01:52.075326] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:01:52.122146] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-05T18:01:52.236940] [INFO ] [MAIN ] AMBP: Adding 260 new records, updating 0 existing records. [2025-09-05T18:01:52.267439] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-05T18:01:52.278032] [INFO ] [MAIN ] AMBP: Combined dataset has 21679 total records. [2025-09-05T18:01:52.481077] [WARN ] [VALIDATOR ] AMBP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:01:52.672270] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-05T18:01:52.686991] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:01:52.689988] [INFO ] [REMOTE ] ALEX: Full fetch complete (33253 records). [2025-09-05T18:01:52.955136] [WARN ] [VALIDATOR ] AMBC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:52.965719] [INFO ] [MAIN ] AMBC: Combined data validation passed. [2025-09-05T18:01:53.158302] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-05T18:01:53.330454] [WARN ] [VALIDATOR ] AMBP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:01:53.335194] [INFO ] [MAIN ] AMBP: Combined data validation passed. [2025-09-05T18:01:53.471939] [INFO ] [MAIN ] AMBC: Update completed successfully. [2025-09-05T18:01:53.479422] [INFO ] [MAIN ] Update Progress: 92/2363 symbols completed. AMBC took 3.1s. Estimated remaining: 45m 7s. Rate: 50.3 symbols/min [2025-09-05T18:01:53.479565] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-05T18:01:53.480425] [INFO ] [MAIN ] Update Progress: 93/2363 symbols completed. ALEX took 16.1s. Estimated remaining: 44m 37s. Rate: 50.9 symbols/min [2025-09-05T18:01:53.866576] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:53.868554] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:53.884085] [INFO ] [MAIN ] AMBP: Update completed successfully. [2025-09-05T18:01:53.886892] [INFO ] [MAIN ] Update Progress: 94/2363 symbols completed. AMBP took 2.9s. Estimated remaining: 44m 17s. Rate: 51.2 symbols/min [2025-09-05T18:01:53.961729] [INFO ] [MAIN ] AMBQ: Loaded 5413 existing records. [2025-09-05T18:01:54.171836] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:54.189493] [WARN ] [MAIN ] AMCR: No existing data found, performing full refresh instead. [2025-09-05T18:01:54.201972] [INFO ] [MAIN ] AMC: Loaded 40508 existing records. [2025-09-05T18:01:54.213202] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-05T18:01:54.265932] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-05T18:01:54.356904] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-05T18:01:54.381113] [INFO ] [MAIN ] AMBQ: Found 1 missing trading days. [2025-09-05T18:01:54.424592] [INFO ] [MAIN ] AMBQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:54.458243] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-05T18:01:54.573095] [INFO ] [MAIN ] AMC: Found 1 missing trading days. [2025-09-05T18:01:54.588855] [INFO ] [MAIN ] AMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:54.626717] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-05T18:01:54.837194] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:01:54.866283] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-05T18:01:55.063428] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-05T18:01:55.374886] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:01:55.539305] [INFO ] [MAIN ] AMC: Adding 390 new records, updating 0 existing records. [2025-09-05T18:01:55.543483] [INFO ] [MAIN ] AMC: Combined dataset has 40898 total records. [2025-09-05T18:01:55.722710] [WARN ] [VALIDATOR ] AMC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:55.872107] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-05T18:01:55.937908] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-05T18:01:56.009592] [INFO ] [MAIN ] AMBQ: Adding 299 new records, updating 0 existing records. [2025-09-05T18:01:56.013450] [INFO ] [MAIN ] AMBQ: Combined dataset has 5712 total records. [2025-09-05T18:01:56.078956] [WARN ] [VALIDATOR ] AMC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:56.095892] [INFO ] [MAIN ] AMC: Combined data validation passed. [2025-09-05T18:01:56.199537] [WARN ] [VALIDATOR ] AMBQ: Not fatal, but first date in data (2025-07-30) does not match expected start date (2025-01-31) [2025-09-05T18:01:56.641303] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-05T18:01:56.664063] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-05T18:01:56.690863] [INFO ] [MAIN ] AMC: Update completed successfully. [2025-09-05T18:01:56.690962] [WARN ] [VALIDATOR ] AMBQ: Missing days changed. Total missing: 123 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29 [2025-09-05T18:01:56.696833] [INFO ] [MAIN ] Update Progress: 95/2363 symbols completed. AMC took 3.2s. Estimated remaining: 44m 55s. Rate: 50.5 symbols/min [2025-09-05T18:01:56.697021] [INFO ] [MAIN ] AMBQ: Combined data validation passed. [2025-09-05T18:01:56.900614] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:56.914199] [INFO ] [MAIN ] AMBQ: Update completed successfully. [2025-09-05T18:01:56.915221] [INFO ] [MAIN ] Update Progress: 96/2363 symbols completed. AMBQ took 3.4s. Estimated remaining: 44m 31s. Rate: 50.9 symbols/min [2025-09-05T18:01:57.120287] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:57.121119] [INFO ] [MAIN ] AME: Loaded 36526 existing records. [2025-09-05T18:01:57.320541] [INFO ] [MAIN ] AME: Found 1 missing trading days. [2025-09-05T18:01:57.321554] [INFO ] [MAIN ] AMG: Loaded 15294 existing records. [2025-09-05T18:01:57.321721] [INFO ] [MAIN ] AME: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:57.468531] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-05T18:01:57.516457] [INFO ] [MAIN ] AMG: Found 1 missing trading days. [2025-09-05T18:01:57.516595] [INFO ] [MAIN ] AMG: Need to fetch 1 months: 2025-09 [2025-09-05T18:01:58.214375] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-05T18:01:58.231090] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:01:58.270626] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-05T18:01:58.389241] [INFO ] [MAIN ] AME: Adding 349 new records, updating 0 existing records. [2025-09-05T18:01:58.393465] [INFO ] [MAIN ] AME: Combined dataset has 36875 total records. [2025-09-05T18:01:58.580842] [WARN ] [VALIDATOR ] AME: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:58.807817] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-05T18:01:58.828103] [WARN ] [VALIDATOR ] AME: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:01:58.828300] [INFO ] [MAIN ] AME: Combined data validation passed. [2025-09-05T18:01:59.036434] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:01:59.064268] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-05T18:01:59.104718] [INFO ] [MAIN ] AMG: Adding 108 new records, updating 0 existing records. [2025-09-05T18:01:59.112012] [INFO ] [MAIN ] AMG: Combined dataset has 15402 total records. [2025-09-05T18:01:59.316708] [WARN ] [VALIDATOR ] AMG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:01:59.507691] [INFO ] [MAIN ] AME: Update completed successfully. [2025-09-05T18:01:59.517681] [INFO ] [MAIN ] Update Progress: 97/2363 symbols completed. AME took 2.8s. Estimated remaining: 45m 3s. Rate: 50.3 symbols/min [2025-09-05T18:01:59.703946] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:01:59.704346] [WARN ] [MAIN ] AMH: No existing data found, performing full refresh instead. [2025-09-05T18:01:59.705011] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-05T18:01:59.705177] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-05T18:01:59.705311] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-05T18:01:59.866438] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-05T18:02:00.076112] [INFO ] [REMOTE ] AMH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:02:00.080091] [WARN ] [VALIDATOR ] AMG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:00.080350] [INFO ] [MAIN ] AMG: Combined data validation passed. [2025-09-05T18:02:00.182472] [INFO ] [MAIN ] AMG: Update completed successfully. [2025-09-05T18:02:00.183973] [INFO ] [MAIN ] Update Progress: 98/2363 symbols completed. AMG took 3.3s. Estimated remaining: 44m 49s. Rate: 50.5 symbols/min [2025-09-05T18:02:00.355237] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:00.374774] [INFO ] [MAIN ] AMN: Loaded 20228 existing records. [2025-09-05T18:02:00.590226] [INFO ] [MAIN ] AMN: Found 1 missing trading days. [2025-09-05T18:02:00.590369] [INFO ] [MAIN ] AMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:00.663498] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-05T18:02:01.165111] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-05T18:02:01.239670] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:02:01.340961] [INFO ] [MAIN ] AMN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:02:01.342794] [INFO ] [MAIN ] AMN: Combined dataset has 20228 total records. [2025-09-05T18:02:01.343314] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:02:01.343411] [FATAL] [MAIN ] AMN: Combined data validation failed. [2025-09-05T18:02:01.343448] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:02:01.343486] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-05T18:02:01.344068] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-09-05T18:02:01.346870] [INFO ] [MAIN ] Update Progress: 99/2363 symbols completed. AMN took 1.2s. Estimated remaining: 44m 48s. Rate: 50.5 symbols/min [2025-09-05T18:02:01.468616] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-05T18:02:01.536601] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:01.551401] [INFO ] [MAIN ] AMP: Loaded 14712 existing records. [2025-09-05T18:02:01.726761] [INFO ] [MAIN ] AMP: Found 1 missing trading days. [2025-09-05T18:02:01.726934] [INFO ] [MAIN ] AMP: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:02.067491] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-05T18:02:02.263473] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-05T18:02:03.063439] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-05T18:02:03.601607] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-05T18:02:03.657585] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-05T18:02:03.863512] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-05T18:02:04.663561] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-05T18:02:04.851086] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-05T18:02:05.463500] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-05T18:02:05.811483] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-05T18:02:05.906265] [INFO ] [MAIN ] AMP: Adding 251 new records, updating 0 existing records. [2025-09-05T18:02:05.909200] [INFO ] [MAIN ] AMP: Combined dataset has 14963 total records. [2025-09-05T18:02:06.093097] [WARN ] [VALIDATOR ] AMP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:06.274129] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-05T18:02:06.320537] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-05T18:02:06.338054] [WARN ] [VALIDATOR ] AMP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:06.338284] [INFO ] [MAIN ] AMP: Combined data validation passed. [2025-09-05T18:02:06.445983] [INFO ] [MAIN ] AMP: Update completed successfully. [2025-09-05T18:02:06.447600] [INFO ] [MAIN ] Update Progress: 100/2363 symbols completed. AMP took 5.1s. Estimated remaining: 46m 15s. Rate: 48.9 symbols/min [2025-09-05T18:02:06.623998] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:06.649346] [INFO ] [MAIN ] AMPX: Loaded 25425 existing records. [2025-09-05T18:02:06.847476] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-05T18:02:06.855297] [INFO ] [MAIN ] AMPX: Found 1 missing trading days. [2025-09-05T18:02:06.865134] [INFO ] [MAIN ] AMPX: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:07.063481] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-05T18:02:07.863495] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-05T18:02:08.679726] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-05T18:02:08.683207] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-05T18:02:08.705527] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:02:08.861736] [INFO ] [MAIN ] AMPX: Adding 385 new records, updating 0 existing records. [2025-09-05T18:02:08.890178] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-05T18:02:08.899232] [INFO ] [MAIN ] AMPX: Combined dataset has 25810 total records. [2025-09-05T18:02:09.082072] [WARN ] [VALIDATOR ] AMPX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:09.285318] [WARN ] [VALIDATOR ] AMPX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:09.285558] [INFO ] [MAIN ] AMPX: Combined data validation passed. [2025-09-05T18:02:09.442739] [INFO ] [MAIN ] AMPX: Update completed successfully. [2025-09-05T18:02:09.445674] [INFO ] [MAIN ] Update Progress: 101/2363 symbols completed. AMPX took 3.0s. Estimated remaining: 46m 53s. Rate: 48.2 symbols/min [2025-09-05T18:02:09.468628] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-05T18:02:09.630014] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:09.647760] [INFO ] [MAIN ] AMPY: Loaded 18189 existing records. [2025-09-05T18:02:09.849078] [INFO ] [MAIN ] AMPY: Found 1 missing trading days. [2025-09-05T18:02:09.849548] [INFO ] [MAIN ] AMPY: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:09.857017] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:02:09.860551] [INFO ] [REMOTE ] ALV: Full fetch complete (46904 records). [2025-09-05T18:02:09.861549] [FATAL] [VALIDATOR ] ALV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:02:09.861679] [FATAL] [MAIN ] ALV: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:02:09.861723] [WARN ] [MAIN ] ALV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:02:09.861777] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-05T18:02:09.861847] [INFO ] [LOCAL ] ALV: Starting deletion of derivative data. [2025-09-05T18:02:09.861946] [INFO ] [MAIN ] Update Progress: 102/2363 symbols completed. ALV took 22.5s. Estimated remaining: 46m 34s. Rate: 48.6 symbols/min [2025-09-05T18:02:10.075873] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:10.079830] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-05T18:02:10.107520] [INFO ] [MAIN ] AMR: Loaded 14493 existing records. [2025-09-05T18:02:10.263596] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-05T18:02:10.287412] [INFO ] [MAIN ] AMR: Found 1 missing trading days. [2025-09-05T18:02:10.287669] [INFO ] [MAIN ] AMR: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:11.063538] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-05T18:02:11.644899] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:02:11.732043] [INFO ] [MAIN ] AMPY: Adding 204 new records, updating 0 existing records. [2025-09-05T18:02:11.736114] [INFO ] [MAIN ] AMPY: Combined dataset has 18393 total records. [2025-09-05T18:02:11.868595] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-05T18:02:11.931420] [WARN ] [VALIDATOR ] AMPY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:12.182765] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-05T18:02:12.202948] [WARN ] [VALIDATOR ] AMPY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:12.203178] [INFO ] [MAIN ] AMPY: Combined data validation passed. [2025-09-05T18:02:12.315702] [INFO ] [MAIN ] AMPY: Update completed successfully. [2025-09-05T18:02:12.317449] [INFO ] [MAIN ] Update Progress: 103/2363 symbols completed. AMPY took 2.9s. Estimated remaining: 46m 59s. Rate: 48.1 symbols/min [2025-09-05T18:02:12.498288] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:12.524986] [INFO ] [MAIN ] AMRC: Loaded 28308 existing records. [2025-09-05T18:02:12.672906] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-05T18:02:12.705251] [INFO ] [MAIN ] AMRC: Found 1 missing trading days. [2025-09-05T18:02:12.705402] [INFO ] [MAIN ] AMRC: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:13.463496] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-05T18:02:14.078776] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:02:14.192929] [INFO ] [MAIN ] AMRC: Adding 295 new records, updating 0 existing records. [2025-09-05T18:02:14.196598] [INFO ] [MAIN ] AMRC: Combined dataset has 28603 total records. [2025-09-05T18:02:14.268724] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-05T18:02:14.348828] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-05T18:02:14.444295] [WARN ] [VALIDATOR ] AMRC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:14.639456] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:02:14.705753] [INFO ] [MAIN ] AMR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:02:14.708226] [INFO ] [MAIN ] AMR: Combined dataset has 14493 total records. [2025-09-05T18:02:14.709384] [FATAL] [VALIDATOR ] AMR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:02:14.738443] [FATAL] [MAIN ] AMR: Combined data validation failed. [2025-09-05T18:02:14.738609] [WARN ] [MAIN ] AMR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:02:14.738902] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-05T18:02:14.740707] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-05T18:02:14.740831] [INFO ] [LOCAL ] AMR: Starting deletion of derivative data. [2025-09-05T18:02:14.753516] [INFO ] [MAIN ] Update Progress: 104/2363 symbols completed. AMR took 4.9s. Estimated remaining: 47m 24s. Rate: 47.7 symbols/min [2025-09-05T18:02:14.937405] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:14.952408] [WARN ] [VALIDATOR ] AMRC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:14.952626] [INFO ] [MAIN ] AMRC: Combined data validation passed. [2025-09-05T18:02:14.961506] [INFO ] [MAIN ] AMRZ: Loaded 19584 existing records. [2025-09-05T18:02:15.068691] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-05T18:02:15.234663] [INFO ] [MAIN ] AMRZ: Found 1 missing trading days. [2025-09-05T18:02:15.237818] [INFO ] [MAIN ] AMRZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:15.310351] [INFO ] [MAIN ] AMRC: Update completed successfully. [2025-09-05T18:02:15.313736] [INFO ] [MAIN ] Update Progress: 105/2363 symbols completed. AMRC took 3.0s. Estimated remaining: 47m 8s. Rate: 47.9 symbols/min [2025-09-05T18:02:15.485377] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:15.509423] [INFO ] [MAIN ] AMT: Loaded 24865 existing records. [2025-09-05T18:02:15.688939] [INFO ] [MAIN ] AMT: Found 1 missing trading days. [2025-09-05T18:02:15.689138] [INFO ] [MAIN ] AMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:15.863478] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-05T18:02:16.448980] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:02:16.602524] [INFO ] [MAIN ] AMT: Adding 388 new records, updating 0 existing records. [2025-09-05T18:02:16.605873] [INFO ] [MAIN ] AMT: Combined dataset has 25253 total records. [2025-09-05T18:02:16.670900] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-05T18:02:16.788927] [WARN ] [VALIDATOR ] AMT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:17.021708] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-05T18:02:17.038864] [WARN ] [VALIDATOR ] AMT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:17.039095] [INFO ] [MAIN ] AMT: Combined data validation passed. [2025-09-05T18:02:17.210609] [INFO ] [MAIN ] AMT: Update completed successfully. [2025-09-05T18:02:17.214183] [INFO ] [MAIN ] Update Progress: 106/2363 symbols completed. AMT took 1.9s. Estimated remaining: 47m 20s. Rate: 47.7 symbols/min [2025-09-05T18:02:17.394318] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:17.405809] [INFO ] [MAIN ] AMTB: Loaded 10224 existing records. [2025-09-05T18:02:17.470701] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-05T18:02:17.587149] [INFO ] [MAIN ] AMTB: Found 1 missing trading days. [2025-09-05T18:02:17.587336] [INFO ] [MAIN ] AMTB: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:18.263477] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-05T18:02:18.808086] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-05T18:02:18.950126] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:02:19.000886] [INFO ] [MAIN ] AMTB: Adding 135 new records, updating 0 existing records. [2025-09-05T18:02:19.002954] [INFO ] [MAIN ] AMTB: Combined dataset has 10359 total records. [2025-09-05T18:02:19.072000] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-05T18:02:19.196394] [WARN ] [VALIDATOR ] AMTB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:19.374621] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-05T18:02:19.547221] [INFO ] [MAIN ] AMRZ: Adding 390 new records, updating 0 existing records. [2025-09-05T18:02:19.551902] [INFO ] [MAIN ] AMRZ: Combined dataset has 19974 total records. [2025-09-05T18:02:19.739708] [WARN ] [VALIDATOR ] AMRZ: Not fatal, but first date in data (2025-06-23) does not match expected start date (2025-01-31) [2025-09-05T18:02:19.866388] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-05T18:02:19.961684] [WARN ] [VALIDATOR ] AMTB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:19.962413] [WARN ] [VALIDATOR ] AMRZ: Missing days changed. Total missing: 97 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20 [2025-09-05T18:02:19.962724] [INFO ] [MAIN ] AMRZ: Combined data validation passed. [2025-09-05T18:02:19.963062] [INFO ] [MAIN ] AMTB: Combined data validation passed. [2025-09-05T18:02:20.145744] [INFO ] [MAIN ] AMTB: Update completed successfully. [2025-09-05T18:02:20.145876] [INFO ] [MAIN ] AMRZ: Update completed successfully. [2025-09-05T18:02:20.148072] [INFO ] [MAIN ] Update Progress: 107/2363 symbols completed. AMRZ took 5.4s. Estimated remaining: 47m 54s. Rate: 47.1 symbols/min [2025-09-05T18:02:20.149777] [INFO ] [MAIN ] Update Progress: 108/2363 symbols completed. AMTB took 2.9s. Estimated remaining: 47m 26s. Rate: 47.5 symbols/min [2025-09-05T18:02:20.504655] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:20.536230] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:20.536966] [WARN ] [MAIN ] AMTD: No existing data found, performing full refresh instead. [2025-09-05T18:02:20.537583] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-05T18:02:20.537689] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-05T18:02:20.537781] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-05T18:02:20.748840] [INFO ] [MAIN ] AMTM: Loaded 24001 existing records. [2025-09-05T18:02:21.027255] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:02:21.150201] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:02:21.156993] [INFO ] [MAIN ] AMTM: Found 1 missing trading days. [2025-09-05T18:02:21.159693] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-05T18:02:21.161403] [INFO ] [REMOTE ] AMCR: Full fetch complete (58347 records). [2025-09-05T18:02:21.161600] [INFO ] [MAIN ] AMTM: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:21.481689] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-05T18:02:21.479844] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-05T18:02:21.587203] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-05T18:02:21.833079] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-05T18:02:21.993795] [INFO ] [MAIN ] AMTM: Adding 359 new records, updating 0 existing records. [2025-09-05T18:02:22.005101] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-05T18:02:22.011933] [INFO ] [MAIN ] AMTM: Combined dataset has 24360 total records. [2025-09-05T18:02:22.204849] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-05T18:02:22.209627] [INFO ] [MAIN ] Update Progress: 109/2363 symbols completed. AMCR took 28.3s. Estimated remaining: 47m 42s. Rate: 47.3 symbols/min [2025-09-05T18:02:22.209491] [WARN ] [VALIDATOR ] AMTM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:22.288212] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-05T18:02:22.504080] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:22.519763] [WARN ] [MAIN ] AMWL: No existing data found, performing full refresh instead. [2025-09-05T18:02:22.545316] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-05T18:02:22.567070] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-05T18:02:22.578704] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-05T18:02:22.943239] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:02:22.950547] [WARN ] [VALIDATOR ] AMTM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:22.950766] [INFO ] [MAIN ] AMTM: Combined data validation passed. [2025-09-05T18:02:23.064634] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-05T18:02:23.093971] [INFO ] [MAIN ] AMTM: Update completed successfully. [2025-09-05T18:02:23.096912] [INFO ] [MAIN ] Update Progress: 110/2363 symbols completed. AMTM took 2.9s. Estimated remaining: 47m 33s. Rate: 47.4 symbols/min [2025-09-05T18:02:23.314371] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:23.336679] [INFO ] [MAIN ] AMX: Loaded 23096 existing records. [2025-09-05T18:02:23.516243] [INFO ] [MAIN ] AMX: Found 1 missing trading days. [2025-09-05T18:02:23.516419] [INFO ] [MAIN ] AMX: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:23.863480] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-05T18:02:24.104595] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-05T18:02:24.224570] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-05T18:02:24.663488] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-05T18:02:24.733986] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:02:24.871366] [INFO ] [MAIN ] AMX: Adding 360 new records, updating 0 existing records. [2025-09-05T18:02:24.874551] [INFO ] [MAIN ] AMX: Combined dataset has 23456 total records. [2025-09-05T18:02:25.061926] [WARN ] [VALIDATOR ] AMX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:25.265157] [WARN ] [VALIDATOR ] AMX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:25.265410] [INFO ] [MAIN ] AMX: Combined data validation passed. [2025-09-05T18:02:25.363549] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-05T18:02:25.418702] [INFO ] [MAIN ] AMX: Update completed successfully. [2025-09-05T18:02:25.421459] [INFO ] [MAIN ] Update Progress: 111/2363 symbols completed. AMX took 2.3s. Estimated remaining: 47m 53s. Rate: 47.0 symbols/min [2025-09-05T18:02:25.468775] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-05T18:02:25.594404] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:25.609362] [INFO ] [MAIN ] AN: Loaded 14239 existing records. [2025-09-05T18:02:25.794466] [INFO ] [MAIN ] AN: Found 1 missing trading days. [2025-09-05T18:02:25.794681] [INFO ] [MAIN ] AN: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:26.263529] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-05T18:02:26.883947] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:02:26.964846] [INFO ] [MAIN ] AN: Adding 262 new records, updating 0 existing records. [2025-09-05T18:02:26.967977] [INFO ] [MAIN ] AN: Combined dataset has 14501 total records. [2025-09-05T18:02:27.069381] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-05T18:02:27.151441] [WARN ] [VALIDATOR ] AN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:27.375789] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-05T18:02:27.396711] [WARN ] [VALIDATOR ] AN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:27.396943] [INFO ] [MAIN ] AN: Combined data validation passed. [2025-09-05T18:02:27.512615] [INFO ] [MAIN ] AN: Update completed successfully. [2025-09-05T18:02:27.514821] [INFO ] [MAIN ] Update Progress: 112/2363 symbols completed. AN took 2.1s. Estimated remaining: 48m 8s. Rate: 46.8 symbols/min [2025-09-05T18:02:27.696768] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:27.736343] [INFO ] [MAIN ] ANET: Loaded 40506 existing records. [2025-09-05T18:02:27.877833] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-05T18:02:27.920138] [INFO ] [MAIN ] ANET: Found 1 missing trading days. [2025-09-05T18:02:27.921299] [INFO ] [MAIN ] ANET: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:28.003344] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-05T18:02:28.259118] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-05T18:02:28.663546] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-05T18:02:29.252862] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:02:29.424434] [INFO ] [MAIN ] ANET: Adding 390 new records, updating 0 existing records. [2025-09-05T18:02:29.428869] [INFO ] [MAIN ] ANET: Combined dataset has 40896 total records. [2025-09-05T18:02:29.468833] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-05T18:02:29.622097] [WARN ] [VALIDATOR ] ANET: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:29.823769] [WARN ] [VALIDATOR ] ANET: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:29.824043] [INFO ] [MAIN ] ANET: Combined data validation passed. [2025-09-05T18:02:30.073801] [INFO ] [MAIN ] ANET: Update completed successfully. [2025-09-05T18:02:30.077698] [INFO ] [MAIN ] Update Progress: 113/2363 symbols completed. ANET took 2.6s. Estimated remaining: 48m 32s. Rate: 46.4 symbols/min [2025-09-05T18:02:30.256053] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:30.263489] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-05T18:02:30.293935] [INFO ] [MAIN ] ANF: Loaded 39221 existing records. [2025-09-05T18:02:30.427039] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:02:30.469398] [INFO ] [REMOTE ] AMH: Full fetch complete (56077 records). [2025-09-05T18:02:30.496742] [INFO ] [MAIN ] ANF: Found 1 missing trading days. [2025-09-05T18:02:30.496980] [INFO ] [MAIN ] ANF: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:30.828526] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-05T18:02:30.902798] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-05T18:02:31.085331] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-05T18:02:31.150912] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-05T18:02:31.151143] [INFO ] [MAIN ] Update Progress: 114/2363 symbols completed. AMH took 31.6s. Estimated remaining: 48m 26s. Rate: 46.4 symbols/min [2025-09-05T18:02:31.338854] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:31.354567] [INFO ] [MAIN ] ANRO: Loaded 14702 existing records. [2025-09-05T18:02:31.536475] [INFO ] [MAIN ] ANRO: Found 1 missing trading days. [2025-09-05T18:02:31.536628] [INFO ] [MAIN ] ANRO: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:31.563237] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:02:31.728151] [INFO ] [MAIN ] ANF: Adding 373 new records, updating 0 existing records. [2025-09-05T18:02:31.732503] [INFO ] [MAIN ] ANF: Combined dataset has 39594 total records. [2025-09-05T18:02:31.868625] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-05T18:02:31.923551] [WARN ] [VALIDATOR ] ANF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:32.137744] [WARN ] [VALIDATOR ] ANF: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:32.137976] [INFO ] [MAIN ] ANF: Combined data validation passed. [2025-09-05T18:02:32.381226] [INFO ] [MAIN ] ANF: Update completed successfully. [2025-09-05T18:02:32.385624] [INFO ] [MAIN ] Update Progress: 115/2363 symbols completed. ANF took 2.3s. Estimated remaining: 48m 24s. Rate: 46.4 symbols/min [2025-09-05T18:02:32.564782] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:32.576925] [INFO ] [MAIN ] ANVS: Loaded 11454 existing records. [2025-09-05T18:02:32.668695] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-05T18:02:32.767876] [INFO ] [MAIN ] ANVS: Found 1 missing trading days. [2025-09-05T18:02:32.768048] [INFO ] [MAIN ] ANVS: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:32.796819] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-05T18:02:33.406416] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-05T18:02:33.463507] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-05T18:02:33.975297] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:02:34.019085] [INFO ] [MAIN ] ANVS: Adding 95 new records, updating 0 existing records. [2025-09-05T18:02:34.021508] [INFO ] [MAIN ] ANVS: Combined dataset has 11549 total records. [2025-09-05T18:02:34.207066] [WARN ] [VALIDATOR ] ANVS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:34.270577] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-05T18:02:34.407154] [WARN ] [VALIDATOR ] ANVS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:34.407357] [INFO ] [MAIN ] ANVS: Combined data validation passed. [2025-09-05T18:02:34.473815] [INFO ] [MAIN ] ANVS: Update completed successfully. [2025-09-05T18:02:34.475426] [INFO ] [MAIN ] Update Progress: 116/2363 symbols completed. ANVS took 2.1s. Estimated remaining: 48m 38s. Rate: 46.2 symbols/min [2025-09-05T18:02:34.657544] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:34.680450] [INFO ] [MAIN ] AOD: Loaded 23051 existing records. [2025-09-05T18:02:34.859209] [INFO ] [MAIN ] AOD: Found 1 missing trading days. [2025-09-05T18:02:34.859372] [INFO ] [MAIN ] AOD: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:35.063475] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-05T18:02:35.252507] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-05T18:02:35.549582] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-05T18:02:35.863506] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-05T18:02:36.600342] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-05T18:02:36.663520] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-05T18:02:37.439314] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-05T18:02:37.463453] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-05T18:02:38.252458] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-05T18:02:38.263460] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-05T18:02:39.052098] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-05T18:02:39.063470] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-05T18:02:39.863514] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-05T18:02:39.874628] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-05T18:02:40.290724] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:02:40.330864] [INFO ] [MAIN ] ANRO: Adding 37 new records, updating 0 existing records. [2025-09-05T18:02:40.332973] [INFO ] [MAIN ] ANRO: Combined dataset has 14739 total records. [2025-09-05T18:02:40.512347] [WARN ] [VALIDATOR ] ANRO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:40.668264] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-05T18:02:40.712245] [WARN ] [VALIDATOR ] ANRO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:40.712463] [INFO ] [MAIN ] ANRO: Combined data validation passed. [2025-09-05T18:02:40.801981] [INFO ] [MAIN ] ANRO: Update completed successfully. [2025-09-05T18:02:40.803830] [INFO ] [MAIN ] Update Progress: 117/2363 symbols completed. ANRO took 9.7s. Estimated remaining: 50m 13s. Rate: 44.7 symbols/min [2025-09-05T18:02:41.463516] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-05T18:02:41.478474] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-05T18:02:41.855948] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:02:41.857379] [INFO ] [REMOTE ] AMWL: Full fetch complete (10192 records). [2025-09-05T18:02:42.230875] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-05T18:02:42.268897] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-05T18:02:42.271530] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-05T18:02:42.271713] [INFO ] [MAIN ] Update Progress: 118/2363 symbols completed. AMWL took 20.1s. Estimated remaining: 50m 15s. Rate: 44.7 symbols/min [2025-09-05T18:02:42.717901] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:02:42.719054] [INFO ] [REMOTE ] AMTD: Full fetch complete (3616 records). [2025-09-05T18:02:43.068604] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-05T18:02:43.135136] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-05T18:02:43.152108] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-05T18:02:43.152221] [INFO ] [MAIN ] Update Progress: 119/2363 symbols completed. AMTD took 23.0s. Estimated remaining: 50m 4s. Rate: 44.8 symbols/min [2025-09-05T18:02:44.424324] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T18:02:44.570452] [INFO ] [MAIN ] AOD: Adding 215 new records, updating 0 existing records. [2025-09-05T18:02:44.574801] [INFO ] [MAIN ] AOD: Combined dataset has 23266 total records. [2025-09-05T18:02:44.792270] [WARN ] [VALIDATOR ] AOD: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:45.012659] [WARN ] [VALIDATOR ] AOD: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:45.012925] [INFO ] [MAIN ] AOD: Combined data validation passed. [2025-09-05T18:02:45.159131] [INFO ] [MAIN ] AOD: Update completed successfully. [2025-09-05T18:02:45.162398] [INFO ] [MAIN ] Update Progress: 120/2363 symbols completed. AOD took 10.7s. Estimated remaining: 50m 16s. Rate: 44.6 symbols/min [2025-09-05T18:02:45.832334] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:45.918566] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:45.907193] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:45.938554] [WARN ] [MAIN ] AON: No existing data found, performing full refresh instead. [2025-09-05T18:02:45.937927] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:45.940156] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-05T18:02:45.940443] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-05T18:02:45.940602] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-05T18:02:45.991899] [INFO ] [MAIN ] AOMD: Loaded 1291 existing records. [2025-09-05T18:02:46.084335] [INFO ] [MAIN ] AOMR: Loaded 7869 existing records. [2025-09-05T18:02:46.339469] [INFO ] [MAIN ] AORT: Loaded 22147 existing records. [2025-09-05T18:02:46.750778] [INFO ] [MAIN ] AOMR: Found 1 missing trading days. [2025-09-05T18:02:46.756280] [INFO ] [MAIN ] AOMR: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:46.801369] [INFO ] [MAIN ] AOMD: Found 1 missing trading days. [2025-09-05T18:02:46.848872] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-05T18:02:46.854064] [INFO ] [MAIN ] AOMD: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:46.887081] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-05T18:02:46.934114] [INFO ] [REMOTE ] AON: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:02:46.939595] [INFO ] [MAIN ] AORT: Found 1 missing trading days. [2025-09-05T18:02:46.940011] [INFO ] [MAIN ] AORT: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:46.939959] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-05T18:02:46.940245] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-05T18:02:47.479731] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:02:47.487172] [INFO ] [MAIN ] AOMD: Adding 6 new records, updating 0 existing records. [2025-09-05T18:02:47.488720] [INFO ] [MAIN ] AOMD: Combined dataset has 1297 total records. [2025-09-05T18:02:47.606623] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:02:47.728569] [WARN ] [VALIDATOR ] AOMD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:47.858439] [INFO ] [MAIN ] AORT: Adding 239 new records, updating 0 existing records. [2025-09-05T18:02:47.966730] [INFO ] [MAIN ] AORT: Combined dataset has 22386 total records. [2025-09-05T18:02:48.167233] [WARN ] [VALIDATOR ] AORT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:48.209415] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T18:02:48.348851] [INFO ] [MAIN ] AOMR: Adding 167 new records, updating 0 existing records. [2025-09-05T18:02:48.429244] [INFO ] [MAIN ] AOMR: Combined dataset has 8036 total records. [2025-09-05T18:02:48.623270] [WARN ] [VALIDATOR ] AOMR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:48.840503] [WARN ] [VALIDATOR ] AOMR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:48.840699] [WARN ] [VALIDATOR ] AORT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:48.840943] [INFO ] [MAIN ] AORT: Combined data validation passed. [2025-09-05T18:02:48.840617] [WARN ] [VALIDATOR ] AOMD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:48.841532] [INFO ] [MAIN ] AOMR: Combined data validation passed. [2025-09-05T18:02:48.841778] [INFO ] [MAIN ] AOMD: Combined data validation passed. [2025-09-05T18:02:48.981577] [INFO ] [MAIN ] AOMD: Update completed successfully. [2025-09-05T18:02:48.986694] [INFO ] [MAIN ] Update Progress: 121/2363 symbols completed. AOMD took 3.8s. Estimated remaining: 51m 0s. Rate: 44.0 symbols/min [2025-09-05T18:02:49.079772] [INFO ] [MAIN ] AORT: Update completed successfully. [2025-09-05T18:02:49.094289] [INFO ] [MAIN ] Update Progress: 122/2363 symbols completed. AORT took 3.9s. Estimated remaining: 50m 36s. Rate: 44.3 symbols/min [2025-09-05T18:02:49.114418] [INFO ] [MAIN ] AOMR: Update completed successfully. [2025-09-05T18:02:49.150185] [INFO ] [MAIN ] Update Progress: 123/2363 symbols completed. AOMR took 4.0s. Estimated remaining: 50m 11s. Rate: 44.6 symbols/min [2025-09-05T18:02:49.454629] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:49.599250] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:49.607299] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-05T18:02:49.639665] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-05T18:02:49.728552] [INFO ] [MAIN ] AP: Loaded 4099 existing records. [2025-09-05T18:02:49.728372] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:49.887961] [INFO ] [MAIN ] AOS: Loaded 37233 existing records. [2025-09-05T18:02:49.950764] [INFO ] [MAIN ] AP: Found 1 missing trading days. [2025-09-05T18:02:49.996728] [INFO ] [MAIN ] AP: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:50.035526] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-05T18:02:50.070383] [INFO ] [MAIN ] APAM: Loaded 27759 existing records. [2025-09-05T18:02:50.258721] [INFO ] [MAIN ] AOS: Found 1 missing trading days. [2025-09-05T18:02:50.261698] [INFO ] [MAIN ] AOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:50.261970] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-05T18:02:50.341355] [INFO ] [MAIN ] APAM: Found 1 missing trading days. [2025-09-05T18:02:50.341514] [INFO ] [MAIN ] APAM: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:50.341774] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-05T18:02:50.448461] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-05T18:02:50.466291] [INFO ] [MAIN ] AP: Adding 30 new records, updating 0 existing records. [2025-09-05T18:02:50.468213] [INFO ] [MAIN ] AP: Combined dataset has 4129 total records. [2025-09-05T18:02:50.650476] [WARN ] [VALIDATOR ] AP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:50.844721] [WARN ] [VALIDATOR ] AP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:50.844900] [INFO ] [MAIN ] AP: Combined data validation passed. [2025-09-05T18:02:50.869540] [INFO ] [MAIN ] AP: Update completed successfully. [2025-09-05T18:02:50.870361] [INFO ] [MAIN ] Update Progress: 124/2363 symbols completed. AP took 1.8s. Estimated remaining: 50m 16s. Rate: 44.5 symbols/min [2025-09-05T18:02:50.939484] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:02:51.143447] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:51.155703] [INFO ] [MAIN ] APAM: Adding 219 new records, updating 0 existing records. [2025-09-05T18:02:51.163018] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:02:51.249540] [INFO ] [MAIN ] APAM: Combined dataset has 27978 total records. [2025-09-05T18:02:51.363548] [INFO ] [MAIN ] AOS: Adding 375 new records, updating 0 existing records. [2025-09-05T18:02:51.440521] [INFO ] [MAIN ] APD: Loaded 34275 existing records. [2025-09-05T18:02:51.650051] [INFO ] [MAIN ] AOS: Combined dataset has 37608 total records. [2025-09-05T18:02:51.655479] [WARN ] [VALIDATOR ] APAM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:51.853341] [INFO ] [MAIN ] APD: Found 1 missing trading days. [2025-09-05T18:02:51.873393] [INFO ] [MAIN ] APD: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:51.897941] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-05T18:02:52.081786] [WARN ] [VALIDATOR ] AOS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:52.271685] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-05T18:02:52.301776] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-05T18:02:52.384155] [WARN ] [VALIDATOR ] APAM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:52.384252] [WARN ] [VALIDATOR ] AOS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:52.384629] [INFO ] [MAIN ] AOS: Combined data validation passed. [2025-09-05T18:02:52.385057] [INFO ] [MAIN ] APAM: Combined data validation passed. [2025-09-05T18:02:52.670128] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:02:52.777039] [INFO ] [MAIN ] APAM: Update completed successfully. [2025-09-05T18:02:52.791278] [INFO ] [MAIN ] Update Progress: 125/2363 symbols completed. APAM took 3.6s. Estimated remaining: 50m 25s. Rate: 44.4 symbols/min [2025-09-05T18:02:52.891863] [INFO ] [MAIN ] APD: Adding 268 new records, updating 0 existing records. [2025-09-05T18:02:53.018630] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:53.024178] [INFO ] [MAIN ] APD: Combined dataset has 34543 total records. [2025-09-05T18:02:53.195237] [INFO ] [MAIN ] APG: Loaded 24317 existing records. [2025-09-05T18:02:53.300301] [WARN ] [VALIDATOR ] APD: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:53.615442] [INFO ] [MAIN ] APG: Found 1 missing trading days. [2025-09-05T18:02:53.675709] [INFO ] [MAIN ] APG: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:53.690212] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-05T18:02:53.732871] [INFO ] [MAIN ] AOS: Update completed successfully. [2025-09-05T18:02:53.739540] [INFO ] [MAIN ] Update Progress: 126/2363 symbols completed. AOS took 4.7s. Estimated remaining: 50m 17s. Rate: 44.5 symbols/min [2025-09-05T18:02:53.853734] [WARN ] [VALIDATOR ] APD: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:53.874549] [INFO ] [MAIN ] APD: Combined data validation passed. [2025-09-05T18:02:53.925850] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:54.078975] [INFO ] [MAIN ] APH: Loaded 25672 existing records. [2025-09-05T18:02:54.243163] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-05T18:02:54.301993] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-05T18:02:54.382691] [INFO ] [MAIN ] APD: Update completed successfully. [2025-09-05T18:02:54.397379] [INFO ] [MAIN ] APH: Found 1 missing trading days. [2025-09-05T18:02:54.396171] [INFO ] [MAIN ] Update Progress: 127/2363 symbols completed. APD took 3.5s. Estimated remaining: 50m 3s. Rate: 44.7 symbols/min [2025-09-05T18:02:54.397500] [INFO ] [MAIN ] APH: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:54.415551] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-05T18:02:54.425336] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:02:54.721950] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:54.741724] [INFO ] [MAIN ] APG: Adding 383 new records, updating 0 existing records. [2025-09-05T18:02:54.745315] [INFO ] [MAIN ] APG: Combined dataset has 24700 total records. [2025-09-05T18:02:54.940967] [WARN ] [VALIDATOR ] APG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:55.014688] [INFO ] [MAIN ] APLE: Loaded 24765 existing records. [2025-09-05T18:02:55.344825] [INFO ] [MAIN ] APLE: Found 1 missing trading days. [2025-09-05T18:02:55.345135] [INFO ] [MAIN ] APLE: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:55.345449] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-05T18:02:55.355008] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:02:55.503754] [INFO ] [MAIN ] APH: Adding 390 new records, updating 0 existing records. [2025-09-05T18:02:55.508142] [INFO ] [MAIN ] APH: Combined dataset has 26062 total records. [2025-09-05T18:02:55.697054] [WARN ] [VALIDATOR ] APH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:55.805502] [WARN ] [VALIDATOR ] APG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:55.816254] [INFO ] [MAIN ] APG: Combined data validation passed. [2025-09-05T18:02:56.029386] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:02:56.153175] [INFO ] [MAIN ] APG: Update completed successfully. [2025-09-05T18:02:56.176925] [INFO ] [MAIN ] Update Progress: 128/2363 symbols completed. APG took 3.4s. Estimated remaining: 50m 9s. Rate: 44.6 symbols/min [2025-09-05T18:02:56.241107] [INFO ] [MAIN ] APLE: Adding 375 new records, updating 0 existing records. [2025-09-05T18:02:56.354619] [INFO ] [MAIN ] APLE: Combined dataset has 25140 total records. [2025-09-05T18:02:56.442336] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:56.579566] [WARN ] [VALIDATOR ] APH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:56.600875] [WARN ] [VALIDATOR ] APLE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:02:56.601362] [INFO ] [MAIN ] APH: Combined data validation passed. [2025-09-05T18:02:56.982969] [INFO ] [MAIN ] APO: Loaded 40152 existing records. [2025-09-05T18:02:56.975955] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-05T18:02:57.082712] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-05T18:02:57.275577] [INFO ] [MAIN ] APO: Found 1 missing trading days. [2025-09-05T18:02:57.276421] [INFO ] [MAIN ] APO: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:57.277343] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-05T18:02:57.291989] [INFO ] [MAIN ] APH: Update completed successfully. [2025-09-05T18:02:57.299439] [INFO ] [MAIN ] Update Progress: 129/2363 symbols completed. APH took 3.6s. Estimated remaining: 50m 4s. Rate: 44.6 symbols/min [2025-09-05T18:02:57.551110] [WARN ] [VALIDATOR ] APLE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:02:57.551753] [INFO ] [MAIN ] APLE: Combined data validation passed. [2025-09-05T18:02:57.676365] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:57.745782] [INFO ] [MAIN ] APOS: Loaded 3202 existing records. [2025-09-05T18:02:58.043217] [INFO ] [MAIN ] APOS: Found 1 missing trading days. [2025-09-05T18:02:58.055618] [INFO ] [MAIN ] APOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:58.061240] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:02:58.062020] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-05T18:02:58.291528] [INFO ] [MAIN ] APO: Adding 390 new records, updating 0 existing records. [2025-09-05T18:02:58.349180] [INFO ] [MAIN ] APO: Combined dataset has 40542 total records. [2025-09-05T18:02:58.541863] [INFO ] [MAIN ] APLE: Update completed successfully. [2025-09-05T18:02:58.561612] [WARN ] [VALIDATOR ] APO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:02:58.564970] [INFO ] [MAIN ] Update Progress: 130/2363 symbols completed. APLE took 4.2s. Estimated remaining: 50m 2s. Rate: 44.6 symbols/min [2025-09-05T18:02:58.933568] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:02:58.957165] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:58.971567] [INFO ] [MAIN ] APOS: Adding 0 new records, updating 0 existing records. [2025-09-05T18:02:58.973496] [INFO ] [MAIN ] APOS: Combined dataset has 3202 total records. [2025-09-05T18:02:58.975258] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:02:58.975900] [FATAL] [MAIN ] APOS: Combined data validation failed. [2025-09-05T18:02:58.976672] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:02:58.976833] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-05T18:02:58.977549] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-09-05T18:02:58.978702] [INFO ] [MAIN ] Update Progress: 131/2363 symbols completed. APOS took 1.7s. Estimated remaining: 49m 44s. Rate: 44.9 symbols/min [2025-09-05T18:02:59.143062] [INFO ] [MAIN ] APTV: Loaded 39159 existing records. [2025-09-05T18:02:59.211714] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-05T18:02:59.325999] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-05T18:02:59.327720] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:02:59.436453] [INFO ] [MAIN ] APTV: Found 1 missing trading days. [2025-09-05T18:02:59.436885] [INFO ] [MAIN ] APTV: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:59.437347] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-05T18:02:59.448250] [WARN ] [VALIDATOR ] APO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:02:59.448782] [INFO ] [MAIN ] APO: Combined data validation passed. [2025-09-05T18:02:59.458240] [INFO ] [MAIN ] AQN: Loaded 24638 existing records. [2025-09-05T18:02:59.753925] [INFO ] [MAIN ] AQN: Found 1 missing trading days. [2025-09-05T18:02:59.759610] [INFO ] [MAIN ] AQN: Need to fetch 1 months: 2025-09 [2025-09-05T18:02:59.766301] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-05T18:02:59.937343] [INFO ] [MAIN ] APO: Update completed successfully. [2025-09-05T18:02:59.943629] [INFO ] [MAIN ] Update Progress: 132/2363 symbols completed. APO took 3.7s. Estimated remaining: 49m 37s. Rate: 45.0 symbols/min [2025-09-05T18:03:00.124517] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:00.133920] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:03:00.142717] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:03:00.196252] [INFO ] [MAIN ] AQNB: Loaded 3159 existing records. [2025-09-05T18:03:00.509691] [INFO ] [MAIN ] AQN: Adding 369 new records, updating 0 existing records. [2025-09-05T18:03:00.579659] [INFO ] [MAIN ] AQNB: Found 1 missing trading days. [2025-09-05T18:03:00.617178] [INFO ] [MAIN ] AQNB: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:00.638204] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-05T18:03:00.656029] [INFO ] [MAIN ] APTV: Adding 388 new records, updating 0 existing records. [2025-09-05T18:03:00.658465] [INFO ] [MAIN ] AQN: Combined dataset has 25007 total records. [2025-09-05T18:03:00.778927] [INFO ] [MAIN ] APTV: Combined dataset has 39547 total records. [2025-09-05T18:03:00.911771] [WARN ] [VALIDATOR ] AQN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:01.153666] [WARN ] [VALIDATOR ] APTV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:01.491365] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-05T18:03:01.504598] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-05T18:03:01.519162] [WARN ] [VALIDATOR ] APTV: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:01.519519] [INFO ] [MAIN ] APTV: Combined data validation passed. [2025-09-05T18:03:01.519249] [WARN ] [VALIDATOR ] AQN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:01.520033] [INFO ] [MAIN ] AQN: Combined data validation passed. [2025-09-05T18:03:01.674846] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T18:03:01.713743] [INFO ] [MAIN ] AQNB: Adding 22 new records, updating 0 existing records. [2025-09-05T18:03:01.719046] [INFO ] [MAIN ] AQNB: Combined dataset has 3181 total records. [2025-09-05T18:03:01.984846] [WARN ] [VALIDATOR ] AQNB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:02.261475] [INFO ] [MAIN ] AQN: Update completed successfully. [2025-09-05T18:03:02.264592] [INFO ] [MAIN ] Update Progress: 133/2363 symbols completed. AQN took 3.3s. Estimated remaining: 49m 52s. Rate: 44.7 symbols/min [2025-09-05T18:03:02.536941] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:02.579492] [INFO ] [MAIN ] AR: Loaded 25607 existing records. [2025-09-05T18:03:02.666829] [INFO ] [MAIN ] APTV: Update completed successfully. [2025-09-05T18:03:02.681978] [INFO ] [MAIN ] Update Progress: 134/2363 symbols completed. APTV took 4.1s. Estimated remaining: 49m 35s. Rate: 45.0 symbols/min [2025-09-05T18:03:02.874043] [INFO ] [MAIN ] AR: Found 1 missing trading days. [2025-09-05T18:03:02.874250] [INFO ] [MAIN ] AR: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:02.874940] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-05T18:03:02.947431] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:02.950377] [WARN ] [VALIDATOR ] AQNB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:02.950538] [INFO ] [MAIN ] AQNB: Combined data validation passed. [2025-09-05T18:03:02.971945] [INFO ] [MAIN ] AQNB: Update completed successfully. [2025-09-05T18:03:02.980722] [INFO ] [MAIN ] Update Progress: 135/2363 symbols completed. AQNB took 3.0s. Estimated remaining: 49m 17s. Rate: 45.2 symbols/min [2025-09-05T18:03:03.096357] [INFO ] [MAIN ] ARCO: Loaded 33885 existing records. [2025-09-05T18:03:03.213972] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:03.353988] [INFO ] [MAIN ] ARCO: Found 1 missing trading days. [2025-09-05T18:03:03.354227] [INFO ] [MAIN ] ARCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:03.354568] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-05T18:03:03.360420] [INFO ] [MAIN ] ARDC: Loaded 10895 existing records. [2025-09-05T18:03:03.559566] [INFO ] [MAIN ] ARDC: Found 1 missing trading days. [2025-09-05T18:03:03.572285] [INFO ] [MAIN ] ARDC: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:03.572802] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-05T18:03:03.575116] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-05T18:03:03.829503] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:03:03.868665] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-05T18:03:03.991108] [INFO ] [MAIN ] AR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:03:03.999855] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:03:04.018067] [INFO ] [MAIN ] AR: Combined dataset has 25997 total records. [2025-09-05T18:03:04.348933] [WARN ] [VALIDATOR ] AR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:04.353783] [INFO ] [MAIN ] ARCO: Adding 311 new records, updating 0 existing records. [2025-09-05T18:03:04.547233] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:03:04.559521] [INFO ] [MAIN ] ARCO: Combined dataset has 34196 total records. [2025-09-05T18:03:04.657444] [INFO ] [MAIN ] ARDC: Adding 106 new records, updating 0 existing records. [2025-09-05T18:03:04.744985] [INFO ] [MAIN ] ARDC: Combined dataset has 11001 total records. [2025-09-05T18:03:04.852523] [WARN ] [VALIDATOR ] ARCO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:05.205107] [WARN ] [VALIDATOR ] ARDC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:05.461799] [WARN ] [VALIDATOR ] ARCO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:05.461930] [WARN ] [VALIDATOR ] ARDC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:05.463122] [INFO ] [MAIN ] ARCO: Combined data validation passed. [2025-09-05T18:03:05.465915] [WARN ] [VALIDATOR ] AR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:05.466269] [INFO ] [MAIN ] AR: Combined data validation passed. [2025-09-05T18:03:05.465602] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-05T18:03:05.466029] [INFO ] [MAIN ] ARDC: Combined data validation passed. [2025-09-05T18:03:05.478802] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-05T18:03:05.774502] [INFO ] [MAIN ] ARDC: Update completed successfully. [2025-09-05T18:03:05.779418] [INFO ] [MAIN ] Update Progress: 136/2363 symbols completed. ARDC took 2.8s. Estimated remaining: 49m 40s. Rate: 44.8 symbols/min [2025-09-05T18:03:06.029828] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:06.073702] [INFO ] [MAIN ] AR: Update completed successfully. [2025-09-05T18:03:06.084040] [INFO ] [MAIN ] Update Progress: 137/2363 symbols completed. AR took 3.8s. Estimated remaining: 49m 21s. Rate: 45.1 symbols/min [2025-09-05T18:03:06.207325] [INFO ] [MAIN ] ARDT: Loaded 13534 existing records. [2025-09-05T18:03:06.425076] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:06.503298] [INFO ] [MAIN ] ARDT: Found 1 missing trading days. [2025-09-05T18:03:06.512979] [INFO ] [MAIN ] ARDT: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:06.513468] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-05T18:03:06.514766] [INFO ] [MAIN ] ARCO: Update completed successfully. [2025-09-05T18:03:06.527236] [INFO ] [MAIN ] Update Progress: 138/2363 symbols completed. ARCO took 3.8s. Estimated remaining: 49m 6s. Rate: 45.3 symbols/min [2025-09-05T18:03:06.529716] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:03:06.614129] [INFO ] [REMOTE ] AON: Full fetch complete (49565 records). [2025-09-05T18:03:06.695236] [INFO ] [MAIN ] ARE: Loaded 24173 existing records. [2025-09-05T18:03:06.767294] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:07.190302] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:03:07.219004] [INFO ] [MAIN ] ARE: Found 1 missing trading days. [2025-09-05T18:03:07.220056] [INFO ] [MAIN ] ARES: Loaded 23163 existing records. [2025-09-05T18:03:07.220113] [INFO ] [MAIN ] ARE: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:07.249166] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-05T18:03:07.399334] [INFO ] [MAIN ] ARDT: Adding 184 new records, updating 0 existing records. [2025-09-05T18:03:07.515311] [INFO ] [MAIN ] ARDT: Combined dataset has 13718 total records. [2025-09-05T18:03:07.721025] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-05T18:03:07.756253] [INFO ] [MAIN ] ARES: Found 1 missing trading days. [2025-09-05T18:03:07.782125] [INFO ] [MAIN ] ARES: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:07.786295] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-05T18:03:07.938709] [WARN ] [VALIDATOR ] ARDT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:08.103045] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:03:08.331140] [INFO ] [MAIN ] ARE: Adding 356 new records, updating 0 existing records. [2025-09-05T18:03:08.347045] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:03:08.376176] [INFO ] [MAIN ] ARE: Combined dataset has 24529 total records. [2025-09-05T18:03:08.618480] [INFO ] [MAIN ] ARES: Adding 372 new records, updating 0 existing records. [2025-09-05T18:03:08.710198] [WARN ] [VALIDATOR ] ARE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:08.783134] [INFO ] [MAIN ] ARES: Combined dataset has 23535 total records. [2025-09-05T18:03:09.189333] [WARN ] [VALIDATOR ] ARES: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:09.403533] [WARN ] [VALIDATOR ] ARDT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:09.405944] [INFO ] [MAIN ] ARDT: Combined data validation passed. [2025-09-05T18:03:09.408079] [INFO ] [MAIN ] AON: Full history saved. [2025-09-05T18:03:09.408436] [INFO ] [MAIN ] Update Progress: 139/2363 symbols completed. AON took 24.2s. Estimated remaining: 49m 29s. Rate: 44.9 symbols/min [2025-09-05T18:03:09.667428] [INFO ] [MAIN ] ARGD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:09.681207] [INFO ] [MAIN ] ARGD: Loaded 1511 existing records. [2025-09-05T18:03:09.707497] [INFO ] [MAIN ] ARDT: Update completed successfully. [2025-09-05T18:03:09.723495] [INFO ] [MAIN ] Update Progress: 140/2363 symbols completed. ARDT took 3.9s. Estimated remaining: 49m 12s. Rate: 45.2 symbols/min [2025-09-05T18:03:09.996521] [INFO ] [MAIN ] ARGD: Found 1 missing trading days. [2025-09-05T18:03:10.007595] [INFO ] [MAIN ] ARGD: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:10.023429] [WARN ] [VALIDATOR ] ARE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:10.013123] [WARN ] [VALIDATOR ] ARES: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:10.053825] [INFO ] [MAIN ] ARE: Combined data validation passed. [2025-09-05T18:03:10.054447] [INFO ] [REMOTE ] ARGD: Fetching primary data for 2025-09. [2025-09-05T18:03:10.075728] [INFO ] [MAIN ] ARES: Combined data validation passed. [2025-09-05T18:03:10.081231] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:10.310513] [INFO ] [MAIN ] ARI: Loaded 20293 existing records. [2025-09-05T18:03:10.534454] [INFO ] [MAIN ] ARI: Found 1 missing trading days. [2025-09-05T18:03:10.536749] [INFO ] [MAIN ] ARI: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:10.538123] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-05T18:03:10.590355] [INFO ] [MAIN ] ARE: Update completed successfully. [2025-09-05T18:03:10.595463] [INFO ] [MAIN ] Update Progress: 141/2363 symbols completed. ARE took 4.5s. Estimated remaining: 49m 3s. Rate: 45.3 symbols/min [2025-09-05T18:03:10.723216] [INFO ] [REMOTE ] ARGD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:03:10.745108] [INFO ] [MAIN ] ARGD: Adding 22 new records, updating 0 existing records. [2025-09-05T18:03:10.770809] [INFO ] [MAIN ] ARGD: Combined dataset has 1533 total records. [2025-09-05T18:03:10.853117] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:10.947471] [INFO ] [MAIN ] ARES: Update completed successfully. [2025-09-05T18:03:10.967276] [INFO ] [MAIN ] Update Progress: 142/2363 symbols completed. ARES took 4.4s. Estimated remaining: 48m 47s. Rate: 45.5 symbols/min [2025-09-05T18:03:11.065306] [WARN ] [VALIDATOR ] ARGD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:11.233946] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:03:11.268784] [INFO ] [MAIN ] ARIS: Loaded 31285 existing records. [2025-09-05T18:03:11.519263] [INFO ] [MAIN ] ARI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:03:11.634814] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:11.693176] [INFO ] [MAIN ] ARI: Combined dataset has 20293 total records. [2025-09-05T18:03:11.735296] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:03:11.739474] [FATAL] [MAIN ] ARI: Combined data validation failed. [2025-09-05T18:03:11.746515] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:03:11.748177] [INFO ] [MAIN ] ARIS: Found 1 missing trading days. [2025-09-05T18:03:11.748374] [INFO ] [MAIN ] ARIS: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:11.746738] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-05T18:03:11.748758] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-05T18:03:11.749895] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-09-05T18:03:11.752458] [INFO ] [MAIN ] Update Progress: 143/2363 symbols completed. ARI took 2.0s. Estimated remaining: 48m 38s. Rate: 45.7 symbols/min [2025-09-05T18:03:11.959556] [INFO ] [MAIN ] ARLO: Loaded 32744 existing records. [2025-09-05T18:03:11.963928] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:12.168506] [INFO ] [MAIN ] ARLO: Found 1 missing trading days. [2025-09-05T18:03:12.171479] [INFO ] [MAIN ] ARMK: Loaded 23826 existing records. [2025-09-05T18:03:12.176896] [INFO ] [MAIN ] ARLO: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:12.183949] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-05T18:03:12.308453] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:03:12.416704] [INFO ] [MAIN ] ARMK: Found 1 missing trading days. [2025-09-05T18:03:12.418502] [INFO ] [MAIN ] ARMK: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:12.419267] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-05T18:03:12.598443] [INFO ] [MAIN ] ARIS: Adding 0 new records, updating 657 existing records. [2025-09-05T18:03:12.604289] [WARN ] [VALIDATOR ] ARGD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:12.604588] [INFO ] [MAIN ] ARGD: Combined data validation passed. [2025-09-05T18:03:12.605791] [INFO ] [MAIN ] ARIS: Combined dataset has 31285 total records. [2025-09-05T18:03:12.616165] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:03:12.620980] [FATAL] [MAIN ] ARIS: Combined data validation failed. [2025-09-05T18:03:12.620941] [INFO ] [MAIN ] ARGD: Update completed successfully. [2025-09-05T18:03:12.621728] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:03:12.622149] [INFO ] [MAIN ] Update Progress: 144/2363 symbols completed. ARGD took 3.2s. Estimated remaining: 48m 29s. Rate: 45.8 symbols/min [2025-09-05T18:03:12.621545] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:03:12.677477] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-05T18:03:12.749301] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-09-05T18:03:12.827223] [INFO ] [MAIN ] Update Progress: 145/2363 symbols completed. ARIS took 2.2s. Estimated remaining: 48m 11s. Rate: 46.0 symbols/min [2025-09-05T18:03:12.885993] [INFO ] [MAIN ] ARLO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:03:12.996683] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:13.060272] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:03:13.060576] [INFO ] [MAIN ] ARLO: Combined dataset has 32744 total records. [2025-09-05T18:03:13.096177] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:03:13.146424] [FATAL] [MAIN ] ARLO: Combined data validation failed. [2025-09-05T18:03:13.164385] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:13.185335] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:03:13.190881] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-05T18:03:13.212909] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-09-05T18:03:13.256307] [INFO ] [MAIN ] Update Progress: 146/2363 symbols completed. ARLO took 2.3s. Estimated remaining: 47m 57s. Rate: 46.2 symbols/min [2025-09-05T18:03:13.295121] [INFO ] [MAIN ] AROC: Loaded 23394 existing records. [2025-09-05T18:03:13.341588] [INFO ] [MAIN ] ARMK: Adding 376 new records, updating 0 existing records. [2025-09-05T18:03:13.587309] [INFO ] [MAIN ] ARR: Loaded 24774 existing records. [2025-09-05T18:03:13.570596] [INFO ] [MAIN ] ARMK: Combined dataset has 24202 total records. [2025-09-05T18:03:13.685406] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:13.949025] [INFO ] [MAIN ] AROC: Found 1 missing trading days. [2025-09-05T18:03:14.002252] [INFO ] [MAIN ] AROC: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:14.044351] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-05T18:03:14.065721] [INFO ] [MAIN ] ARW: Loaded 14946 existing records. [2025-09-05T18:03:14.198893] [INFO ] [MAIN ] ARR: Found 1 missing trading days. [2025-09-05T18:03:14.214569] [INFO ] [MAIN ] ARR: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:14.215097] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-05T18:03:14.214443] [WARN ] [VALIDATOR ] ARMK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:14.511980] [INFO ] [MAIN ] ARW: Found 1 missing trading days. [2025-09-05T18:03:14.517593] [INFO ] [MAIN ] ARW: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:14.533849] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-05T18:03:14.612603] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:03:14.760776] [INFO ] [MAIN ] AROC: Adding 370 new records, updating 0 existing records. [2025-09-05T18:03:14.767825] [INFO ] [MAIN ] AROC: Combined dataset has 23764 total records. [2025-09-05T18:03:14.982467] [WARN ] [VALIDATOR ] AROC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:14.977121] [WARN ] [VALIDATOR ] ARMK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:14.994844] [INFO ] [MAIN ] ARMK: Combined data validation passed. [2025-09-05T18:03:15.035633] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:03:15.397077] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:03:15.447459] [INFO ] [MAIN ] ARR: Adding 375 new records, updating 0 existing records. [2025-09-05T18:03:15.514180] [INFO ] [MAIN ] ARW: Adding 0 new records, updating 0 existing records. [2025-09-05T18:03:15.522419] [INFO ] [MAIN ] ARR: Combined dataset has 25149 total records. [2025-09-05T18:03:15.523908] [INFO ] [MAIN ] ARW: Combined dataset has 14946 total records. [2025-09-05T18:03:15.546991] [FATAL] [VALIDATOR ] ARW: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:03:15.562815] [FATAL] [MAIN ] ARW: Combined data validation failed. [2025-09-05T18:03:15.593845] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:03:15.599153] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-05T18:03:15.606198] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-09-05T18:03:15.613837] [INFO ] [MAIN ] Update Progress: 147/2363 symbols completed. ARW took 2.3s. Estimated remaining: 48m 11s. Rate: 46.0 symbols/min [2025-09-05T18:03:15.837918] [WARN ] [VALIDATOR ] ARR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:15.989353] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:16.177182] [INFO ] [MAIN ] ARX: Loaded 9529 existing records. [2025-09-05T18:03:16.218515] [WARN ] [VALIDATOR ] AROC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:16.239313] [INFO ] [MAIN ] AROC: Combined data validation passed. [2025-09-05T18:03:16.295754] [INFO ] [MAIN ] ARMK: Update completed successfully. [2025-09-05T18:03:16.326527] [INFO ] [MAIN ] Update Progress: 148/2363 symbols completed. ARMK took 4.6s. Estimated remaining: 48m 1s. Rate: 46.1 symbols/min [2025-09-05T18:03:16.435627] [INFO ] [MAIN ] ARX: Found 1 missing trading days. [2025-09-05T18:03:16.467328] [INFO ] [MAIN ] ARX: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:16.473556] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-05T18:03:16.661869] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:16.725599] [INFO ] [MAIN ] AROC: Update completed successfully. [2025-09-05T18:03:16.729566] [INFO ] [MAIN ] Update Progress: 149/2363 symbols completed. AROC took 4.1s. Estimated remaining: 47m 46s. Rate: 46.3 symbols/min [2025-09-05T18:03:16.730881] [INFO ] [MAIN ] AS: Loaded 25417 existing records. [2025-09-05T18:03:17.066345] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:17.093962] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-09-05T18:03:17.103096] [INFO ] [MAIN ] AS: Found 1 missing trading days. [2025-09-05T18:03:17.103562] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-05T18:03:17.103736] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-05T18:03:17.103979] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-05T18:03:17.103895] [INFO ] [MAIN ] AS: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:17.104287] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-05T18:03:17.182587] [WARN ] [VALIDATOR ] ARR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:17.202386] [INFO ] [MAIN ] ARR: Combined data validation passed. [2025-09-05T18:03:17.589147] [INFO ] [REMOTE ] ASA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:03:17.592907] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-05T18:03:17.656504] [INFO ] [MAIN ] ARR: Update completed successfully. [2025-09-05T18:03:17.660211] [INFO ] [MAIN ] Update Progress: 150/2363 symbols completed. ARR took 4.8s. Estimated remaining: 47m 40s. Rate: 46.4 symbols/min [2025-09-05T18:03:17.832890] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:17.863271] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:03:17.944224] [INFO ] [MAIN ] ASAN: Loaded 39575 existing records. [2025-09-05T18:03:18.137308] [INFO ] [MAIN ] AS: Adding 389 new records, updating 0 existing records. [2025-09-05T18:03:18.143808] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T18:03:18.299711] [INFO ] [MAIN ] AS: Combined dataset has 25806 total records. [2025-09-05T18:03:18.363437] [INFO ] [MAIN ] ASAN: Found 1 missing trading days. [2025-09-05T18:03:18.417492] [INFO ] [MAIN ] ASAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:18.417400] [INFO ] [MAIN ] ARX: Adding 259 new records, updating 0 existing records. [2025-09-05T18:03:18.449514] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-05T18:03:18.545638] [INFO ] [MAIN ] ARX: Combined dataset has 9788 total records. [2025-09-05T18:03:18.564966] [WARN ] [VALIDATOR ] AS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:18.807046] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-05T18:03:18.845887] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-05T18:03:18.904943] [WARN ] [VALIDATOR ] ARX: Not fatal, but first date in data (2025-07-24) does not match expected start date (2025-01-31) [2025-09-05T18:03:19.139697] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:03:19.315052] [INFO ] [MAIN ] ASAN: Adding 390 new records, updating 0 existing records. [2025-09-05T18:03:19.322783] [WARN ] [VALIDATOR ] AS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:19.323163] [INFO ] [MAIN ] AS: Combined data validation passed. [2025-09-05T18:03:19.323241] [INFO ] [MAIN ] ASAN: Combined dataset has 39965 total records. [2025-09-05T18:03:19.322621] [WARN ] [VALIDATOR ] ARX: Missing days changed. Total missing: 119 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23 [2025-09-05T18:03:19.323928] [INFO ] [MAIN ] ARX: Combined data validation passed. [2025-09-05T18:03:19.578850] [INFO ] [MAIN ] ARX: Update completed successfully. [2025-09-05T18:03:19.591570] [INFO ] [MAIN ] Update Progress: 151/2363 symbols completed. ARX took 4.0s. Estimated remaining: 47m 48s. Rate: 46.3 symbols/min [2025-09-05T18:03:19.692303] [WARN ] [VALIDATOR ] ASAN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:19.955260] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:20.042221] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-05T18:03:20.080690] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-05T18:03:20.112480] [INFO ] [MAIN ] AS: Update completed successfully. [2025-09-05T18:03:20.115724] [INFO ] [MAIN ] Update Progress: 152/2363 symbols completed. AS took 3.7s. Estimated remaining: 47m 35s. Rate: 46.5 symbols/min [2025-09-05T18:03:20.210342] [INFO ] [MAIN ] ASB: Loaded 23362 existing records. [2025-09-05T18:03:20.412984] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:20.495793] [INFO ] [MAIN ] ASBA: Loaded 1755 existing records. [2025-09-05T18:03:20.494099] [INFO ] [MAIN ] ASB: Found 1 missing trading days. [2025-09-05T18:03:20.525991] [INFO ] [MAIN ] ASB: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:20.526272] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-05T18:03:20.669845] [INFO ] [MAIN ] ASBA: Found 1 missing trading days. [2025-09-05T18:03:20.669986] [INFO ] [MAIN ] ASBA: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:20.670274] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-05T18:03:20.676076] [WARN ] [VALIDATOR ] ASAN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:20.676277] [INFO ] [MAIN ] ASAN: Combined data validation passed. [2025-09-05T18:03:20.913133] [INFO ] [MAIN ] ASAN: Update completed successfully. [2025-09-05T18:03:20.920714] [INFO ] [MAIN ] Update Progress: 153/2363 symbols completed. ASAN took 3.3s. Estimated remaining: 47m 27s. Rate: 46.6 symbols/min [2025-09-05T18:03:21.093495] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:21.104852] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-05T18:03:21.109469] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-05T18:03:21.138121] [INFO ] [MAIN ] ASC: Loaded 28475 existing records. [2025-09-05T18:03:21.286328] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:03:21.387717] [INFO ] [MAIN ] ASC: Found 1 missing trading days. [2025-09-05T18:03:21.403200] [INFO ] [MAIN ] ASC: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:21.468545] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-05T18:03:21.495522] [INFO ] [MAIN ] ASB: Adding 348 new records, updating 0 existing records. [2025-09-05T18:03:21.500334] [INFO ] [MAIN ] ASB: Combined dataset has 23710 total records. [2025-09-05T18:03:21.609439] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:03:21.621838] [INFO ] [MAIN ] ASBA: Adding 25 new records, updating 0 existing records. [2025-09-05T18:03:21.644281] [INFO ] [MAIN ] ASBA: Combined dataset has 1780 total records. [2025-09-05T18:03:21.815439] [WARN ] [VALIDATOR ] ASB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:22.010079] [WARN ] [VALIDATOR ] ASBA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:22.203819] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-05T18:03:22.233145] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:03:22.405466] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-05T18:03:22.425069] [INFO ] [MAIN ] ASC: Adding 249 new records, updating 0 existing records. [2025-09-05T18:03:22.432486] [INFO ] [MAIN ] ASC: Combined dataset has 28724 total records. [2025-09-05T18:03:22.586014] [WARN ] [VALIDATOR ] ASB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:22.622894] [WARN ] [VALIDATOR ] ASC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:22.634313] [INFO ] [MAIN ] ASB: Combined data validation passed. [2025-09-05T18:03:22.957458] [INFO ] [MAIN ] ASB: Update completed successfully. [2025-09-05T18:03:22.960214] [INFO ] [MAIN ] Update Progress: 154/2363 symbols completed. ASB took 3.4s. Estimated remaining: 47m 36s. Rate: 46.4 symbols/min [2025-09-05T18:03:23.139990] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:23.153003] [INFO ] [MAIN ] ASG: Loaded 9218 existing records. [2025-09-05T18:03:23.239554] [WARN ] [VALIDATOR ] ASBA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:23.250696] [WARN ] [VALIDATOR ] ASC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:23.261563] [INFO ] [MAIN ] ASC: Combined data validation passed. [2025-09-05T18:03:23.261684] [INFO ] [MAIN ] ASBA: Combined data validation passed. [2025-09-05T18:03:23.342020] [INFO ] [MAIN ] ASG: Found 1 missing trading days. [2025-09-05T18:03:23.342400] [INFO ] [MAIN ] ASG: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:23.342637] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-05T18:03:23.350026] [INFO ] [MAIN ] ASBA: Update completed successfully. [2025-09-05T18:03:23.350480] [INFO ] [MAIN ] Update Progress: 155/2363 symbols completed. ASBA took 3.2s. Estimated remaining: 47m 22s. Rate: 46.6 symbols/min [2025-09-05T18:03:23.632287] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:23.645137] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-05T18:03:23.669363] [INFO ] [MAIN ] ASGI: Loaded 16920 existing records. [2025-09-05T18:03:23.862510] [INFO ] [MAIN ] ASGI: Found 1 missing trading days. [2025-09-05T18:03:23.863404] [INFO ] [MAIN ] ASGI: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:23.864520] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-05T18:03:23.928963] [INFO ] [MAIN ] ASC: Update completed successfully. [2025-09-05T18:03:23.933877] [INFO ] [MAIN ] Update Progress: 156/2363 symbols completed. ASC took 3.0s. Estimated remaining: 47m 11s. Rate: 46.8 symbols/min [2025-09-05T18:03:24.109207] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:24.109437] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-09-05T18:03:24.109598] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-05T18:03:24.109671] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-05T18:03:24.109725] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-05T18:03:24.478700] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:03:24.545731] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:03:24.596206] [INFO ] [MAIN ] ASG: Adding 99 new records, updating 0 existing records. [2025-09-05T18:03:24.598468] [INFO ] [MAIN ] ASG: Combined dataset has 9317 total records. [2025-09-05T18:03:24.668627] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-05T18:03:24.801928] [WARN ] [VALIDATOR ] ASG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:24.999010] [WARN ] [VALIDATOR ] ASG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:24.999259] [INFO ] [MAIN ] ASG: Combined data validation passed. [2025-09-05T18:03:25.059687] [INFO ] [MAIN ] ASG: Update completed successfully. [2025-09-05T18:03:25.060869] [INFO ] [MAIN ] Update Progress: 157/2363 symbols completed. ASG took 2.1s. Estimated remaining: 47m 8s. Rate: 46.8 symbols/min [2025-09-05T18:03:25.167748] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:03:25.237673] [INFO ] [MAIN ] ASGI: Adding 140 new records, updating 0 existing records. [2025-09-05T18:03:25.240892] [INFO ] [MAIN ] ASGI: Combined dataset has 17060 total records. [2025-09-05T18:03:25.428902] [WARN ] [VALIDATOR ] ASGI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:25.473349] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-05T18:03:25.631937] [WARN ] [VALIDATOR ] ASGI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:25.632261] [INFO ] [MAIN ] ASGI: Combined data validation passed. [2025-09-05T18:03:25.740505] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-05T18:03:25.757827] [INFO ] [MAIN ] ASGI: Update completed successfully. [2025-09-05T18:03:25.761290] [INFO ] [MAIN ] Update Progress: 158/2363 symbols completed. ASGI took 2.4s. Estimated remaining: 46m 58s. Rate: 46.9 symbols/min [2025-09-05T18:03:26.263576] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-05T18:03:26.824831] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-05T18:03:26.842018] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-05T18:03:27.063518] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-05T18:03:27.863536] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-05T18:03:27.988403] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-05T18:03:28.663524] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-05T18:03:29.142971] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:03:29.144588] [INFO ] [REMOTE ] ASA: Full fetch complete (13855 records). [2025-09-05T18:03:29.565321] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-05T18:03:29.632701] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-05T18:03:29.642447] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-05T18:03:29.659197] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-05T18:03:29.659305] [INFO ] [MAIN ] Update Progress: 159/2363 symbols completed. ASA took 12.9s. Estimated remaining: 47m 33s. Rate: 46.3 symbols/min [2025-09-05T18:03:31.221407] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-05T18:03:31.229436] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-05T18:03:32.766537] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-05T18:03:32.775182] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-05T18:03:34.164448] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-05T18:03:34.171412] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-05T18:03:35.249375] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-05T18:03:35.256856] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-05T18:03:36.780677] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-05T18:03:36.789058] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-05T18:03:38.401503] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-05T18:03:38.409784] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-05T18:03:38.787294] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:03:38.789476] [INFO ] [REMOTE ] ASGN: Full fetch complete (40051 records). [2025-09-05T18:03:39.161127] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-05T18:03:39.316240] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-05T18:03:39.316395] [INFO ] [MAIN ] Update Progress: 160/2363 symbols completed. ASGN took 15.4s. Estimated remaining: 49m 27s. Rate: 44.5 symbols/min [2025-09-05T18:03:40.029695] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:40.030737] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:40.033541] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:40.035090] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:40.035768] [WARN ] [MAIN ] ASPN: No existing data found, performing full refresh instead. [2025-09-05T18:03:40.036265] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-05T18:03:40.036317] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-05T18:03:40.036454] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-05T18:03:40.126847] [INFO ] [MAIN ] ASR: Loaded 4621 existing records. [2025-09-05T18:03:40.224402] [INFO ] [MAIN ] ASIX: Loaded 17503 existing records. [2025-09-05T18:03:40.606549] [INFO ] [MAIN ] ASH: Loaded 28100 existing records. [2025-09-05T18:03:40.663083] [INFO ] [MAIN ] ASR: Found 1 missing trading days. [2025-09-05T18:03:40.794290] [INFO ] [MAIN ] ASR: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:40.809899] [INFO ] [MAIN ] ASIX: Found 1 missing trading days. [2025-09-05T18:03:40.821002] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-05T18:03:40.861975] [INFO ] [MAIN ] ASIX: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:40.911059] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:03:40.911426] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-05T18:03:40.919564] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-05T18:03:40.994631] [INFO ] [MAIN ] ASH: Found 1 missing trading days. [2025-09-05T18:03:40.994759] [INFO ] [MAIN ] ASH: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:40.994982] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-05T18:03:41.423077] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:03:41.451751] [INFO ] [MAIN ] ASR: Adding 115 new records, updating 0 existing records. [2025-09-05T18:03:41.454286] [INFO ] [MAIN ] ASR: Combined dataset has 4736 total records. [2025-09-05T18:03:41.459951] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:03:41.580582] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:03:41.825700] [INFO ] [MAIN ] ASIX: Adding 160 new records, updating 0 existing records. [2025-09-05T18:03:41.822322] [WARN ] [VALIDATOR ] ASR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:41.836589] [INFO ] [MAIN ] ASH: Adding 276 new records, updating 0 existing records. [2025-09-05T18:03:41.973072] [INFO ] [MAIN ] ASH: Combined dataset has 28376 total records. [2025-09-05T18:03:41.973335] [INFO ] [MAIN ] ASIX: Combined dataset has 17663 total records. [2025-09-05T18:03:42.362212] [WARN ] [VALIDATOR ] ASH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:42.391506] [WARN ] [VALIDATOR ] ASIX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:03:42.811773] [WARN ] [VALIDATOR ] ASR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:42.812362] [INFO ] [MAIN ] ASR: Combined data validation passed. [2025-09-05T18:03:42.811865] [WARN ] [VALIDATOR ] ASH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:42.812624] [INFO ] [MAIN ] ASH: Combined data validation passed. [2025-09-05T18:03:42.811961] [WARN ] [VALIDATOR ] ASIX: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:03:42.814544] [INFO ] [MAIN ] ASIX: Combined data validation passed. [2025-09-05T18:03:42.963893] [INFO ] [MAIN ] ASR: Update completed successfully. [2025-09-05T18:03:43.014882] [INFO ] [MAIN ] Update Progress: 161/2363 symbols completed. ASR took 3.7s. Estimated remaining: 49m 58s. Rate: 44.1 symbols/min [2025-09-05T18:03:43.222898] [INFO ] [MAIN ] ASIX: Update completed successfully. [2025-09-05T18:03:43.325865] [INFO ] [MAIN ] Update Progress: 162/2363 symbols completed. ASIX took 4.0s. Estimated remaining: 49m 42s. Rate: 44.3 symbols/min [2025-09-05T18:03:43.323751] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:43.333732] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-05T18:03:43.364432] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-05T18:03:43.374867] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-09-05T18:03:43.395851] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-05T18:03:43.414865] [INFO ] [MAIN ] ASH: Update completed successfully. [2025-09-05T18:03:43.424125] [INFO ] [MAIN ] Update Progress: 163/2363 symbols completed. ASH took 4.1s. Estimated remaining: 49m 24s. Rate: 44.5 symbols/min [2025-09-05T18:03:43.415282] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-05T18:03:43.478014] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-05T18:03:43.712729] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:43.846534] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:43.999187] [INFO ] [MAIN ] ATEN: Loaded 18489 existing records. [2025-09-05T18:03:44.078925] [INFO ] [MAIN ] ATGE: Loaded 14111 existing records. [2025-09-05T18:03:44.240692] [INFO ] [REMOTE ] ASX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:03:44.329153] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-05T18:03:44.409052] [INFO ] [MAIN ] ATEN: Found 1 missing trading days. [2025-09-05T18:03:44.414661] [INFO ] [MAIN ] ATEN: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:44.435808] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-05T18:03:44.471785] [INFO ] [MAIN ] ATGE: Found 1 missing trading days. [2025-09-05T18:03:44.472022] [INFO ] [MAIN ] ATGE: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:44.472270] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-05T18:03:44.944040] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:03:45.020534] [INFO ] [MAIN ] ATGE: Adding 184 new records, updating 0 existing records. [2025-09-05T18:03:45.022756] [INFO ] [MAIN ] ATGE: Combined dataset has 14295 total records. [2025-09-05T18:03:45.198562] [WARN ] [VALIDATOR ] ATGE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:45.357735] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:03:45.497294] [INFO ] [MAIN ] ATEN: Adding 257 new records, updating 0 existing records. [2025-09-05T18:03:45.502134] [INFO ] [MAIN ] ATEN: Combined dataset has 18746 total records. [2025-09-05T18:03:45.641404] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-05T18:03:45.673204] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-05T18:03:45.729110] [WARN ] [VALIDATOR ] ATEN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:45.919583] [WARN ] [VALIDATOR ] ATGE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:45.920302] [INFO ] [MAIN ] ATGE: Combined data validation passed. [2025-09-05T18:03:45.985903] [WARN ] [VALIDATOR ] ATEN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:45.988200] [INFO ] [MAIN ] ATEN: Combined data validation passed. [2025-09-05T18:03:46.120089] [INFO ] [MAIN ] ATEN: Update completed successfully. [2025-09-05T18:03:46.125132] [INFO ] [MAIN ] Update Progress: 164/2363 symbols completed. ATEN took 2.8s. Estimated remaining: 49m 41s. Rate: 44.3 symbols/min [2025-09-05T18:03:46.125468] [INFO ] [MAIN ] ATGE: Update completed successfully. [2025-09-05T18:03:46.159065] [INFO ] [MAIN ] Update Progress: 165/2363 symbols completed. ATGE took 2.7s. Estimated remaining: 49m 22s. Rate: 44.5 symbols/min [2025-09-05T18:03:46.433622] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:46.478425] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:46.478774] [WARN ] [MAIN ] ATHS: No existing data found, performing full refresh instead. [2025-09-05T18:03:46.479131] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-05T18:03:46.479227] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-05T18:03:46.479305] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-05T18:03:46.652173] [INFO ] [MAIN ] ATHM: Loaded 13521 existing records. [2025-09-05T18:03:47.027440] [INFO ] [MAIN ] ATHM: Found 1 missing trading days. [2025-09-05T18:03:47.036402] [INFO ] [MAIN ] ATHM: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:47.036303] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-05T18:03:47.055782] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:03:47.056122] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-05T18:03:47.066863] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-05T18:03:47.067930] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-05T18:03:47.727466] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-05T18:03:47.738002] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-05T18:03:47.756791] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:03:47.830917] [INFO ] [MAIN ] ATHM: Adding 169 new records, updating 0 existing records. [2025-09-05T18:03:47.833357] [INFO ] [MAIN ] ATHM: Combined dataset has 13690 total records. [2025-09-05T18:03:48.016274] [WARN ] [VALIDATOR ] ATHM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:48.054061] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-05T18:03:48.094142] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-05T18:03:48.217387] [WARN ] [VALIDATOR ] ATHM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:48.217619] [INFO ] [MAIN ] ATHM: Combined data validation passed. [2025-09-05T18:03:48.297403] [INFO ] [MAIN ] ATHM: Update completed successfully. [2025-09-05T18:03:48.298919] [INFO ] [MAIN ] Update Progress: 166/2363 symbols completed. ATHM took 2.2s. Estimated remaining: 49m 31s. Rate: 44.4 symbols/min [2025-09-05T18:03:48.470192] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:48.493332] [INFO ] [MAIN ] ATI: Loaded 24650 existing records. [2025-09-05T18:03:48.675505] [INFO ] [MAIN ] ATI: Found 1 missing trading days. [2025-09-05T18:03:48.675665] [INFO ] [MAIN ] ATI: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:48.675879] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-05T18:03:48.767019] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-05T18:03:48.768719] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-05T18:03:48.956276] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-05T18:03:48.966288] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-05T18:03:49.238010] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-05T18:03:49.248579] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-05T18:03:49.309828] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:03:49.460726] [INFO ] [MAIN ] ATI: Adding 387 new records, updating 0 existing records. [2025-09-05T18:03:49.464418] [INFO ] [MAIN ] ATI: Combined dataset has 25037 total records. [2025-09-05T18:03:49.643379] [WARN ] [VALIDATOR ] ATI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:49.681497] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-05T18:03:49.742224] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-05T18:03:49.882846] [WARN ] [VALIDATOR ] ATI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:49.883069] [INFO ] [MAIN ] ATI: Combined data validation passed. [2025-09-05T18:03:50.035380] [INFO ] [MAIN ] ATI: Update completed successfully. [2025-09-05T18:03:50.038250] [INFO ] [MAIN ] Update Progress: 167/2363 symbols completed. ATI took 1.7s. Estimated remaining: 49m 35s. Rate: 44.3 symbols/min [2025-09-05T18:03:50.235406] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:50.254408] [INFO ] [MAIN ] ATKR: Loaded 16546 existing records. [2025-09-05T18:03:50.470849] [INFO ] [MAIN ] ATKR: Found 1 missing trading days. [2025-09-05T18:03:50.471043] [INFO ] [MAIN ] ATKR: Need to fetch 1 months: 2025-09 [2025-09-05T18:03:50.471428] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-05T18:03:50.511996] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-05T18:03:50.752970] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-05T18:03:50.915344] [INFO ] [MAIN ] ATKR: Adding 258 new records, updating 0 existing records. [2025-09-05T18:03:50.920820] [INFO ] [MAIN ] ATKR: Combined dataset has 16804 total records. [2025-09-05T18:03:51.066271] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-05T18:03:51.265423] [WARN ] [VALIDATOR ] ATKR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:03:51.290613] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-05T18:03:51.549968] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-05T18:03:51.569899] [WARN ] [VALIDATOR ] ATKR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:03:51.570122] [INFO ] [MAIN ] ATKR: Combined data validation passed. [2025-09-05T18:03:51.678721] [INFO ] [MAIN ] ATKR: Update completed successfully. [2025-09-05T18:03:51.681547] [INFO ] [MAIN ] Update Progress: 168/2363 symbols completed. ATKR took 1.6s. Estimated remaining: 49m 37s. Rate: 44.2 symbols/min [2025-09-05T18:03:51.813606] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-05T18:03:51.860195] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:03:51.860364] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-09-05T18:03:51.860494] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-05T18:03:51.860535] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-05T18:03:51.860580] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-05T18:03:51.871360] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-05T18:03:52.219203] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:03:52.663511] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-05T18:03:52.735327] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-05T18:03:53.463484] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-05T18:03:53.890142] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-05T18:03:54.263489] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-05T18:03:54.569331] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-05T18:03:55.063480] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-05T18:03:55.768524] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-05T18:03:55.863513] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-05T18:03:56.663525] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-05T18:03:56.961928] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-05T18:03:57.388308] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-05T18:03:57.463472] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-05T18:03:58.225567] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-05T18:03:58.263452] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-05T18:03:59.063471] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-05T18:03:59.460711] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-05T18:03:59.557363] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-05T18:03:59.863470] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-05T18:04:00.099214] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-05T18:04:00.663464] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-05T18:04:00.720582] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:04:00.721507] [INFO ] [REMOTE ] ATHS: Full fetch complete (7618 records). [2025-09-05T18:04:01.084061] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-05T18:04:01.123586] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-05T18:04:01.123961] [INFO ] [MAIN ] Update Progress: 169/2363 symbols completed. ATHS took 14.9s. Estimated remaining: 51m 21s. Rate: 42.7 symbols/min [2025-09-05T18:04:01.305246] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:01.325333] [INFO ] [MAIN ] ATO: Loaded 18880 existing records. [2025-09-05T18:04:01.473518] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-05T18:04:01.505531] [INFO ] [MAIN ] ATO: Found 1 missing trading days. [2025-09-05T18:04:01.505819] [INFO ] [MAIN ] ATO: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:02.161692] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-05T18:04:02.263528] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-05T18:04:02.274435] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:04:02.277553] [INFO ] [REMOTE ] ASPN: Full fetch complete (54315 records). [2025-09-05T18:04:02.680662] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-05T18:04:02.895157] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-05T18:04:02.895307] [INFO ] [MAIN ] Update Progress: 170/2363 symbols completed. ASPN took 23.6s. Estimated remaining: 51m 24s. Rate: 42.7 symbols/min [2025-09-05T18:04:03.068294] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:03.068351] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-05T18:04:03.085120] [INFO ] [MAIN ] ATR: Loaded 14958 existing records. [2025-09-05T18:04:03.262815] [INFO ] [MAIN ] ATR: Found 1 missing trading days. [2025-09-05T18:04:03.263002] [INFO ] [MAIN ] ATR: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:03.847840] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-05T18:04:03.863424] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-05T18:04:04.663457] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-05T18:04:05.088013] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-05T18:04:05.306157] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:04:05.429851] [INFO ] [MAIN ] ATO: Adding 289 new records, updating 0 existing records. [2025-09-05T18:04:05.433524] [INFO ] [MAIN ] ATO: Combined dataset has 19169 total records. [2025-09-05T18:04:05.465573] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-05T18:04:05.611587] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-05T18:04:05.640557] [WARN ] [VALIDATOR ] ATO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:05.837476] [WARN ] [VALIDATOR ] ATO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:05.837730] [INFO ] [MAIN ] ATO: Combined data validation passed. [2025-09-05T18:04:05.963066] [INFO ] [MAIN ] ATO: Update completed successfully. [2025-09-05T18:04:05.964738] [INFO ] [MAIN ] Update Progress: 171/2363 symbols completed. ATO took 4.8s. Estimated remaining: 51m 44s. Rate: 42.4 symbols/min [2025-09-05T18:04:06.138027] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:06.149197] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:04:06.152802] [INFO ] [MAIN ] ATS: Loaded 8721 existing records. [2025-09-05T18:04:06.266462] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-05T18:04:06.346375] [INFO ] [MAIN ] ATR: Adding 242 new records, updating 0 existing records. [2025-09-05T18:04:06.426705] [INFO ] [MAIN ] ATS: Found 1 missing trading days. [2025-09-05T18:04:06.427018] [INFO ] [MAIN ] ATS: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:06.427373] [INFO ] [MAIN ] ATR: Combined dataset has 15200 total records. [2025-09-05T18:04:06.604091] [WARN ] [VALIDATOR ] ATR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:06.798404] [WARN ] [VALIDATOR ] ATR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:06.798705] [INFO ] [MAIN ] ATR: Combined data validation passed. [2025-09-05T18:04:06.897747] [INFO ] [MAIN ] ATR: Update completed successfully. [2025-09-05T18:04:06.899559] [INFO ] [MAIN ] Update Progress: 172/2363 symbols completed. ATR took 4.0s. Estimated remaining: 51m 36s. Rate: 42.5 symbols/min [2025-09-05T18:04:07.068893] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-05T18:04:07.070878] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:07.107710] [INFO ] [MAIN ] ATUS: Loaded 37685 existing records. [2025-09-05T18:04:07.287970] [INFO ] [MAIN ] ATUS: Found 1 missing trading days. [2025-09-05T18:04:07.288096] [INFO ] [MAIN ] ATUS: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:07.863499] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-05T18:04:07.968030] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:04:08.014305] [INFO ] [MAIN ] ATS: Adding 93 new records, updating 0 existing records. [2025-09-05T18:04:08.016334] [INFO ] [MAIN ] ATS: Combined dataset has 8814 total records. [2025-09-05T18:04:08.207712] [WARN ] [VALIDATOR ] ATS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:08.413653] [WARN ] [VALIDATOR ] ATS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:08.413877] [INFO ] [MAIN ] ATS: Combined data validation passed. [2025-09-05T18:04:08.478855] [INFO ] [MAIN ] ATS: Update completed successfully. [2025-09-05T18:04:08.480351] [INFO ] [MAIN ] Update Progress: 173/2363 symbols completed. ATS took 2.5s. Estimated remaining: 51m 37s. Rate: 42.4 symbols/min [2025-09-05T18:04:08.669917] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-05T18:04:08.673450] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:08.709165] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-05T18:04:08.741227] [INFO ] [MAIN ] AU: Loaded 25224 existing records. [2025-09-05T18:04:08.929019] [INFO ] [MAIN ] AU: Found 1 missing trading days. [2025-09-05T18:04:08.929192] [INFO ] [MAIN ] AU: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:09.467868] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-05T18:04:09.471293] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:04:09.640404] [INFO ] [MAIN ] ATUS: Adding 373 new records, updating 0 existing records. [2025-09-05T18:04:09.668404] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-05T18:04:09.677039] [INFO ] [MAIN ] ATUS: Combined dataset has 38058 total records. [2025-09-05T18:04:09.879820] [WARN ] [VALIDATOR ] ATUS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:10.110913] [WARN ] [VALIDATOR ] ATUS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:10.111205] [INFO ] [MAIN ] ATUS: Combined data validation passed. [2025-09-05T18:04:10.277102] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-05T18:04:10.344878] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:04:10.371630] [INFO ] [MAIN ] ATUS: Update completed successfully. [2025-09-05T18:04:10.387202] [INFO ] [MAIN ] Update Progress: 174/2363 symbols completed. ATUS took 3.5s. Estimated remaining: 51m 42s. Rate: 42.3 symbols/min [2025-09-05T18:04:10.665356] [INFO ] [MAIN ] AU: Adding 388 new records, updating 0 existing records. [2025-09-05T18:04:10.733720] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:10.739603] [INFO ] [MAIN ] AU: Combined dataset has 25612 total records. [2025-09-05T18:04:10.916466] [INFO ] [MAIN ] AUB: Loaded 21864 existing records. [2025-09-05T18:04:10.937259] [WARN ] [VALIDATOR ] AU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:11.072125] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-05T18:04:11.312591] [INFO ] [MAIN ] AUB: Found 1 missing trading days. [2025-09-05T18:04:11.332875] [INFO ] [MAIN ] AUB: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:11.350886] [WARN ] [VALIDATOR ] AU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:11.351116] [INFO ] [MAIN ] AU: Combined data validation passed. [2025-09-05T18:04:11.512631] [INFO ] [MAIN ] AU: Update completed successfully. [2025-09-05T18:04:11.515329] [INFO ] [MAIN ] Update Progress: 175/2363 symbols completed. AU took 3.0s. Estimated remaining: 51m 37s. Rate: 42.4 symbols/min [2025-09-05T18:04:11.689181] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:11.694108] [INFO ] [MAIN ] AUNA: Loaded 3584 existing records. [2025-09-05T18:04:11.872984] [INFO ] [MAIN ] AUNA: Found 1 missing trading days. [2025-09-05T18:04:11.868548] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-05T18:04:11.874382] [INFO ] [MAIN ] AUNA: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:11.904596] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-05T18:04:12.347469] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:04:12.447619] [INFO ] [MAIN ] AUB: Adding 0 new records, updating 0 existing records. [2025-09-05T18:04:12.449398] [INFO ] [MAIN ] AUB: Combined dataset has 21864 total records. [2025-09-05T18:04:12.449876] [FATAL] [VALIDATOR ] AUB: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:04:12.449961] [FATAL] [MAIN ] AUB: Combined data validation failed. [2025-09-05T18:04:12.450043] [WARN ] [MAIN ] AUB: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:04:12.450087] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-05T18:04:12.450681] [INFO ] [LOCAL ] AUB: Starting deletion of derivative data. [2025-09-05T18:04:12.453107] [INFO ] [MAIN ] Update Progress: 176/2363 symbols completed. AUB took 2.0s. Estimated remaining: 51m 30s. Rate: 42.5 symbols/min [2025-09-05T18:04:12.623527] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:12.652554] [INFO ] [MAIN ] AVA: Loaded 29472 existing records. [2025-09-05T18:04:12.673306] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-05T18:04:12.833965] [INFO ] [MAIN ] AVA: Found 1 missing trading days. [2025-09-05T18:04:12.834147] [INFO ] [MAIN ] AVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:13.109965] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-05T18:04:13.463541] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-05T18:04:13.680392] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:04:13.701081] [INFO ] [MAIN ] AUNA: Adding 34 new records, updating 0 existing records. [2025-09-05T18:04:13.702838] [INFO ] [MAIN ] AUNA: Combined dataset has 3618 total records. [2025-09-05T18:04:13.885034] [WARN ] [VALIDATOR ] AUNA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:14.070439] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:04:14.193962] [INFO ] [MAIN ] AVA: Adding 282 new records, updating 0 existing records. [2025-09-05T18:04:14.198231] [INFO ] [MAIN ] AVA: Combined dataset has 29754 total records. [2025-09-05T18:04:14.268539] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-05T18:04:14.382463] [WARN ] [VALIDATOR ] AVA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:14.579606] [WARN ] [VALIDATOR ] AUNA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:14.580043] [INFO ] [MAIN ] AUNA: Combined data validation passed. [2025-09-05T18:04:14.601760] [INFO ] [MAIN ] AUNA: Update completed successfully. [2025-09-05T18:04:14.603137] [INFO ] [MAIN ] Update Progress: 177/2363 symbols completed. AUNA took 3.1s. Estimated remaining: 51m 37s. Rate: 42.3 symbols/min [2025-09-05T18:04:14.605021] [WARN ] [VALIDATOR ] AVA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:14.605357] [INFO ] [MAIN ] AVA: Combined data validation passed. [2025-09-05T18:04:14.893067] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:14.913796] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:04:14.919510] [INFO ] [MAIN ] AVAL: Loaded 3838 existing records. [2025-09-05T18:04:14.920929] [INFO ] [REMOTE ] ASX: Full fetch complete (57178 records). [2025-09-05T18:04:14.945221] [FATAL] [VALIDATOR ] ASX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:04:14.976875] [FATAL] [MAIN ] ASX: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:04:14.994072] [WARN ] [MAIN ] ASX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:04:15.008739] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-05T18:04:15.021969] [INFO ] [LOCAL ] ASX: Starting deletion of derivative data. [2025-09-05T18:04:15.033030] [INFO ] [MAIN ] Update Progress: 178/2363 symbols completed. ASX took 32.0s. Estimated remaining: 51m 24s. Rate: 42.5 symbols/min [2025-09-05T18:04:15.112000] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-05T18:04:15.270875] [INFO ] [MAIN ] AVAL: Found 1 missing trading days. [2025-09-05T18:04:15.295122] [INFO ] [MAIN ] AVAL: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:15.301473] [INFO ] [MAIN ] AVA: Update completed successfully. [2025-09-05T18:04:15.355512] [INFO ] [MAIN ] Update Progress: 179/2363 symbols completed. AVA took 2.9s. Estimated remaining: 51m 9s. Rate: 42.7 symbols/min [2025-09-05T18:04:15.357048] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:15.543130] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:15.543752] [INFO ] [MAIN ] AVB: Loaded 20156 existing records. [2025-09-05T18:04:15.659314] [INFO ] [MAIN ] AVBC: Loaded 3436 existing records. [2025-09-05T18:04:15.826943] [INFO ] [MAIN ] AVB: Found 1 missing trading days. [2025-09-05T18:04:15.827128] [INFO ] [MAIN ] AVB: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:15.873243] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-05T18:04:15.899370] [INFO ] [MAIN ] AVBC: Found 1 missing trading days. [2025-09-05T18:04:15.899534] [INFO ] [MAIN ] AVBC: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:16.505923] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:04:16.518948] [INFO ] [MAIN ] AVAL: Adding 27 new records, updating 0 existing records. [2025-09-05T18:04:16.520349] [INFO ] [MAIN ] AVAL: Combined dataset has 3865 total records. [2025-09-05T18:04:16.668615] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-05T18:04:16.704713] [WARN ] [VALIDATOR ] AVAL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:16.924398] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-05T18:04:16.938672] [WARN ] [VALIDATOR ] AVAL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:16.938908] [INFO ] [MAIN ] AVAL: Combined data validation passed. [2025-09-05T18:04:16.962092] [INFO ] [MAIN ] AVAL: Update completed successfully. [2025-09-05T18:04:16.962725] [INFO ] [MAIN ] Update Progress: 180/2363 symbols completed. AVAL took 2.4s. Estimated remaining: 51m 10s. Rate: 42.7 symbols/min [2025-09-05T18:04:17.134764] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:17.141243] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:04:17.218082] [INFO ] [MAIN ] AVD: Loaded 11303 existing records. [2025-09-05T18:04:17.371914] [INFO ] [MAIN ] AVB: Adding 317 new records, updating 0 existing records. [2025-09-05T18:04:17.448976] [INFO ] [MAIN ] AVD: Found 1 missing trading days. [2025-09-05T18:04:17.449347] [INFO ] [MAIN ] AVD: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:17.449267] [INFO ] [MAIN ] AVB: Combined dataset has 20473 total records. [2025-09-05T18:04:17.470806] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-05T18:04:17.630341] [WARN ] [VALIDATOR ] AVB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:17.824842] [WARN ] [VALIDATOR ] AVB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:17.825043] [INFO ] [MAIN ] AVB: Combined data validation passed. [2025-09-05T18:04:17.955706] [INFO ] [MAIN ] AVB: Update completed successfully. [2025-09-05T18:04:17.958309] [INFO ] [MAIN ] Update Progress: 181/2363 symbols completed. AVB took 2.9s. Estimated remaining: 51m 4s. Rate: 42.7 symbols/min [2025-09-05T18:04:18.180949] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:18.181146] [WARN ] [MAIN ] AVK: No existing data found, performing full refresh instead. [2025-09-05T18:04:18.181269] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-05T18:04:18.181308] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-05T18:04:18.181354] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-05T18:04:18.271972] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-05T18:04:18.445088] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:04:18.548976] [INFO ] [MAIN ] AVBC: Adding 102 new records, updating 0 existing records. [2025-09-05T18:04:18.616679] [INFO ] [REMOTE ] AVK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:04:18.617097] [INFO ] [MAIN ] AVBC: Combined dataset has 3538 total records. [2025-09-05T18:04:18.800062] [WARN ] [VALIDATOR ] AVBC: Not fatal, but first date in data (2025-08-01) does not match expected start date (2025-01-31) [2025-09-05T18:04:18.985086] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:04:19.034413] [INFO ] [MAIN ] AVD: Adding 177 new records, updating 0 existing records. [2025-09-05T18:04:19.037560] [INFO ] [MAIN ] AVD: Combined dataset has 11480 total records. [2025-09-05T18:04:19.068719] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-05T18:04:19.226219] [WARN ] [VALIDATOR ] AVD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:19.424450] [WARN ] [VALIDATOR ] AVD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:19.424567] [WARN ] [VALIDATOR ] AVBC: Missing days changed. Total missing: 125 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31 [2025-09-05T18:04:19.424809] [INFO ] [MAIN ] AVD: Combined data validation passed. [2025-09-05T18:04:19.425213] [INFO ] [MAIN ] AVBC: Combined data validation passed. [2025-09-05T18:04:19.505903] [INFO ] [MAIN ] AVBC: Update completed successfully. [2025-09-05T18:04:19.512546] [INFO ] [MAIN ] Update Progress: 182/2363 symbols completed. AVBC took 4.2s. Estimated remaining: 51m 4s. Rate: 42.7 symbols/min [2025-09-05T18:04:19.512804] [INFO ] [MAIN ] AVD: Update completed successfully. [2025-09-05T18:04:19.578052] [INFO ] [MAIN ] Update Progress: 183/2363 symbols completed. AVD took 2.6s. Estimated remaining: 50m 47s. Rate: 42.9 symbols/min [2025-09-05T18:04:19.818846] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:19.866089] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-05T18:04:19.868495] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:19.877252] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:04:19.880318] [INFO ] [REMOTE ] ATMU: Full fetch complete (42893 records). [2025-09-05T18:04:20.006842] [INFO ] [MAIN ] AVNS: Loaded 16074 existing records. [2025-09-05T18:04:20.018192] [INFO ] [MAIN ] AVNT: Loaded 19020 existing records. [2025-09-05T18:04:20.489517] [INFO ] [MAIN ] AVNS: Found 1 missing trading days. [2025-09-05T18:04:20.525532] [INFO ] [MAIN ] AVNS: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:20.568916] [INFO ] [MAIN ] AVNT: Found 1 missing trading days. [2025-09-05T18:04:20.588824] [INFO ] [MAIN ] AVNT: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:20.636134] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-05T18:04:20.700827] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-05T18:04:20.825196] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-05T18:04:20.825336] [INFO ] [MAIN ] Update Progress: 184/2363 symbols completed. ATMU took 29.1s. Estimated remaining: 50m 44s. Rate: 43.0 symbols/min [2025-09-05T18:04:20.994387] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:21.020361] [INFO ] [MAIN ] AVTR: Loaded 25599 existing records. [2025-09-05T18:04:21.212130] [INFO ] [MAIN ] AVTR: Found 1 missing trading days. [2025-09-05T18:04:21.212449] [INFO ] [MAIN ] AVTR: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:21.215787] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-05T18:04:21.295610] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:04:21.388812] [INFO ] [MAIN ] AVNS: Adding 245 new records, updating 0 existing records. [2025-09-05T18:04:21.391592] [INFO ] [MAIN ] AVNS: Combined dataset has 16319 total records. [2025-09-05T18:04:21.468574] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-05T18:04:21.572170] [WARN ] [VALIDATOR ] AVNS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:21.760604] [WARN ] [VALIDATOR ] AVNS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:21.760871] [INFO ] [MAIN ] AVNS: Combined data validation passed. [2025-09-05T18:04:21.857636] [INFO ] [MAIN ] AVNS: Update completed successfully. [2025-09-05T18:04:21.859144] [INFO ] [MAIN ] Update Progress: 185/2363 symbols completed. AVNS took 2.3s. Estimated remaining: 50m 38s. Rate: 43.0 symbols/min [2025-09-05T18:04:22.056026] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:22.075446] [INFO ] [MAIN ] AVY: Loaded 16903 existing records. [2025-09-05T18:04:22.210124] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:04:22.268564] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-05T18:04:22.314082] [INFO ] [MAIN ] AVY: Found 1 missing trading days. [2025-09-05T18:04:22.324752] [INFO ] [MAIN ] AVY: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:22.380620] [INFO ] [MAIN ] AVNT: Adding 267 new records, updating 0 existing records. [2025-09-05T18:04:22.384313] [INFO ] [MAIN ] AVNT: Combined dataset has 19287 total records. [2025-09-05T18:04:22.572084] [WARN ] [VALIDATOR ] AVNT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:22.775308] [WARN ] [VALIDATOR ] AVNT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:22.775531] [INFO ] [MAIN ] AVNT: Combined data validation passed. [2025-09-05T18:04:22.891870] [INFO ] [MAIN ] AVNT: Update completed successfully. [2025-09-05T18:04:22.894098] [INFO ] [MAIN ] Update Progress: 186/2363 symbols completed. AVNT took 3.3s. Estimated remaining: 50m 32s. Rate: 43.1 symbols/min [2025-09-05T18:04:23.067372] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:23.064558] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-05T18:04:23.079535] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-05T18:04:23.099721] [INFO ] [MAIN ] AWF: Loaded 17500 existing records. [2025-09-05T18:04:23.270801] [INFO ] [MAIN ] AWF: Found 1 missing trading days. [2025-09-05T18:04:23.270989] [INFO ] [MAIN ] AWF: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:23.675427] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:04:23.783606] [INFO ] [MAIN ] AVY: Adding 274 new records, updating 0 existing records. [2025-09-05T18:04:23.786493] [INFO ] [MAIN ] AVY: Combined dataset has 17177 total records. [2025-09-05T18:04:23.868731] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-05T18:04:23.969102] [WARN ] [VALIDATOR ] AVY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:24.161025] [WARN ] [VALIDATOR ] AVY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:24.161274] [INFO ] [MAIN ] AVY: Combined data validation passed. [2025-09-05T18:04:24.265723] [INFO ] [MAIN ] AVY: Update completed successfully. [2025-09-05T18:04:24.267969] [INFO ] [MAIN ] Update Progress: 187/2363 symbols completed. AVY took 2.4s. Estimated remaining: 50m 31s. Rate: 43.1 symbols/min [2025-09-05T18:04:24.439531] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:24.452362] [INFO ] [MAIN ] AWI: Loaded 12467 existing records. [2025-09-05T18:04:24.626442] [INFO ] [MAIN ] AWI: Found 1 missing trading days. [2025-09-05T18:04:24.626617] [INFO ] [MAIN ] AWI: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:24.663472] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-05T18:04:24.914579] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-05T18:04:24.993113] [INFO ] [MAIN ] AWI: Adding 183 new records, updating 0 existing records. [2025-09-05T18:04:24.995606] [INFO ] [MAIN ] AWI: Combined dataset has 12650 total records. [2025-09-05T18:04:25.110167] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T18:04:25.260435] [WARN ] [VALIDATOR ] AWI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:25.333772] [INFO ] [MAIN ] AWF: Adding 138 new records, updating 285 existing records. [2025-09-05T18:04:25.440168] [INFO ] [MAIN ] AWF: Combined dataset has 17638 total records. [2025-09-05T18:04:25.473813] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-05T18:04:25.661626] [WARN ] [VALIDATOR ] AWF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:25.863254] [WARN ] [VALIDATOR ] AWI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:25.863157] [WARN ] [VALIDATOR ] AWF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:25.863669] [INFO ] [MAIN ] AWI: Combined data validation passed. [2025-09-05T18:04:25.863755] [INFO ] [MAIN ] AWF: Combined data validation passed. [2025-09-05T18:04:26.038004] [INFO ] [MAIN ] AWF: Update completed successfully. [2025-09-05T18:04:26.040291] [INFO ] [MAIN ] Update Progress: 188/2363 symbols completed. AWF took 3.1s. Estimated remaining: 50m 34s. Rate: 43.0 symbols/min [2025-09-05T18:04:26.222666] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:26.235770] [INFO ] [MAIN ] AWI: Update completed successfully. [2025-09-05T18:04:26.237923] [INFO ] [MAIN ] Update Progress: 189/2363 symbols completed. AWI took 2.0s. Estimated remaining: 50m 18s. Rate: 43.2 symbols/min [2025-09-05T18:04:26.265304] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-05T18:04:26.438628] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:26.457521] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:04:26.458759] [INFO ] [MAIN ] AWK: Loaded 36454 existing records. [2025-09-05T18:04:26.711215] [INFO ] [MAIN ] AWP: Loaded 17028 existing records. [2025-09-05T18:04:26.834149] [INFO ] [MAIN ] AVTR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:04:26.868402] [INFO ] [MAIN ] AWK: Found 1 missing trading days. [2025-09-05T18:04:26.891073] [INFO ] [MAIN ] AWK: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:26.996143] [INFO ] [MAIN ] AVTR: Combined dataset has 25989 total records. [2025-09-05T18:04:27.001467] [INFO ] [MAIN ] AWP: Found 1 missing trading days. [2025-09-05T18:04:27.001589] [INFO ] [MAIN ] AWP: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:27.066128] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-05T18:04:27.181604] [WARN ] [VALIDATOR ] AVTR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:27.373929] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-05T18:04:27.386720] [WARN ] [VALIDATOR ] AVTR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:27.386925] [INFO ] [MAIN ] AVTR: Combined data validation passed. [2025-09-05T18:04:27.545036] [INFO ] [MAIN ] AVTR: Update completed successfully. [2025-09-05T18:04:27.548157] [INFO ] [MAIN ] Update Progress: 190/2363 symbols completed. AVTR took 6.7s. Estimated remaining: 50m 16s. Rate: 43.2 symbols/min [2025-09-05T18:04:27.710510] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:04:27.727206] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:27.868031] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-05T18:04:27.867974] [INFO ] [MAIN ] AWR: Loaded 16543 existing records. [2025-09-05T18:04:27.899441] [INFO ] [MAIN ] AWK: Adding 326 new records, updating 0 existing records. [2025-09-05T18:04:28.066362] [INFO ] [MAIN ] AWK: Combined dataset has 36780 total records. [2025-09-05T18:04:28.066284] [INFO ] [MAIN ] AWR: Found 1 missing trading days. [2025-09-05T18:04:28.066504] [INFO ] [MAIN ] AWR: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:28.241145] [WARN ] [VALIDATOR ] AWK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:28.437686] [WARN ] [VALIDATOR ] AWK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:28.437920] [INFO ] [MAIN ] AWK: Combined data validation passed. [2025-09-05T18:04:28.666441] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-05T18:04:28.687997] [INFO ] [MAIN ] AWK: Update completed successfully. [2025-09-05T18:04:28.695107] [INFO ] [MAIN ] Update Progress: 191/2363 symbols completed. AWK took 2.7s. Estimated remaining: 50m 12s. Rate: 43.3 symbols/min [2025-09-05T18:04:28.874226] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:28.889698] [INFO ] [MAIN ] AX: Loaded 12945 existing records. [2025-09-05T18:04:29.065037] [INFO ] [MAIN ] AX: Found 1 missing trading days. [2025-09-05T18:04:29.065376] [INFO ] [MAIN ] AX: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:29.071553] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:04:29.136776] [INFO ] [MAIN ] AWP: Adding 149 new records, updating 0 existing records. [2025-09-05T18:04:29.140636] [INFO ] [MAIN ] AWP: Combined dataset has 17177 total records. [2025-09-05T18:04:29.256050] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:04:29.404604] [INFO ] [MAIN ] AWR: Adding 152 new records, updating 0 existing records. [2025-09-05T18:04:29.400272] [WARN ] [VALIDATOR ] AWP: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:29.469492] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-05T18:04:29.530858] [INFO ] [MAIN ] AWR: Combined dataset has 16695 total records. [2025-09-05T18:04:29.791580] [WARN ] [VALIDATOR ] AWR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:30.000059] [WARN ] [VALIDATOR ] AWR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:30.000435] [INFO ] [MAIN ] AWR: Combined data validation passed. [2025-09-05T18:04:30.000186] [WARN ] [VALIDATOR ] AWP: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:30.000885] [INFO ] [MAIN ] AWP: Combined data validation passed. [2025-09-05T18:04:30.199377] [INFO ] [MAIN ] AWR: Update completed successfully. [2025-09-05T18:04:30.202573] [INFO ] [MAIN ] Update Progress: 192/2363 symbols completed. AWR took 2.7s. Estimated remaining: 50m 12s. Rate: 43.2 symbols/min [2025-09-05T18:04:30.215903] [INFO ] [MAIN ] AWP: Update completed successfully. [2025-09-05T18:04:30.254720] [INFO ] [MAIN ] Update Progress: 193/2363 symbols completed. AWP took 4.0s. Estimated remaining: 49m 56s. Rate: 43.5 symbols/min [2025-09-05T18:04:30.273379] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-05T18:04:30.537563] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:30.570601] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:30.585399] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-05T18:04:30.615169] [INFO ] [MAIN ] AXL: Loaded 24069 existing records. [2025-09-05T18:04:30.725201] [INFO ] [MAIN ] AXP: Loaded 25455 existing records. [2025-09-05T18:04:30.787631] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:04:30.988399] [INFO ] [MAIN ] AXL: Found 1 missing trading days. [2025-09-05T18:04:31.009393] [INFO ] [MAIN ] AXL: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:31.081828] [INFO ] [MAIN ] AX: Adding 197 new records, updating 0 existing records. [2025-09-05T18:04:31.075099] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-05T18:04:31.114214] [INFO ] [MAIN ] AXP: Found 1 missing trading days. [2025-09-05T18:04:31.114380] [INFO ] [MAIN ] AXP: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:31.116423] [INFO ] [MAIN ] AX: Combined dataset has 13142 total records. [2025-09-05T18:04:31.299603] [WARN ] [VALIDATOR ] AX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:31.489582] [WARN ] [VALIDATOR ] AX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:31.489847] [INFO ] [MAIN ] AX: Combined data validation passed. [2025-09-05T18:04:31.567476] [INFO ] [MAIN ] AX: Update completed successfully. [2025-09-05T18:04:31.569010] [INFO ] [MAIN ] Update Progress: 194/2363 symbols completed. AX took 2.9s. Estimated remaining: 49m 54s. Rate: 43.5 symbols/min [2025-09-05T18:04:31.742524] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:31.745808] [INFO ] [MAIN ] AXR: Loaded 1490 existing records. [2025-09-05T18:04:31.865463] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-05T18:04:31.923869] [INFO ] [MAIN ] AXR: Found 1 missing trading days. [2025-09-05T18:04:31.924018] [INFO ] [MAIN ] AXR: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:32.028284] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-05T18:04:32.551682] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:04:32.668696] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-05T18:04:32.698518] [INFO ] [MAIN ] AXL: Adding 374 new records, updating 0 existing records. [2025-09-05T18:04:32.701790] [INFO ] [MAIN ] AXL: Combined dataset has 24443 total records. [2025-09-05T18:04:32.883312] [WARN ] [VALIDATOR ] AXL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:33.088214] [WARN ] [VALIDATOR ] AXL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:33.088436] [INFO ] [MAIN ] AXL: Combined data validation passed. [2025-09-05T18:04:33.232855] [INFO ] [MAIN ] AXL: Update completed successfully. [2025-09-05T18:04:33.235634] [INFO ] [MAIN ] Update Progress: 195/2363 symbols completed. AXL took 3.0s. Estimated remaining: 49m 55s. Rate: 43.4 symbols/min [2025-09-05T18:04:33.409150] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:33.427004] [INFO ] [MAIN ] AXS: Loaded 18551 existing records. [2025-09-05T18:04:33.469291] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-05T18:04:33.602365] [INFO ] [MAIN ] AXS: Found 1 missing trading days. [2025-09-05T18:04:33.602514] [INFO ] [MAIN ] AXS: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:33.719941] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-05T18:04:34.098444] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:04:34.114933] [INFO ] [MAIN ] AXR: Adding 49 new records, updating 0 existing records. [2025-09-05T18:04:34.116580] [INFO ] [MAIN ] AXR: Combined dataset has 1539 total records. [2025-09-05T18:04:34.268580] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-05T18:04:34.309021] [WARN ] [VALIDATOR ] AXR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:34.506610] [WARN ] [VALIDATOR ] AXR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:34.506841] [INFO ] [MAIN ] AXR: Combined data validation passed. [2025-09-05T18:04:34.516991] [INFO ] [MAIN ] AXR: Update completed successfully. [2025-09-05T18:04:34.517327] [INFO ] [MAIN ] Update Progress: 196/2363 symbols completed. AXR took 2.9s. Estimated remaining: 49m 53s. Rate: 43.4 symbols/min [2025-09-05T18:04:34.690569] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:34.727104] [INFO ] [MAIN ] AXTA: Loaded 39246 existing records. [2025-09-05T18:04:34.908995] [INFO ] [MAIN ] AXTA: Found 1 missing trading days. [2025-09-05T18:04:34.909170] [INFO ] [MAIN ] AXTA: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:35.063508] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-05T18:04:35.443840] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-05T18:04:35.704358] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:04:35.857722] [INFO ] [MAIN ] AXTA: Adding 386 new records, updating 0 existing records. [2025-09-05T18:04:35.861608] [INFO ] [MAIN ] AXTA: Combined dataset has 39632 total records. [2025-09-05T18:04:35.873184] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-05T18:04:36.040999] [WARN ] [VALIDATOR ] AXTA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:36.237826] [WARN ] [VALIDATOR ] AXTA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:36.238023] [INFO ] [MAIN ] AXTA: Combined data validation passed. [2025-09-05T18:04:36.476453] [INFO ] [MAIN ] AXTA: Update completed successfully. [2025-09-05T18:04:36.480730] [INFO ] [MAIN ] Update Progress: 197/2363 symbols completed. AXTA took 2.0s. Estimated remaining: 49m 58s. Rate: 43.4 symbols/min [2025-09-05T18:04:36.503482] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:04:36.617998] [INFO ] [MAIN ] AXS: Adding 298 new records, updating 0 existing records. [2025-09-05T18:04:36.621328] [INFO ] [MAIN ] AXS: Combined dataset has 18849 total records. [2025-09-05T18:04:36.668778] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-05T18:04:36.806110] [WARN ] [VALIDATOR ] AXS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:36.999018] [WARN ] [VALIDATOR ] AXS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:36.999251] [INFO ] [MAIN ] AXS: Combined data validation passed. [2025-09-05T18:04:37.114191] [INFO ] [MAIN ] AXS: Update completed successfully. [2025-09-05T18:04:37.116098] [INFO ] [MAIN ] Update Progress: 198/2363 symbols completed. AXS took 3.9s. Estimated remaining: 49m 48s. Rate: 43.5 symbols/min [2025-09-05T18:04:37.463489] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-05T18:04:37.507757] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:04:37.656766] [INFO ] [MAIN ] AXP: Adding 388 new records, updating 0 existing records. [2025-09-05T18:04:37.660294] [INFO ] [MAIN ] AXP: Combined dataset has 25843 total records. [2025-09-05T18:04:37.841990] [WARN ] [VALIDATOR ] AXP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:38.038358] [WARN ] [VALIDATOR ] AXP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:38.038630] [INFO ] [MAIN ] AXP: Combined data validation passed. [2025-09-05T18:04:38.202364] [INFO ] [MAIN ] AXP: Update completed successfully. [2025-09-05T18:04:38.205276] [INFO ] [MAIN ] Update Progress: 199/2363 symbols completed. AXP took 7.9s. Estimated remaining: 49m 44s. Rate: 43.5 symbols/min [2025-09-05T18:04:38.578931] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-05T18:04:38.583762] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-05T18:04:39.551275] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:04:39.552689] [INFO ] [REMOTE ] AVK: Full fetch complete (19444 records). [2025-09-05T18:04:39.553218] [FATAL] [VALIDATOR ] AVK: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:04:39.553309] [FATAL] [MAIN ] AVK: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:04:39.553363] [WARN ] [MAIN ] AVK: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:04:39.553424] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-05T18:04:39.553504] [INFO ] [LOCAL ] AVK: Starting deletion of derivative data. [2025-09-05T18:04:39.553622] [INFO ] [MAIN ] Update Progress: 200/2363 symbols completed. AVK took 21.6s. Estimated remaining: 49m 42s. Rate: 43.5 symbols/min [2025-09-05T18:04:40.163819] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:40.190409] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:40.196873] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:40.207625] [WARN ] [MAIN ] AYI: No existing data found, performing full refresh instead. [2025-09-05T18:04:40.207855] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-05T18:04:40.207906] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-05T18:04:40.207956] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-05T18:04:40.332308] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:40.376860] [INFO ] [MAIN ] AZO: Loaded 5052 existing records. [2025-09-05T18:04:40.543020] [INFO ] [MAIN ] AZZ: Loaded 16998 existing records. [2025-09-05T18:04:40.946194] [INFO ] [MAIN ] AZO: Found 1 missing trading days. [2025-09-05T18:04:40.944124] [INFO ] [MAIN ] B: Loaded 25723 existing records. [2025-09-05T18:04:40.971700] [INFO ] [MAIN ] AZO: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:40.966496] [INFO ] [REMOTE ] AYI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:04:41.007893] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-05T18:04:41.008133] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-05T18:04:41.082248] [INFO ] [MAIN ] AZZ: Found 1 missing trading days. [2025-09-05T18:04:41.105364] [INFO ] [MAIN ] AZZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:41.132629] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-05T18:04:41.211698] [INFO ] [MAIN ] B: Found 1 missing trading days. [2025-09-05T18:04:41.211833] [INFO ] [MAIN ] B: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:41.463520] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-05T18:04:41.544392] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:04:41.567443] [INFO ] [MAIN ] AZO: Adding 71 new records, updating 0 existing records. [2025-09-05T18:04:41.569175] [INFO ] [MAIN ] AZO: Combined dataset has 5123 total records. [2025-09-05T18:04:41.674881] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:04:41.804443] [INFO ] [MAIN ] AZZ: Adding 95 new records, updating 0 existing records. [2025-09-05T18:04:41.835979] [WARN ] [VALIDATOR ] AZO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:41.979898] [INFO ] [MAIN ] AZZ: Combined dataset has 17093 total records. [2025-09-05T18:04:42.211049] [WARN ] [VALIDATOR ] AZZ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:42.324056] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:04:42.563831] [INFO ] [MAIN ] B: Adding 390 new records, updating 0 existing records. [2025-09-05T18:04:42.569679] [INFO ] [MAIN ] B: Combined dataset has 26113 total records. [2025-09-05T18:04:42.667340] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-05T18:04:42.705203] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-05T18:04:42.790153] [WARN ] [VALIDATOR ] B: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:42.903785] [WARN ] [VALIDATOR ] AZO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:42.903615] [WARN ] [VALIDATOR ] AZZ: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:42.909326] [INFO ] [MAIN ] AZO: Combined data validation passed. [2025-09-05T18:04:42.919884] [INFO ] [MAIN ] AZZ: Combined data validation passed. [2025-09-05T18:04:43.091581] [INFO ] [MAIN ] AZO: Update completed successfully. [2025-09-05T18:04:43.093586] [INFO ] [MAIN ] Update Progress: 201/2363 symbols completed. AZO took 3.5s. Estimated remaining: 50m 4s. Rate: 43.2 symbols/min [2025-09-05T18:04:43.320136] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:43.334243] [INFO ] [MAIN ] AZZ: Update completed successfully. [2025-09-05T18:04:43.336883] [INFO ] [MAIN ] Update Progress: 202/2363 symbols completed. AZZ took 3.8s. Estimated remaining: 49m 50s. Rate: 43.4 symbols/min [2025-09-05T18:04:43.534629] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:43.552806] [INFO ] [MAIN ] BA: Loaded 40532 existing records. [2025-09-05T18:04:43.552899] [WARN ] [VALIDATOR ] B: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:43.590582] [INFO ] [MAIN ] B: Combined data validation passed. [2025-09-05T18:04:43.890183] [INFO ] [MAIN ] BABA: Loaded 25801 existing records. [2025-09-05T18:04:43.888560] [INFO ] [MAIN ] BA: Found 1 missing trading days. [2025-09-05T18:04:43.890463] [INFO ] [MAIN ] BA: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:43.896339] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-05T18:04:44.165953] [INFO ] [MAIN ] BABA: Found 1 missing trading days. [2025-09-05T18:04:44.175895] [INFO ] [MAIN ] BABA: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:44.191294] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-05T18:04:44.195537] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-05T18:04:44.275215] [INFO ] [MAIN ] B: Update completed successfully. [2025-09-05T18:04:44.280221] [INFO ] [MAIN ] Update Progress: 203/2363 symbols completed. B took 4.7s. Estimated remaining: 49m 44s. Rate: 43.4 symbols/min [2025-09-05T18:04:44.559316] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:44.572584] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:04:44.664129] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-05T18:04:44.830216] [INFO ] [MAIN ] BA: Adding 390 new records, updating 0 existing records. [2025-09-05T18:04:44.848879] [INFO ] [MAIN ] BAC: Loaded 40548 existing records. [2025-09-05T18:04:45.008688] [INFO ] [MAIN ] BA: Combined dataset has 40922 total records. [2025-09-05T18:04:45.112562] [INFO ] [MAIN ] BAC: Found 1 missing trading days. [2025-09-05T18:04:45.148129] [INFO ] [MAIN ] BAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:45.251841] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:04:45.272213] [WARN ] [VALIDATOR ] BA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:45.477556] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-05T18:04:45.609720] [INFO ] [MAIN ] BABA: Adding 390 new records, updating 0 existing records. [2025-09-05T18:04:45.616349] [INFO ] [MAIN ] BABA: Combined dataset has 26191 total records. [2025-09-05T18:04:45.796200] [WARN ] [VALIDATOR ] BABA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:45.989727] [WARN ] [VALIDATOR ] BA: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:45.990530] [INFO ] [MAIN ] BA: Combined data validation passed. [2025-09-05T18:04:45.997318] [WARN ] [VALIDATOR ] BABA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:45.997581] [INFO ] [MAIN ] BABA: Combined data validation passed. [2025-09-05T18:04:46.356083] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-05T18:04:46.365065] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-05T18:04:46.387344] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:04:46.693916] [INFO ] [MAIN ] BAC: Adding 390 new records, updating 0 existing records. [2025-09-05T18:04:46.710720] [INFO ] [MAIN ] BAC: Combined dataset has 40938 total records. [2025-09-05T18:04:46.711810] [INFO ] [MAIN ] BABA: Update completed successfully. [2025-09-05T18:04:46.715972] [INFO ] [MAIN ] Update Progress: 204/2363 symbols completed. BABA took 3.4s. Estimated remaining: 49m 54s. Rate: 43.3 symbols/min [2025-09-05T18:04:46.917519] [INFO ] [MAIN ] BA: Update completed successfully. [2025-09-05T18:04:46.950674] [INFO ] [MAIN ] Update Progress: 205/2363 symbols completed. BA took 3.8s. Estimated remaining: 49m 40s. Rate: 43.4 symbols/min [2025-09-05T18:04:47.177283] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:47.252863] [WARN ] [VALIDATOR ] BAC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:47.431099] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:47.554358] [INFO ] [MAIN ] BAH: Loaded 24591 existing records. [2025-09-05T18:04:47.656282] [INFO ] [MAIN ] BAK: Loaded 19089 existing records. [2025-09-05T18:04:47.809733] [INFO ] [MAIN ] BAH: Found 1 missing trading days. [2025-09-05T18:04:47.839612] [INFO ] [MAIN ] BAH: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:47.845424] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-05T18:04:47.944684] [INFO ] [MAIN ] BAK: Found 1 missing trading days. [2025-09-05T18:04:47.945691] [INFO ] [MAIN ] BAK: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:47.946195] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-05T18:04:47.974595] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-05T18:04:47.984525] [WARN ] [VALIDATOR ] BAC: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:47.984808] [INFO ] [MAIN ] BAC: Combined data validation passed. [2025-09-05T18:04:48.254298] [INFO ] [MAIN ] BAC: Update completed successfully. [2025-09-05T18:04:48.260932] [INFO ] [MAIN ] Update Progress: 206/2363 symbols completed. BAC took 4.0s. Estimated remaining: 49m 38s. Rate: 43.5 symbols/min [2025-09-05T18:04:48.452854] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:48.480230] [INFO ] [MAIN ] BALL: Loaded 24501 existing records. [2025-09-05T18:04:48.668218] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-05T18:04:48.668152] [INFO ] [MAIN ] BALL: Found 1 missing trading days. [2025-09-05T18:04:48.668611] [INFO ] [MAIN ] BALL: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:48.680270] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:04:48.800827] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:04:48.855618] [INFO ] [MAIN ] BAH: Adding 389 new records, updating 0 existing records. [2025-09-05T18:04:48.949709] [INFO ] [MAIN ] BAK: Adding 262 new records, updating 0 existing records. [2025-09-05T18:04:48.951738] [INFO ] [MAIN ] BAH: Combined dataset has 24980 total records. [2025-09-05T18:04:49.044042] [INFO ] [MAIN ] BAK: Combined dataset has 19351 total records. [2025-09-05T18:04:49.238979] [WARN ] [VALIDATOR ] BAH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:49.407534] [WARN ] [VALIDATOR ] BAK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:49.469734] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-05T18:04:49.736806] [WARN ] [VALIDATOR ] BAH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:49.737164] [INFO ] [MAIN ] BAH: Combined data validation passed. [2025-09-05T18:04:49.736926] [WARN ] [VALIDATOR ] BAK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:49.737367] [INFO ] [MAIN ] BAK: Combined data validation passed. [2025-09-05T18:04:49.958242] [INFO ] [MAIN ] BAK: Update completed successfully. [2025-09-05T18:04:49.964830] [INFO ] [MAIN ] Update Progress: 207/2363 symbols completed. BAK took 3.0s. Estimated remaining: 49m 40s. Rate: 43.4 symbols/min [2025-09-05T18:04:50.185359] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:50.201938] [INFO ] [MAIN ] BAH: Update completed successfully. [2025-09-05T18:04:50.215224] [INFO ] [MAIN ] Update Progress: 208/2363 symbols completed. BAH took 3.5s. Estimated remaining: 49m 27s. Rate: 43.6 symbols/min [2025-09-05T18:04:50.222441] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-05T18:04:50.211659] [INFO ] [MAIN ] BALY: Loaded 4312 existing records. [2025-09-05T18:04:50.290509] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-05T18:04:50.385234] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:04:50.648497] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:50.698592] [INFO ] [MAIN ] BALY: Found 1 missing trading days. [2025-09-05T18:04:50.724703] [INFO ] [MAIN ] BALY: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:50.785359] [INFO ] [MAIN ] BALL: Adding 376 new records, updating 0 existing records. [2025-09-05T18:04:50.796864] [INFO ] [MAIN ] BALL: Combined dataset has 24877 total records. [2025-09-05T18:04:50.873370] [INFO ] [MAIN ] BAM: Loaded 24692 existing records. [2025-09-05T18:04:51.065961] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-05T18:04:51.176033] [WARN ] [VALIDATOR ] BALL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:51.184404] [INFO ] [MAIN ] BAM: Found 1 missing trading days. [2025-09-05T18:04:51.226963] [INFO ] [MAIN ] BAM: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:51.378630] [WARN ] [VALIDATOR ] BALL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:51.378871] [INFO ] [MAIN ] BALL: Combined data validation passed. [2025-09-05T18:04:51.485686] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:04:51.508503] [INFO ] [MAIN ] BALY: Adding 88 new records, updating 0 existing records. [2025-09-05T18:04:51.544710] [INFO ] [MAIN ] BALY: Combined dataset has 4400 total records. [2025-09-05T18:04:51.581446] [INFO ] [MAIN ] BALL: Update completed successfully. [2025-09-05T18:04:51.596264] [INFO ] [MAIN ] Update Progress: 209/2363 symbols completed. BALL took 3.3s. Estimated remaining: 49m 26s. Rate: 43.6 symbols/min [2025-09-05T18:04:51.875493] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-05T18:04:51.922226] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:51.919083] [WARN ] [VALIDATOR ] BALY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:52.141843] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-05T18:04:52.161899] [INFO ] [MAIN ] BANC: Loaded 38430 existing records. [2025-09-05T18:04:52.362708] [INFO ] [MAIN ] BANC: Found 1 missing trading days. [2025-09-05T18:04:52.362919] [INFO ] [MAIN ] BANC: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:52.369873] [WARN ] [VALIDATOR ] BALY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:52.370037] [INFO ] [MAIN ] BALY: Combined data validation passed. [2025-09-05T18:04:52.396161] [INFO ] [MAIN ] BALY: Update completed successfully. [2025-09-05T18:04:52.396660] [INFO ] [MAIN ] Update Progress: 210/2363 symbols completed. BALY took 2.4s. Estimated remaining: 49m 19s. Rate: 43.7 symbols/min [2025-09-05T18:04:52.571694] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:52.572500] [WARN ] [MAIN ] BAP: No existing data found, performing full refresh instead. [2025-09-05T18:04:52.572698] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-05T18:04:52.572740] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-05T18:04:52.572787] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-05T18:04:52.669819] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-05T18:04:52.885412] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:04:52.972020] [INFO ] [REMOTE ] BAP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:04:53.092804] [INFO ] [MAIN ] BAM: Adding 389 new records, updating 0 existing records. [2025-09-05T18:04:53.096521] [INFO ] [MAIN ] BAM: Combined dataset has 25081 total records. [2025-09-05T18:04:53.287273] [WARN ] [VALIDATOR ] BAM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:53.475677] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-05T18:04:53.498381] [WARN ] [VALIDATOR ] BAM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:53.498574] [INFO ] [MAIN ] BAM: Combined data validation passed. [2025-09-05T18:04:53.667093] [INFO ] [MAIN ] BAM: Update completed successfully. [2025-09-05T18:04:53.669823] [INFO ] [MAIN ] Update Progress: 211/2363 symbols completed. BAM took 3.5s. Estimated remaining: 49m 16s. Rate: 43.7 symbols/min [2025-09-05T18:04:53.856410] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:53.856582] [WARN ] [MAIN ] BARK: No existing data found, performing full refresh instead. [2025-09-05T18:04:53.856731] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-05T18:04:53.856773] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-05T18:04:53.856818] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-05T18:04:54.255197] [INFO ] [REMOTE ] BARK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:04:54.268232] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-05T18:04:54.272304] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-05T18:04:54.853440] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:04:55.014468] [INFO ] [MAIN ] BANC: Adding 387 new records, updating 0 existing records. [2025-09-05T18:04:55.032698] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-05T18:04:55.039172] [INFO ] [MAIN ] BANC: Combined dataset has 38817 total records. [2025-09-05T18:04:55.070240] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-05T18:04:55.226424] [WARN ] [VALIDATOR ] BANC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:04:55.423564] [WARN ] [VALIDATOR ] BANC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:04:55.423815] [INFO ] [MAIN ] BANC: Combined data validation passed. [2025-09-05T18:04:55.659256] [INFO ] [MAIN ] BANC: Update completed successfully. [2025-09-05T18:04:55.665298] [INFO ] [MAIN ] Update Progress: 212/2363 symbols completed. BANC took 4.1s. Estimated remaining: 49m 21s. Rate: 43.6 symbols/min [2025-09-05T18:04:55.839554] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:55.867603] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-05T18:04:55.868238] [INFO ] [MAIN ] BAX: Loaded 25597 existing records. [2025-09-05T18:04:56.078810] [INFO ] [MAIN ] BAX: Found 1 missing trading days. [2025-09-05T18:04:56.078995] [INFO ] [MAIN ] BAX: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:56.254832] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-05T18:04:56.663466] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-05T18:04:57.463486] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-05T18:04:57.480941] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:04:57.534925] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-05T18:04:57.670205] [INFO ] [MAIN ] BAX: Adding 390 new records, updating 0 existing records. [2025-09-05T18:04:57.673995] [INFO ] [MAIN ] BAX: Combined dataset has 25987 total records. [2025-09-05T18:04:57.858217] [WARN ] [VALIDATOR ] BAX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:04:58.057660] [WARN ] [VALIDATOR ] BAX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:04:58.057902] [INFO ] [MAIN ] BAX: Combined data validation passed. [2025-09-05T18:04:58.240716] [INFO ] [MAIN ] BAX: Update completed successfully. [2025-09-05T18:04:58.245231] [INFO ] [MAIN ] Update Progress: 213/2363 symbols completed. BAX took 2.6s. Estimated remaining: 49m 32s. Rate: 43.4 symbols/min [2025-09-05T18:04:58.273698] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-05T18:04:58.450250] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:04:58.487598] [INFO ] [MAIN ] BB: Loaded 39761 existing records. [2025-09-05T18:04:58.668089] [INFO ] [MAIN ] BB: Found 1 missing trading days. [2025-09-05T18:04:58.668281] [INFO ] [MAIN ] BB: Need to fetch 1 months: 2025-09 [2025-09-05T18:04:58.683865] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-05T18:04:59.063472] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-05T18:04:59.562680] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:04:59.564370] [INFO ] [REMOTE ] AYI: Full fetch complete (27720 records). [2025-09-05T18:04:59.867008] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-05T18:04:59.932146] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-05T18:04:59.957129] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-05T18:05:00.083364] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-05T18:05:00.083541] [INFO ] [MAIN ] Update Progress: 214/2363 symbols completed. AYI took 20.5s. Estimated remaining: 49m 35s. Rate: 43.3 symbols/min [2025-09-05T18:05:00.255407] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:00.295428] [INFO ] [MAIN ] BBAI: Loaded 40560 existing records. [2025-09-05T18:05:00.477878] [INFO ] [MAIN ] BBAI: Found 1 missing trading days. [2025-09-05T18:05:00.478074] [INFO ] [MAIN ] BBAI: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:00.663471] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-05T18:05:01.338466] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-05T18:05:01.424165] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:05:01.471342] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-05T18:05:01.586837] [INFO ] [MAIN ] BBAI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:05:01.589588] [INFO ] [MAIN ] BBAI: Combined dataset has 40560 total records. [2025-09-05T18:05:01.590183] [FATAL] [VALIDATOR ] BBAI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:05:01.590272] [FATAL] [MAIN ] BBAI: Combined data validation failed. [2025-09-05T18:05:01.590311] [WARN ] [MAIN ] BBAI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:05:01.590351] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-05T18:05:01.591134] [INFO ] [LOCAL ] BBAI: Starting deletion of derivative data. [2025-09-05T18:05:01.599486] [INFO ] [MAIN ] Update Progress: 215/2363 symbols completed. BBAI took 1.5s. Estimated remaining: 49m 35s. Rate: 43.3 symbols/min [2025-09-05T18:05:01.786490] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:01.828563] [INFO ] [MAIN ] BBAR: Loaded 31056 existing records. [2025-09-05T18:05:02.021588] [INFO ] [MAIN ] BBAR: Found 1 missing trading days. [2025-09-05T18:05:02.021772] [INFO ] [MAIN ] BBAR: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:02.263460] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-05T18:05:03.063488] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-05T18:05:03.115446] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-05T18:05:03.129310] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:05:03.333620] [INFO ] [MAIN ] BB: Adding 383 new records, updating 0 existing records. [2025-09-05T18:05:03.337792] [INFO ] [MAIN ] BB: Combined dataset has 40144 total records. [2025-09-05T18:05:03.522503] [WARN ] [VALIDATOR ] BB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:05:03.725929] [WARN ] [VALIDATOR ] BB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:05:03.726180] [INFO ] [MAIN ] BB: Combined data validation passed. [2025-09-05T18:05:03.892790] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-05T18:05:03.961478] [INFO ] [MAIN ] BB: Update completed successfully. [2025-09-05T18:05:03.967220] [INFO ] [MAIN ] Update Progress: 216/2363 symbols completed. BB took 5.7s. Estimated remaining: 49m 43s. Rate: 43.2 symbols/min [2025-09-05T18:05:04.158892] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:04.186388] [INFO ] [MAIN ] BBD: Loaded 25439 existing records. [2025-09-05T18:05:04.378842] [INFO ] [MAIN ] BBD: Found 1 missing trading days. [2025-09-05T18:05:04.378984] [INFO ] [MAIN ] BBD: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:04.663479] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-05T18:05:04.746347] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-05T18:05:04.985462] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:05:05.148609] [INFO ] [MAIN ] BBD: Adding 390 new records, updating 0 existing records. [2025-09-05T18:05:05.152824] [INFO ] [MAIN ] BBD: Combined dataset has 25829 total records. [2025-09-05T18:05:05.353075] [WARN ] [VALIDATOR ] BBD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:05.464725] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-05T18:05:05.571592] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-05T18:05:05.586513] [WARN ] [VALIDATOR ] BBD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:05.586729] [INFO ] [MAIN ] BBD: Combined data validation passed. [2025-09-05T18:05:05.744585] [INFO ] [MAIN ] BBD: Update completed successfully. [2025-09-05T18:05:05.747862] [INFO ] [MAIN ] Update Progress: 217/2363 symbols completed. BBD took 1.8s. Estimated remaining: 49m 46s. Rate: 43.1 symbols/min [2025-09-05T18:05:05.924957] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:05.939372] [INFO ] [MAIN ] BBDC: Loaded 14915 existing records. [2025-09-05T18:05:06.120319] [INFO ] [MAIN ] BBDC: Found 1 missing trading days. [2025-09-05T18:05:06.120471] [INFO ] [MAIN ] BBDC: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:06.263525] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-05T18:05:06.724910] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:05:06.812857] [INFO ] [MAIN ] BBDC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:05:06.815379] [INFO ] [MAIN ] BBDC: Combined dataset has 14915 total records. [2025-09-05T18:05:06.815870] [FATAL] [VALIDATOR ] BBDC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:05:06.815966] [FATAL] [MAIN ] BBDC: Combined data validation failed. [2025-09-05T18:05:06.816005] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:05:06.816055] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-05T18:05:06.816473] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-09-05T18:05:06.818406] [INFO ] [MAIN ] Update Progress: 218/2363 symbols completed. BBDC took 1.1s. Estimated remaining: 49m 41s. Rate: 43.2 symbols/min [2025-09-05T18:05:07.002691] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:07.006554] [INFO ] [MAIN ] BBDO: Loaded 2132 existing records. [2025-09-05T18:05:07.067953] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-05T18:05:07.196022] [INFO ] [MAIN ] BBDO: Found 1 missing trading days. [2025-09-05T18:05:07.196264] [INFO ] [MAIN ] BBDO: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:07.221843] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-05T18:05:07.800748] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:05:07.868602] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-05T18:05:07.929238] [INFO ] [MAIN ] BBAR: Adding 346 new records, updating 0 existing records. [2025-09-05T18:05:07.934239] [INFO ] [MAIN ] BBAR: Combined dataset has 31402 total records. [2025-09-05T18:05:08.120741] [WARN ] [VALIDATOR ] BBAR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:05:08.319985] [WARN ] [VALIDATOR ] BBAR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:05:08.320213] [INFO ] [MAIN ] BBAR: Combined data validation passed. [2025-09-05T18:05:08.517200] [INFO ] [MAIN ] BBAR: Update completed successfully. [2025-09-05T18:05:08.521028] [INFO ] [MAIN ] Update Progress: 219/2363 symbols completed. BBAR took 6.9s. Estimated remaining: 49m 43s. Rate: 43.1 symbols/min [2025-09-05T18:05:08.668608] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-05T18:05:08.702473] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:08.720735] [INFO ] [MAIN ] BBN: Loaded 14015 existing records. [2025-09-05T18:05:08.893827] [INFO ] [MAIN ] BBN: Found 1 missing trading days. [2025-09-05T18:05:08.893996] [INFO ] [MAIN ] BBN: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:09.463505] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-05T18:05:09.525974] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-05T18:05:09.916245] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-05T18:05:10.053771] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:05:10.066003] [INFO ] [MAIN ] BBDO: Adding 28 new records, updating 2 existing records. [2025-09-05T18:05:10.067844] [INFO ] [MAIN ] BBDO: Combined dataset has 2160 total records. [2025-09-05T18:05:10.253952] [WARN ] [VALIDATOR ] BBDO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:10.268534] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-05T18:05:10.453371] [WARN ] [VALIDATOR ] BBDO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:10.453592] [INFO ] [MAIN ] BBDO: Combined data validation passed. [2025-09-05T18:05:10.467930] [INFO ] [MAIN ] BBDO: Update completed successfully. [2025-09-05T18:05:10.468420] [INFO ] [MAIN ] Update Progress: 220/2363 symbols completed. BBDO took 3.6s. Estimated remaining: 49m 47s. Rate: 43.0 symbols/min [2025-09-05T18:05:10.644871] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:10.647757] [INFO ] [MAIN ] BBT: Loaded 981 existing records. [2025-09-05T18:05:10.825897] [INFO ] [MAIN ] BBT: Found 4 missing trading days. [2025-09-05T18:05:10.826052] [INFO ] [MAIN ] BBT: Need to fetch 2 months: 2025-08, 2025-09 [2025-09-05T18:05:11.063684] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-05T18:05:11.289250] [WARN ] [MAIN ] BBT: Failed to fetch data for month 2025-08. [2025-09-05T18:05:11.555577] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:05:11.618204] [INFO ] [MAIN ] BBN: Adding 219 new records, updating 0 existing records. [2025-09-05T18:05:11.620619] [INFO ] [MAIN ] BBN: Combined dataset has 14234 total records. [2025-09-05T18:05:11.799878] [WARN ] [VALIDATOR ] BBN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:05:11.873742] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-05T18:05:12.006154] [WARN ] [VALIDATOR ] BBN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:05:12.006363] [INFO ] [MAIN ] BBN: Combined data validation passed. [2025-09-05T18:05:12.093062] [INFO ] [MAIN ] BBN: Update completed successfully. [2025-09-05T18:05:12.094632] [INFO ] [MAIN ] Update Progress: 221/2363 symbols completed. BBN took 3.6s. Estimated remaining: 49m 48s. Rate: 43.0 symbols/min [2025-09-05T18:05:12.264998] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:12.268833] [INFO ] [MAIN ] BBU: Loaded 2384 existing records. [2025-09-05T18:05:12.437356] [INFO ] [MAIN ] BBU: Found 1 missing trading days. [2025-09-05T18:05:12.437522] [INFO ] [MAIN ] BBU: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:12.663430] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-05T18:05:12.788472] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:05:12.886562] [INFO ] [MAIN ] BBT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:05:12.887848] [INFO ] [MAIN ] BBT: Combined dataset has 981 total records. [2025-09-05T18:05:12.888226] [FATAL] [VALIDATOR ] BBT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:05:12.888306] [FATAL] [MAIN ] BBT: Combined data validation failed. [2025-09-05T18:05:12.888346] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:05:12.888391] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-05T18:05:12.888709] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-05T18:05:12.889101] [INFO ] [MAIN ] Update Progress: 222/2363 symbols completed. BBT took 2.4s. Estimated remaining: 49m 41s. Rate: 43.1 symbols/min [2025-09-05T18:05:13.067233] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:13.074718] [INFO ] [MAIN ] BBUC: Loaded 5880 existing records. [2025-09-05T18:05:13.245389] [INFO ] [MAIN ] BBUC: Found 1 missing trading days. [2025-09-05T18:05:13.245585] [INFO ] [MAIN ] BBUC: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:13.463486] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-05T18:05:14.020067] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-05T18:05:14.263482] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-05T18:05:14.367028] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:05:14.400603] [INFO ] [MAIN ] BBUC: Adding 68 new records, updating 0 existing records. [2025-09-05T18:05:14.402223] [INFO ] [MAIN ] BBUC: Combined dataset has 5948 total records. [2025-09-05T18:05:14.578099] [WARN ] [VALIDATOR ] BBUC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:14.682535] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:05:14.720211] [INFO ] [MAIN ] BBU: Adding 50 new records, updating 0 existing records. [2025-09-05T18:05:14.778038] [INFO ] [MAIN ] BBU: Combined dataset has 2434 total records. [2025-09-05T18:05:14.959591] [WARN ] [VALIDATOR ] BBU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:15.067346] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-05T18:05:15.167823] [WARN ] [VALIDATOR ] BBUC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:15.167918] [WARN ] [VALIDATOR ] BBU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:15.168114] [INFO ] [MAIN ] BBUC: Combined data validation passed. [2025-09-05T18:05:15.168499] [INFO ] [MAIN ] BBU: Combined data validation passed. [2025-09-05T18:05:15.209661] [INFO ] [MAIN ] BBU: Update completed successfully. [2025-09-05T18:05:15.215989] [INFO ] [MAIN ] Update Progress: 223/2363 symbols completed. BBU took 3.1s. Estimated remaining: 49m 48s. Rate: 43.0 symbols/min [2025-09-05T18:05:15.224672] [INFO ] [MAIN ] BBUC: Update completed successfully. [2025-09-05T18:05:15.254240] [INFO ] [MAIN ] Update Progress: 224/2363 symbols completed. BBUC took 2.4s. Estimated remaining: 49m 34s. Rate: 43.2 symbols/min [2025-09-05T18:05:15.561879] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:15.565079] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:15.576946] [INFO ] [MAIN ] BBW: Loaded 11312 existing records. [2025-09-05T18:05:15.701455] [INFO ] [MAIN ] BBVA: Loaded 23352 existing records. [2025-09-05T18:05:15.865423] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-05T18:05:15.857370] [INFO ] [MAIN ] BBW: Found 1 missing trading days. [2025-09-05T18:05:15.868636] [INFO ] [MAIN ] BBW: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:15.943853] [INFO ] [MAIN ] BBVA: Found 1 missing trading days. [2025-09-05T18:05:15.944011] [INFO ] [MAIN ] BBVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:16.663495] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-05T18:05:16.683506] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-05T18:05:17.181935] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:05:17.269299] [INFO ] [MAIN ] BBW: Adding 232 new records, updating 0 existing records. [2025-09-05T18:05:17.271710] [INFO ] [MAIN ] BBW: Combined dataset has 11544 total records. [2025-09-05T18:05:17.459484] [WARN ] [VALIDATOR ] BBW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:17.471033] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-05T18:05:17.690997] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-05T18:05:17.703011] [WARN ] [VALIDATOR ] BBW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:17.703230] [INFO ] [MAIN ] BBW: Combined data validation passed. [2025-09-05T18:05:17.776584] [INFO ] [MAIN ] BBW: Update completed successfully. [2025-09-05T18:05:17.778061] [INFO ] [MAIN ] Update Progress: 225/2363 symbols completed. BBW took 2.5s. Estimated remaining: 49m 43s. Rate: 43.0 symbols/min [2025-09-05T18:05:17.929166] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:05:17.987980] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:18.106976] [INFO ] [MAIN ] BBVA: Adding 365 new records, updating 0 existing records. [2025-09-05T18:05:18.110371] [INFO ] [MAIN ] BBVA: Combined dataset has 23717 total records. [2025-09-05T18:05:18.226430] [INFO ] [MAIN ] BBWI: Loaded 25602 existing records. [2025-09-05T18:05:18.264695] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-05T18:05:18.418665] [WARN ] [VALIDATOR ] BBVA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:18.614427] [INFO ] [MAIN ] BBWI: Found 1 missing trading days. [2025-09-05T18:05:18.620353] [INFO ] [MAIN ] BBWI: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:18.707019] [WARN ] [VALIDATOR ] BBVA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:18.707259] [INFO ] [MAIN ] BBVA: Combined data validation passed. [2025-09-05T18:05:18.854969] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:05:18.867717] [INFO ] [REMOTE ] BAP: Full fetch complete (28442 records). [2025-09-05T18:05:18.902707] [INFO ] [MAIN ] BBVA: Update completed successfully. [2025-09-05T18:05:18.951113] [INFO ] [MAIN ] Update Progress: 226/2363 symbols completed. BBVA took 3.7s. Estimated remaining: 49m 40s. Rate: 43.0 symbols/min [2025-09-05T18:05:19.070962] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-05T18:05:19.385370] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:19.431080] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-05T18:05:19.557233] [INFO ] [MAIN ] BBY: Loaded 40265 existing records. [2025-09-05T18:05:19.765701] [INFO ] [MAIN ] BBY: Found 1 missing trading days. [2025-09-05T18:05:19.766856] [INFO ] [MAIN ] BBY: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:19.781284] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-05T18:05:19.781445] [INFO ] [MAIN ] Update Progress: 227/2363 symbols completed. BAP took 27.4s. Estimated remaining: 49m 33s. Rate: 43.1 symbols/min [2025-09-05T18:05:19.871318] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-05T18:05:19.952670] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:19.972599] [INFO ] [MAIN ] BC: Loaded 20778 existing records. [2025-09-05T18:05:20.145419] [INFO ] [MAIN ] BC: Found 1 missing trading days. [2025-09-05T18:05:20.145574] [INFO ] [MAIN ] BC: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:20.663503] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-05T18:05:20.821174] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-05T18:05:20.855350] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:05:21.001208] [INFO ] [MAIN ] BBWI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:05:21.004566] [INFO ] [MAIN ] BBWI: Combined dataset has 25992 total records. [2025-09-05T18:05:21.181790] [WARN ] [VALIDATOR ] BBWI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:21.371800] [WARN ] [VALIDATOR ] BBWI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:21.372016] [INFO ] [MAIN ] BBWI: Combined data validation passed. [2025-09-05T18:05:21.474115] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-05T18:05:21.473628] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:05:21.673811] [INFO ] [MAIN ] BC: Adding 294 new records, updating 0 existing records. [2025-09-05T18:05:21.709774] [INFO ] [MAIN ] BC: Combined dataset has 21072 total records. [2025-09-05T18:05:21.721374] [INFO ] [MAIN ] BBWI: Update completed successfully. [2025-09-05T18:05:21.764003] [INFO ] [MAIN ] Update Progress: 228/2363 symbols completed. BBWI took 4.0s. Estimated remaining: 49m 37s. Rate: 43.0 symbols/min [2025-09-05T18:05:22.027202] [WARN ] [VALIDATOR ] BC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:22.160077] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:22.263693] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-05T18:05:22.298141] [INFO ] [MAIN ] BCAT: Loaded 25688 existing records. [2025-09-05T18:05:22.484399] [INFO ] [MAIN ] BCAT: Found 1 missing trading days. [2025-09-05T18:05:22.484789] [INFO ] [MAIN ] BCAT: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:22.494524] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:05:22.673231] [INFO ] [MAIN ] BBY: Adding 386 new records, updating 0 existing records. [2025-09-05T18:05:22.678125] [WARN ] [VALIDATOR ] BC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:22.678337] [INFO ] [MAIN ] BC: Combined data validation passed. [2025-09-05T18:05:22.679670] [INFO ] [MAIN ] BBY: Combined dataset has 40651 total records. [2025-09-05T18:05:22.994895] [WARN ] [VALIDATOR ] BBY: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:05:23.069262] [INFO ] [MAIN ] BC: Update completed successfully. [2025-09-05T18:05:23.069085] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-05T18:05:23.077010] [INFO ] [MAIN ] Update Progress: 229/2363 symbols completed. BC took 3.3s. Estimated remaining: 49m 35s. Rate: 43.0 symbols/min [2025-09-05T18:05:23.380267] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:23.397915] [INFO ] [MAIN ] BCC: Loaded 13578 existing records. [2025-09-05T18:05:23.590516] [INFO ] [MAIN ] BCC: Found 1 missing trading days. [2025-09-05T18:05:23.591587] [INFO ] [MAIN ] BCC: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:23.594632] [WARN ] [VALIDATOR ] BBY: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:05:23.594839] [INFO ] [MAIN ] BBY: Combined data validation passed. [2025-09-05T18:05:23.713819] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-05T18:05:23.863528] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-05T18:05:23.882656] [INFO ] [MAIN ] BBY: Update completed successfully. [2025-09-05T18:05:23.888315] [INFO ] [MAIN ] Update Progress: 230/2363 symbols completed. BBY took 4.9s. Estimated remaining: 49m 28s. Rate: 43.1 symbols/min [2025-09-05T18:05:24.058702] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:24.082099] [INFO ] [MAIN ] BCE: Loaded 24960 existing records. [2025-09-05T18:05:24.260096] [INFO ] [MAIN ] BCE: Found 1 missing trading days. [2025-09-05T18:05:24.260277] [INFO ] [MAIN ] BCE: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:24.352609] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:05:24.354871] [INFO ] [REMOTE ] BARK: Full fetch complete (42470 records). [2025-09-05T18:05:24.606755] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:05:24.669783] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-05T18:05:24.821377] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-05T18:05:24.838508] [INFO ] [MAIN ] BCAT: Adding 243 new records, updating 0 existing records. [2025-09-05T18:05:24.842292] [INFO ] [MAIN ] BCAT: Combined dataset has 25931 total records. [2025-09-05T18:05:25.107507] [WARN ] [VALIDATOR ] BCAT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:05:25.338073] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:05:25.424855] [INFO ] [MAIN ] BCC: Adding 204 new records, updating 0 existing records. [2025-09-05T18:05:25.435863] [INFO ] [MAIN ] BCC: Combined dataset has 13782 total records. [2025-09-05T18:05:25.489348] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-05T18:05:25.631671] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-05T18:05:25.652479] [INFO ] [MAIN ] Update Progress: 231/2363 symbols completed. BARK took 32.0s. Estimated remaining: 49m 30s. Rate: 43.1 symbols/min [2025-09-05T18:05:25.706385] [WARN ] [VALIDATOR ] BCC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:26.017975] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:26.092627] [WARN ] [VALIDATOR ] BCAT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:05:26.093341] [INFO ] [MAIN ] BCAT: Combined data validation passed. [2025-09-05T18:05:26.193400] [INFO ] [MAIN ] BCH: Loaded 13580 existing records. [2025-09-05T18:05:26.241522] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:05:26.528851] [INFO ] [MAIN ] BCH: Found 1 missing trading days. [2025-09-05T18:05:26.540242] [INFO ] [MAIN ] BCE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:05:26.536453] [INFO ] [MAIN ] BCH: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:26.541073] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-05T18:05:26.552625] [INFO ] [MAIN ] BCE: Combined dataset has 24960 total records. [2025-09-05T18:05:26.557041] [FATAL] [VALIDATOR ] BCE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:05:26.561872] [FATAL] [MAIN ] BCE: Combined data validation failed. [2025-09-05T18:05:26.587356] [WARN ] [MAIN ] BCE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:05:26.588527] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-05T18:05:26.593287] [INFO ] [LOCAL ] BCE: Starting deletion of derivative data. [2025-09-05T18:05:26.598081] [INFO ] [MAIN ] BCAT: Update completed successfully. [2025-09-05T18:05:26.600921] [WARN ] [VALIDATOR ] BCC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:26.600691] [INFO ] [MAIN ] Update Progress: 232/2363 symbols completed. BCE took 2.7s. Estimated remaining: 49m 25s. Rate: 43.1 symbols/min [2025-09-05T18:05:26.604214] [INFO ] [MAIN ] BCC: Combined data validation passed. [2025-09-05T18:05:26.604698] [INFO ] [MAIN ] Update Progress: 233/2363 symbols completed. BCAT took 4.8s. Estimated remaining: 49m 11s. Rate: 43.3 symbols/min [2025-09-05T18:05:27.034434] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:27.037512] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:27.073183] [INFO ] [MAIN ] BCO: Loaded 12168 existing records. [2025-09-05T18:05:27.087635] [INFO ] [MAIN ] BCC: Update completed successfully. [2025-09-05T18:05:27.162050] [INFO ] [MAIN ] Update Progress: 234/2363 symbols completed. BCC took 4.0s. Estimated remaining: 49m 2s. Rate: 43.4 symbols/min [2025-09-05T18:05:27.167951] [INFO ] [MAIN ] BCS: Loaded 25535 existing records. [2025-09-05T18:05:27.452797] [INFO ] [MAIN ] BCO: Found 1 missing trading days. [2025-09-05T18:05:27.467570] [INFO ] [MAIN ] BCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:27.473228] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-05T18:05:27.644316] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:27.642876] [INFO ] [MAIN ] BCS: Found 1 missing trading days. [2025-09-05T18:05:27.644503] [INFO ] [MAIN ] BCS: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:27.649773] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:05:27.719540] [INFO ] [MAIN ] BCH: Adding 212 new records, updating 0 existing records. [2025-09-05T18:05:27.724805] [INFO ] [MAIN ] BCSF: Loaded 12507 existing records. [2025-09-05T18:05:27.847173] [INFO ] [MAIN ] BCH: Combined dataset has 13792 total records. [2025-09-05T18:05:27.877621] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-05T18:05:27.904947] [INFO ] [MAIN ] BCSF: Found 1 missing trading days. [2025-09-05T18:05:27.947054] [INFO ] [MAIN ] BCSF: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:28.106572] [WARN ] [VALIDATOR ] BCH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:28.221163] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:05:28.365376] [INFO ] [MAIN ] BCO: Adding 176 new records, updating 0 existing records. [2025-09-05T18:05:28.368805] [INFO ] [MAIN ] BCO: Combined dataset has 12344 total records. [2025-09-05T18:05:28.548155] [WARN ] [VALIDATOR ] BCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:28.664094] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-05T18:05:28.750631] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:05:28.903827] [INFO ] [MAIN ] BCS: Adding 389 new records, updating 0 existing records. [2025-09-05T18:05:28.910347] [INFO ] [MAIN ] BCS: Combined dataset has 25924 total records. [2025-09-05T18:05:28.998587] [WARN ] [VALIDATOR ] BCH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:28.998680] [WARN ] [VALIDATOR ] BCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:29.009354] [INFO ] [MAIN ] BCO: Combined data validation passed. [2025-09-05T18:05:29.009477] [INFO ] [MAIN ] BCH: Combined data validation passed. [2025-09-05T18:05:29.225463] [WARN ] [VALIDATOR ] BCS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:29.284993] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:05:29.307486] [INFO ] [MAIN ] BCH: Update completed successfully. [2025-09-05T18:05:29.346815] [INFO ] [MAIN ] Update Progress: 235/2363 symbols completed. BCH took 3.6s. Estimated remaining: 49m 8s. Rate: 43.3 symbols/min [2025-09-05T18:05:29.525706] [INFO ] [MAIN ] BCSF: Adding 152 new records, updating 0 existing records. [2025-09-05T18:05:29.626789] [INFO ] [MAIN ] BCO: Update completed successfully. [2025-09-05T18:05:29.641480] [INFO ] [MAIN ] Update Progress: 236/2363 symbols completed. BCO took 3.0s. Estimated remaining: 48m 57s. Rate: 43.5 symbols/min [2025-09-05T18:05:29.699562] [INFO ] [MAIN ] BCSF: Combined dataset has 12659 total records. [2025-09-05T18:05:29.833893] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:30.042630] [INFO ] [MAIN ] BCX: Loaded 10467 existing records. [2025-09-05T18:05:30.043971] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:30.156525] [WARN ] [VALIDATOR ] BCSF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:30.313698] [INFO ] [MAIN ] BDC: Loaded 11725 existing records. [2025-09-05T18:05:30.411699] [INFO ] [MAIN ] BCX: Found 1 missing trading days. [2025-09-05T18:05:30.441826] [INFO ] [MAIN ] BCX: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:30.481986] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-05T18:05:30.672922] [INFO ] [MAIN ] BDC: Found 1 missing trading days. [2025-09-05T18:05:30.673409] [INFO ] [MAIN ] BDC: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:30.673762] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-05T18:05:30.680528] [WARN ] [VALIDATOR ] BCS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:30.680912] [INFO ] [MAIN ] BCS: Combined data validation passed. [2025-09-05T18:05:30.808922] [WARN ] [VALIDATOR ] BCSF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:30.812494] [INFO ] [MAIN ] BCSF: Combined data validation passed. [2025-09-05T18:05:30.903606] [INFO ] [MAIN ] BCS: Update completed successfully. [2025-09-05T18:05:30.914809] [INFO ] [MAIN ] Update Progress: 237/2363 symbols completed. BCS took 4.3s. Estimated remaining: 48m 54s. Rate: 43.5 symbols/min [2025-09-05T18:05:30.928329] [INFO ] [MAIN ] BCSF: Update completed successfully. [2025-09-05T18:05:30.929705] [INFO ] [MAIN ] Update Progress: 238/2363 symbols completed. BCSF took 3.7s. Estimated remaining: 48m 41s. Rate: 43.7 symbols/min [2025-09-05T18:05:31.137988] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:05:31.203201] [INFO ] [MAIN ] BDC: Adding 159 new records, updating 0 existing records. [2025-09-05T18:05:31.205658] [INFO ] [MAIN ] BDC: Combined dataset has 11884 total records. [2025-09-05T18:05:31.383343] [WARN ] [VALIDATOR ] BDC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:31.505480] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:05:31.622636] [INFO ] [MAIN ] BCX: Adding 99 new records, updating 0 existing records. [2025-09-05T18:05:31.629874] [INFO ] [MAIN ] BCX: Combined dataset has 10566 total records. [2025-09-05T18:05:31.818472] [WARN ] [VALIDATOR ] BCX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:32.012320] [WARN ] [VALIDATOR ] BDC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:32.016052] [INFO ] [MAIN ] BDC: Combined data validation passed. [2025-09-05T18:05:32.015949] [WARN ] [VALIDATOR ] BCX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:32.016386] [INFO ] [MAIN ] BCX: Combined data validation passed. [2025-09-05T18:05:32.149275] [INFO ] [MAIN ] BDC: Update completed successfully. [2025-09-05T18:05:32.151234] [INFO ] [MAIN ] Update Progress: 239/2363 symbols completed. BDC took 2.5s. Estimated remaining: 48m 38s. Rate: 43.7 symbols/min [2025-09-05T18:05:32.158666] [INFO ] [MAIN ] BCX: Update completed successfully. [2025-09-05T18:05:32.159800] [INFO ] [MAIN ] Update Progress: 240/2363 symbols completed. BCX took 2.8s. Estimated remaining: 48m 24s. Rate: 43.9 symbols/min [2025-09-05T18:05:32.734530] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:32.826425] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:32.908977] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:32.905680] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:32.907323] [WARN ] [MAIN ] BDJ: No existing data found, performing full refresh instead. [2025-09-05T18:05:32.909415] [WARN ] [MAIN ] BDX: No existing data found, performing full refresh instead. [2025-09-05T18:05:32.910253] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-05T18:05:32.910162] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-05T18:05:32.910813] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-05T18:05:32.910880] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-05T18:05:32.911194] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-05T18:05:32.911268] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-05T18:05:33.197043] [INFO ] [MAIN ] BDN: Loaded 22657 existing records. [2025-09-05T18:05:33.410401] [INFO ] [MAIN ] BE: Loaded 25661 existing records. [2025-09-05T18:05:33.874336] [INFO ] [REMOTE ] BDX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:05:33.940287] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-05T18:05:34.042493] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:05:34.056604] [INFO ] [MAIN ] BE: Found 1 missing trading days. [2025-09-05T18:05:34.082438] [INFO ] [MAIN ] BDN: Found 1 missing trading days. [2025-09-05T18:05:34.081254] [INFO ] [MAIN ] BE: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:34.081161] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-05T18:05:34.082606] [INFO ] [MAIN ] BDN: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:34.083135] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-05T18:05:34.084430] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-05T18:05:34.579126] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:05:34.731893] [INFO ] [MAIN ] BDN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:05:34.733760] [INFO ] [MAIN ] BDN: Combined dataset has 22657 total records. [2025-09-05T18:05:34.734231] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:05:34.734315] [FATAL] [MAIN ] BDN: Combined data validation failed. [2025-09-05T18:05:34.734352] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:05:34.734392] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-05T18:05:34.734904] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-09-05T18:05:34.737444] [INFO ] [MAIN ] Update Progress: 241/2363 symbols completed. BDN took 2.6s. Estimated remaining: 48m 34s. Rate: 43.7 symbols/min [2025-09-05T18:05:34.915361] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:34.924356] [INFO ] [MAIN ] BEDU: Loaded 197 existing records. [2025-09-05T18:05:34.994696] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:05:35.212284] [INFO ] [MAIN ] BEDU: Found 1 missing trading days. [2025-09-05T18:05:35.222675] [INFO ] [MAIN ] BEDU: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:35.228118] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-05T18:05:35.259504] [INFO ] [MAIN ] BE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:05:35.263154] [INFO ] [MAIN ] BE: Combined dataset has 26051 total records. [2025-09-05T18:05:35.445377] [WARN ] [VALIDATOR ] BE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:35.651591] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-05T18:05:35.658620] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-05T18:05:35.667799] [WARN ] [VALIDATOR ] BE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:35.668031] [INFO ] [MAIN ] BE: Combined data validation passed. [2025-09-05T18:05:35.758937] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:05:35.762253] [INFO ] [MAIN ] BEDU: Adding 1 new records, updating 0 existing records. [2025-09-05T18:05:35.764443] [INFO ] [MAIN ] BEDU: Combined dataset has 198 total records. [2025-09-05T18:05:36.008923] [WARN ] [VALIDATOR ] BEDU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:36.208604] [INFO ] [MAIN ] BE: Update completed successfully. [2025-09-05T18:05:36.211986] [INFO ] [MAIN ] Update Progress: 242/2363 symbols completed. BE took 4.1s. Estimated remaining: 48m 33s. Rate: 43.7 symbols/min [2025-09-05T18:05:36.397562] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:36.408857] [WARN ] [MAIN ] BEKE: No existing data found, performing full refresh instead. [2025-09-05T18:05:36.414289] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-05T18:05:36.420114] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-05T18:05:36.436835] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-05T18:05:36.484946] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-05T18:05:36.533283] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-05T18:05:36.813958] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:05:36.814370] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-05T18:05:36.820950] [WARN ] [VALIDATOR ] BEDU: Missing days changed. Total missing: 98 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-07-01, 2025-07-08, 2025-07-24, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-12, 2025-08-13, 2025-08-15, 2025-08-20 [2025-09-05T18:05:36.821178] [INFO ] [MAIN ] BEDU: Combined data validation passed. [2025-09-05T18:05:36.824002] [INFO ] [MAIN ] BEDU: Update completed successfully. [2025-09-05T18:05:36.824230] [INFO ] [MAIN ] Update Progress: 243/2363 symbols completed. BEDU took 2.1s. Estimated remaining: 48m 25s. Rate: 43.8 symbols/min [2025-09-05T18:05:37.001236] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:37.028203] [INFO ] [MAIN ] BEN: Loaded 25286 existing records. [2025-09-05T18:05:37.215760] [INFO ] [MAIN ] BEN: Found 1 missing trading days. [2025-09-05T18:05:37.216006] [INFO ] [MAIN ] BEN: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:37.241167] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-05T18:05:37.463468] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-05T18:05:38.261378] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-05T18:05:38.270665] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-05T18:05:38.702004] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-05T18:05:38.831546] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:05:38.966631] [INFO ] [MAIN ] BEN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:05:38.969393] [INFO ] [MAIN ] BEN: Combined dataset has 25286 total records. [2025-09-05T18:05:38.988031] [FATAL] [VALIDATOR ] BEN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:05:38.989615] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-05T18:05:38.989750] [FATAL] [MAIN ] BEN: Combined data validation failed. [2025-09-05T18:05:38.995844] [WARN ] [MAIN ] BEN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:05:38.996864] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-05T18:05:38.997507] [INFO ] [LOCAL ] BEN: Starting deletion of derivative data. [2025-09-05T18:05:39.000456] [INFO ] [MAIN ] Update Progress: 244/2363 symbols completed. BEN took 2.2s. Estimated remaining: 48m 31s. Rate: 43.7 symbols/min [2025-09-05T18:05:39.068743] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-05T18:05:39.183221] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:39.202978] [INFO ] [MAIN ] BEP: Loaded 18120 existing records. [2025-09-05T18:05:39.382937] [INFO ] [MAIN ] BEP: Found 1 missing trading days. [2025-09-05T18:05:39.383087] [INFO ] [MAIN ] BEP: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:39.863522] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-05T18:05:40.663498] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-05T18:05:41.174155] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-05T18:05:41.469173] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-05T18:05:41.472751] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-05T18:05:41.753029] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-05T18:05:42.069479] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:05:42.169672] [INFO ] [MAIN ] BEP: Adding 213 new records, updating 0 existing records. [2025-09-05T18:05:42.172627] [INFO ] [MAIN ] BEP: Combined dataset has 18333 total records. [2025-09-05T18:05:42.270018] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-05T18:05:42.355391] [WARN ] [VALIDATOR ] BEP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:42.547143] [WARN ] [VALIDATOR ] BEP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:42.547371] [INFO ] [MAIN ] BEP: Combined data validation passed. [2025-09-05T18:05:42.664295] [INFO ] [MAIN ] BEP: Update completed successfully. [2025-09-05T18:05:42.666588] [INFO ] [MAIN ] Update Progress: 245/2363 symbols completed. BEP took 3.7s. Estimated remaining: 48m 49s. Rate: 43.4 symbols/min [2025-09-05T18:05:42.856447] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:42.894956] [INFO ] [MAIN ] BEPC: Loaded 34665 existing records. [2025-09-05T18:05:43.082526] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-05T18:05:43.095781] [INFO ] [MAIN ] BEPC: Found 1 missing trading days. [2025-09-05T18:05:43.097236] [INFO ] [MAIN ] BEPC: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:43.863471] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-05T18:05:44.192832] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-05T18:05:44.663493] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-05T18:05:44.800776] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-05T18:05:45.031917] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-05T18:05:45.273706] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:05:45.429328] [INFO ] [MAIN ] BEPC: Adding 371 new records, updating 0 existing records. [2025-09-05T18:05:45.434750] [INFO ] [MAIN ] BEPC: Combined dataset has 35036 total records. [2025-09-05T18:05:45.468601] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-05T18:05:45.615993] [WARN ] [VALIDATOR ] BEPC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:05:45.828021] [WARN ] [VALIDATOR ] BEPC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:05:45.828276] [INFO ] [MAIN ] BEPC: Combined data validation passed. [2025-09-05T18:05:46.053101] [INFO ] [MAIN ] BEPC: Update completed successfully. [2025-09-05T18:05:46.057626] [INFO ] [MAIN ] Update Progress: 246/2363 symbols completed. BEPC took 3.4s. Estimated remaining: 49m 5s. Rate: 43.1 symbols/min [2025-09-05T18:05:46.250232] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:46.255336] [INFO ] [MAIN ] BEPH: Loaded 2340 existing records. [2025-09-05T18:05:46.268884] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-05T18:05:46.443798] [INFO ] [MAIN ] BEPH: Found 1 missing trading days. [2025-09-05T18:05:46.443936] [INFO ] [MAIN ] BEPH: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:46.801350] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-05T18:05:47.063502] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-05T18:05:47.523321] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:05:47.537111] [INFO ] [MAIN ] BEPH: Adding 29 new records, updating 0 existing records. [2025-09-05T18:05:47.538568] [INFO ] [MAIN ] BEPH: Combined dataset has 2369 total records. [2025-09-05T18:05:47.714490] [WARN ] [VALIDATOR ] BEPH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:47.873587] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-05T18:05:47.916767] [WARN ] [VALIDATOR ] BEPH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:47.917028] [INFO ] [MAIN ] BEPH: Combined data validation passed. [2025-09-05T18:05:47.933919] [INFO ] [MAIN ] BEPH: Update completed successfully. [2025-09-05T18:05:47.934494] [INFO ] [MAIN ] Update Progress: 247/2363 symbols completed. BEPH took 1.9s. Estimated remaining: 49m 8s. Rate: 43.1 symbols/min [2025-09-05T18:05:48.115545] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:48.115784] [WARN ] [MAIN ] BEPI: No existing data found, performing full refresh instead. [2025-09-05T18:05:48.115962] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-05T18:05:48.116034] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-05T18:05:48.116102] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-05T18:05:48.492010] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:05:48.525604] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-05T18:05:48.663486] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-05T18:05:49.424160] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-05T18:05:49.463471] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-05T18:05:49.964178] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-05T18:05:50.263463] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-05T18:05:50.421293] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-05T18:05:51.063485] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-05T18:05:51.112493] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-05T18:05:51.863540] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-05T18:05:52.663509] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-05T18:05:53.138892] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-05T18:05:53.463550] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-05T18:05:53.796030] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:05:53.798379] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-05T18:05:53.812387] [INFO ] [REMOTE ] BDJ: Full fetch complete (32111 records). [2025-09-05T18:05:54.205670] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-05T18:05:54.205519] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-05T18:05:54.274019] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-05T18:05:54.357384] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-05T18:05:54.357524] [INFO ] [MAIN ] Update Progress: 248/2363 symbols completed. BDJ took 22.2s. Estimated remaining: 49m 49s. Rate: 42.4 symbols/min [2025-09-05T18:05:54.527190] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:54.530744] [INFO ] [MAIN ] BEPJ: Loaded 2006 existing records. [2025-09-05T18:05:54.699268] [INFO ] [MAIN ] BEPJ: Found 1 missing trading days. [2025-09-05T18:05:54.699456] [INFO ] [MAIN ] BEPJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:55.063488] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-05T18:05:55.358615] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-05T18:05:55.799919] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-05T18:05:55.863478] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-05T18:05:56.283875] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-05T18:05:56.663529] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-05T18:05:57.405236] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:05:57.412962] [INFO ] [MAIN ] BEPJ: Adding 15 new records, updating 0 existing records. [2025-09-05T18:05:57.414262] [INFO ] [MAIN ] BEPJ: Combined dataset has 2021 total records. [2025-09-05T18:05:57.463457] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-05T18:05:57.596853] [WARN ] [VALIDATOR ] BEPJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:05:57.785320] [WARN ] [VALIDATOR ] BEPJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:05:57.785548] [INFO ] [MAIN ] BEPJ: Combined data validation passed. [2025-09-05T18:05:57.798922] [INFO ] [MAIN ] BEPJ: Update completed successfully. [2025-09-05T18:05:57.799283] [INFO ] [MAIN ] Update Progress: 249/2363 symbols completed. BEPJ took 3.4s. Estimated remaining: 50m 5s. Rate: 42.2 symbols/min [2025-09-05T18:05:57.972532] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:05:57.989382] [INFO ] [MAIN ] BFAM: Loaded 16206 existing records. [2025-09-05T18:05:58.167584] [INFO ] [MAIN ] BFAM: Found 1 missing trading days. [2025-09-05T18:05:58.167842] [INFO ] [MAIN ] BFAM: Need to fetch 1 months: 2025-09 [2025-09-05T18:05:58.172540] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-05T18:05:58.263473] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-05T18:05:59.063484] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-05T18:05:59.543493] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-05T18:05:59.647665] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:05:59.650504] [INFO ] [REMOTE ] BDX: Full fetch complete (56992 records). [2025-09-05T18:05:59.868585] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-05T18:06:00.030783] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-05T18:06:00.307454] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-05T18:06:00.307616] [INFO ] [MAIN ] Update Progress: 250/2363 symbols completed. BDX took 28.1s. Estimated remaining: 50m 13s. Rate: 42.1 symbols/min [2025-09-05T18:06:00.500939] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:00.510253] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:06:00.648985] [INFO ] [MAIN ] BFAM: Adding 196 new records, updating 0 existing records. [2025-09-05T18:06:00.664775] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-05T18:06:00.670957] [INFO ] [MAIN ] BFH: Loaded 31380 existing records. [2025-09-05T18:06:00.719449] [INFO ] [MAIN ] BFAM: Combined dataset has 16402 total records. [2025-09-05T18:06:01.185974] [INFO ] [MAIN ] BFH: Found 1 missing trading days. [2025-09-05T18:06:01.198235] [INFO ] [MAIN ] BFH: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:01.231923] [WARN ] [VALIDATOR ] BFAM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:01.467197] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-05T18:06:01.467407] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-05T18:06:01.481880] [WARN ] [VALIDATOR ] BFAM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:01.482390] [INFO ] [MAIN ] BFAM: Combined data validation passed. [2025-09-05T18:06:01.615495] [INFO ] [MAIN ] BFAM: Update completed successfully. [2025-09-05T18:06:01.617717] [INFO ] [MAIN ] Update Progress: 251/2363 symbols completed. BFAM took 3.8s. Estimated remaining: 50m 11s. Rate: 42.1 symbols/min [2025-09-05T18:06:01.807731] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:01.819630] [INFO ] [MAIN ] BFK: Loaded 10448 existing records. [2025-09-05T18:06:02.003436] [INFO ] [MAIN ] BFK: Found 1 missing trading days. [2025-09-05T18:06:02.003624] [INFO ] [MAIN ] BFK: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:02.263482] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-05T18:06:02.744149] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-05T18:06:03.063466] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-05T18:06:03.564167] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:06:03.567285] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-05T18:06:03.568681] [INFO ] [REMOTE ] BEPI: Full fetch complete (3797 records). [2025-09-05T18:06:03.864329] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-05T18:06:03.945585] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-05T18:06:03.965136] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-05T18:06:03.965326] [INFO ] [MAIN ] Update Progress: 252/2363 symbols completed. BEPI took 16.0s. Estimated remaining: 50m 17s. Rate: 42.0 symbols/min [2025-09-05T18:06:04.191062] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:04.191434] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-09-05T18:06:04.191602] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-05T18:06:04.191665] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-05T18:06:04.191720] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-05T18:06:04.556493] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:06:04.559718] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:06:04.663150] [INFO ] [MAIN ] BFH: Adding 225 new records, updating 0 existing records. [2025-09-05T18:06:04.663602] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-05T18:06:04.667525] [INFO ] [MAIN ] BFH: Combined dataset has 31605 total records. [2025-09-05T18:06:04.843953] [WARN ] [VALIDATOR ] BFH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:06:05.042893] [WARN ] [VALIDATOR ] BFH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:06:05.043120] [INFO ] [MAIN ] BFH: Combined data validation passed. [2025-09-05T18:06:05.234158] [INFO ] [MAIN ] BFH: Update completed successfully. [2025-09-05T18:06:05.238051] [INFO ] [MAIN ] Update Progress: 253/2363 symbols completed. BFH took 4.9s. Estimated remaining: 50m 14s. Rate: 42.0 symbols/min [2025-09-05T18:06:05.406106] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:05.412288] [INFO ] [MAIN ] BFS: Loaded 4546 existing records. [2025-09-05T18:06:05.474578] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-05T18:06:05.583903] [INFO ] [MAIN ] BFS: Found 1 missing trading days. [2025-09-05T18:06:05.584010] [INFO ] [MAIN ] BFS: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:06.263494] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-05T18:06:06.467508] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:06:06.539701] [INFO ] [MAIN ] BFK: Adding 199 new records, updating 0 existing records. [2025-09-05T18:06:06.542231] [INFO ] [MAIN ] BFK: Combined dataset has 10647 total records. [2025-09-05T18:06:06.731172] [WARN ] [VALIDATOR ] BFK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:06:06.956347] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-05T18:06:06.975755] [WARN ] [VALIDATOR ] BFK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:06:06.975996] [INFO ] [MAIN ] BFK: Combined data validation passed. [2025-09-05T18:06:07.039316] [INFO ] [MAIN ] BFK: Update completed successfully. [2025-09-05T18:06:07.040761] [INFO ] [MAIN ] Update Progress: 254/2363 symbols completed. BFK took 5.4s. Estimated remaining: 50m 16s. Rate: 42.0 symbols/min [2025-09-05T18:06:07.073017] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-05T18:06:07.218691] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:07.226274] [INFO ] [MAIN ] BFZ: Loaded 5940 existing records. [2025-09-05T18:06:07.398240] [INFO ] [MAIN ] BFZ: Found 1 missing trading days. [2025-09-05T18:06:07.398457] [INFO ] [MAIN ] BFZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:07.863475] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-05T18:06:07.964051] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-05T18:06:08.005892] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:06:08.037737] [INFO ] [MAIN ] BFS: Adding 110 new records, updating 0 existing records. [2025-09-05T18:06:08.039307] [INFO ] [MAIN ] BFS: Combined dataset has 4656 total records. [2025-09-05T18:06:08.213991] [WARN ] [VALIDATOR ] BFS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:08.403358] [WARN ] [VALIDATOR ] BFS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:08.403580] [INFO ] [MAIN ] BFS: Combined data validation passed. [2025-09-05T18:06:08.432624] [INFO ] [MAIN ] BFS: Update completed successfully. [2025-09-05T18:06:08.433349] [INFO ] [MAIN ] Update Progress: 255/2363 symbols completed. BFS took 3.2s. Estimated remaining: 50m 14s. Rate: 42.0 symbols/min [2025-09-05T18:06:08.604274] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:08.627224] [INFO ] [MAIN ] BG: Loaded 24352 existing records. [2025-09-05T18:06:08.670168] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-05T18:06:08.815555] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:06:08.816762] [INFO ] [MAIN ] BG: Found 1 missing trading days. [2025-09-05T18:06:08.824125] [INFO ] [MAIN ] BG: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:08.869979] [INFO ] [MAIN ] BFZ: Adding 151 new records, updating 0 existing records. [2025-09-05T18:06:08.872459] [INFO ] [MAIN ] BFZ: Combined dataset has 6091 total records. [2025-09-05T18:06:09.056063] [WARN ] [VALIDATOR ] BFZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:09.251966] [WARN ] [VALIDATOR ] BFZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:09.252199] [INFO ] [MAIN ] BFZ: Combined data validation passed. [2025-09-05T18:06:09.291160] [INFO ] [MAIN ] BFZ: Update completed successfully. [2025-09-05T18:06:09.292077] [INFO ] [MAIN ] Update Progress: 256/2363 symbols completed. BFZ took 2.3s. Estimated remaining: 50m 8s. Rate: 42.0 symbols/min [2025-09-05T18:06:09.465040] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-05T18:06:09.466501] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:09.476761] [INFO ] [MAIN ] BGB: Loaded 7596 existing records. [2025-09-05T18:06:09.648415] [INFO ] [MAIN ] BGB: Found 1 missing trading days. [2025-09-05T18:06:09.648584] [INFO ] [MAIN ] BGB: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:10.263483] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-05T18:06:10.676165] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-05T18:06:11.039697] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:06:11.068590] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-05T18:06:11.080838] [INFO ] [MAIN ] BGB: Adding 0 new records, updating 0 existing records. [2025-09-05T18:06:11.082311] [INFO ] [MAIN ] BGB: Combined dataset has 7596 total records. [2025-09-05T18:06:11.082731] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:06:11.082793] [FATAL] [MAIN ] BGB: Combined data validation failed. [2025-09-05T18:06:11.082931] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:06:11.083031] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-05T18:06:11.083413] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-09-05T18:06:11.085124] [INFO ] [MAIN ] Update Progress: 257/2363 symbols completed. BGB took 1.8s. Estimated remaining: 50m 10s. Rate: 42.0 symbols/min [2025-09-05T18:06:11.263794] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:11.308515] [INFO ] [MAIN ] BGH: Loaded 7583 existing records. [2025-09-05T18:06:11.398182] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-05T18:06:11.501901] [INFO ] [MAIN ] BGH: Found 1 missing trading days. [2025-09-05T18:06:11.502067] [INFO ] [MAIN ] BGH: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:11.715100] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:06:11.875283] [INFO ] [MAIN ] BG: Adding 372 new records, updating 0 existing records. [2025-09-05T18:06:11.868630] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-05T18:06:11.879705] [INFO ] [MAIN ] BG: Combined dataset has 24724 total records. [2025-09-05T18:06:12.075556] [WARN ] [VALIDATOR ] BG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:12.285501] [WARN ] [VALIDATOR ] BG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:12.285784] [INFO ] [MAIN ] BG: Combined data validation passed. [2025-09-05T18:06:12.442305] [INFO ] [MAIN ] BG: Update completed successfully. [2025-09-05T18:06:12.445308] [INFO ] [MAIN ] Update Progress: 258/2363 symbols completed. BG took 4.0s. Estimated remaining: 50m 8s. Rate: 42.0 symbols/min [2025-09-05T18:06:12.615068] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:12.622679] [INFO ] [MAIN ] BGR: Loaded 6292 existing records. [2025-09-05T18:06:12.668716] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-05T18:06:12.796868] [INFO ] [MAIN ] BGR: Found 1 missing trading days. [2025-09-05T18:06:12.797025] [INFO ] [MAIN ] BGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:13.463786] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-05T18:06:14.028195] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-05T18:06:14.263485] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-05T18:06:14.346142] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-05T18:06:14.596585] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:06:14.639480] [INFO ] [MAIN ] BGH: Adding 0 new records, updating 0 existing records. [2025-09-05T18:06:14.641017] [INFO ] [MAIN ] BGH: Combined dataset has 7583 total records. [2025-09-05T18:06:14.641435] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:06:14.641517] [FATAL] [MAIN ] BGH: Combined data validation failed. [2025-09-05T18:06:14.641554] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:06:14.641592] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-05T18:06:14.641953] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-09-05T18:06:14.643341] [INFO ] [MAIN ] Update Progress: 259/2363 symbols completed. BGH took 3.6s. Estimated remaining: 50m 12s. Rate: 41.9 symbols/min [2025-09-05T18:06:14.824259] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:14.824489] [WARN ] [MAIN ] BGS: No existing data found, performing full refresh instead. [2025-09-05T18:06:14.824668] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-05T18:06:14.824715] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-05T18:06:14.824775] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-05T18:06:15.068674] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-05T18:06:15.185249] [INFO ] [REMOTE ] BGS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:06:15.756456] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:06:15.759169] [INFO ] [REMOTE ] BEKE: Full fetch complete (57566 records). [2025-09-05T18:06:15.760035] [FATAL] [VALIDATOR ] BEKE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:06:15.760123] [FATAL] [MAIN ] BEKE: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:06:15.760162] [WARN ] [MAIN ] BEKE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:06:15.760202] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-05T18:06:15.760268] [INFO ] [LOCAL ] BEKE: Starting deletion of derivative data. [2025-09-05T18:06:15.760359] [INFO ] [MAIN ] Update Progress: 260/2363 symbols completed. BEKE took 39.5s. Estimated remaining: 50m 8s. Rate: 41.9 symbols/min [2025-09-05T18:06:15.869174] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-05T18:06:15.943242] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:15.943421] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-09-05T18:06:15.943550] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-05T18:06:15.943590] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-05T18:06:15.943637] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-05T18:06:16.309052] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:06:16.341576] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-05T18:06:16.663468] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-05T18:06:17.027848] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:06:17.074284] [INFO ] [MAIN ] BGR: Adding 127 new records, updating 0 existing records. [2025-09-05T18:06:17.076262] [INFO ] [MAIN ] BGR: Combined dataset has 6419 total records. [2025-09-05T18:06:17.252351] [WARN ] [VALIDATOR ] BGR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:17.440277] [WARN ] [VALIDATOR ] BGR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:17.440483] [INFO ] [MAIN ] BGR: Combined data validation passed. [2025-09-05T18:06:17.470259] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-05T18:06:17.483203] [INFO ] [MAIN ] BGR: Update completed successfully. [2025-09-05T18:06:17.484194] [INFO ] [MAIN ] Update Progress: 261/2363 symbols completed. BGR took 5.0s. Estimated remaining: 50m 9s. Rate: 41.9 symbols/min [2025-09-05T18:06:17.655013] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:17.668250] [INFO ] [MAIN ] BGT: Loaded 12738 existing records. [2025-09-05T18:06:17.839144] [INFO ] [MAIN ] BGT: Found 1 missing trading days. [2025-09-05T18:06:17.839310] [INFO ] [MAIN ] BGT: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:17.902068] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-05T18:06:18.227011] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-05T18:06:18.263431] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-05T18:06:19.063521] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-05T18:06:19.182334] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:06:19.227427] [INFO ] [MAIN ] BGT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:06:19.228701] [INFO ] [MAIN ] BGT: Combined dataset has 12738 total records. [2025-09-05T18:06:19.229071] [FATAL] [VALIDATOR ] BGT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:06:19.229147] [FATAL] [MAIN ] BGT: Combined data validation failed. [2025-09-05T18:06:19.229183] [WARN ] [MAIN ] BGT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:06:19.229224] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-05T18:06:19.229620] [INFO ] [LOCAL ] BGT: Starting deletion of derivative data. [2025-09-05T18:06:19.230935] [INFO ] [MAIN ] Update Progress: 262/2363 symbols completed. BGT took 1.7s. Estimated remaining: 50m 10s. Rate: 41.9 symbols/min [2025-09-05T18:06:19.398664] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:19.398859] [WARN ] [MAIN ] BGX: No existing data found, performing full refresh instead. [2025-09-05T18:06:19.398984] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-05T18:06:19.399048] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-05T18:06:19.399096] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-05T18:06:19.752023] [INFO ] [REMOTE ] BGX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:06:19.863479] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-05T18:06:20.663467] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-05T18:06:20.810594] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-05T18:06:21.463480] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-05T18:06:21.606161] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-05T18:06:21.680281] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-05T18:06:22.263487] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-05T18:06:23.063515] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-05T18:06:23.107779] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-05T18:06:23.468616] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-05T18:06:23.863491] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-05T18:06:24.530563] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-05T18:06:24.663172] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-05T18:06:24.671935] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-05T18:06:25.274997] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-05T18:06:25.463517] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-05T18:06:26.263533] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-05T18:06:27.063491] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-05T18:06:27.268357] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-05T18:06:27.558526] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-05T18:06:27.863476] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-05T18:06:28.140552] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-05T18:06:28.545009] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-05T18:06:28.663523] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-05T18:06:29.061715] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-05T18:06:29.463484] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-05T18:06:30.263518] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-05T18:06:30.285189] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-05T18:06:31.010430] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:06:31.013317] [INFO ] [REMOTE ] BFLY: Full fetch complete (56678 records). [2025-09-05T18:06:31.068610] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-05T18:06:31.380125] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-05T18:06:31.608101] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-05T18:06:31.608264] [INFO ] [MAIN ] Update Progress: 263/2363 symbols completed. BFLY took 27.6s. Estimated remaining: 51m 36s. Rate: 40.7 symbols/min [2025-09-05T18:06:31.784919] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:31.796918] [INFO ] [MAIN ] BGY: Loaded 11024 existing records. [2025-09-05T18:06:31.872835] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-05T18:06:31.975658] [INFO ] [MAIN ] BGY: Found 1 missing trading days. [2025-09-05T18:06:31.975868] [INFO ] [MAIN ] BGY: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:32.153030] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-05T18:06:32.535232] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-05T18:06:32.663488] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-05T18:06:33.463484] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-05T18:06:33.612822] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:06:33.657612] [INFO ] [MAIN ] BGY: Adding 171 new records, updating 0 existing records. [2025-09-05T18:06:33.660175] [INFO ] [MAIN ] BGY: Combined dataset has 11195 total records. [2025-09-05T18:06:33.855389] [WARN ] [VALIDATOR ] BGY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:34.072081] [WARN ] [VALIDATOR ] BGY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:34.072320] [INFO ] [MAIN ] BGY: Combined data validation passed. [2025-09-05T18:06:34.138047] [INFO ] [MAIN ] BGY: Update completed successfully. [2025-09-05T18:06:34.139300] [INFO ] [MAIN ] Update Progress: 264/2363 symbols completed. BGY took 2.5s. Estimated remaining: 51m 43s. Rate: 40.6 symbols/min [2025-09-05T18:06:34.268705] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-05T18:06:34.314121] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:34.322465] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-05T18:06:34.333906] [INFO ] [MAIN ] BH: Loaded 9685 existing records. [2025-09-05T18:06:34.508624] [INFO ] [MAIN ] BH: Found 1 missing trading days. [2025-09-05T18:06:34.508801] [INFO ] [MAIN ] BH: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:35.063498] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-05T18:06:35.297364] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-05T18:06:35.863489] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-05T18:06:36.190431] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:06:36.253212] [INFO ] [MAIN ] BH: Adding 131 new records, updating 0 existing records. [2025-09-05T18:06:36.255500] [INFO ] [MAIN ] BH: Combined dataset has 9816 total records. [2025-09-05T18:06:36.460382] [WARN ] [VALIDATOR ] BH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:36.663465] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-05T18:06:36.669961] [WARN ] [VALIDATOR ] BH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:36.670157] [INFO ] [MAIN ] BH: Combined data validation passed. [2025-09-05T18:06:36.733288] [INFO ] [MAIN ] BH: Update completed successfully. [2025-09-05T18:06:36.734708] [INFO ] [MAIN ] Update Progress: 265/2363 symbols completed. BH took 2.6s. Estimated remaining: 51m 51s. Rate: 40.5 symbols/min [2025-09-05T18:06:36.957490] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:36.979128] [INFO ] [MAIN ] BHC: Loaded 22459 existing records. [2025-09-05T18:06:37.172940] [INFO ] [MAIN ] BHC: Found 1 missing trading days. [2025-09-05T18:06:37.173180] [INFO ] [MAIN ] BHC: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:37.252352] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-05T18:06:37.267534] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-05T18:06:37.463501] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-05T18:06:37.897292] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:06:37.898100] [INFO ] [REMOTE ] BGSF: Full fetch complete (5044 records). [2025-09-05T18:06:38.271722] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-05T18:06:38.293734] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-05T18:06:38.319223] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-05T18:06:38.319342] [INFO ] [MAIN ] Update Progress: 266/2363 symbols completed. BGSF took 22.6s. Estimated remaining: 51m 50s. Rate: 40.5 symbols/min [2025-09-05T18:06:38.517480] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:38.531966] [INFO ] [MAIN ] BHE: Loaded 11070 existing records. [2025-09-05T18:06:38.723006] [INFO ] [MAIN ] BHE: Found 1 missing trading days. [2025-09-05T18:06:38.723175] [INFO ] [MAIN ] BHE: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:38.874558] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-05T18:06:39.063485] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-05T18:06:39.737157] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:06:39.792071] [INFO ] [MAIN ] BHE: Adding 118 new records, updating 0 existing records. [2025-09-05T18:06:39.794600] [INFO ] [MAIN ] BHE: Combined dataset has 11188 total records. [2025-09-05T18:06:39.868595] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-05T18:06:39.988770] [WARN ] [VALIDATOR ] BHE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:40.191133] [WARN ] [VALIDATOR ] BHE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:40.191371] [INFO ] [MAIN ] BHE: Combined data validation passed. [2025-09-05T18:06:40.261141] [INFO ] [MAIN ] BHE: Update completed successfully. [2025-09-05T18:06:40.262545] [INFO ] [MAIN ] Update Progress: 267/2363 symbols completed. BHE took 1.9s. Estimated remaining: 51m 52s. Rate: 40.4 symbols/min [2025-09-05T18:06:40.436013] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:40.454518] [INFO ] [MAIN ] BHK: Loaded 17667 existing records. [2025-09-05T18:06:40.633938] [INFO ] [MAIN ] BHK: Found 1 missing trading days. [2025-09-05T18:06:40.634155] [INFO ] [MAIN ] BHK: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:40.663453] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-05T18:06:41.463473] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-05T18:06:41.811880] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:06:41.888479] [INFO ] [MAIN ] BHK: Adding 194 new records, updating 0 existing records. [2025-09-05T18:06:41.891088] [INFO ] [MAIN ] BHK: Combined dataset has 17861 total records. [2025-09-05T18:06:42.071070] [WARN ] [VALIDATOR ] BHK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:06:42.182780] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:06:42.289616] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-05T18:06:42.442436] [INFO ] [MAIN ] BHC: Adding 331 new records, updating 0 existing records. [2025-09-05T18:06:42.445613] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-05T18:06:42.461263] [INFO ] [MAIN ] BHC: Combined dataset has 22790 total records. [2025-09-05T18:06:42.659185] [WARN ] [VALIDATOR ] BHC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:42.866633] [WARN ] [VALIDATOR ] BHK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:06:42.867156] [INFO ] [MAIN ] BHK: Combined data validation passed. [2025-09-05T18:06:42.872547] [WARN ] [VALIDATOR ] BHC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:42.872730] [INFO ] [MAIN ] BHC: Combined data validation passed. [2025-09-05T18:06:43.055268] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-05T18:06:43.063818] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-05T18:06:43.115735] [INFO ] [MAIN ] BHK: Update completed successfully. [2025-09-05T18:06:43.117449] [INFO ] [MAIN ] Update Progress: 268/2363 symbols completed. BHK took 2.9s. Estimated remaining: 52m 1s. Rate: 40.3 symbols/min [2025-09-05T18:06:43.226085] [INFO ] [MAIN ] BHC: Update completed successfully. [2025-09-05T18:06:43.230802] [INFO ] [MAIN ] Update Progress: 269/2363 symbols completed. BHC took 6.5s. Estimated remaining: 51m 49s. Rate: 40.4 symbols/min [2025-09-05T18:06:43.404465] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:43.477213] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:43.501028] [INFO ] [MAIN ] BHP: Loaded 25490 existing records. [2025-09-05T18:06:43.610912] [INFO ] [MAIN ] BHR: Loaded 15777 existing records. [2025-09-05T18:06:43.828952] [INFO ] [MAIN ] BHP: Found 1 missing trading days. [2025-09-05T18:06:43.846934] [INFO ] [MAIN ] BHP: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:43.876428] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-05T18:06:43.883245] [INFO ] [MAIN ] BHR: Found 1 missing trading days. [2025-09-05T18:06:43.883437] [INFO ] [MAIN ] BHR: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:44.663455] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-05T18:06:44.691520] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:06:44.693149] [INFO ] [REMOTE ] BGX: Full fetch complete (11881 records). [2025-09-05T18:06:45.060243] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-05T18:06:45.110988] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-05T18:06:45.111200] [INFO ] [MAIN ] Update Progress: 270/2363 symbols completed. BGX took 25.9s. Estimated remaining: 51m 51s. Rate: 40.4 symbols/min [2025-09-05T18:06:45.250430] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-05T18:06:45.328924] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:45.331445] [INFO ] [MAIN ] BHV: Loaded 493 existing records. [2025-09-05T18:06:45.473724] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-05T18:06:45.504854] [INFO ] [MAIN ] BHV: Found 1 missing trading days. [2025-09-05T18:06:45.505021] [INFO ] [MAIN ] BHV: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:45.531995] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:06:45.688456] [INFO ] [MAIN ] BHP: Adding 389 new records, updating 0 existing records. [2025-09-05T18:06:45.691995] [INFO ] [MAIN ] BHP: Combined dataset has 25879 total records. [2025-09-05T18:06:45.879388] [WARN ] [VALIDATOR ] BHP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:46.001818] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:06:46.172584] [INFO ] [MAIN ] BHR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:06:46.176501] [INFO ] [MAIN ] BHR: Combined dataset has 15777 total records. [2025-09-05T18:06:46.177757] [FATAL] [VALIDATOR ] BHR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:06:46.178108] [FATAL] [MAIN ] BHR: Combined data validation failed. [2025-09-05T18:06:46.178369] [WARN ] [MAIN ] BHR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:06:46.178733] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-05T18:06:46.179301] [INFO ] [LOCAL ] BHR: Starting deletion of derivative data. [2025-09-05T18:06:46.181487] [INFO ] [MAIN ] Update Progress: 271/2363 symbols completed. BHR took 2.9s. Estimated remaining: 51m 46s. Rate: 40.4 symbols/min [2025-09-05T18:06:46.268607] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-05T18:06:46.356898] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:46.361330] [WARN ] [VALIDATOR ] BHP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:46.361539] [INFO ] [MAIN ] BHP: Combined data validation passed. [2025-09-05T18:06:46.473283] [INFO ] [MAIN ] BHVN: Loaded 23899 existing records. [2025-09-05T18:06:46.710381] [INFO ] [MAIN ] BHP: Update completed successfully. [2025-09-05T18:06:46.719496] [INFO ] [MAIN ] Update Progress: 272/2363 symbols completed. BHP took 3.6s. Estimated remaining: 51m 37s. Rate: 40.5 symbols/min [2025-09-05T18:06:46.716456] [INFO ] [MAIN ] BHVN: Found 1 missing trading days. [2025-09-05T18:06:46.763005] [INFO ] [MAIN ] BHVN: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:46.892259] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:46.917289] [INFO ] [MAIN ] BILL: Loaded 25174 existing records. [2025-09-05T18:06:47.025634] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:06:47.049100] [INFO ] [MAIN ] BHV: Adding 0 new records, updating 0 existing records. [2025-09-05T18:06:47.060356] [INFO ] [MAIN ] BHV: Combined dataset has 493 total records. [2025-09-05T18:06:47.065501] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-05T18:06:47.077680] [FATAL] [VALIDATOR ] BHV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:06:47.106485] [FATAL] [MAIN ] BHV: Combined data validation failed. [2025-09-05T18:06:47.114106] [INFO ] [MAIN ] BILL: Found 1 missing trading days. [2025-09-05T18:06:47.114224] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:06:47.114314] [INFO ] [MAIN ] BILL: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:47.114582] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-05T18:06:47.114797] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-05T18:06:47.115122] [INFO ] [MAIN ] Update Progress: 273/2363 symbols completed. BHV took 2.0s. Estimated remaining: 51m 27s. Rate: 40.6 symbols/min [2025-09-05T18:06:47.289198] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:47.302308] [INFO ] [MAIN ] BIO: Loaded 12128 existing records. [2025-09-05T18:06:47.475053] [INFO ] [MAIN ] BIO: Found 1 missing trading days. [2025-09-05T18:06:47.475249] [INFO ] [MAIN ] BIO: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:47.503355] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:06:47.644917] [INFO ] [MAIN ] BHVN: Adding 381 new records, updating 0 existing records. [2025-09-05T18:06:47.648346] [INFO ] [MAIN ] BHVN: Combined dataset has 24280 total records. [2025-09-05T18:06:47.841155] [WARN ] [VALIDATOR ] BHVN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:47.871691] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-05T18:06:48.046167] [WARN ] [VALIDATOR ] BHVN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:48.046390] [INFO ] [MAIN ] BHVN: Combined data validation passed. [2025-09-05T18:06:48.197720] [INFO ] [MAIN ] BHVN: Update completed successfully. [2025-09-05T18:06:48.200999] [INFO ] [MAIN ] Update Progress: 274/2363 symbols completed. BHVN took 2.0s. Estimated remaining: 51m 23s. Rate: 40.7 symbols/min [2025-09-05T18:06:48.384530] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:48.416265] [INFO ] [MAIN ] BIP: Loaded 28784 existing records. [2025-09-05T18:06:48.535969] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:06:48.655380] [INFO ] [MAIN ] BIP: Found 1 missing trading days. [2025-09-05T18:06:48.665853] [INFO ] [MAIN ] BIP: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:48.667106] [INFO ] [MAIN ] BIO: Adding 146 new records, updating 0 existing records. [2025-09-05T18:06:48.665947] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-05T18:06:48.670866] [INFO ] [MAIN ] BIO: Combined dataset has 12274 total records. [2025-09-05T18:06:48.863415] [WARN ] [VALIDATOR ] BIO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:49.064630] [WARN ] [VALIDATOR ] BIO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:49.064898] [INFO ] [MAIN ] BIO: Combined data validation passed. [2025-09-05T18:06:49.140565] [INFO ] [MAIN ] BIO: Update completed successfully. [2025-09-05T18:06:49.142120] [INFO ] [MAIN ] Update Progress: 275/2363 symbols completed. BIO took 2.0s. Estimated remaining: 51m 17s. Rate: 40.7 symbols/min [2025-09-05T18:06:49.319966] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:49.354390] [INFO ] [MAIN ] BIPC: Loaded 31121 existing records. [2025-09-05T18:06:49.464282] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-05T18:06:49.544550] [INFO ] [MAIN ] BIPC: Found 1 missing trading days. [2025-09-05T18:06:49.544727] [INFO ] [MAIN ] BIPC: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:49.847862] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:06:50.005054] [INFO ] [MAIN ] BILL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:06:50.008279] [INFO ] [MAIN ] BILL: Combined dataset has 25564 total records. [2025-09-05T18:06:50.188428] [WARN ] [VALIDATOR ] BILL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:50.268683] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-05T18:06:50.389113] [WARN ] [VALIDATOR ] BILL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:50.389384] [INFO ] [MAIN ] BILL: Combined data validation passed. [2025-09-05T18:06:50.545314] [INFO ] [MAIN ] BILL: Update completed successfully. [2025-09-05T18:06:50.548244] [INFO ] [MAIN ] Update Progress: 276/2363 symbols completed. BILL took 3.8s. Estimated remaining: 51m 15s. Rate: 40.7 symbols/min [2025-09-05T18:06:50.693046] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-05T18:06:50.771310] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:50.774168] [INFO ] [MAIN ] BIPH: Loaded 1056 existing records. [2025-09-05T18:06:50.952524] [INFO ] [MAIN ] BIPH: Found 1 missing trading days. [2025-09-05T18:06:50.958312] [INFO ] [MAIN ] BIPH: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:50.959412] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:06:51.068577] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-05T18:06:51.081777] [INFO ] [MAIN ] BIP: Adding 254 new records, updating 0 existing records. [2025-09-05T18:06:51.086352] [INFO ] [MAIN ] BIP: Combined dataset has 29038 total records. [2025-09-05T18:06:51.277896] [WARN ] [VALIDATOR ] BIP: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:06:51.477491] [WARN ] [VALIDATOR ] BIP: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:06:51.477742] [INFO ] [MAIN ] BIP: Combined data validation passed. [2025-09-05T18:06:51.655454] [INFO ] [MAIN ] BIP: Update completed successfully. [2025-09-05T18:06:51.658711] [INFO ] [MAIN ] Update Progress: 277/2363 symbols completed. BIP took 3.5s. Estimated remaining: 51m 11s. Rate: 40.8 symbols/min [2025-09-05T18:06:51.863503] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-05T18:06:52.202052] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-05T18:06:52.331909] [INFO ] [MAIN ] BIPC: Adding 241 new records, updating 0 existing records. [2025-09-05T18:06:52.335309] [INFO ] [MAIN ] BIPC: Combined dataset has 31362 total records. [2025-09-05T18:06:52.529435] [WARN ] [VALIDATOR ] BIPC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:06:52.668932] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-05T18:06:52.725184] [WARN ] [VALIDATOR ] BIPC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:06:52.725374] [INFO ] [MAIN ] BIPC: Combined data validation passed. [2025-09-05T18:06:52.952409] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-05T18:06:52.982594] [INFO ] [MAIN ] BIPC: Update completed successfully. [2025-09-05T18:06:52.987118] [INFO ] [MAIN ] Update Progress: 278/2363 symbols completed. BIPC took 3.8s. Estimated remaining: 51m 9s. Rate: 40.8 symbols/min [2025-09-05T18:06:53.334948] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:06:53.342706] [INFO ] [MAIN ] BIPH: Adding 30 new records, updating 0 existing records. [2025-09-05T18:06:53.344015] [INFO ] [MAIN ] BIPH: Combined dataset has 1086 total records. [2025-09-05T18:06:53.499230] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-05T18:06:53.580378] [WARN ] [VALIDATOR ] BIPH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:53.771228] [WARN ] [VALIDATOR ] BIPH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:53.771451] [INFO ] [MAIN ] BIPH: Combined data validation passed. [2025-09-05T18:06:53.780077] [INFO ] [MAIN ] BIPH: Update completed successfully. [2025-09-05T18:06:53.780369] [INFO ] [MAIN ] Update Progress: 279/2363 symbols completed. BIPH took 3.2s. Estimated remaining: 51m 2s. Rate: 40.8 symbols/min [2025-09-05T18:06:54.210670] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:06:54.215105] [INFO ] [REMOTE ] BGS: Full fetch complete (54588 records). [2025-09-05T18:06:54.652959] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-05T18:06:54.953751] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-05T18:06:54.953924] [INFO ] [MAIN ] Update Progress: 280/2363 symbols completed. BGS took 40.3s. Estimated remaining: 50m 59s. Rate: 40.9 symbols/min [2025-09-05T18:06:55.733211] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:55.864212] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:55.865779] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:55.890117] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:55.893541] [INFO ] [MAIN ] BIPJ: Loaded 1469 existing records. [2025-09-05T18:06:55.977813] [INFO ] [MAIN ] BIPI: Loaded 1404 existing records. [2025-09-05T18:06:56.073608] [INFO ] [MAIN ] BIT: Loaded 16028 existing records. [2025-09-05T18:06:56.267750] [INFO ] [MAIN ] BIPJ: Found 1 missing trading days. [2025-09-05T18:06:56.306211] [INFO ] [MAIN ] BIPJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:56.312215] [INFO ] [MAIN ] BIRK: Loaded 38409 existing records. [2025-09-05T18:06:56.337307] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-05T18:06:56.445206] [INFO ] [MAIN ] BIPI: Found 1 missing trading days. [2025-09-05T18:06:56.477433] [INFO ] [MAIN ] BIPI: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:56.509789] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-05T18:06:56.589154] [INFO ] [MAIN ] BIT: Found 1 missing trading days. [2025-09-05T18:06:56.618596] [INFO ] [MAIN ] BIT: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:56.647324] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-05T18:06:56.660976] [INFO ] [MAIN ] BIRK: Found 1 missing trading days. [2025-09-05T18:06:56.661085] [INFO ] [MAIN ] BIRK: Need to fetch 1 months: 2025-09 [2025-09-05T18:06:56.663405] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-05T18:06:57.066453] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:06:57.074076] [INFO ] [MAIN ] BIPJ: Adding 12 new records, updating 0 existing records. [2025-09-05T18:06:57.075365] [INFO ] [MAIN ] BIPJ: Combined dataset has 1481 total records. [2025-09-05T18:06:57.165027] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:06:57.198322] [INFO ] [MAIN ] BIPI: Adding 43 new records, updating 0 existing records. [2025-09-05T18:06:57.231664] [INFO ] [MAIN ] BIPI: Combined dataset has 1447 total records. [2025-09-05T18:06:57.250673] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:06:57.358132] [WARN ] [VALIDATOR ] BIPJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:57.753598] [WARN ] [VALIDATOR ] BIPI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:06:57.759602] [INFO ] [MAIN ] BIRK: Adding 366 new records, updating 0 existing records. [2025-09-05T18:06:57.979696] [INFO ] [MAIN ] BIRK: Combined dataset has 38775 total records. [2025-09-05T18:06:58.180485] [WARN ] [VALIDATOR ] BIRK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:06:58.227038] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-05T18:06:58.484200] [INFO ] [MAIN ] BIT: Adding 292 new records, updating 0 existing records. [2025-09-05T18:06:58.523581] [INFO ] [MAIN ] BIT: Combined dataset has 16320 total records. [2025-09-05T18:06:58.679857] [WARN ] [VALIDATOR ] BIPJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:58.679765] [WARN ] [VALIDATOR ] BIPI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:06:58.743075] [WARN ] [VALIDATOR ] BIT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:06:58.743600] [INFO ] [MAIN ] BIPJ: Combined data validation passed. [2025-09-05T18:06:58.743348] [INFO ] [MAIN ] BIPI: Combined data validation passed. [2025-09-05T18:06:58.843994] [INFO ] [MAIN ] BIPI: Update completed successfully. [2025-09-05T18:06:58.864123] [INFO ] [MAIN ] Update Progress: 281/2363 symbols completed. BIPI took 3.9s. Estimated remaining: 51m 15s. Rate: 40.6 symbols/min [2025-09-05T18:06:58.875454] [INFO ] [MAIN ] BIPJ: Update completed successfully. [2025-09-05T18:06:58.916354] [INFO ] [MAIN ] Update Progress: 282/2363 symbols completed. BIPJ took 4.0s. Estimated remaining: 51m 3s. Rate: 40.8 symbols/min [2025-09-05T18:06:59.269709] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:59.324770] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:06:59.325544] [WARN ] [MAIN ] BK: No existing data found, performing full refresh instead. [2025-09-05T18:06:59.325893] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-05T18:06:59.326125] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-05T18:06:59.326517] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-05T18:06:59.449812] [WARN ] [VALIDATOR ] BIT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:06:59.450530] [INFO ] [MAIN ] BIT: Combined data validation passed. [2025-09-05T18:06:59.450583] [WARN ] [VALIDATOR ] BIRK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:06:59.451221] [INFO ] [MAIN ] BIRK: Combined data validation passed. [2025-09-05T18:06:59.613883] [INFO ] [MAIN ] BJ: Loaded 24505 existing records. [2025-09-05T18:07:00.050055] [INFO ] [REMOTE ] BK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:07:00.113418] [INFO ] [MAIN ] BJ: Found 1 missing trading days. [2025-09-05T18:07:00.113733] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-05T18:07:00.119323] [INFO ] [MAIN ] BJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:00.120128] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-05T18:07:00.230107] [INFO ] [MAIN ] BIT: Update completed successfully. [2025-09-05T18:07:00.233132] [INFO ] [MAIN ] Update Progress: 283/2363 symbols completed. BIT took 5.3s. Estimated remaining: 51m 1s. Rate: 40.8 symbols/min [2025-09-05T18:07:00.426016] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:00.434901] [INFO ] [MAIN ] BIRK: Update completed successfully. [2025-09-05T18:07:00.439447] [INFO ] [MAIN ] Update Progress: 284/2363 symbols completed. BIRK took 5.5s. Estimated remaining: 50m 50s. Rate: 40.9 symbols/min [2025-09-05T18:07:00.622434] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:00.636539] [INFO ] [MAIN ] BKD: Loaded 38044 existing records. [2025-09-05T18:07:00.747544] [INFO ] [MAIN ] BKE: Loaded 15844 existing records. [2025-09-05T18:07:00.893382] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:07:00.911713] [INFO ] [MAIN ] BKD: Found 1 missing trading days. [2025-09-05T18:07:00.940040] [INFO ] [MAIN ] BKD: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:00.982875] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-05T18:07:01.148918] [INFO ] [MAIN ] BKE: Found 1 missing trading days. [2025-09-05T18:07:01.164378] [INFO ] [MAIN ] BKE: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:01.178724] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-05T18:07:01.178382] [INFO ] [MAIN ] BJ: Adding 385 new records, updating 0 existing records. [2025-09-05T18:07:01.183044] [INFO ] [MAIN ] BJ: Combined dataset has 24890 total records. [2025-09-05T18:07:01.363018] [WARN ] [VALIDATOR ] BJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:01.557766] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:07:01.668131] [INFO ] [MAIN ] BKE: Adding 314 new records, updating 0 existing records. [2025-09-05T18:07:01.672635] [INFO ] [MAIN ] BKE: Combined dataset has 16158 total records. [2025-09-05T18:07:01.868272] [WARN ] [VALIDATOR ] BKE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:01.898274] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:07:02.241446] [INFO ] [MAIN ] BKD: Adding 359 new records, updating 0 existing records. [2025-09-05T18:07:02.249521] [INFO ] [MAIN ] BKD: Combined dataset has 38403 total records. [2025-09-05T18:07:02.443615] [WARN ] [VALIDATOR ] BKD: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:07:02.491268] [WARN ] [VALIDATOR ] BJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:02.516207] [INFO ] [MAIN ] BJ: Combined data validation passed. [2025-09-05T18:07:02.709964] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-05T18:07:02.778165] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-05T18:07:02.847599] [INFO ] [MAIN ] BJ: Update completed successfully. [2025-09-05T18:07:02.851202] [INFO ] [MAIN ] Update Progress: 285/2363 symbols completed. BJ took 4.0s. Estimated remaining: 50m 55s. Rate: 40.8 symbols/min [2025-09-05T18:07:03.031067] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:03.033908] [WARN ] [VALIDATOR ] BKE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:03.038094] [INFO ] [MAIN ] BKE: Combined data validation passed. [2025-09-05T18:07:03.150269] [INFO ] [MAIN ] BKE: Update completed successfully. [2025-09-05T18:07:03.152619] [INFO ] [MAIN ] Update Progress: 286/2363 symbols completed. BKE took 2.7s. Estimated remaining: 50m 45s. Rate: 40.9 symbols/min [2025-09-05T18:07:03.150118] [WARN ] [VALIDATOR ] BKD: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:07:03.174168] [INFO ] [MAIN ] BKD: Combined data validation passed. [2025-09-05T18:07:03.244103] [INFO ] [MAIN ] BKH: Loaded 28078 existing records. [2025-09-05T18:07:03.519463] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:03.639020] [INFO ] [MAIN ] BKH: Found 1 missing trading days. [2025-09-05T18:07:03.644902] [INFO ] [MAIN ] BKH: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:03.645245] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-05T18:07:03.727096] [INFO ] [MAIN ] BKKT: Loaded 18249 existing records. [2025-09-05T18:07:03.879190] [INFO ] [MAIN ] BKD: Update completed successfully. [2025-09-05T18:07:03.909540] [INFO ] [MAIN ] Update Progress: 287/2363 symbols completed. BKD took 3.7s. Estimated remaining: 50m 39s. Rate: 41.0 symbols/min [2025-09-05T18:07:04.088987] [INFO ] [MAIN ] BKKT: Found 1 missing trading days. [2025-09-05T18:07:04.097011] [INFO ] [MAIN ] BKKT: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:04.098172] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-05T18:07:04.098428] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:07:04.237128] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:04.272871] [INFO ] [MAIN ] BKH: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:04.277932] [INFO ] [MAIN ] BKN: Loaded 3330 existing records. [2025-09-05T18:07:04.283451] [INFO ] [MAIN ] BKH: Combined dataset has 28078 total records. [2025-09-05T18:07:04.302271] [FATAL] [VALIDATOR ] BKH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:04.361618] [FATAL] [MAIN ] BKH: Combined data validation failed. [2025-09-05T18:07:04.390109] [WARN ] [MAIN ] BKH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:04.400919] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-05T18:07:04.406937] [INFO ] [LOCAL ] BKH: Starting deletion of derivative data. [2025-09-05T18:07:04.444707] [INFO ] [MAIN ] Update Progress: 288/2363 symbols completed. BKH took 1.6s. Estimated remaining: 50m 31s. Rate: 41.1 symbols/min [2025-09-05T18:07:04.551873] [INFO ] [MAIN ] BKN: Found 1 missing trading days. [2025-09-05T18:07:04.563473] [INFO ] [MAIN ] BKN: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:04.574666] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-05T18:07:04.659880] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:04.688245] [INFO ] [MAIN ] BKSY: Loaded 24143 existing records. [2025-09-05T18:07:04.872735] [INFO ] [MAIN ] BKSY: Found 1 missing trading days. [2025-09-05T18:07:04.872970] [INFO ] [MAIN ] BKSY: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:04.873224] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-05T18:07:04.913190] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:07:04.912059] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-05T18:07:04.945072] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-05T18:07:05.040560] [INFO ] [MAIN ] BKKT: Adding 261 new records, updating 0 existing records. [2025-09-05T18:07:05.043677] [INFO ] [MAIN ] BKKT: Combined dataset has 18510 total records. [2025-09-05T18:07:05.226333] [WARN ] [VALIDATOR ] BKKT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:05.422940] [WARN ] [VALIDATOR ] BKKT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:05.423184] [INFO ] [MAIN ] BKKT: Combined data validation passed. [2025-09-05T18:07:05.536022] [INFO ] [MAIN ] BKKT: Update completed successfully. [2025-09-05T18:07:05.538211] [INFO ] [MAIN ] Update Progress: 289/2363 symbols completed. BKKT took 2.4s. Estimated remaining: 50m 26s. Rate: 41.1 symbols/min [2025-09-05T18:07:05.616203] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T18:07:05.670006] [INFO ] [MAIN ] BKN: Adding 95 new records, updating 0 existing records. [2025-09-05T18:07:05.693501] [INFO ] [MAIN ] BKN: Combined dataset has 3425 total records. [2025-09-05T18:07:05.768180] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:05.861535] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:07:05.898063] [INFO ] [MAIN ] BKT: Loaded 4769 existing records. [2025-09-05T18:07:06.078021] [WARN ] [VALIDATOR ] BKN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:06.355492] [INFO ] [MAIN ] BKSY: Adding 356 new records, updating 0 existing records. [2025-09-05T18:07:06.450748] [INFO ] [MAIN ] BKT: Found 1 missing trading days. [2025-09-05T18:07:06.488923] [INFO ] [MAIN ] BKT: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:06.494806] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-05T18:07:06.499082] [INFO ] [MAIN ] BKSY: Combined dataset has 24499 total records. [2025-09-05T18:07:06.726776] [WARN ] [VALIDATOR ] BKSY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:06.952518] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-05T18:07:06.964729] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-05T18:07:06.973437] [WARN ] [VALIDATOR ] BKSY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:06.973492] [WARN ] [VALIDATOR ] BKN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:06.973690] [INFO ] [MAIN ] BKSY: Combined data validation passed. [2025-09-05T18:07:06.973811] [INFO ] [MAIN ] BKN: Combined data validation passed. [2025-09-05T18:07:07.086838] [INFO ] [MAIN ] BKN: Update completed successfully. [2025-09-05T18:07:07.089254] [INFO ] [MAIN ] Update Progress: 290/2363 symbols completed. BKN took 3.2s. Estimated remaining: 50m 26s. Rate: 41.1 symbols/min [2025-09-05T18:07:07.303859] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:07.342999] [INFO ] [MAIN ] BKSY: Update completed successfully. [2025-09-05T18:07:07.346080] [INFO ] [MAIN ] Update Progress: 291/2363 symbols completed. BKSY took 2.9s. Estimated remaining: 50m 16s. Rate: 41.2 symbols/min [2025-09-05T18:07:07.454360] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:07:07.542931] [INFO ] [MAIN ] BKT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:07.567036] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:07.585353] [INFO ] [MAIN ] BKT: Combined dataset has 4769 total records. [2025-09-05T18:07:07.586000] [FATAL] [VALIDATOR ] BKT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:07.587471] [FATAL] [MAIN ] BKT: Combined data validation failed. [2025-09-05T18:07:07.587717] [WARN ] [MAIN ] BKT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:07.587358] [INFO ] [MAIN ] BKU: Loaded 31614 existing records. [2025-09-05T18:07:07.593140] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-05T18:07:07.630992] [INFO ] [LOCAL ] BKT: Starting deletion of derivative data. [2025-09-05T18:07:07.695726] [INFO ] [MAIN ] BKV: Loaded 13480 existing records. [2025-09-05T18:07:07.696592] [INFO ] [MAIN ] Update Progress: 292/2363 symbols completed. BKT took 2.2s. Estimated remaining: 50m 6s. Rate: 41.3 symbols/min [2025-09-05T18:07:08.015844] [INFO ] [MAIN ] BKU: Found 1 missing trading days. [2025-09-05T18:07:08.045548] [INFO ] [MAIN ] BKU: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:08.110165] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-05T18:07:08.169960] [INFO ] [MAIN ] BKV: Found 1 missing trading days. [2025-09-05T18:07:08.164194] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:08.170293] [INFO ] [MAIN ] BKV: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:08.170958] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-05T18:07:08.189893] [INFO ] [MAIN ] BLCO: Loaded 16726 existing records. [2025-09-05T18:07:08.369246] [INFO ] [MAIN ] BLCO: Found 1 missing trading days. [2025-09-05T18:07:08.369440] [INFO ] [MAIN ] BLCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:08.663482] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-05T18:07:08.867713] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:07:08.969972] [INFO ] [MAIN ] BKU: Adding 226 new records, updating 0 existing records. [2025-09-05T18:07:08.990974] [INFO ] [MAIN ] BKU: Combined dataset has 31840 total records. [2025-09-05T18:07:09.061666] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-05T18:07:09.125934] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:07:09.276607] [WARN ] [VALIDATOR ] BKU: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:07:09.290263] [INFO ] [MAIN ] BLCO: Adding 333 new records, updating 0 existing records. [2025-09-05T18:07:09.397347] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T18:07:09.452756] [INFO ] [MAIN ] BLCO: Combined dataset has 17059 total records. [2025-09-05T18:07:09.518398] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-05T18:07:09.522906] [INFO ] [MAIN ] BKV: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:09.600965] [INFO ] [MAIN ] BKV: Combined dataset has 13480 total records. [2025-09-05T18:07:09.619966] [FATAL] [VALIDATOR ] BKV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:09.620540] [FATAL] [MAIN ] BKV: Combined data validation failed. [2025-09-05T18:07:09.635960] [WARN ] [MAIN ] BKV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:09.643831] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-05T18:07:09.647292] [INFO ] [LOCAL ] BKV: Starting deletion of derivative data. [2025-09-05T18:07:09.649126] [INFO ] [MAIN ] Update Progress: 293/2363 symbols completed. BKV took 2.3s. Estimated remaining: 50m 8s. Rate: 41.3 symbols/min [2025-09-05T18:07:09.799568] [WARN ] [VALIDATOR ] BLCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:09.986442] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:10.088907] [INFO ] [MAIN ] BLD: Loaded 14208 existing records. [2025-09-05T18:07:10.265805] [INFO ] [MAIN ] BLD: Found 1 missing trading days. [2025-09-05T18:07:10.266230] [INFO ] [MAIN ] BLD: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:10.266534] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-05T18:07:10.278218] [WARN ] [VALIDATOR ] BKU: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:07:10.278369] [WARN ] [VALIDATOR ] BLCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:10.278747] [INFO ] [MAIN ] BKU: Combined data validation passed. [2025-09-05T18:07:10.278889] [INFO ] [MAIN ] BLCO: Combined data validation passed. [2025-09-05T18:07:10.471447] [INFO ] [MAIN ] BLCO: Update completed successfully. [2025-09-05T18:07:10.473596] [INFO ] [MAIN ] Update Progress: 294/2363 symbols completed. BLCO took 2.8s. Estimated remaining: 50m 3s. Rate: 41.3 symbols/min [2025-09-05T18:07:10.650807] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:10.681637] [INFO ] [MAIN ] BLDR: Loaded 24893 existing records. [2025-09-05T18:07:10.805119] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:07:10.931430] [INFO ] [MAIN ] BLDR: Found 1 missing trading days. [2025-09-05T18:07:10.978800] [INFO ] [MAIN ] BLDR: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:10.985809] [INFO ] [MAIN ] BLD: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:10.989262] [INFO ] [MAIN ] BLD: Combined dataset has 14208 total records. [2025-09-05T18:07:10.990446] [FATAL] [VALIDATOR ] BLD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:10.991846] [FATAL] [MAIN ] BLD: Combined data validation failed. [2025-09-05T18:07:10.993159] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:10.994282] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-05T18:07:10.995860] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-09-05T18:07:10.998459] [INFO ] [MAIN ] Update Progress: 295/2363 symbols completed. BLD took 1.3s. Estimated remaining: 49m 55s. Rate: 41.4 symbols/min [2025-09-05T18:07:11.065328] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-05T18:07:11.182747] [INFO ] [MAIN ] BKU: Update completed successfully. [2025-09-05T18:07:11.184787] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:11.188397] [INFO ] [MAIN ] Update Progress: 296/2363 symbols completed. BKU took 4.1s. Estimated remaining: 49m 44s. Rate: 41.6 symbols/min [2025-09-05T18:07:11.294361] [INFO ] [MAIN ] BLE: Loaded 6686 existing records. [2025-09-05T18:07:11.465474] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:11.539694] [INFO ] [MAIN ] BLE: Found 1 missing trading days. [2025-09-05T18:07:11.539926] [INFO ] [MAIN ] BLE: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:11.583977] [INFO ] [MAIN ] BLK: Loaded 15365 existing records. [2025-09-05T18:07:11.617178] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-05T18:07:11.769982] [INFO ] [MAIN ] BLK: Found 1 missing trading days. [2025-09-05T18:07:11.770118] [INFO ] [MAIN ] BLK: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:11.777477] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:07:11.868522] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-05T18:07:11.925727] [INFO ] [MAIN ] BLDR: Adding 384 new records, updating 0 existing records. [2025-09-05T18:07:11.930895] [INFO ] [MAIN ] BLDR: Combined dataset has 25277 total records. [2025-09-05T18:07:12.115770] [WARN ] [VALIDATOR ] BLDR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:12.312075] [WARN ] [VALIDATOR ] BLDR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:12.312312] [INFO ] [MAIN ] BLDR: Combined data validation passed. [2025-09-05T18:07:12.486440] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:07:12.510427] [INFO ] [MAIN ] BLDR: Update completed successfully. [2025-09-05T18:07:12.512356] [INFO ] [MAIN ] Update Progress: 297/2363 symbols completed. BLDR took 2.0s. Estimated remaining: 49m 42s. Rate: 41.6 symbols/min [2025-09-05T18:07:12.666742] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-05T18:07:12.678001] [INFO ] [MAIN ] BLK: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:12.736438] [INFO ] [MAIN ] BLK: Combined dataset has 15365 total records. [2025-09-05T18:07:12.757934] [FATAL] [VALIDATOR ] BLK: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:12.760560] [FATAL] [MAIN ] BLK: Combined data validation failed. [2025-09-05T18:07:12.760491] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:12.760735] [WARN ] [MAIN ] BLK: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:12.760844] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-05T18:07:12.761679] [INFO ] [LOCAL ] BLK: Starting deletion of derivative data. [2025-09-05T18:07:12.763218] [INFO ] [MAIN ] Update Progress: 298/2363 symbols completed. BLK took 1.6s. Estimated remaining: 49m 32s. Rate: 41.7 symbols/min [2025-09-05T18:07:12.945594] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:12.957813] [INFO ] [MAIN ] BLND: Loaded 36738 existing records. [2025-09-05T18:07:13.072107] [INFO ] [MAIN ] BLSH: Loaded 6007 existing records. [2025-09-05T18:07:13.255916] [INFO ] [MAIN ] BLND: Found 1 missing trading days. [2025-09-05T18:07:13.266314] [INFO ] [MAIN ] BLND: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:13.322107] [INFO ] [MAIN ] BLSH: Found 1 missing trading days. [2025-09-05T18:07:13.322255] [INFO ] [MAIN ] BLSH: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:13.463474] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-05T18:07:14.263516] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-05T18:07:14.455473] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:07:14.487737] [INFO ] [MAIN ] BLE: Adding 136 new records, updating 0 existing records. [2025-09-05T18:07:14.490090] [INFO ] [MAIN ] BLE: Combined dataset has 6822 total records. [2025-09-05T18:07:14.690440] [WARN ] [VALIDATOR ] BLE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:14.909205] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-05T18:07:14.935443] [WARN ] [VALIDATOR ] BLE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:14.935673] [INFO ] [MAIN ] BLE: Combined data validation passed. [2025-09-05T18:07:14.978966] [INFO ] [MAIN ] BLE: Update completed successfully. [2025-09-05T18:07:14.979991] [INFO ] [MAIN ] Update Progress: 299/2363 symbols completed. BLE took 4.0s. Estimated remaining: 49m 36s. Rate: 41.6 symbols/min [2025-09-05T18:07:15.069678] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-05T18:07:15.150913] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:15.160062] [INFO ] [MAIN ] BLW: Loaded 5782 existing records. [2025-09-05T18:07:15.329150] [INFO ] [MAIN ] BLW: Found 1 missing trading days. [2025-09-05T18:07:15.329299] [INFO ] [MAIN ] BLW: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:15.835407] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:07:15.872138] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-05T18:07:15.992403] [INFO ] [MAIN ] BLND: Adding 383 new records, updating 0 existing records. [2025-09-05T18:07:15.997592] [INFO ] [MAIN ] BLND: Combined dataset has 37121 total records. [2025-09-05T18:07:16.180172] [WARN ] [VALIDATOR ] BLND: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:07:16.378297] [WARN ] [VALIDATOR ] BLND: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:07:16.378523] [INFO ] [MAIN ] BLND: Combined data validation passed. [2025-09-05T18:07:16.552885] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-05T18:07:16.627551] [INFO ] [MAIN ] BLND: Update completed successfully. [2025-09-05T18:07:16.647026] [INFO ] [MAIN ] Update Progress: 300/2363 symbols completed. BLND took 4.1s. Estimated remaining: 49m 36s. Rate: 41.6 symbols/min [2025-09-05T18:07:16.679223] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-05T18:07:16.851297] [INFO ] [MAIN ] BLSH: Adding 390 new records, updating 0 existing records. [2025-09-05T18:07:16.907067] [INFO ] [MAIN ] BLSH: Combined dataset has 6397 total records. [2025-09-05T18:07:16.925567] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:16.992567] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-09-05T18:07:17.031790] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-05T18:07:17.032082] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-05T18:07:17.037915] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-05T18:07:17.216062] [WARN ] [VALIDATOR ] BLSH: Not fatal, but first date in data (2025-08-13) does not match expected start date (2025-01-31) [2025-09-05T18:07:17.234377] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T18:07:17.421897] [INFO ] [MAIN ] BLW: Adding 86 new records, updating 0 existing records. [2025-09-05T18:07:17.664484] [INFO ] [MAIN ] BLW: Combined dataset has 5868 total records. [2025-09-05T18:07:17.776352] [INFO ] [REMOTE ] BLX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:07:17.786691] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-05T18:07:17.935256] [WARN ] [VALIDATOR ] BLW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:18.135458] [WARN ] [VALIDATOR ] BLSH: Missing days changed. Total missing: 133 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12 [2025-09-05T18:07:18.135865] [INFO ] [MAIN ] BLSH: Combined data validation passed. [2025-09-05T18:07:18.135563] [WARN ] [VALIDATOR ] BLW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:18.136580] [INFO ] [MAIN ] BLW: Combined data validation passed. [2025-09-05T18:07:18.212547] [INFO ] [MAIN ] BLW: Update completed successfully. [2025-09-05T18:07:18.212761] [INFO ] [MAIN ] BLSH: Update completed successfully. [2025-09-05T18:07:18.213734] [INFO ] [MAIN ] Update Progress: 301/2363 symbols completed. BLW took 3.2s. Estimated remaining: 49m 36s. Rate: 41.6 symbols/min [2025-09-05T18:07:18.214816] [INFO ] [MAIN ] Update Progress: 302/2363 symbols completed. BLSH took 5.5s. Estimated remaining: 49m 25s. Rate: 41.7 symbols/min [2025-09-05T18:07:18.522227] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:18.569000] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:18.580747] [INFO ] [MAIN ] BME: Loaded 5343 existing records. [2025-09-05T18:07:18.683486] [INFO ] [MAIN ] BMA: Loaded 16260 existing records. [2025-09-05T18:07:18.878277] [INFO ] [MAIN ] BME: Found 1 missing trading days. [2025-09-05T18:07:18.878925] [INFO ] [MAIN ] BME: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:18.879318] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-05T18:07:18.957179] [INFO ] [MAIN ] BMA: Found 1 missing trading days. [2025-09-05T18:07:18.957553] [INFO ] [MAIN ] BMA: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:18.972446] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-05T18:07:19.018470] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-05T18:07:19.063480] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-05T18:07:19.863514] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-05T18:07:20.039177] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:07:20.071431] [INFO ] [MAIN ] BME: Adding 57 new records, updating 0 existing records. [2025-09-05T18:07:20.073213] [INFO ] [MAIN ] BME: Combined dataset has 5400 total records. [2025-09-05T18:07:20.251029] [WARN ] [VALIDATOR ] BME: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:20.440396] [WARN ] [VALIDATOR ] BME: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:20.440599] [INFO ] [MAIN ] BME: Combined data validation passed. [2025-09-05T18:07:20.474987] [INFO ] [MAIN ] BME: Update completed successfully. [2025-09-05T18:07:20.475973] [INFO ] [MAIN ] Update Progress: 303/2363 symbols completed. BME took 2.3s. Estimated remaining: 49m 29s. Rate: 41.6 symbols/min [2025-09-05T18:07:20.652156] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:20.659535] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:07:20.668426] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-05T18:07:20.750764] [INFO ] [MAIN ] BMEZ: Loaded 11845 existing records. [2025-09-05T18:07:20.791260] [INFO ] [MAIN ] BMA: Adding 282 new records, updating 0 existing records. [2025-09-05T18:07:21.006258] [INFO ] [MAIN ] BMA: Combined dataset has 16542 total records. [2025-09-05T18:07:21.062056] [INFO ] [MAIN ] BMEZ: Found 1 missing trading days. [2025-09-05T18:07:21.072092] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-05T18:07:21.082698] [INFO ] [MAIN ] BMEZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:21.260443] [WARN ] [VALIDATOR ] BMA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:21.452020] [WARN ] [VALIDATOR ] BMA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:21.452257] [INFO ] [MAIN ] BMA: Combined data validation passed. [2025-09-05T18:07:21.501482] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-05T18:07:21.569060] [INFO ] [MAIN ] BMA: Update completed successfully. [2025-09-05T18:07:21.571763] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-05T18:07:21.571426] [INFO ] [MAIN ] Update Progress: 304/2363 symbols completed. BMA took 3.4s. Estimated remaining: 49m 25s. Rate: 41.7 symbols/min [2025-09-05T18:07:21.745913] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:21.759592] [INFO ] [MAIN ] BMI: Loaded 11155 existing records. [2025-09-05T18:07:21.941499] [INFO ] [MAIN ] BMI: Found 1 missing trading days. [2025-09-05T18:07:21.941664] [INFO ] [MAIN ] BMI: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:22.246286] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:07:22.249351] [INFO ] [REMOTE ] BK: Full fetch complete (58249 records). [2025-09-05T18:07:22.272402] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-05T18:07:22.667170] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-05T18:07:22.931578] [INFO ] [MAIN ] BK: Full history saved. [2025-09-05T18:07:22.931738] [INFO ] [MAIN ] Update Progress: 305/2363 symbols completed. BK took 23.9s. Estimated remaining: 49m 23s. Rate: 41.7 symbols/min [2025-09-05T18:07:23.068689] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-05T18:07:23.129771] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:23.132937] [INFO ] [MAIN ] BMN: Loaded 1222 existing records. [2025-09-05T18:07:23.326928] [INFO ] [MAIN ] BMN: Found 1 missing trading days. [2025-09-05T18:07:23.327063] [INFO ] [MAIN ] BMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:23.455904] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:07:23.511739] [INFO ] [MAIN ] BMEZ: Adding 130 new records, updating 0 existing records. [2025-09-05T18:07:23.513864] [INFO ] [MAIN ] BMEZ: Combined dataset has 11975 total records. [2025-09-05T18:07:23.691274] [WARN ] [VALIDATOR ] BMEZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:23.758902] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:07:23.864915] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-05T18:07:23.955375] [INFO ] [MAIN ] BMI: Adding 230 new records, updating 0 existing records. [2025-09-05T18:07:23.958861] [INFO ] [MAIN ] BMI: Combined dataset has 11385 total records. [2025-09-05T18:07:24.138959] [WARN ] [VALIDATOR ] BMI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:24.346970] [WARN ] [VALIDATOR ] BMI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:24.347262] [INFO ] [MAIN ] BMI: Combined data validation passed. [2025-09-05T18:07:24.346895] [WARN ] [VALIDATOR ] BMEZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:24.347606] [INFO ] [MAIN ] BMEZ: Combined data validation passed. [2025-09-05T18:07:24.483041] [INFO ] [MAIN ] BMEZ: Update completed successfully. [2025-09-05T18:07:24.485084] [INFO ] [MAIN ] Update Progress: 306/2363 symbols completed. BMEZ took 4.0s. Estimated remaining: 49m 22s. Rate: 41.7 symbols/min [2025-09-05T18:07:24.668452] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-05T18:07:24.672432] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:24.682854] [INFO ] [MAIN ] BMI: Update completed successfully. [2025-09-05T18:07:24.684208] [INFO ] [MAIN ] Update Progress: 307/2363 symbols completed. BMI took 3.1s. Estimated remaining: 49m 12s. Rate: 41.8 symbols/min [2025-09-05T18:07:24.836367] [INFO ] [MAIN ] BMO: Loaded 30742 existing records. [2025-09-05T18:07:24.951075] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:25.079727] [INFO ] [MAIN ] BMO: Found 1 missing trading days. [2025-09-05T18:07:25.079933] [INFO ] [MAIN ] BMO: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:25.090795] [INFO ] [MAIN ] BMY: Loaded 25737 existing records. [2025-09-05T18:07:25.269919] [INFO ] [MAIN ] BMY: Found 1 missing trading days. [2025-09-05T18:07:25.283110] [INFO ] [MAIN ] BMY: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:25.289538] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:07:25.301983] [INFO ] [MAIN ] BMN: Adding 19 new records, updating 0 existing records. [2025-09-05T18:07:25.300040] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-05T18:07:25.307607] [INFO ] [MAIN ] BMN: Combined dataset has 1241 total records. [2025-09-05T18:07:25.474236] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-05T18:07:25.496512] [WARN ] [VALIDATOR ] BMN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:25.695530] [WARN ] [VALIDATOR ] BMN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:25.695760] [INFO ] [MAIN ] BMN: Combined data validation passed. [2025-09-05T18:07:25.704969] [INFO ] [MAIN ] BMN: Update completed successfully. [2025-09-05T18:07:25.705293] [INFO ] [MAIN ] Update Progress: 308/2363 symbols completed. BMN took 2.8s. Estimated remaining: 49m 8s. Rate: 41.8 symbols/min [2025-09-05T18:07:25.873440] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:25.897617] [INFO ] [MAIN ] BN: Loaded 25217 existing records. [2025-09-05T18:07:26.072171] [INFO ] [MAIN ] BN: Found 1 missing trading days. [2025-09-05T18:07:26.072351] [INFO ] [MAIN ] BN: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:26.263475] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-05T18:07:26.715537] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-05T18:07:26.843713] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:07:26.973880] [INFO ] [MAIN ] BMY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:26.975691] [INFO ] [MAIN ] BMY: Combined dataset has 25737 total records. [2025-09-05T18:07:26.976129] [FATAL] [VALIDATOR ] BMY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:26.976211] [FATAL] [MAIN ] BMY: Combined data validation failed. [2025-09-05T18:07:26.976256] [WARN ] [MAIN ] BMY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:26.976304] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-05T18:07:26.976987] [INFO ] [LOCAL ] BMY: Starting deletion of derivative data. [2025-09-05T18:07:26.980534] [INFO ] [MAIN ] Update Progress: 309/2363 symbols completed. BMY took 2.3s. Estimated remaining: 49m 6s. Rate: 41.8 symbols/min [2025-09-05T18:07:27.068718] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-05T18:07:27.168166] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:27.183402] [INFO ] [MAIN ] BNED: Loaded 14456 existing records. [2025-09-05T18:07:27.358204] [INFO ] [MAIN ] BNED: Found 1 missing trading days. [2025-09-05T18:07:27.358387] [INFO ] [MAIN ] BNED: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:27.863466] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-05T18:07:27.970100] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:07:28.121073] [INFO ] [MAIN ] BN: Adding 376 new records, updating 0 existing records. [2025-09-05T18:07:28.124738] [INFO ] [MAIN ] BN: Combined dataset has 25593 total records. [2025-09-05T18:07:28.309312] [WARN ] [VALIDATOR ] BN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:28.501624] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:07:28.579124] [INFO ] [MAIN ] BNED: Adding 153 new records, updating 0 existing records. [2025-09-05T18:07:28.582255] [INFO ] [MAIN ] BNED: Combined dataset has 14609 total records. [2025-09-05T18:07:28.666637] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-05T18:07:28.770189] [WARN ] [VALIDATOR ] BNED: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:28.971310] [WARN ] [VALIDATOR ] BN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:28.971466] [WARN ] [VALIDATOR ] BNED: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:28.971998] [INFO ] [MAIN ] BNED: Combined data validation passed. [2025-09-05T18:07:28.971876] [INFO ] [MAIN ] BN: Combined data validation passed. [2025-09-05T18:07:29.142193] [INFO ] [MAIN ] BNED: Update completed successfully. [2025-09-05T18:07:29.144392] [INFO ] [MAIN ] Update Progress: 310/2363 symbols completed. BNED took 2.2s. Estimated remaining: 49m 9s. Rate: 41.8 symbols/min [2025-09-05T18:07:29.341135] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:29.355206] [INFO ] [MAIN ] BNH: Loaded 3432 existing records. [2025-09-05T18:07:29.464027] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-05T18:07:29.566533] [INFO ] [MAIN ] BNH: Found 1 missing trading days. [2025-09-05T18:07:29.571250] [INFO ] [MAIN ] BNH: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:29.575254] [INFO ] [MAIN ] BN: Update completed successfully. [2025-09-05T18:07:29.578710] [INFO ] [MAIN ] Update Progress: 311/2363 symbols completed. BN took 3.9s. Estimated remaining: 49m 1s. Rate: 41.9 symbols/min [2025-09-05T18:07:29.748843] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:29.751581] [INFO ] [MAIN ] BNJ: Loaded 1035 existing records. [2025-09-05T18:07:29.928490] [INFO ] [MAIN ] BNJ: Found 1 missing trading days. [2025-09-05T18:07:29.928742] [INFO ] [MAIN ] BNJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:29.938296] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-05T18:07:29.952922] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:07:30.093541] [INFO ] [MAIN ] BMO: Adding 365 new records, updating 0 existing records. [2025-09-05T18:07:30.098054] [INFO ] [MAIN ] BMO: Combined dataset has 31107 total records. [2025-09-05T18:07:30.264439] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-05T18:07:30.288906] [WARN ] [VALIDATOR ] BMO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:07:30.490044] [WARN ] [VALIDATOR ] BMO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:07:30.490408] [INFO ] [MAIN ] BMO: Combined data validation passed. [2025-09-05T18:07:30.705587] [INFO ] [MAIN ] BMO: Update completed successfully. [2025-09-05T18:07:30.710217] [INFO ] [MAIN ] Update Progress: 312/2363 symbols completed. BMO took 6.2s. Estimated remaining: 48m 58s. Rate: 41.9 symbols/min [2025-09-05T18:07:30.884355] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:30.886559] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:07:30.894628] [INFO ] [MAIN ] BNJ: Adding 31 new records, updating 0 existing records. [2025-09-05T18:07:30.896133] [INFO ] [MAIN ] BNJ: Combined dataset has 1066 total records. [2025-09-05T18:07:31.082737] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-05T18:07:31.096707] [WARN ] [VALIDATOR ] BNJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:31.119878] [INFO ] [MAIN ] BNL: Loaded 22476 existing records. [2025-09-05T18:07:31.466136] [INFO ] [MAIN ] BNL: Found 1 missing trading days. [2025-09-05T18:07:31.466579] [INFO ] [MAIN ] BNL: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:31.475441] [WARN ] [VALIDATOR ] BNJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:31.475699] [INFO ] [MAIN ] BNJ: Combined data validation passed. [2025-09-05T18:07:31.483691] [INFO ] [MAIN ] BNJ: Update completed successfully. [2025-09-05T18:07:31.483999] [INFO ] [MAIN ] Update Progress: 313/2363 symbols completed. BNJ took 1.9s. Estimated remaining: 48m 52s. Rate: 42.0 symbols/min [2025-09-05T18:07:31.652024] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:31.674541] [INFO ] [MAIN ] BNS: Loaded 24408 existing records. [2025-09-05T18:07:31.848528] [INFO ] [MAIN ] BNS: Found 1 missing trading days. [2025-09-05T18:07:31.848715] [INFO ] [MAIN ] BNS: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:31.863432] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-05T18:07:32.087213] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:07:32.099879] [INFO ] [MAIN ] BNH: Adding 36 new records, updating 0 existing records. [2025-09-05T18:07:32.101340] [INFO ] [MAIN ] BNH: Combined dataset has 3468 total records. [2025-09-05T18:07:32.283309] [WARN ] [VALIDATOR ] BNH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:07:32.469944] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:07:32.628435] [INFO ] [MAIN ] BNS: Adding 389 new records, updating 0 existing records. [2025-09-05T18:07:32.634813] [INFO ] [MAIN ] BNS: Combined dataset has 24797 total records. [2025-09-05T18:07:32.668572] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-05T18:07:32.824617] [WARN ] [VALIDATOR ] BNS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:32.932380] [WARN ] [VALIDATOR ] BNH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:07:32.947963] [INFO ] [MAIN ] BNH: Combined data validation passed. [2025-09-05T18:07:33.036766] [INFO ] [MAIN ] BNH: Update completed successfully. [2025-09-05T18:07:33.037697] [INFO ] [MAIN ] Update Progress: 314/2363 symbols completed. BNH took 3.9s. Estimated remaining: 48m 51s. Rate: 41.9 symbols/min [2025-09-05T18:07:33.082197] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-05T18:07:33.350082] [INFO ] [MAIN ] BNL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:33.351560] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:33.358737] [INFO ] [MAIN ] BNT: Loaded 1289 existing records. [2025-09-05T18:07:33.356400] [INFO ] [MAIN ] BNL: Combined dataset has 22476 total records. [2025-09-05T18:07:33.403374] [FATAL] [VALIDATOR ] BNL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:33.452298] [FATAL] [MAIN ] BNL: Combined data validation failed. [2025-09-05T18:07:33.463677] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-05T18:07:33.463107] [WARN ] [MAIN ] BNL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:33.514405] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-05T18:07:33.536941] [INFO ] [LOCAL ] BNL: Starting deletion of derivative data. [2025-09-05T18:07:33.538698] [INFO ] [MAIN ] BNT: Found 1 missing trading days. [2025-09-05T18:07:33.539159] [INFO ] [MAIN ] BNT: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:33.541772] [INFO ] [MAIN ] Update Progress: 315/2363 symbols completed. BNL took 2.8s. Estimated remaining: 48m 44s. Rate: 42.0 symbols/min [2025-09-05T18:07:33.721044] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:33.722156] [WARN ] [VALIDATOR ] BNS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:33.722456] [INFO ] [MAIN ] BNS: Combined data validation passed. [2025-09-05T18:07:33.727939] [INFO ] [MAIN ] BNY: Loaded 3629 existing records. [2025-09-05T18:07:34.011711] [INFO ] [MAIN ] BNY: Found 1 missing trading days. [2025-09-05T18:07:34.015662] [INFO ] [MAIN ] BNY: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:34.052104] [INFO ] [MAIN ] BNS: Update completed successfully. [2025-09-05T18:07:34.055576] [INFO ] [MAIN ] Update Progress: 316/2363 symbols completed. BNS took 2.6s. Estimated remaining: 48m 37s. Rate: 42.1 symbols/min [2025-09-05T18:07:34.227094] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:34.237111] [INFO ] [MAIN ] BOC: Loaded 9083 existing records. [2025-09-05T18:07:34.268560] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-05T18:07:34.416594] [INFO ] [MAIN ] BOC: Found 1 missing trading days. [2025-09-05T18:07:34.416761] [INFO ] [MAIN ] BOC: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:34.464423] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-05T18:07:35.063490] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-05T18:07:35.136876] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:07:35.154232] [INFO ] [MAIN ] BNT: Adding 68 new records, updating 0 existing records. [2025-09-05T18:07:35.155592] [INFO ] [MAIN ] BNT: Combined dataset has 1357 total records. [2025-09-05T18:07:35.364899] [WARN ] [VALIDATOR ] BNT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:35.553907] [WARN ] [VALIDATOR ] BNT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:35.554145] [INFO ] [MAIN ] BNT: Combined data validation passed. [2025-09-05T18:07:35.563279] [INFO ] [MAIN ] BNT: Update completed successfully. [2025-09-05T18:07:35.563685] [INFO ] [MAIN ] Update Progress: 317/2363 symbols completed. BNT took 2.5s. Estimated remaining: 48m 36s. Rate: 42.1 symbols/min [2025-09-05T18:07:35.863482] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-05T18:07:36.057053] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-05T18:07:36.663447] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-05T18:07:36.679350] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:07:36.700110] [INFO ] [MAIN ] BNY: Adding 42 new records, updating 0 existing records. [2025-09-05T18:07:36.701627] [INFO ] [MAIN ] BNY: Combined dataset has 3671 total records. [2025-09-05T18:07:36.883071] [WARN ] [VALIDATOR ] BNY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:37.076727] [WARN ] [VALIDATOR ] BNY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:37.076954] [INFO ] [MAIN ] BNY: Combined data validation passed. [2025-09-05T18:07:37.099805] [INFO ] [MAIN ] BNY: Update completed successfully. [2025-09-05T18:07:37.100433] [INFO ] [MAIN ] Update Progress: 318/2363 symbols completed. BNY took 3.6s. Estimated remaining: 48m 35s. Rate: 42.1 symbols/min [2025-09-05T18:07:37.463517] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-05T18:07:37.731299] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-05T18:07:38.263540] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-05T18:07:38.605915] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:07:38.669169] [INFO ] [MAIN ] BOC: Adding 134 new records, updating 0 existing records. [2025-09-05T18:07:38.671358] [INFO ] [MAIN ] BOC: Combined dataset has 9217 total records. [2025-09-05T18:07:38.854443] [WARN ] [VALIDATOR ] BOC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:39.032517] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:07:39.039379] [INFO ] [REMOTE ] BLX: Full fetch complete (16969 records). [2025-09-05T18:07:39.407434] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-05T18:07:39.484789] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-05T18:07:39.485155] [INFO ] [MAIN ] Update Progress: 319/2363 symbols completed. BLX took 22.8s. Estimated remaining: 48m 40s. Rate: 42.0 symbols/min [2025-09-05T18:07:39.488216] [WARN ] [VALIDATOR ] BOC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:39.488357] [INFO ] [MAIN ] BOC: Combined data validation passed. [2025-09-05T18:07:39.553002] [INFO ] [MAIN ] BOC: Update completed successfully. [2025-09-05T18:07:39.554258] [INFO ] [MAIN ] Update Progress: 320/2363 symbols completed. BOC took 5.5s. Estimated remaining: 48m 30s. Rate: 42.1 symbols/min [2025-09-05T18:07:40.130563] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:40.226562] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:40.226659] [WARN ] [MAIN ] BOND: No existing data found, performing full refresh instead. [2025-09-05T18:07:40.270685] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:40.273385] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-05T18:07:40.274283] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:40.274634] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-05T18:07:40.275087] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-05T18:07:40.274942] [WARN ] [MAIN ] BOH: No existing data found, performing full refresh instead. [2025-09-05T18:07:40.280914] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-05T18:07:40.341195] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-05T18:07:40.377771] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-05T18:07:40.390227] [INFO ] [MAIN ] BOE: Loaded 7655 existing records. [2025-09-05T18:07:40.697101] [INFO ] [MAIN ] BOOT: Loaded 18147 existing records. [2025-09-05T18:07:40.995995] [INFO ] [MAIN ] BOE: Found 1 missing trading days. [2025-09-05T18:07:41.026214] [INFO ] [MAIN ] BOE: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:41.050284] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-05T18:07:41.293232] [INFO ] [REMOTE ] BOND: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:07:41.326730] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-05T18:07:41.326416] [INFO ] [MAIN ] BOOT: Found 1 missing trading days. [2025-09-05T18:07:41.337913] [INFO ] [MAIN ] BOOT: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:41.363424] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-05T18:07:41.403572] [INFO ] [REMOTE ] BOH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:07:41.463441] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-05T18:07:42.045767] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:07:42.158051] [INFO ] [MAIN ] BOOT: Adding 281 new records, updating 0 existing records. [2025-09-05T18:07:42.160992] [INFO ] [MAIN ] BOOT: Combined dataset has 18428 total records. [2025-09-05T18:07:42.349860] [WARN ] [VALIDATOR ] BOOT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:42.466410] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:07:42.612500] [INFO ] [MAIN ] BOE: Adding 192 new records, updating 0 existing records. [2025-09-05T18:07:42.615550] [INFO ] [MAIN ] BOE: Combined dataset has 7847 total records. [2025-09-05T18:07:42.796830] [WARN ] [VALIDATOR ] BOE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:43.027354] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-05T18:07:43.034407] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-05T18:07:43.036400] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-05T18:07:43.056295] [WARN ] [VALIDATOR ] BOOT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:43.056351] [WARN ] [VALIDATOR ] BOE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:43.056554] [INFO ] [MAIN ] BOOT: Combined data validation passed. [2025-09-05T18:07:43.056697] [INFO ] [MAIN ] BOE: Combined data validation passed. [2025-09-05T18:07:43.126146] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-05T18:07:43.218812] [INFO ] [MAIN ] BOE: Update completed successfully. [2025-09-05T18:07:43.219940] [INFO ] [MAIN ] Update Progress: 321/2363 symbols completed. BOE took 3.7s. Estimated remaining: 48m 42s. Rate: 41.9 symbols/min [2025-09-05T18:07:43.220015] [INFO ] [MAIN ] BOOT: Update completed successfully. [2025-09-05T18:07:43.221869] [INFO ] [MAIN ] Update Progress: 322/2363 symbols completed. BOOT took 3.7s. Estimated remaining: 48m 32s. Rate: 42.1 symbols/min [2025-09-05T18:07:43.548301] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:43.572816] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:43.584254] [INFO ] [MAIN ] BOW: Loaded 10077 existing records. [2025-09-05T18:07:43.774163] [INFO ] [MAIN ] BOW: Found 1 missing trading days. [2025-09-05T18:07:43.770330] [INFO ] [MAIN ] BORR: Loaded 24399 existing records. [2025-09-05T18:07:43.805482] [INFO ] [MAIN ] BOW: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:43.870050] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-05T18:07:43.958401] [INFO ] [MAIN ] BORR: Found 1 missing trading days. [2025-09-05T18:07:43.958537] [INFO ] [MAIN ] BORR: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:44.294795] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-05T18:07:44.579069] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-05T18:07:44.663509] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-05T18:07:45.128057] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:07:45.282921] [INFO ] [MAIN ] BORR: Adding 388 new records, updating 0 existing records. [2025-09-05T18:07:45.288111] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:07:45.363228] [INFO ] [MAIN ] BORR: Combined dataset has 24787 total records. [2025-09-05T18:07:45.367823] [INFO ] [MAIN ] BOW: Adding 176 new records, updating 0 existing records. [2025-09-05T18:07:45.466770] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-05T18:07:45.480466] [INFO ] [MAIN ] BOW: Combined dataset has 10253 total records. [2025-09-05T18:07:45.669307] [WARN ] [VALIDATOR ] BORR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:45.855525] [WARN ] [VALIDATOR ] BOW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:46.141572] [WARN ] [VALIDATOR ] BORR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:46.141666] [WARN ] [VALIDATOR ] BOW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:46.142057] [INFO ] [MAIN ] BOW: Combined data validation passed. [2025-09-05T18:07:46.141950] [INFO ] [MAIN ] BORR: Combined data validation passed. [2025-09-05T18:07:46.274192] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-05T18:07:46.299134] [INFO ] [MAIN ] BOW: Update completed successfully. [2025-09-05T18:07:46.301245] [INFO ] [MAIN ] Update Progress: 323/2363 symbols completed. BOW took 3.1s. Estimated remaining: 48m 41s. Rate: 41.9 symbols/min [2025-09-05T18:07:46.485226] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:46.531762] [INFO ] [MAIN ] BORR: Update completed successfully. [2025-09-05T18:07:46.535250] [INFO ] [MAIN ] Update Progress: 324/2363 symbols completed. BORR took 3.3s. Estimated remaining: 48m 32s. Rate: 42.0 symbols/min [2025-09-05T18:07:46.645758] [INFO ] [MAIN ] BOX: Loaded 24098 existing records. [2025-09-05T18:07:46.819990] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:46.898040] [INFO ] [MAIN ] BOX: Found 1 missing trading days. [2025-09-05T18:07:46.898442] [INFO ] [MAIN ] BOX: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:46.925956] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-05T18:07:46.941427] [INFO ] [MAIN ] BP: Loaded 25696 existing records. [2025-09-05T18:07:47.068555] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-05T18:07:47.128302] [INFO ] [MAIN ] BP: Found 1 missing trading days. [2025-09-05T18:07:47.128436] [INFO ] [MAIN ] BP: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:47.690822] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:07:47.832820] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-05T18:07:47.875102] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-05T18:07:47.875042] [INFO ] [MAIN ] BOX: Adding 378 new records, updating 0 existing records. [2025-09-05T18:07:47.880960] [INFO ] [MAIN ] BOX: Combined dataset has 24476 total records. [2025-09-05T18:07:48.062986] [WARN ] [VALIDATOR ] BOX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:48.264385] [WARN ] [VALIDATOR ] BOX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:48.264658] [INFO ] [MAIN ] BOX: Combined data validation passed. [2025-09-05T18:07:48.433343] [INFO ] [MAIN ] BOX: Update completed successfully. [2025-09-05T18:07:48.437195] [INFO ] [MAIN ] Update Progress: 325/2363 symbols completed. BOX took 2.1s. Estimated remaining: 48m 33s. Rate: 42.0 symbols/min [2025-09-05T18:07:48.624099] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:48.636826] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:07:48.664792] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-05T18:07:48.809264] [INFO ] [MAIN ] BR: Loaded 16065 existing records. [2025-09-05T18:07:49.023684] [INFO ] [MAIN ] BP: Adding 390 new records, updating 0 existing records. [2025-09-05T18:07:49.165966] [INFO ] [MAIN ] BR: Found 1 missing trading days. [2025-09-05T18:07:49.166440] [INFO ] [MAIN ] BR: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:49.167587] [INFO ] [MAIN ] BP: Combined dataset has 26086 total records. [2025-09-05T18:07:49.385834] [WARN ] [VALIDATOR ] BP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:49.468586] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-05T18:07:49.635088] [WARN ] [VALIDATOR ] BP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:49.635346] [INFO ] [MAIN ] BP: Combined data validation passed. [2025-09-05T18:07:49.816297] [INFO ] [MAIN ] BP: Update completed successfully. [2025-09-05T18:07:49.819609] [INFO ] [MAIN ] Update Progress: 326/2363 symbols completed. BP took 3.3s. Estimated remaining: 48m 32s. Rate: 42.0 symbols/min [2025-09-05T18:07:50.011548] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:50.035408] [INFO ] [MAIN ] BRBR: Loaded 25090 existing records. [2025-09-05T18:07:50.231205] [INFO ] [MAIN ] BRBR: Found 1 missing trading days. [2025-09-05T18:07:50.231431] [INFO ] [MAIN ] BRBR: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:50.263513] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-05T18:07:50.488317] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-05T18:07:50.870027] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:07:50.996840] [INFO ] [MAIN ] BRBR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:50.999011] [INFO ] [MAIN ] BRBR: Combined dataset has 25090 total records. [2025-09-05T18:07:50.999633] [FATAL] [VALIDATOR ] BRBR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:50.999761] [FATAL] [MAIN ] BRBR: Combined data validation failed. [2025-09-05T18:07:50.999861] [WARN ] [MAIN ] BRBR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:51.000008] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-05T18:07:51.000628] [INFO ] [LOCAL ] BRBR: Starting deletion of derivative data. [2025-09-05T18:07:51.003799] [INFO ] [MAIN ] Update Progress: 327/2363 symbols completed. BRBR took 1.2s. Estimated remaining: 48m 29s. Rate: 42.0 symbols/min [2025-09-05T18:07:51.068582] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-05T18:07:51.082711] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-05T18:07:51.221435] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:51.230970] [INFO ] [MAIN ] BRC: Loaded 8452 existing records. [2025-09-05T18:07:51.406543] [INFO ] [MAIN ] BRC: Found 1 missing trading days. [2025-09-05T18:07:51.406756] [INFO ] [MAIN ] BRC: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:51.863478] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-05T18:07:52.085760] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-05T18:07:52.663476] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-05T18:07:53.201670] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-05T18:07:53.463448] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-05T18:07:53.811033] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-05T18:07:54.263525] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-05T18:07:54.558761] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-05T18:07:55.063482] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-05T18:07:55.809773] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:07:55.870096] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-05T18:07:55.909494] [INFO ] [MAIN ] BR: Adding 233 new records, updating 0 existing records. [2025-09-05T18:07:55.912207] [INFO ] [MAIN ] BR: Combined dataset has 16298 total records. [2025-09-05T18:07:56.142279] [WARN ] [VALIDATOR ] BR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:56.348173] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-05T18:07:56.363846] [WARN ] [VALIDATOR ] BR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:56.364122] [INFO ] [MAIN ] BR: Combined data validation passed. [2025-09-05T18:07:56.468667] [INFO ] [MAIN ] BR: Update completed successfully. [2025-09-05T18:07:56.470522] [INFO ] [MAIN ] Update Progress: 328/2363 symbols completed. BR took 8.0s. Estimated remaining: 48m 52s. Rate: 41.6 symbols/min [2025-09-05T18:07:56.649190] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:56.667583] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-05T18:07:56.668795] [INFO ] [MAIN ] BRCC: Loaded 19951 existing records. [2025-09-05T18:07:56.845794] [INFO ] [MAIN ] BRCC: Found 1 missing trading days. [2025-09-05T18:07:56.845932] [INFO ] [MAIN ] BRCC: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:56.982523] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:07:57.032631] [INFO ] [MAIN ] BRC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:07:57.034118] [INFO ] [MAIN ] BRC: Combined dataset has 8452 total records. [2025-09-05T18:07:57.034569] [FATAL] [VALIDATOR ] BRC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:07:57.034684] [FATAL] [MAIN ] BRC: Combined data validation failed. [2025-09-05T18:07:57.034736] [WARN ] [MAIN ] BRC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:07:57.034797] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-05T18:07:57.035122] [INFO ] [LOCAL ] BRC: Starting deletion of derivative data. [2025-09-05T18:07:57.036814] [INFO ] [MAIN ] Update Progress: 329/2363 symbols completed. BRC took 6.0s. Estimated remaining: 48m 46s. Rate: 41.7 symbols/min [2025-09-05T18:07:57.210924] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:57.211136] [WARN ] [MAIN ] BRFS: No existing data found, performing full refresh instead. [2025-09-05T18:07:57.211263] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-05T18:07:57.211302] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-05T18:07:57.211348] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-05T18:07:57.466127] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-05T18:07:57.573834] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:07:57.595497] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-05T18:07:58.263529] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-05T18:07:58.307513] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:07:58.427982] [INFO ] [MAIN ] BRCC: Adding 252 new records, updating 0 existing records. [2025-09-05T18:07:58.430991] [INFO ] [MAIN ] BRCC: Combined dataset has 20203 total records. [2025-09-05T18:07:58.608141] [WARN ] [VALIDATOR ] BRCC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:07:58.803031] [WARN ] [VALIDATOR ] BRCC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:07:58.803254] [INFO ] [MAIN ] BRCC: Combined data validation passed. [2025-09-05T18:07:58.919149] [INFO ] [MAIN ] BRCC: Update completed successfully. [2025-09-05T18:07:58.921573] [INFO ] [MAIN ] Update Progress: 330/2363 symbols completed. BRCC took 2.5s. Estimated remaining: 48m 47s. Rate: 41.7 symbols/min [2025-09-05T18:07:59.070043] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-05T18:07:59.095022] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:07:59.119351] [INFO ] [MAIN ] BRO: Loaded 25071 existing records. [2025-09-05T18:07:59.296841] [INFO ] [MAIN ] BRO: Found 1 missing trading days. [2025-09-05T18:07:59.296985] [INFO ] [MAIN ] BRO: Need to fetch 1 months: 2025-09 [2025-09-05T18:07:59.839483] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-05T18:07:59.863432] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-05T18:08:00.352082] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-05T18:08:00.663478] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-05T18:08:01.377418] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-05T18:08:01.463470] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-05T18:08:01.960871] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:08:02.112396] [INFO ] [MAIN ] BRO: Adding 374 new records, updating 0 existing records. [2025-09-05T18:08:02.117165] [INFO ] [MAIN ] BRO: Combined dataset has 25445 total records. [2025-09-05T18:08:02.272138] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-05T18:08:02.301446] [WARN ] [VALIDATOR ] BRO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:02.495899] [WARN ] [VALIDATOR ] BRO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:02.496121] [INFO ] [MAIN ] BRO: Combined data validation passed. [2025-09-05T18:08:02.682995] [INFO ] [MAIN ] BRO: Update completed successfully. [2025-09-05T18:08:02.687245] [INFO ] [MAIN ] Update Progress: 331/2363 symbols completed. BRO took 3.8s. Estimated remaining: 48m 60s. Rate: 41.5 symbols/min [2025-09-05T18:08:02.684032] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-05T18:08:02.877753] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:02.903117] [INFO ] [MAIN ] BROS: Loaded 25457 existing records. [2025-09-05T18:08:03.073243] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-05T18:08:03.083308] [INFO ] [MAIN ] BROS: Found 1 missing trading days. [2025-09-05T18:08:03.084393] [INFO ] [MAIN ] BROS: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:03.390226] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-05T18:08:03.659537] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:08:03.662784] [INFO ] [REMOTE ] BOND: Full fetch complete (34629 records). [2025-09-05T18:08:03.868711] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-05T18:08:04.040519] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-05T18:08:04.204218] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-05T18:08:04.204385] [INFO ] [MAIN ] Update Progress: 332/2363 symbols completed. BOND took 24.6s. Estimated remaining: 48m 59s. Rate: 41.5 symbols/min [2025-09-05T18:08:04.393440] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:04.410882] [INFO ] [MAIN ] BRSL: Loaded 16608 existing records. [2025-09-05T18:08:04.588226] [INFO ] [MAIN ] BRSL: Found 1 missing trading days. [2025-09-05T18:08:04.591289] [INFO ] [MAIN ] BRSL: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:04.591598] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:08:04.594003] [INFO ] [REMOTE ] BOH: Full fetch complete (33767 records). [2025-09-05T18:08:04.668604] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-05T18:08:04.971324] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-05T18:08:05.123209] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-05T18:08:05.123349] [INFO ] [MAIN ] Update Progress: 333/2363 symbols completed. BOH took 25.6s. Estimated remaining: 48m 54s. Rate: 41.5 symbols/min [2025-09-05T18:08:05.295356] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:05.312529] [INFO ] [MAIN ] BRSP: Loaded 17494 existing records. [2025-09-05T18:08:05.480443] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-05T18:08:05.488328] [INFO ] [MAIN ] BRSP: Found 1 missing trading days. [2025-09-05T18:08:05.489622] [INFO ] [MAIN ] BRSP: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:06.224928] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T18:08:06.268606] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-05T18:08:06.361564] [INFO ] [MAIN ] BRSL: Adding 354 new records, updating 0 existing records. [2025-09-05T18:08:06.364424] [INFO ] [MAIN ] BRSL: Combined dataset has 16962 total records. [2025-09-05T18:08:06.549295] [WARN ] [VALIDATOR ] BRSL: Not fatal, but first date in data (2025-07-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:06.737817] [WARN ] [VALIDATOR ] BRSL: Missing days changed. Total missing: 104 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01 [2025-09-05T18:08:06.738073] [INFO ] [MAIN ] BRSL: Combined data validation passed. [2025-09-05T18:08:06.849430] [INFO ] [MAIN ] BRSL: Update completed successfully. [2025-09-05T18:08:06.851188] [INFO ] [MAIN ] Update Progress: 334/2363 symbols completed. BRSL took 2.6s. Estimated remaining: 48m 54s. Rate: 41.5 symbols/min [2025-09-05T18:08:07.064726] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:07.068935] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-05T18:08:07.064828] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-05T18:08:07.069727] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:08:07.103193] [INFO ] [MAIN ] BRT: Loaded 2324 existing records. [2025-09-05T18:08:07.288789] [INFO ] [MAIN ] BRSP: Adding 272 new records, updating 0 existing records. [2025-09-05T18:08:07.366204] [INFO ] [MAIN ] BRT: Found 1 missing trading days. [2025-09-05T18:08:07.366526] [INFO ] [MAIN ] BRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:07.367301] [INFO ] [MAIN ] BRSP: Combined dataset has 17766 total records. [2025-09-05T18:08:07.551572] [WARN ] [VALIDATOR ] BRSP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:07.737254] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:08:07.868344] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-05T18:08:07.901974] [INFO ] [MAIN ] BROS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:08:07.906668] [INFO ] [MAIN ] BROS: Combined dataset has 25847 total records. [2025-09-05T18:08:08.090681] [WARN ] [VALIDATOR ] BROS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:08.276226] [WARN ] [VALIDATOR ] BRSP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:08.277283] [INFO ] [MAIN ] BRSP: Combined data validation passed. [2025-09-05T18:08:08.372533] [WARN ] [VALIDATOR ] BROS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:08.374813] [INFO ] [MAIN ] BROS: Combined data validation passed. [2025-09-05T18:08:08.484160] [INFO ] [MAIN ] BRSP: Update completed successfully. [2025-09-05T18:08:08.487365] [INFO ] [MAIN ] Update Progress: 335/2363 symbols completed. BRSP took 3.4s. Estimated remaining: 48m 54s. Rate: 41.5 symbols/min [2025-09-05T18:08:08.668166] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-05T18:08:08.671662] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:08.686668] [INFO ] [MAIN ] BRW: Loaded 9932 existing records. [2025-09-05T18:08:08.868388] [INFO ] [MAIN ] BRW: Found 1 missing trading days. [2025-09-05T18:08:08.869033] [INFO ] [MAIN ] BRW: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:08.910205] [INFO ] [MAIN ] BROS: Update completed successfully. [2025-09-05T18:08:08.913146] [INFO ] [MAIN ] Update Progress: 336/2363 symbols completed. BROS took 6.2s. Estimated remaining: 48m 46s. Rate: 41.6 symbols/min [2025-09-05T18:08:09.093384] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:08:09.093275] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:09.105497] [INFO ] [MAIN ] BRT: Adding 45 new records, updating 0 existing records. [2025-09-05T18:08:09.107549] [INFO ] [MAIN ] BRT: Combined dataset has 2369 total records. [2025-09-05T18:08:09.297841] [WARN ] [VALIDATOR ] BRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:09.339552] [INFO ] [MAIN ] BRX: Loaded 24823 existing records. [2025-09-05T18:08:09.472053] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-05T18:08:09.677241] [INFO ] [MAIN ] BRX: Found 1 missing trading days. [2025-09-05T18:08:09.677506] [INFO ] [MAIN ] BRX: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:09.687328] [WARN ] [VALIDATOR ] BRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:09.687584] [INFO ] [MAIN ] BRT: Combined data validation passed. [2025-09-05T18:08:09.702766] [INFO ] [MAIN ] BRT: Update completed successfully. [2025-09-05T18:08:09.703259] [INFO ] [MAIN ] Update Progress: 337/2363 symbols completed. BRT took 2.9s. Estimated remaining: 48m 41s. Rate: 41.6 symbols/min [2025-09-05T18:08:09.877365] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:09.909923] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-05T18:08:09.932894] [INFO ] [MAIN ] BSAC: Loaded 15205 existing records. [2025-09-05T18:08:10.111802] [INFO ] [MAIN ] BSAC: Found 1 missing trading days. [2025-09-05T18:08:10.111949] [INFO ] [MAIN ] BSAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:10.263497] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-05T18:08:10.652436] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:08:10.713211] [INFO ] [MAIN ] BRW: Adding 263 new records, updating 0 existing records. [2025-09-05T18:08:10.715518] [INFO ] [MAIN ] BRW: Combined dataset has 10195 total records. [2025-09-05T18:08:10.897763] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:08:10.901368] [WARN ] [VALIDATOR ] BRW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:11.073396] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-05T18:08:11.075434] [INFO ] [MAIN ] BSAC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:08:11.130357] [INFO ] [MAIN ] BSAC: Combined dataset has 15205 total records. [2025-09-05T18:08:11.161270] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:08:11.161544] [FATAL] [MAIN ] BSAC: Combined data validation failed. [2025-09-05T18:08:11.161597] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:08:11.161664] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-05T18:08:11.162231] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-09-05T18:08:11.164789] [INFO ] [MAIN ] Update Progress: 338/2363 symbols completed. BSAC took 1.5s. Estimated remaining: 48m 40s. Rate: 41.6 symbols/min [2025-09-05T18:08:11.341260] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:11.359757] [WARN ] [VALIDATOR ] BRW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:11.360720] [INFO ] [MAIN ] BRW: Combined data validation passed. [2025-09-05T18:08:11.361439] [INFO ] [MAIN ] BSBR: Loaded 17320 existing records. [2025-09-05T18:08:11.610145] [INFO ] [MAIN ] BSBR: Found 1 missing trading days. [2025-09-05T18:08:11.612691] [INFO ] [MAIN ] BSBR: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:11.621100] [INFO ] [MAIN ] BRW: Update completed successfully. [2025-09-05T18:08:11.622435] [INFO ] [MAIN ] Update Progress: 339/2363 symbols completed. BRW took 3.1s. Estimated remaining: 48m 32s. Rate: 41.7 symbols/min [2025-09-05T18:08:11.785538] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:08:11.817927] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:11.868573] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-05T18:08:11.892699] [INFO ] [MAIN ] BSL: Loaded 3305 existing records. [2025-09-05T18:08:12.031855] [INFO ] [MAIN ] BRX: Adding 386 new records, updating 0 existing records. [2025-09-05T18:08:12.137046] [INFO ] [MAIN ] BSL: Found 1 missing trading days. [2025-09-05T18:08:12.137279] [INFO ] [MAIN ] BSL: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:12.137989] [INFO ] [MAIN ] BRX: Combined dataset has 25209 total records. [2025-09-05T18:08:12.320536] [WARN ] [VALIDATOR ] BRX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:12.370735] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:08:12.681552] [INFO ] [MAIN ] BSBR: Adding 291 new records, updating 0 existing records. [2025-09-05T18:08:12.672797] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-05T18:08:12.687076] [INFO ] [MAIN ] BSBR: Combined dataset has 17611 total records. [2025-09-05T18:08:12.875260] [WARN ] [VALIDATOR ] BSBR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:13.082293] [WARN ] [VALIDATOR ] BRX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:13.082391] [WARN ] [VALIDATOR ] BSBR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:13.082949] [INFO ] [MAIN ] BSBR: Combined data validation passed. [2025-09-05T18:08:13.082828] [INFO ] [MAIN ] BRX: Combined data validation passed. [2025-09-05T18:08:13.290930] [INFO ] [MAIN ] BSBR: Update completed successfully. [2025-09-05T18:08:13.296880] [INFO ] [MAIN ] Update Progress: 340/2363 symbols completed. BSBR took 2.1s. Estimated remaining: 48m 32s. Rate: 41.7 symbols/min [2025-09-05T18:08:13.476446] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-05T18:08:13.487282] [INFO ] [MAIN ] BRX: Update completed successfully. [2025-09-05T18:08:13.512001] [INFO ] [MAIN ] Update Progress: 341/2363 symbols completed. BRX took 4.6s. Estimated remaining: 48m 24s. Rate: 41.8 symbols/min [2025-09-05T18:08:13.514971] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:13.696882] [INFO ] [MAIN ] BSM: Loaded 16187 existing records. [2025-09-05T18:08:13.698144] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:13.852283] [INFO ] [MAIN ] BST: Loaded 8552 existing records. [2025-09-05T18:08:13.910769] [INFO ] [MAIN ] BSM: Found 1 missing trading days. [2025-09-05T18:08:13.934709] [INFO ] [MAIN ] BSM: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:14.052267] [INFO ] [MAIN ] BST: Found 1 missing trading days. [2025-09-05T18:08:14.052429] [INFO ] [MAIN ] BST: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:14.263492] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-05T18:08:14.568040] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:08:14.585691] [INFO ] [MAIN ] BSL: Adding 14 new records, updating 0 existing records. [2025-09-05T18:08:14.587955] [INFO ] [MAIN ] BSL: Combined dataset has 3319 total records. [2025-09-05T18:08:14.775178] [WARN ] [VALIDATOR ] BSL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:14.911803] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-05T18:08:15.005671] [WARN ] [VALIDATOR ] BSL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:15.005883] [INFO ] [MAIN ] BSL: Combined data validation passed. [2025-09-05T18:08:15.027265] [INFO ] [MAIN ] BSL: Update completed successfully. [2025-09-05T18:08:15.027841] [INFO ] [MAIN ] Update Progress: 342/2363 symbols completed. BSL took 3.4s. Estimated remaining: 48m 23s. Rate: 41.8 symbols/min [2025-09-05T18:08:15.070221] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-05T18:08:15.137157] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:08:15.264967] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:15.268854] [INFO ] [MAIN ] BST: Adding 0 new records, updating 0 existing records. [2025-09-05T18:08:15.271836] [INFO ] [MAIN ] BST: Combined dataset has 8552 total records. [2025-09-05T18:08:15.272261] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:08:15.272375] [FATAL] [MAIN ] BST: Combined data validation failed. [2025-09-05T18:08:15.272414] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:08:15.272461] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-05T18:08:15.272834] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-09-05T18:08:15.277332] [INFO ] [MAIN ] Update Progress: 343/2363 symbols completed. BST took 1.8s. Estimated remaining: 48m 14s. Rate: 41.9 symbols/min [2025-09-05T18:08:15.385631] [INFO ] [MAIN ] BSTZ: Loaded 12208 existing records. [2025-09-05T18:08:15.594030] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:15.654673] [INFO ] [MAIN ] BSTZ: Found 1 missing trading days. [2025-09-05T18:08:15.654920] [INFO ] [MAIN ] BSTZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:15.678837] [INFO ] [MAIN ] BSX: Loaded 25671 existing records. [2025-09-05T18:08:15.854980] [INFO ] [MAIN ] BSX: Found 1 missing trading days. [2025-09-05T18:08:15.855130] [INFO ] [MAIN ] BSX: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:15.863415] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-05T18:08:16.471804] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:08:16.616788] [INFO ] [MAIN ] BSX: Adding 390 new records, updating 0 existing records. [2025-09-05T18:08:16.619913] [INFO ] [MAIN ] BSX: Combined dataset has 26061 total records. [2025-09-05T18:08:16.675151] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-05T18:08:16.798793] [WARN ] [VALIDATOR ] BSX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:17.030570] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-05T18:08:17.046750] [WARN ] [VALIDATOR ] BSX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:17.046964] [INFO ] [MAIN ] BSX: Combined data validation passed. [2025-09-05T18:08:17.210450] [INFO ] [MAIN ] BSX: Update completed successfully. [2025-09-05T18:08:17.214241] [INFO ] [MAIN ] Update Progress: 344/2363 symbols completed. BSX took 1.9s. Estimated remaining: 48m 16s. Rate: 41.8 symbols/min [2025-09-05T18:08:17.389355] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:17.393183] [INFO ] [MAIN ] BTA: Loaded 2454 existing records. [2025-09-05T18:08:17.469191] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-05T18:08:17.573367] [INFO ] [MAIN ] BTA: Found 1 missing trading days. [2025-09-05T18:08:17.573556] [INFO ] [MAIN ] BTA: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:18.106463] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:08:18.164406] [INFO ] [MAIN ] BSTZ: Adding 144 new records, updating 0 existing records. [2025-09-05T18:08:18.166912] [INFO ] [MAIN ] BSTZ: Combined dataset has 12352 total records. [2025-09-05T18:08:18.268806] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-05T18:08:18.350724] [WARN ] [VALIDATOR ] BSTZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:18.540586] [WARN ] [VALIDATOR ] BSTZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:18.540811] [INFO ] [MAIN ] BSTZ: Combined data validation passed. [2025-09-05T18:08:18.616683] [INFO ] [MAIN ] BSTZ: Update completed successfully. [2025-09-05T18:08:18.618265] [INFO ] [MAIN ] Update Progress: 345/2363 symbols completed. BSTZ took 3.6s. Estimated remaining: 48m 14s. Rate: 41.8 symbols/min [2025-09-05T18:08:18.790218] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:18.801320] [INFO ] [MAIN ] BTCM: Loaded 10119 existing records. [2025-09-05T18:08:18.904417] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:08:18.940716] [INFO ] [MAIN ] BTA: Adding 86 new records, updating 0 existing records. [2025-09-05T18:08:18.992785] [INFO ] [MAIN ] BTCM: Found 1 missing trading days. [2025-09-05T18:08:18.992951] [INFO ] [MAIN ] BTCM: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:18.993461] [INFO ] [MAIN ] BTA: Combined dataset has 2540 total records. [2025-09-05T18:08:19.068625] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-05T18:08:19.172975] [WARN ] [VALIDATOR ] BTA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:19.380814] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-05T18:08:19.397255] [WARN ] [VALIDATOR ] BTA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:19.397499] [INFO ] [MAIN ] BTA: Combined data validation passed. [2025-09-05T18:08:19.413796] [INFO ] [MAIN ] BTA: Update completed successfully. [2025-09-05T18:08:19.414230] [INFO ] [MAIN ] Update Progress: 346/2363 symbols completed. BTA took 2.2s. Estimated remaining: 48m 9s. Rate: 41.9 symbols/min [2025-09-05T18:08:19.583674] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:19.630782] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:08:19.631531] [INFO ] [MAIN ] BTE: Loaded 39688 existing records. [2025-09-05T18:08:19.878258] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-05T18:08:19.863798] [INFO ] [MAIN ] BSM: Adding 277 new records, updating 0 existing records. [2025-09-05T18:08:19.921796] [INFO ] [MAIN ] BTE: Found 1 missing trading days. [2025-09-05T18:08:19.922549] [INFO ] [MAIN ] BTE: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:19.923693] [INFO ] [MAIN ] BSM: Combined dataset has 16464 total records. [2025-09-05T18:08:20.125068] [WARN ] [VALIDATOR ] BSM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:20.313458] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:08:20.316080] [INFO ] [REMOTE ] BRFS: Full fetch complete (45235 records). [2025-09-05T18:08:20.676187] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-05T18:08:20.728497] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-05T18:08:20.829094] [WARN ] [VALIDATOR ] BSM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:20.829870] [INFO ] [MAIN ] BSM: Combined data validation passed. [2025-09-05T18:08:20.948734] [INFO ] [MAIN ] BSM: Update completed successfully. [2025-09-05T18:08:20.951415] [INFO ] [MAIN ] Update Progress: 347/2363 symbols completed. BSM took 7.6s. Estimated remaining: 48m 8s. Rate: 41.9 symbols/min [2025-09-05T18:08:21.181236] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:21.200501] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-05T18:08:21.200684] [INFO ] [MAIN ] Update Progress: 348/2363 symbols completed. BRFS took 24.2s. Estimated remaining: 47m 60s. Rate: 42.0 symbols/min [2025-09-05T18:08:21.327310] [INFO ] [MAIN ] BTI: Loaded 25619 existing records. [2025-09-05T18:08:21.478584] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-05T18:08:21.565844] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:21.598024] [INFO ] [MAIN ] BTI: Found 1 missing trading days. [2025-09-05T18:08:21.598189] [INFO ] [MAIN ] BTI: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:21.601379] [INFO ] [MAIN ] BTO: Loaded 4074 existing records. [2025-09-05T18:08:21.795225] [INFO ] [MAIN ] BTO: Found 1 missing trading days. [2025-09-05T18:08:21.795404] [INFO ] [MAIN ] BTO: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:22.263440] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-05T18:08:22.573953] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-05T18:08:22.707727] [INFO ] [MAIN ] BTE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:08:22.710814] [INFO ] [MAIN ] BTE: Combined dataset has 39688 total records. [2025-09-05T18:08:22.711317] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:08:22.711399] [FATAL] [MAIN ] BTE: Combined data validation failed. [2025-09-05T18:08:22.711438] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:08:22.711482] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-05T18:08:22.712282] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-09-05T18:08:22.717595] [INFO ] [MAIN ] Update Progress: 349/2363 symbols completed. BTE took 3.3s. Estimated remaining: 47m 59s. Rate: 42.0 symbols/min [2025-09-05T18:08:22.820983] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T18:08:22.949424] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:22.960707] [INFO ] [MAIN ] BTCM: Adding 92 new records, updating 0 existing records. [2025-09-05T18:08:22.970628] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:08:23.031679] [INFO ] [MAIN ] BTT: Loaded 7154 existing records. [2025-09-05T18:08:23.042337] [INFO ] [MAIN ] BTCM: Combined dataset has 10211 total records. [2025-09-05T18:08:23.068107] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-05T18:08:23.358824] [INFO ] [MAIN ] BTI: Adding 389 new records, updating 0 existing records. [2025-09-05T18:08:23.469601] [INFO ] [MAIN ] BTT: Found 1 missing trading days. [2025-09-05T18:08:23.491790] [INFO ] [MAIN ] BTT: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:23.561780] [WARN ] [VALIDATOR ] BTCM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:23.669572] [INFO ] [MAIN ] BTI: Combined dataset has 26008 total records. [2025-09-05T18:08:23.873887] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-05T18:08:23.959060] [WARN ] [VALIDATOR ] BTI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:24.216071] [WARN ] [VALIDATOR ] BTCM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:24.216175] [WARN ] [VALIDATOR ] BTI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:24.216675] [INFO ] [MAIN ] BTCM: Combined data validation passed. [2025-09-05T18:08:24.217128] [INFO ] [MAIN ] BTI: Combined data validation passed. [2025-09-05T18:08:24.387041] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T18:08:24.471506] [INFO ] [MAIN ] BTO: Adding 47 new records, updating 0 existing records. [2025-09-05T18:08:24.472396] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:08:24.536960] [INFO ] [MAIN ] BTI: Update completed successfully. [2025-09-05T18:08:24.546021] [INFO ] [MAIN ] Update Progress: 350/2363 symbols completed. BTI took 3.6s. Estimated remaining: 47m 60s. Rate: 41.9 symbols/min [2025-09-05T18:08:24.537538] [INFO ] [MAIN ] BTO: Combined dataset has 4121 total records. [2025-09-05T18:08:24.606815] [INFO ] [MAIN ] BTT: Adding 103 new records, updating 0 existing records. [2025-09-05T18:08:24.755719] [INFO ] [MAIN ] BTCM: Update completed successfully. [2025-09-05T18:08:24.793245] [INFO ] [MAIN ] Update Progress: 351/2363 symbols completed. BTCM took 6.2s. Estimated remaining: 47m 52s. Rate: 42.0 symbols/min [2025-09-05T18:08:24.846187] [INFO ] [MAIN ] BTT: Combined dataset has 7257 total records. [2025-09-05T18:08:24.959501] [WARN ] [VALIDATOR ] BTO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:25.129500] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:25.325714] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:25.421890] [WARN ] [VALIDATOR ] BTT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:25.700005] [INFO ] [MAIN ] BTU: Loaded 40145 existing records. [2025-09-05T18:08:25.709928] [INFO ] [MAIN ] BTX: Loaded 24069 existing records. [2025-09-05T18:08:26.068929] [INFO ] [MAIN ] BTX: Found 1 missing trading days. [2025-09-05T18:08:26.134792] [INFO ] [MAIN ] BTU: Found 1 missing trading days. [2025-09-05T18:08:26.135992] [INFO ] [MAIN ] BTU: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:26.135374] [INFO ] [MAIN ] BTX: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:26.137032] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-05T18:08:26.137745] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-05T18:08:26.147820] [WARN ] [VALIDATOR ] BTO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:26.147905] [WARN ] [VALIDATOR ] BTT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:26.148275] [INFO ] [MAIN ] BTT: Combined data validation passed. [2025-09-05T18:08:26.148426] [INFO ] [MAIN ] BTO: Combined data validation passed. [2025-09-05T18:08:26.217150] [INFO ] [MAIN ] BTO: Update completed successfully. [2025-09-05T18:08:26.220409] [INFO ] [MAIN ] Update Progress: 352/2363 symbols completed. BTO took 5.0s. Estimated remaining: 47m 50s. Rate: 42.0 symbols/min [2025-09-05T18:08:26.255562] [INFO ] [MAIN ] BTT: Update completed successfully. [2025-09-05T18:08:26.288783] [INFO ] [MAIN ] Update Progress: 353/2363 symbols completed. BTT took 3.6s. Estimated remaining: 47m 41s. Rate: 42.2 symbols/min [2025-09-05T18:08:26.570051] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:26.589630] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:26.604470] [INFO ] [MAIN ] BTZ: Loaded 9696 existing records. [2025-09-05T18:08:26.794153] [INFO ] [MAIN ] BTZ: Found 1 missing trading days. [2025-09-05T18:08:26.794417] [INFO ] [MAIN ] BTZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:26.794673] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-05T18:08:26.810948] [INFO ] [MAIN ] BUD: Loaded 39615 existing records. [2025-09-05T18:08:26.998285] [INFO ] [MAIN ] BUD: Found 1 missing trading days. [2025-09-05T18:08:26.998565] [INFO ] [MAIN ] BUD: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:27.006081] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:08:27.068619] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-05T18:08:27.168532] [INFO ] [MAIN ] BTU: Adding 390 new records, updating 0 existing records. [2025-09-05T18:08:27.172448] [INFO ] [MAIN ] BTU: Combined dataset has 40535 total records. [2025-09-05T18:08:27.406714] [WARN ] [VALIDATOR ] BTU: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:08:27.492468] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T18:08:27.684383] [INFO ] [MAIN ] BTX: Adding 200 new records, updating 0 existing records. [2025-09-05T18:08:27.691711] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:08:27.782902] [INFO ] [MAIN ] BTX: Combined dataset has 24269 total records. [2025-09-05T18:08:27.890879] [INFO ] [MAIN ] BUD: Adding 0 new records, updating 0 existing records. [2025-09-05T18:08:27.949908] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:08:27.949735] [INFO ] [MAIN ] BUD: Combined dataset has 39615 total records. [2025-09-05T18:08:28.025500] [FATAL] [VALIDATOR ] BUD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:08:28.094539] [INFO ] [MAIN ] BTZ: Adding 163 new records, updating 0 existing records. [2025-09-05T18:08:28.092936] [FATAL] [MAIN ] BUD: Combined data validation failed. [2025-09-05T18:08:28.101010] [WARN ] [VALIDATOR ] BTX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:08:28.102669] [WARN ] [MAIN ] BUD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:08:28.133821] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-05T18:08:28.150704] [INFO ] [MAIN ] BTZ: Combined dataset has 9859 total records. [2025-09-05T18:08:28.167177] [INFO ] [LOCAL ] BUD: Starting deletion of derivative data. [2025-09-05T18:08:28.250915] [INFO ] [MAIN ] Update Progress: 354/2363 symbols completed. BUD took 1.9s. Estimated remaining: 47m 43s. Rate: 42.1 symbols/min [2025-09-05T18:08:28.609070] [WARN ] [VALIDATOR ] BTZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:28.779792] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:28.868456] [INFO ] [MAIN ] BUI: Loaded 8647 existing records. [2025-09-05T18:08:28.957912] [WARN ] [VALIDATOR ] BTU: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:08:28.967600] [INFO ] [MAIN ] BTU: Combined data validation passed. [2025-09-05T18:08:29.160113] [INFO ] [MAIN ] BUI: Found 1 missing trading days. [2025-09-05T18:08:29.204489] [INFO ] [MAIN ] BUI: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:29.207075] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-05T18:08:29.341444] [WARN ] [VALIDATOR ] BTX: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:08:29.342400] [INFO ] [MAIN ] BTX: Combined data validation passed. [2025-09-05T18:08:29.359594] [WARN ] [VALIDATOR ] BTZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:29.408976] [INFO ] [MAIN ] BTZ: Combined data validation passed. [2025-09-05T18:08:29.566247] [INFO ] [MAIN ] BTZ: Update completed successfully. [2025-09-05T18:08:29.566614] [INFO ] [MAIN ] BTX: Update completed successfully. [2025-09-05T18:08:29.569775] [INFO ] [MAIN ] Update Progress: 355/2363 symbols completed. BTX took 4.8s. Estimated remaining: 47m 41s. Rate: 42.1 symbols/min [2025-09-05T18:08:29.579860] [INFO ] [MAIN ] Update Progress: 356/2363 symbols completed. BTZ took 3.4s. Estimated remaining: 47m 31s. Rate: 42.2 symbols/min [2025-09-05T18:08:29.591378] [INFO ] [MAIN ] BTU: Update completed successfully. [2025-09-05T18:08:29.682473] [INFO ] [MAIN ] Update Progress: 357/2363 symbols completed. BTU took 5.1s. Estimated remaining: 47m 22s. Rate: 42.3 symbols/min [2025-09-05T18:08:29.909249] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:29.934187] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:29.962258] [INFO ] [MAIN ] BURL: Loaded 21561 existing records. [2025-09-05T18:08:30.084813] [INFO ] [MAIN ] BUR: Loaded 22364 existing records. [2025-09-05T18:08:30.145475] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:08:30.281057] [INFO ] [MAIN ] BURL: Found 1 missing trading days. [2025-09-05T18:08:30.292600] [INFO ] [MAIN ] BURL: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:30.299048] [INFO ] [MAIN ] BUI: Adding 68 new records, updating 0 existing records. [2025-09-05T18:08:30.298082] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-05T18:08:30.381077] [INFO ] [MAIN ] BUI: Combined dataset has 8715 total records. [2025-09-05T18:08:30.433692] [INFO ] [MAIN ] BUR: Found 1 missing trading days. [2025-09-05T18:08:30.446027] [INFO ] [MAIN ] BUR: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:30.461097] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-05T18:08:30.571071] [WARN ] [VALIDATOR ] BUI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:08:30.760131] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:08:30.898915] [INFO ] [MAIN ] BURL: Adding 332 new records, updating 0 existing records. [2025-09-05T18:08:30.903105] [INFO ] [MAIN ] BURL: Combined dataset has 21893 total records. [2025-09-05T18:08:31.092869] [WARN ] [VALIDATOR ] BURL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:31.291764] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:08:31.323229] [WARN ] [VALIDATOR ] BUI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:08:31.344154] [INFO ] [MAIN ] BUI: Combined data validation passed. [2025-09-05T18:08:31.425811] [INFO ] [MAIN ] BUR: Adding 345 new records, updating 0 existing records. [2025-09-05T18:08:31.488582] [INFO ] [MAIN ] BUI: Update completed successfully. [2025-09-05T18:08:31.488440] [INFO ] [MAIN ] BUR: Combined dataset has 22709 total records. [2025-09-05T18:08:31.489729] [INFO ] [MAIN ] Update Progress: 358/2363 symbols completed. BUI took 3.2s. Estimated remaining: 47m 23s. Rate: 42.3 symbols/min [2025-09-05T18:08:31.683920] [WARN ] [VALIDATOR ] BUR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:31.791561] [WARN ] [VALIDATOR ] BURL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:31.802811] [INFO ] [MAIN ] BURL: Combined data validation passed. [2025-09-05T18:08:32.021112] [INFO ] [MAIN ] BURL: Update completed successfully. [2025-09-05T18:08:32.024177] [INFO ] [MAIN ] Update Progress: 359/2363 symbols completed. BURL took 2.4s. Estimated remaining: 47m 17s. Rate: 42.4 symbols/min [2025-09-05T18:08:32.029698] [WARN ] [VALIDATOR ] BUR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:32.029852] [INFO ] [MAIN ] BUR: Combined data validation passed. [2025-09-05T18:08:32.164252] [INFO ] [MAIN ] BUR: Update completed successfully. [2025-09-05T18:08:32.167407] [INFO ] [MAIN ] Update Progress: 360/2363 symbols completed. BUR took 2.6s. Estimated remaining: 47m 8s. Rate: 42.5 symbols/min [2025-09-05T18:08:32.782497] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:32.801283] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:32.850419] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:32.869977] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-09-05T18:08:32.870202] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-05T18:08:32.870260] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-05T18:08:32.870327] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-05T18:08:32.869758] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:32.891606] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-09-05T18:08:32.900884] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-05T18:08:32.901030] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-05T18:08:32.912028] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-05T18:08:33.143075] [INFO ] [MAIN ] BVN: Loaded 20616 existing records. [2025-09-05T18:08:33.317939] [INFO ] [MAIN ] BW: Loaded 17810 existing records. [2025-09-05T18:08:33.816376] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:08:33.888597] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-05T18:08:33.925278] [INFO ] [MAIN ] BVN: Found 1 missing trading days. [2025-09-05T18:08:33.984707] [INFO ] [MAIN ] BVN: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:34.015194] [INFO ] [REMOTE ] BV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:08:34.015394] [INFO ] [MAIN ] BW: Found 1 missing trading days. [2025-09-05T18:08:34.016509] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-05T18:08:34.017508] [INFO ] [MAIN ] BW: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:34.015948] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-05T18:08:34.017857] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-05T18:08:34.591836] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:08:34.655326] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:08:34.798002] [INFO ] [MAIN ] BW: Adding 350 new records, updating 0 existing records. [2025-09-05T18:08:34.862223] [INFO ] [MAIN ] BVN: Adding 317 new records, updating 0 existing records. [2025-09-05T18:08:34.865008] [INFO ] [MAIN ] BW: Combined dataset has 18160 total records. [2025-09-05T18:08:34.968251] [INFO ] [MAIN ] BVN: Combined dataset has 20933 total records. [2025-09-05T18:08:35.138381] [WARN ] [VALIDATOR ] BW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:35.307058] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-05T18:08:35.392760] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-05T18:08:35.397795] [WARN ] [VALIDATOR ] BVN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:35.669930] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-05T18:08:35.678061] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-05T18:08:35.682885] [WARN ] [VALIDATOR ] BW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:35.682935] [WARN ] [VALIDATOR ] BVN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:35.683109] [INFO ] [MAIN ] BW: Combined data validation passed. [2025-09-05T18:08:35.683224] [INFO ] [MAIN ] BVN: Combined data validation passed. [2025-09-05T18:08:35.895936] [INFO ] [MAIN ] BW: Update completed successfully. [2025-09-05T18:08:35.898415] [INFO ] [MAIN ] Update Progress: 361/2363 symbols completed. BW took 3.7s. Estimated remaining: 47m 20s. Rate: 42.3 symbols/min [2025-09-05T18:08:36.021886] [INFO ] [MAIN ] BVN: Update completed successfully. [2025-09-05T18:08:36.034444] [INFO ] [MAIN ] Update Progress: 362/2363 symbols completed. BVN took 3.9s. Estimated remaining: 47m 11s. Rate: 42.4 symbols/min [2025-09-05T18:08:36.133378] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:36.248599] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-05T18:08:36.274834] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:36.281203] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-05T18:08:36.295674] [INFO ] [MAIN ] BWA: Loaded 24904 existing records. [2025-09-05T18:08:36.334300] [INFO ] [MAIN ] BWG: Loaded 6314 existing records. [2025-09-05T18:08:36.638308] [INFO ] [MAIN ] BWG: Found 1 missing trading days. [2025-09-05T18:08:36.663388] [INFO ] [MAIN ] BWA: Found 1 missing trading days. [2025-09-05T18:08:36.663556] [INFO ] [MAIN ] BWA: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:36.663855] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-05T18:08:36.663948] [INFO ] [MAIN ] BWG: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:36.665112] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-05T18:08:36.773383] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-05T18:08:37.331214] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-05T18:08:37.463490] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-05T18:08:37.477072] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:08:37.514930] [INFO ] [MAIN ] BWG: Adding 98 new records, updating 0 existing records. [2025-09-05T18:08:37.524416] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:08:37.524499] [INFO ] [MAIN ] BWG: Combined dataset has 6412 total records. [2025-09-05T18:08:37.858500] [INFO ] [MAIN ] BWA: Adding 384 new records, updating 0 existing records. [2025-09-05T18:08:37.857225] [WARN ] [VALIDATOR ] BWG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:38.038828] [INFO ] [MAIN ] BWA: Combined dataset has 25288 total records. [2025-09-05T18:08:38.224414] [WARN ] [VALIDATOR ] BWA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:38.267419] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-05T18:08:38.428615] [WARN ] [VALIDATOR ] BWG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:38.428715] [WARN ] [VALIDATOR ] BWA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:38.429100] [INFO ] [MAIN ] BWA: Combined data validation passed. [2025-09-05T18:08:38.428989] [INFO ] [MAIN ] BWG: Combined data validation passed. [2025-09-05T18:08:38.587396] [INFO ] [MAIN ] BWG: Update completed successfully. [2025-09-05T18:08:38.588430] [INFO ] [MAIN ] Update Progress: 363/2363 symbols completed. BWG took 2.5s. Estimated remaining: 47m 16s. Rate: 42.3 symbols/min [2025-09-05T18:08:38.794868] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:38.795059] [INFO ] [MAIN ] BWA: Update completed successfully. [2025-09-05T18:08:38.798352] [INFO ] [MAIN ] Update Progress: 364/2363 symbols completed. BWA took 2.9s. Estimated remaining: 47m 8s. Rate: 42.4 symbols/min [2025-09-05T18:08:38.910597] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-05T18:08:38.946700] [INFO ] [MAIN ] BWLP: Loaded 15238 existing records. [2025-09-05T18:08:39.081700] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-05T18:08:39.090329] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:39.200447] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-05T18:08:39.197938] [INFO ] [MAIN ] BWMX: Loaded 4549 existing records. [2025-09-05T18:08:39.241546] [INFO ] [MAIN ] BWLP: Found 1 missing trading days. [2025-09-05T18:08:39.267201] [INFO ] [MAIN ] BWLP: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:39.402241] [INFO ] [MAIN ] BWMX: Found 1 missing trading days. [2025-09-05T18:08:39.402405] [INFO ] [MAIN ] BWMX: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:39.863470] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-05T18:08:40.622156] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-05T18:08:40.638369] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:08:40.658634] [INFO ] [MAIN ] BWMX: Adding 60 new records, updating 0 existing records. [2025-09-05T18:08:40.660131] [INFO ] [MAIN ] BWMX: Combined dataset has 4609 total records. [2025-09-05T18:08:40.671376] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-05T18:08:40.846769] [WARN ] [VALIDATOR ] BWMX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:41.035606] [WARN ] [VALIDATOR ] BWMX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:41.035844] [INFO ] [MAIN ] BWMX: Combined data validation passed. [2025-09-05T18:08:41.065110] [INFO ] [MAIN ] BWMX: Update completed successfully. [2025-09-05T18:08:41.065822] [INFO ] [MAIN ] Update Progress: 365/2363 symbols completed. BWMX took 2.3s. Estimated remaining: 47m 11s. Rate: 42.3 symbols/min [2025-09-05T18:08:41.236560] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:41.240143] [INFO ] [MAIN ] BWNB: Loaded 1874 existing records. [2025-09-05T18:08:41.411514] [INFO ] [MAIN ] BWNB: Found 1 missing trading days. [2025-09-05T18:08:41.411701] [INFO ] [MAIN ] BWNB: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:41.463466] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-05T18:08:41.813663] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-05T18:08:42.057850] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:08:42.070571] [INFO ] [MAIN ] BWNB: Adding 31 new records, updating 0 existing records. [2025-09-05T18:08:42.072242] [INFO ] [MAIN ] BWNB: Combined dataset has 1905 total records. [2025-09-05T18:08:42.268620] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-05T18:08:42.340665] [WARN ] [VALIDATOR ] BWNB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:42.614359] [WARN ] [VALIDATOR ] BWNB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:42.614614] [INFO ] [MAIN ] BWNB: Combined data validation passed. [2025-09-05T18:08:42.635903] [INFO ] [MAIN ] BWNB: Update completed successfully. [2025-09-05T18:08:42.636541] [INFO ] [MAIN ] Update Progress: 366/2363 symbols completed. BWNB took 1.6s. Estimated remaining: 47m 11s. Rate: 42.3 symbols/min [2025-09-05T18:08:42.864176] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:42.870324] [INFO ] [MAIN ] BWSN: Loaded 2452 existing records. [2025-09-05T18:08:43.063520] [INFO ] [MAIN ] BWSN: Found 1 missing trading days. [2025-09-05T18:08:43.063688] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-05T18:08:43.064101] [INFO ] [MAIN ] BWSN: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:43.797546] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-05T18:08:43.863418] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-05T18:08:44.451066] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-05T18:08:44.546162] [INFO ] [MAIN ] BWLP: Adding 190 new records, updating 0 existing records. [2025-09-05T18:08:44.548678] [INFO ] [MAIN ] BWLP: Combined dataset has 15428 total records. [2025-09-05T18:08:44.668563] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-05T18:08:44.731258] [WARN ] [VALIDATOR ] BWLP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:44.941084] [WARN ] [VALIDATOR ] BWLP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:44.941323] [INFO ] [MAIN ] BWLP: Combined data validation passed. [2025-09-05T18:08:45.038160] [INFO ] [MAIN ] BWLP: Update completed successfully. [2025-09-05T18:08:45.039975] [INFO ] [MAIN ] Update Progress: 367/2363 symbols completed. BWLP took 6.4s. Estimated remaining: 47m 15s. Rate: 42.2 symbols/min [2025-09-05T18:08:45.218922] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:45.243097] [INFO ] [MAIN ] BWXT: Loaded 22948 existing records. [2025-09-05T18:08:45.439312] [INFO ] [MAIN ] BWXT: Found 1 missing trading days. [2025-09-05T18:08:45.439571] [INFO ] [MAIN ] BWXT: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:45.460125] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-05T18:08:45.466999] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-05T18:08:45.910390] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-05T18:08:46.023199] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:08:46.153274] [INFO ] [MAIN ] BWXT: Adding 349 new records, updating 0 existing records. [2025-09-05T18:08:46.156480] [INFO ] [MAIN ] BWXT: Combined dataset has 23297 total records. [2025-09-05T18:08:46.268593] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-05T18:08:46.335478] [WARN ] [VALIDATOR ] BWXT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:46.526079] [WARN ] [VALIDATOR ] BWXT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:46.526305] [INFO ] [MAIN ] BWXT: Combined data validation passed. [2025-09-05T18:08:46.675003] [INFO ] [MAIN ] BWXT: Update completed successfully. [2025-09-05T18:08:46.677835] [INFO ] [MAIN ] Update Progress: 368/2363 symbols completed. BWXT took 1.6s. Estimated remaining: 47m 14s. Rate: 42.2 symbols/min [2025-09-05T18:08:46.849073] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:46.875143] [INFO ] [MAIN ] BX: Loaded 25547 existing records. [2025-09-05T18:08:47.057127] [INFO ] [MAIN ] BX: Found 1 missing trading days. [2025-09-05T18:08:47.057280] [INFO ] [MAIN ] BX: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:47.063433] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-05T18:08:47.745757] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:08:47.760141] [INFO ] [MAIN ] BWSN: Adding 26 new records, updating 0 existing records. [2025-09-05T18:08:47.761601] [INFO ] [MAIN ] BWSN: Combined dataset has 2478 total records. [2025-09-05T18:08:47.868553] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-05T18:08:47.942434] [WARN ] [VALIDATOR ] BWSN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:48.152690] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-05T18:08:48.170075] [WARN ] [VALIDATOR ] BWSN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:48.170295] [INFO ] [MAIN ] BWSN: Combined data validation passed. [2025-09-05T18:08:48.188406] [INFO ] [MAIN ] BWSN: Update completed successfully. [2025-09-05T18:08:48.188963] [INFO ] [MAIN ] Update Progress: 369/2363 symbols completed. BWSN took 5.6s. Estimated remaining: 47m 14s. Rate: 42.2 symbols/min [2025-09-05T18:08:48.362980] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:48.371250] [INFO ] [MAIN ] BXC: Loaded 6605 existing records. [2025-09-05T18:08:48.547663] [INFO ] [MAIN ] BXC: Found 1 missing trading days. [2025-09-05T18:08:48.547850] [INFO ] [MAIN ] BXC: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:48.663453] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-05T18:08:49.030723] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:08:49.060827] [INFO ] [MAIN ] BXC: Adding 71 new records, updating 0 existing records. [2025-09-05T18:08:49.062733] [INFO ] [MAIN ] BXC: Combined dataset has 6676 total records. [2025-09-05T18:08:49.270443] [WARN ] [VALIDATOR ] BXC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:49.271612] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-05T18:08:49.463724] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-05T18:08:49.478520] [WARN ] [VALIDATOR ] BXC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:49.478836] [INFO ] [MAIN ] BXC: Combined data validation passed. [2025-09-05T18:08:49.525939] [INFO ] [MAIN ] BXC: Update completed successfully. [2025-09-05T18:08:49.527022] [INFO ] [MAIN ] Update Progress: 370/2363 symbols completed. BXC took 1.3s. Estimated remaining: 47m 12s. Rate: 42.2 symbols/min [2025-09-05T18:08:49.712706] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:49.736399] [INFO ] [MAIN ] BXMT: Loaded 21985 existing records. [2025-09-05T18:08:49.924104] [INFO ] [MAIN ] BXMT: Found 1 missing trading days. [2025-09-05T18:08:49.924311] [INFO ] [MAIN ] BXMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:50.263488] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-05T18:08:50.291795] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-05T18:08:51.063482] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-05T18:08:51.721862] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:08:51.723249] [INFO ] [REMOTE ] BUXX: Full fetch complete (15992 records). [2025-09-05T18:08:51.868411] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-05T18:08:52.090990] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-05T18:08:52.169379] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-05T18:08:52.197267] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-05T18:08:52.197395] [INFO ] [MAIN ] Update Progress: 371/2363 symbols completed. BUXX took 20.0s. Estimated remaining: 47m 17s. Rate: 42.1 symbols/min [2025-09-05T18:08:52.365438] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:52.375092] [INFO ] [MAIN ] BXMX: Loaded 8451 existing records. [2025-09-05T18:08:52.543162] [INFO ] [MAIN ] BXMX: Found 1 missing trading days. [2025-09-05T18:08:52.543289] [INFO ] [MAIN ] BXMX: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:52.663451] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-05T18:08:52.740816] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:08:52.881439] [INFO ] [MAIN ] BX: Adding 388 new records, updating 0 existing records. [2025-09-05T18:08:52.885247] [INFO ] [MAIN ] BX: Combined dataset has 25935 total records. [2025-09-05T18:08:53.058020] [WARN ] [VALIDATOR ] BX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:53.249105] [WARN ] [VALIDATOR ] BX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:53.249332] [INFO ] [MAIN ] BX: Combined data validation passed. [2025-09-05T18:08:53.420997] [INFO ] [MAIN ] BX: Update completed successfully. [2025-09-05T18:08:53.423735] [INFO ] [MAIN ] Update Progress: 372/2363 symbols completed. BX took 6.7s. Estimated remaining: 47m 15s. Rate: 42.1 symbols/min [2025-09-05T18:08:53.468546] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-05T18:08:53.533687] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:08:53.645272] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:53.649131] [INFO ] [MAIN ] BXMX: Adding 108 new records, updating 0 existing records. [2025-09-05T18:08:53.651599] [INFO ] [MAIN ] BXMX: Combined dataset has 8559 total records. [2025-09-05T18:08:53.861880] [WARN ] [VALIDATOR ] BXMX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:53.863060] [INFO ] [MAIN ] BXP: Loaded 23587 existing records. [2025-09-05T18:08:54.234399] [INFO ] [MAIN ] BXP: Found 1 missing trading days. [2025-09-05T18:08:54.234514] [INFO ] [MAIN ] BXP: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:54.244532] [WARN ] [VALIDATOR ] BXMX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:54.244807] [INFO ] [MAIN ] BXMX: Combined data validation passed. [2025-09-05T18:08:54.268926] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-05T18:08:54.305170] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:08:54.415410] [INFO ] [MAIN ] BXMX: Update completed successfully. [2025-09-05T18:08:54.431911] [INFO ] [MAIN ] Update Progress: 373/2363 symbols completed. BXMX took 2.2s. Estimated remaining: 47m 11s. Rate: 42.2 symbols/min [2025-09-05T18:08:54.487163] [INFO ] [MAIN ] BXMT: Adding 343 new records, updating 0 existing records. [2025-09-05T18:08:54.639134] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:54.637727] [INFO ] [MAIN ] BXMT: Combined dataset has 22328 total records. [2025-09-05T18:08:54.862560] [WARN ] [VALIDATOR ] BXMT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:54.863960] [INFO ] [MAIN ] BXSL: Loaded 22116 existing records. [2025-09-05T18:08:55.082254] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-05T18:08:55.220922] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:08:55.261580] [INFO ] [MAIN ] BXSL: Found 1 missing trading days. [2025-09-05T18:08:55.261973] [INFO ] [MAIN ] BXSL: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:55.263437] [INFO ] [REMOTE ] BV: Full fetch complete (42113 records). [2025-09-05T18:08:55.649606] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-05T18:08:55.705064] [WARN ] [VALIDATOR ] BXMT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:55.705371] [INFO ] [MAIN ] BXMT: Combined data validation passed. [2025-09-05T18:08:55.858843] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:08:55.869854] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-05T18:08:56.043374] [INFO ] [MAIN ] BXP: Adding 377 new records, updating 0 existing records. [2025-09-05T18:08:56.049499] [INFO ] [MAIN ] BXMT: Update completed successfully. [2025-09-05T18:08:56.053818] [INFO ] [MAIN ] Update Progress: 374/2363 symbols completed. BXMT took 6.5s. Estimated remaining: 47m 10s. Rate: 42.2 symbols/min [2025-09-05T18:08:56.146220] [INFO ] [MAIN ] BXP: Combined dataset has 23964 total records. [2025-09-05T18:08:56.382265] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:56.489634] [WARN ] [VALIDATOR ] BXP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:56.567028] [INFO ] [MAIN ] BV: Full history saved. [2025-09-05T18:08:56.555228] [INFO ] [MAIN ] BY: Loaded 10876 existing records. [2025-09-05T18:08:56.583957] [INFO ] [MAIN ] Update Progress: 375/2363 symbols completed. BV took 24.4s. Estimated remaining: 47m 4s. Rate: 42.2 symbols/min [2025-09-05T18:08:57.016367] [INFO ] [MAIN ] BY: Found 1 missing trading days. [2025-09-05T18:08:57.036718] [INFO ] [MAIN ] BY: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:57.043752] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-05T18:08:57.071470] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:57.099075] [INFO ] [MAIN ] BYD: Loaded 22004 existing records. [2025-09-05T18:08:57.296254] [INFO ] [MAIN ] BYD: Found 1 missing trading days. [2025-09-05T18:08:57.296775] [INFO ] [MAIN ] BYD: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:57.301541] [WARN ] [VALIDATOR ] BXP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:57.301807] [INFO ] [MAIN ] BXP: Combined data validation passed. [2025-09-05T18:08:57.455569] [INFO ] [MAIN ] BXP: Update completed successfully. [2025-09-05T18:08:57.459708] [INFO ] [MAIN ] Update Progress: 376/2363 symbols completed. BXP took 4.0s. Estimated remaining: 47m 0s. Rate: 42.3 symbols/min [2025-09-05T18:08:57.503123] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-05T18:08:57.619722] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:08:57.637695] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:08:57.693263] [INFO ] [MAIN ] BY: Adding 168 new records, updating 0 existing records. [2025-09-05T18:08:57.698465] [INFO ] [MAIN ] BYM: Loaded 5194 existing records. [2025-09-05T18:08:57.768007] [INFO ] [MAIN ] BY: Combined dataset has 11044 total records. [2025-09-05T18:08:57.987134] [INFO ] [MAIN ] BYM: Found 1 missing trading days. [2025-09-05T18:08:57.987750] [INFO ] [MAIN ] BYM: Need to fetch 1 months: 2025-09 [2025-09-05T18:08:57.999019] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-05T18:08:58.126160] [WARN ] [VALIDATOR ] BY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:58.269772] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-05T18:08:58.291365] [INFO ] [MAIN ] BXSL: Adding 368 new records, updating 0 existing records. [2025-09-05T18:08:58.327003] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:08:58.530299] [INFO ] [MAIN ] BXSL: Combined dataset has 22484 total records. [2025-09-05T18:08:58.693521] [INFO ] [MAIN ] BYD: Adding 296 new records, updating 0 existing records. [2025-09-05T18:08:58.797871] [WARN ] [VALIDATOR ] BXSL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:58.828908] [INFO ] [MAIN ] BYD: Combined dataset has 22300 total records. [2025-09-05T18:08:59.164240] [WARN ] [VALIDATOR ] BYD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:59.223168] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:08:59.321243] [INFO ] [MAIN ] BYM: Adding 98 new records, updating 0 existing records. [2025-09-05T18:08:59.409011] [INFO ] [MAIN ] BYM: Combined dataset has 5292 total records. [2025-09-05T18:08:59.601232] [WARN ] [VALIDATOR ] BYM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:08:59.690377] [WARN ] [VALIDATOR ] BY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:59.712441] [INFO ] [MAIN ] BY: Combined data validation passed. [2025-09-05T18:08:59.712247] [WARN ] [VALIDATOR ] BYD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:59.695621] [WARN ] [VALIDATOR ] BXSL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:08:59.716313] [INFO ] [MAIN ] BXSL: Combined data validation passed. [2025-09-05T18:08:59.716483] [INFO ] [MAIN ] BYD: Combined data validation passed. [2025-09-05T18:09:00.083475] [INFO ] [MAIN ] BY: Update completed successfully. [2025-09-05T18:09:00.086206] [INFO ] [MAIN ] Update Progress: 377/2363 symbols completed. BY took 4.0s. Estimated remaining: 47m 5s. Rate: 42.2 symbols/min [2025-09-05T18:09:00.236583] [INFO ] [MAIN ] BYD: Update completed successfully. [2025-09-05T18:09:00.245008] [INFO ] [MAIN ] Update Progress: 378/2363 symbols completed. BYD took 3.6s. Estimated remaining: 46m 57s. Rate: 42.3 symbols/min [2025-09-05T18:09:00.359627] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:00.500963] [INFO ] [MAIN ] BXSL: Update completed successfully. [2025-09-05T18:09:00.527851] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:00.526740] [INFO ] [MAIN ] Update Progress: 379/2363 symbols completed. BXSL took 6.1s. Estimated remaining: 46m 50s. Rate: 42.4 symbols/min [2025-09-05T18:09:00.529085] [INFO ] [MAIN ] BZH: Loaded 15142 existing records. [2025-09-05T18:09:00.838605] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:00.895567] [INFO ] [MAIN ] C: Loaded 25722 existing records. [2025-09-05T18:09:00.924512] [INFO ] [MAIN ] BZH: Found 1 missing trading days. [2025-09-05T18:09:00.969668] [INFO ] [MAIN ] BZH: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:00.980528] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-05T18:09:01.005934] [INFO ] [MAIN ] CAAP: Loaded 7987 existing records. [2025-09-05T18:09:01.201121] [INFO ] [MAIN ] C: Found 1 missing trading days. [2025-09-05T18:09:01.201513] [INFO ] [MAIN ] C: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:01.202045] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-05T18:09:01.278074] [INFO ] [MAIN ] CAAP: Found 1 missing trading days. [2025-09-05T18:09:01.278389] [INFO ] [MAIN ] CAAP: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:01.278848] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-05T18:09:01.282190] [WARN ] [VALIDATOR ] BYM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:01.282319] [INFO ] [MAIN ] BYM: Combined data validation passed. [2025-09-05T18:09:01.315397] [INFO ] [MAIN ] BYM: Update completed successfully. [2025-09-05T18:09:01.316124] [INFO ] [MAIN ] Update Progress: 380/2363 symbols completed. BYM took 3.9s. Estimated remaining: 46m 45s. Rate: 42.4 symbols/min [2025-09-05T18:09:01.487272] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:01.498478] [INFO ] [MAIN ] CABO: Loaded 9027 existing records. [2025-09-05T18:09:01.663603] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:09:01.685139] [INFO ] [MAIN ] CABO: Found 1 missing trading days. [2025-09-05T18:09:01.687666] [INFO ] [MAIN ] CABO: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:01.695177] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-05T18:09:01.791299] [INFO ] [MAIN ] BZH: Adding 266 new records, updating 0 existing records. [2025-09-05T18:09:01.798423] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:09:01.831093] [INFO ] [MAIN ] BZH: Combined dataset has 15408 total records. [2025-09-05T18:09:01.851594] [INFO ] [MAIN ] CAAP: Adding 175 new records, updating 0 existing records. [2025-09-05T18:09:01.969222] [INFO ] [MAIN ] CAAP: Combined dataset has 8162 total records. [2025-09-05T18:09:02.135136] [WARN ] [VALIDATOR ] BZH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:02.366359] [WARN ] [VALIDATOR ] CAAP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:02.372022] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T18:09:02.647232] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:09:02.756824] [INFO ] [MAIN ] CABO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:09:02.850089] [INFO ] [MAIN ] C: Adding 390 new records, updating 0 existing records. [2025-09-05T18:09:02.871998] [INFO ] [MAIN ] CABO: Combined dataset has 9027 total records. [2025-09-05T18:09:02.873237] [FATAL] [VALIDATOR ] CABO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:09:02.875310] [FATAL] [MAIN ] CABO: Combined data validation failed. [2025-09-05T18:09:02.875793] [WARN ] [MAIN ] CABO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:09:02.876447] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-05T18:09:02.877352] [INFO ] [LOCAL ] CABO: Starting deletion of derivative data. [2025-09-05T18:09:02.879773] [INFO ] [MAIN ] Update Progress: 381/2363 symbols completed. CABO took 1.6s. Estimated remaining: 46m 44s. Rate: 42.4 symbols/min [2025-09-05T18:09:02.880538] [INFO ] [MAIN ] C: Combined dataset has 26112 total records. [2025-09-05T18:09:03.271055] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:03.297560] [WARN ] [VALIDATOR ] C: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:03.387861] [INFO ] [MAIN ] CACI: Loaded 10002 existing records. [2025-09-05T18:09:03.703634] [WARN ] [VALIDATOR ] BZH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:03.726841] [INFO ] [MAIN ] BZH: Combined data validation passed. [2025-09-05T18:09:03.726297] [INFO ] [MAIN ] CACI: Found 1 missing trading days. [2025-09-05T18:09:03.726733] [WARN ] [VALIDATOR ] CAAP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:03.727202] [INFO ] [MAIN ] CAAP: Combined data validation passed. [2025-09-05T18:09:03.727312] [INFO ] [MAIN ] CACI: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:03.728953] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-05T18:09:03.863503] [INFO ] [MAIN ] CAAP: Update completed successfully. [2025-09-05T18:09:03.876018] [INFO ] [MAIN ] Update Progress: 382/2363 symbols completed. CAAP took 3.3s. Estimated remaining: 46m 41s. Rate: 42.4 symbols/min [2025-09-05T18:09:03.897064] [INFO ] [MAIN ] BZH: Update completed successfully. [2025-09-05T18:09:03.919059] [INFO ] [MAIN ] Update Progress: 383/2363 symbols completed. BZH took 3.8s. Estimated remaining: 46m 32s. Rate: 42.5 symbols/min [2025-09-05T18:09:04.095971] [WARN ] [VALIDATOR ] C: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:04.167389] [INFO ] [MAIN ] C: Combined data validation passed. [2025-09-05T18:09:04.173257] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:04.365164] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:04.454624] [INFO ] [MAIN ] CADE: Loaded 23723 existing records. [2025-09-05T18:09:04.454767] [INFO ] [MAIN ] C: Update completed successfully. [2025-09-05T18:09:04.463684] [INFO ] [MAIN ] Update Progress: 384/2363 symbols completed. C took 4.2s. Estimated remaining: 46m 26s. Rate: 42.6 symbols/min [2025-09-05T18:09:04.757948] [INFO ] [MAIN ] CAE: Loaded 29257 existing records. [2025-09-05T18:09:04.826493] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:04.889726] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:09:04.923441] [INFO ] [MAIN ] CADE: Found 1 missing trading days. [2025-09-05T18:09:04.948933] [INFO ] [MAIN ] CADE: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:04.990373] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-05T18:09:05.026866] [INFO ] [MAIN ] CACI: Adding 129 new records, updating 0 existing records. [2025-09-05T18:09:05.027113] [INFO ] [MAIN ] CAF: Loaded 1307 existing records. [2025-09-05T18:09:05.211405] [INFO ] [MAIN ] CACI: Combined dataset has 10131 total records. [2025-09-05T18:09:05.203854] [INFO ] [MAIN ] CAE: Found 1 missing trading days. [2025-09-05T18:09:05.214723] [INFO ] [MAIN ] CAE: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:05.225631] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-05T18:09:05.320820] [INFO ] [MAIN ] CAF: Found 1 missing trading days. [2025-09-05T18:09:05.354625] [INFO ] [MAIN ] CAF: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:05.386810] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-05T18:09:05.464617] [WARN ] [VALIDATOR ] CACI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:05.654769] [WARN ] [VALIDATOR ] CACI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:05.655000] [INFO ] [MAIN ] CACI: Combined data validation passed. [2025-09-05T18:09:05.729872] [INFO ] [MAIN ] CACI: Update completed successfully. [2025-09-05T18:09:05.730175] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:09:05.732245] [INFO ] [MAIN ] Update Progress: 385/2363 symbols completed. CACI took 2.9s. Estimated remaining: 46m 24s. Rate: 42.6 symbols/min [2025-09-05T18:09:05.866231] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:09:05.908890] [INFO ] [MAIN ] CAF: Adding 39 new records, updating 0 existing records. [2025-09-05T18:09:05.999935] [INFO ] [MAIN ] CAF: Combined dataset has 1346 total records. [2025-09-05T18:09:06.058292] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:06.112909] [INFO ] [MAIN ] CADE: Adding 384 new records, updating 0 existing records. [2025-09-05T18:09:06.193263] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:09:06.344296] [INFO ] [MAIN ] CADE: Combined dataset has 24107 total records. [2025-09-05T18:09:06.363067] [WARN ] [VALIDATOR ] CAF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:06.513201] [INFO ] [MAIN ] CAE: Adding 252 new records, updating 0 existing records. [2025-09-05T18:09:06.596564] [INFO ] [MAIN ] CAG: Loaded 25665 existing records. [2025-09-05T18:09:06.900461] [WARN ] [VALIDATOR ] CADE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:06.956201] [INFO ] [MAIN ] CAE: Combined dataset has 29509 total records. [2025-09-05T18:09:07.095439] [INFO ] [MAIN ] CAG: Found 1 missing trading days. [2025-09-05T18:09:07.128125] [INFO ] [MAIN ] CAG: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:07.174084] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-05T18:09:07.373482] [WARN ] [VALIDATOR ] CAE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:07.583777] [WARN ] [VALIDATOR ] CAE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:07.583860] [WARN ] [VALIDATOR ] CADE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:07.584164] [WARN ] [VALIDATOR ] CAF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:07.584542] [INFO ] [MAIN ] CAE: Combined data validation passed. [2025-09-05T18:09:07.584674] [INFO ] [MAIN ] CADE: Combined data validation passed. [2025-09-05T18:09:07.584894] [INFO ] [MAIN ] CAF: Combined data validation passed. [2025-09-05T18:09:07.647296] [INFO ] [MAIN ] CAF: Update completed successfully. [2025-09-05T18:09:07.648238] [INFO ] [MAIN ] Update Progress: 386/2363 symbols completed. CAF took 3.2s. Estimated remaining: 46m 25s. Rate: 42.6 symbols/min [2025-09-05T18:09:07.992274] [INFO ] [MAIN ] CAE: Update completed successfully. [2025-09-05T18:09:08.010204] [INFO ] [MAIN ] Update Progress: 387/2363 symbols completed. CAE took 4.0s. Estimated remaining: 46m 19s. Rate: 42.7 symbols/min [2025-09-05T18:09:08.051105] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:08.259975] [INFO ] [MAIN ] CADE: Update completed successfully. [2025-09-05T18:09:08.284443] [INFO ] [MAIN ] Update Progress: 388/2363 symbols completed. CADE took 4.4s. Estimated remaining: 46m 11s. Rate: 42.8 symbols/min [2025-09-05T18:09:08.285119] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:09:08.293253] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:08.319683] [INFO ] [MAIN ] CAH: Loaded 24529 existing records. [2025-09-05T18:09:08.747999] [INFO ] [MAIN ] CAL: Loaded 19956 existing records. [2025-09-05T18:09:08.832803] [INFO ] [MAIN ] CAG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:09:08.884773] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:08.941378] [INFO ] [MAIN ] CAH: Found 1 missing trading days. [2025-09-05T18:09:09.005355] [INFO ] [MAIN ] CAH: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:09.006818] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-05T18:09:09.087750] [INFO ] [MAIN ] CAG: Combined dataset has 26055 total records. [2025-09-05T18:09:09.103994] [INFO ] [MAIN ] CAL: Found 1 missing trading days. [2025-09-05T18:09:09.106351] [INFO ] [MAIN ] CAL: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:09.107148] [INFO ] [MAIN ] CALX: Loaded 18206 existing records. [2025-09-05T18:09:09.140749] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-05T18:09:09.457615] [WARN ] [VALIDATOR ] CAG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:09.518869] [INFO ] [MAIN ] CALX: Found 1 missing trading days. [2025-09-05T18:09:09.566977] [INFO ] [MAIN ] CALX: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:09.585026] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-05T18:09:09.665238] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:09:09.851891] [INFO ] [MAIN ] CAH: Adding 377 new records, updating 0 existing records. [2025-09-05T18:09:09.857759] [INFO ] [MAIN ] CAH: Combined dataset has 24906 total records. [2025-09-05T18:09:10.042054] [WARN ] [VALIDATOR ] CAH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:10.130667] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:09:10.239706] [WARN ] [VALIDATOR ] CAG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:10.240019] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:09:10.326021] [INFO ] [MAIN ] CAG: Combined data validation passed. [2025-09-05T18:09:10.468585] [INFO ] [MAIN ] CAL: Adding 361 new records, updating 0 existing records. [2025-09-05T18:09:10.469574] [INFO ] [MAIN ] CALX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:09:10.535441] [INFO ] [MAIN ] CALX: Combined dataset has 18206 total records. [2025-09-05T18:09:10.537020] [FATAL] [VALIDATOR ] CALX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:09:10.564305] [FATAL] [MAIN ] CALX: Combined data validation failed. [2025-09-05T18:09:10.566177] [WARN ] [MAIN ] CALX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:09:10.566882] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-05T18:09:10.571874] [INFO ] [LOCAL ] CALX: Starting deletion of derivative data. [2025-09-05T18:09:10.575213] [INFO ] [MAIN ] Update Progress: 389/2363 symbols completed. CALX took 2.3s. Estimated remaining: 46m 15s. Rate: 42.7 symbols/min [2025-09-05T18:09:10.575677] [INFO ] [MAIN ] CAL: Combined dataset has 20317 total records. [2025-09-05T18:09:10.983708] [WARN ] [VALIDATOR ] CAL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:11.069288] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:11.201972] [INFO ] [MAIN ] CANG: Loaded 13627 existing records. [2025-09-05T18:09:11.201361] [INFO ] [MAIN ] CAG: Update completed successfully. [2025-09-05T18:09:11.249978] [INFO ] [MAIN ] Update Progress: 390/2363 symbols completed. CAG took 5.5s. Estimated remaining: 46m 9s. Rate: 42.7 symbols/min [2025-09-05T18:09:11.565200] [INFO ] [MAIN ] CANG: Found 1 missing trading days. [2025-09-05T18:09:11.570779] [INFO ] [MAIN ] CANG: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:11.576238] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-05T18:09:11.634257] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:11.641528] [INFO ] [MAIN ] CAPL: Loaded 4136 existing records. [2025-09-05T18:09:11.642074] [WARN ] [VALIDATOR ] CAH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:11.662849] [INFO ] [MAIN ] CAH: Combined data validation passed. [2025-09-05T18:09:11.856104] [WARN ] [VALIDATOR ] CAL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:11.874364] [INFO ] [MAIN ] CAL: Combined data validation passed. [2025-09-05T18:09:11.935130] [INFO ] [MAIN ] CAPL: Found 1 missing trading days. [2025-09-05T18:09:11.936569] [INFO ] [MAIN ] CAPL: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:11.937746] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-05T18:09:12.109880] [INFO ] [MAIN ] CAL: Update completed successfully. [2025-09-05T18:09:12.112307] [INFO ] [MAIN ] Update Progress: 391/2363 symbols completed. CAL took 4.1s. Estimated remaining: 46m 5s. Rate: 42.8 symbols/min [2025-09-05T18:09:12.152695] [INFO ] [MAIN ] CAH: Update completed successfully. [2025-09-05T18:09:12.199736] [INFO ] [MAIN ] Update Progress: 392/2363 symbols completed. CAH took 4.5s. Estimated remaining: 45m 57s. Rate: 42.9 symbols/min [2025-09-05T18:09:12.401041] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:12.407672] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:09:12.464341] [INFO ] [MAIN ] CAPL: Adding 34 new records, updating 0 existing records. [2025-09-05T18:09:12.498755] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:12.498968] [INFO ] [MAIN ] CAPL: Combined dataset has 4170 total records. [2025-09-05T18:09:12.616220] [INFO ] [MAIN ] CARR: Loaded 25608 existing records. [2025-09-05T18:09:12.742979] [WARN ] [VALIDATOR ] CAPL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:12.765479] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-05T18:09:12.941279] [INFO ] [MAIN ] CARS: Loaded 30044 existing records. [2025-09-05T18:09:13.096508] [INFO ] [MAIN ] CANG: Adding 247 new records, updating 0 existing records. [2025-09-05T18:09:13.299947] [INFO ] [MAIN ] CARR: Found 1 missing trading days. [2025-09-05T18:09:13.300281] [INFO ] [MAIN ] CARR: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:13.300628] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-05T18:09:13.318970] [INFO ] [MAIN ] CANG: Combined dataset has 13874 total records. [2025-09-05T18:09:13.418097] [INFO ] [MAIN ] CARS: Found 1 missing trading days. [2025-09-05T18:09:13.442354] [INFO ] [MAIN ] CARS: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:13.456150] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-05T18:09:13.567548] [WARN ] [VALIDATOR ] CANG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:13.760043] [WARN ] [VALIDATOR ] CAPL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:13.760114] [WARN ] [VALIDATOR ] CANG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:13.760429] [INFO ] [MAIN ] CAPL: Combined data validation passed. [2025-09-05T18:09:13.760348] [INFO ] [MAIN ] CANG: Combined data validation passed. [2025-09-05T18:09:13.842107] [INFO ] [MAIN ] CAPL: Update completed successfully. [2025-09-05T18:09:13.844214] [INFO ] [MAIN ] Update Progress: 393/2363 symbols completed. CAPL took 2.6s. Estimated remaining: 45m 57s. Rate: 42.9 symbols/min [2025-09-05T18:09:14.023603] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:14.034972] [INFO ] [MAIN ] CANG: Update completed successfully. [2025-09-05T18:09:14.036457] [INFO ] [MAIN ] Update Progress: 394/2363 symbols completed. CANG took 3.5s. Estimated remaining: 45m 50s. Rate: 43.0 symbols/min [2025-09-05T18:09:14.170052] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:09:14.240211] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:14.228144] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:09:14.428049] [INFO ] [MAIN ] CARS: Adding 238 new records, updating 0 existing records. [2025-09-05T18:09:14.428254] [INFO ] [MAIN ] CATO: Loaded 5030 existing records. [2025-09-05T18:09:14.534010] [INFO ] [MAIN ] CAT: Loaded 39868 existing records. [2025-09-05T18:09:14.554609] [INFO ] [MAIN ] CARR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:09:14.649400] [INFO ] [MAIN ] CARS: Combined dataset has 30282 total records. [2025-09-05T18:09:14.690819] [INFO ] [MAIN ] CARR: Combined dataset has 25608 total records. [2025-09-05T18:09:14.759595] [FATAL] [VALIDATOR ] CARR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:09:14.944188] [INFO ] [MAIN ] CATO: Found 1 missing trading days. [2025-09-05T18:09:14.875483] [FATAL] [MAIN ] CARR: Combined data validation failed. [2025-09-05T18:09:14.962425] [INFO ] [MAIN ] CATO: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:14.969335] [INFO ] [MAIN ] CAT: Found 1 missing trading days. [2025-09-05T18:09:14.985128] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-05T18:09:14.985246] [INFO ] [MAIN ] CAT: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:14.969475] [WARN ] [MAIN ] CARR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:09:15.005868] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-05T18:09:14.991445] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-05T18:09:15.040028] [INFO ] [LOCAL ] CARR: Starting deletion of derivative data. [2025-09-05T18:09:15.043157] [WARN ] [VALIDATOR ] CARS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:15.066354] [INFO ] [MAIN ] Update Progress: 395/2363 symbols completed. CARR took 2.9s. Estimated remaining: 45m 46s. Rate: 43.0 symbols/min [2025-09-05T18:09:15.407918] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:15.443075] [WARN ] [VALIDATOR ] CARS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:15.444290] [INFO ] [MAIN ] CARS: Combined data validation passed. [2025-09-05T18:09:15.445113] [INFO ] [MAIN ] CAVA: Loaded 25662 existing records. [2025-09-05T18:09:15.536451] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:09:15.648831] [INFO ] [MAIN ] CATO: Adding 82 new records, updating 0 existing records. [2025-09-05T18:09:15.764751] [INFO ] [MAIN ] CAVA: Found 1 missing trading days. [2025-09-05T18:09:15.766471] [INFO ] [MAIN ] CAVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:15.766928] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-05T18:09:15.767041] [INFO ] [MAIN ] CATO: Combined dataset has 5112 total records. [2025-09-05T18:09:15.881700] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:09:16.042191] [WARN ] [VALIDATOR ] CATO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:16.247112] [INFO ] [MAIN ] CAT: Adding 378 new records, updating 0 existing records. [2025-09-05T18:09:16.333999] [INFO ] [MAIN ] CAT: Combined dataset has 40246 total records. [2025-09-05T18:09:16.578186] [WARN ] [VALIDATOR ] CAT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:16.591024] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:09:16.736221] [WARN ] [VALIDATOR ] CATO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:16.769201] [INFO ] [MAIN ] CATO: Combined data validation passed. [2025-09-05T18:09:16.787824] [INFO ] [MAIN ] CARS: Update completed successfully. [2025-09-05T18:09:16.849601] [INFO ] [MAIN ] Update Progress: 396/2363 symbols completed. CARS took 4.6s. Estimated remaining: 45m 47s. Rate: 43.0 symbols/min [2025-09-05T18:09:17.018095] [INFO ] [MAIN ] CAVA: Adding 390 new records, updating 0 existing records. [2025-09-05T18:09:17.151184] [INFO ] [MAIN ] CAVA: Combined dataset has 26052 total records. [2025-09-05T18:09:17.176476] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:17.182327] [WARN ] [MAIN ] CB: No existing data found, performing full refresh instead. [2025-09-05T18:09:17.195561] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-05T18:09:17.201301] [INFO ] [MAIN ] CATO: Update completed successfully. [2025-09-05T18:09:17.211840] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-05T18:09:17.238959] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-05T18:09:17.254094] [INFO ] [MAIN ] Update Progress: 397/2363 symbols completed. CATO took 3.2s. Estimated remaining: 45m 41s. Rate: 43.0 symbols/min [2025-09-05T18:09:17.495662] [WARN ] [VALIDATOR ] CAVA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:17.928729] [INFO ] [REMOTE ] CB: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:09:17.929189] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-05T18:09:17.939201] [WARN ] [VALIDATOR ] CAT: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:17.939684] [INFO ] [MAIN ] CAT: Combined data validation passed. [2025-09-05T18:09:18.001178] [WARN ] [VALIDATOR ] CAVA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:18.010552] [INFO ] [MAIN ] CAVA: Combined data validation passed. [2025-09-05T18:09:18.353511] [INFO ] [MAIN ] CAVA: Update completed successfully. [2025-09-05T18:09:18.358331] [INFO ] [MAIN ] Update Progress: 398/2363 symbols completed. CAVA took 3.3s. Estimated remaining: 45m 38s. Rate: 43.1 symbols/min [2025-09-05T18:09:18.362713] [INFO ] [MAIN ] CAT: Update completed successfully. [2025-09-05T18:09:18.368114] [INFO ] [MAIN ] Update Progress: 399/2363 symbols completed. CAT took 4.5s. Estimated remaining: 45m 30s. Rate: 43.2 symbols/min [2025-09-05T18:09:20.169762] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-05T18:09:20.180016] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-05T18:09:22.036083] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-05T18:09:22.045553] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-05T18:09:24.180636] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-05T18:09:24.191427] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-05T18:09:26.217568] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-05T18:09:26.228528] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-05T18:09:28.042798] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-05T18:09:28.053028] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-05T18:09:29.831231] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-05T18:09:29.841437] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-05T18:09:31.956770] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-05T18:09:31.968148] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-05T18:09:33.682809] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-05T18:09:33.694211] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-05T18:09:34.309397] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:09:34.312375] [INFO ] [REMOTE ] CB: Full fetch complete (54350 records). [2025-09-05T18:09:34.679490] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-05T18:09:34.928128] [INFO ] [MAIN ] CB: Full history saved. [2025-09-05T18:09:34.928286] [INFO ] [MAIN ] Update Progress: 400/2363 symbols completed. CB took 18.0s. Estimated remaining: 46m 43s. Rate: 42.0 symbols/min [2025-09-05T18:09:35.545800] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:35.555415] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:35.629453] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:35.627965] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:35.641843] [INFO ] [MAIN ] CBAN: Loaded 4793 existing records. [2025-09-05T18:09:35.641616] [INFO ] [MAIN ] CBL: Loaded 8176 existing records. [2025-09-05T18:09:35.701980] [INFO ] [MAIN ] CBNA: Loaded 1529 existing records. [2025-09-05T18:09:36.123700] [INFO ] [MAIN ] CBAN: Found 1 missing trading days. [2025-09-05T18:09:36.127088] [INFO ] [MAIN ] CBL: Found 1 missing trading days. [2025-09-05T18:09:36.137446] [INFO ] [MAIN ] CBL: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:36.124385] [INFO ] [MAIN ] CBRE: Loaded 23790 existing records. [2025-09-05T18:09:36.153336] [INFO ] [MAIN ] CBAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:36.153626] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-05T18:09:36.167954] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-05T18:09:36.217787] [INFO ] [MAIN ] CBNA: Found 1 missing trading days. [2025-09-05T18:09:36.257964] [INFO ] [MAIN ] CBNA: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:36.267329] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-05T18:09:36.371062] [INFO ] [MAIN ] CBRE: Found 1 missing trading days. [2025-09-05T18:09:36.371204] [INFO ] [MAIN ] CBRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:36.371407] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-05T18:09:36.467486] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:09:36.506844] [INFO ] [MAIN ] CBL: Adding 102 new records, updating 0 existing records. [2025-09-05T18:09:36.508753] [INFO ] [MAIN ] CBL: Combined dataset has 8278 total records. [2025-09-05T18:09:36.684052] [WARN ] [VALIDATOR ] CBL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:36.873365] [WARN ] [VALIDATOR ] CBL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:36.873569] [INFO ] [MAIN ] CBL: Combined data validation passed. [2025-09-05T18:09:36.928421] [INFO ] [MAIN ] CBL: Update completed successfully. [2025-09-05T18:09:36.928596] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:09:36.930175] [INFO ] [MAIN ] Update Progress: 401/2363 symbols completed. CBL took 2.0s. Estimated remaining: 46m 44s. Rate: 42.0 symbols/min [2025-09-05T18:09:36.940928] [INFO ] [MAIN ] CBNA: Adding 20 new records, updating 0 existing records. [2025-09-05T18:09:36.975514] [INFO ] [MAIN ] CBNA: Combined dataset has 1549 total records. [2025-09-05T18:09:37.256412] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:37.269429] [WARN ] [MAIN ] CBT: No existing data found, performing full refresh instead. [2025-09-05T18:09:37.312972] [WARN ] [VALIDATOR ] CBNA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:37.314093] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:09:37.313181] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-05T18:09:37.327244] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-05T18:09:37.368796] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-05T18:09:37.453491] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:09:37.623108] [INFO ] [MAIN ] CBAN: Adding 53 new records, updating 0 existing records. [2025-09-05T18:09:37.775268] [INFO ] [MAIN ] CBAN: Combined dataset has 4846 total records. [2025-09-05T18:09:37.842839] [INFO ] [MAIN ] CBRE: Adding 338 new records, updating 0 existing records. [2025-09-05T18:09:38.167753] [INFO ] [MAIN ] CBRE: Combined dataset has 24128 total records. [2025-09-05T18:09:38.298830] [INFO ] [REMOTE ] CBT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:09:38.312164] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-05T18:09:38.311416] [WARN ] [VALIDATOR ] CBAN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:38.599449] [WARN ] [VALIDATOR ] CBRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:38.806496] [WARN ] [VALIDATOR ] CBNA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:38.817061] [INFO ] [MAIN ] CBNA: Combined data validation passed. [2025-09-05T18:09:38.893622] [INFO ] [MAIN ] CBNA: Update completed successfully. [2025-09-05T18:09:38.904884] [INFO ] [MAIN ] Update Progress: 402/2363 symbols completed. CBNA took 4.0s. Estimated remaining: 46m 45s. Rate: 41.9 symbols/min [2025-09-05T18:09:39.083069] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:39.096667] [WARN ] [VALIDATOR ] CBAN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:39.096882] [INFO ] [MAIN ] CBAN: Combined data validation passed. [2025-09-05T18:09:39.096558] [WARN ] [VALIDATOR ] CBRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:39.097241] [INFO ] [MAIN ] CBRE: Combined data validation passed. [2025-09-05T18:09:39.103037] [INFO ] [MAIN ] CBU: Loaded 11157 existing records. [2025-09-05T18:09:39.291463] [INFO ] [MAIN ] CBAN: Update completed successfully. [2025-09-05T18:09:39.304742] [INFO ] [MAIN ] Update Progress: 403/2363 symbols completed. CBAN took 4.4s. Estimated remaining: 46m 39s. Rate: 42.0 symbols/min [2025-09-05T18:09:39.584872] [INFO ] [MAIN ] CBU: Found 1 missing trading days. [2025-09-05T18:09:39.601979] [INFO ] [MAIN ] CBU: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:39.614951] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-05T18:09:39.663220] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:39.718400] [INFO ] [MAIN ] CBRE: Update completed successfully. [2025-09-05T18:09:39.718299] [INFO ] [MAIN ] CBZ: Loaded 25073 existing records. [2025-09-05T18:09:39.721761] [INFO ] [MAIN ] Update Progress: 404/2363 symbols completed. CBRE took 4.8s. Estimated remaining: 46m 33s. Rate: 42.1 symbols/min [2025-09-05T18:09:40.021445] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:40.070547] [INFO ] [MAIN ] CBZ: Found 1 missing trading days. [2025-09-05T18:09:40.070752] [INFO ] [MAIN ] CBZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:40.071515] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-05T18:09:40.091280] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-05T18:09:40.098101] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-05T18:09:40.122321] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:09:40.194398] [INFO ] [MAIN ] CBU: Adding 137 new records, updating 0 existing records. [2025-09-05T18:09:40.196751] [INFO ] [MAIN ] CC: Loaded 39922 existing records. [2025-09-05T18:09:40.315354] [INFO ] [MAIN ] CBU: Combined dataset has 11294 total records. [2025-09-05T18:09:40.456100] [INFO ] [MAIN ] CC: Found 1 missing trading days. [2025-09-05T18:09:40.482262] [INFO ] [MAIN ] CC: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:40.482807] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-05T18:09:40.560788] [WARN ] [VALIDATOR ] CBU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:40.744771] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:09:40.868417] [INFO ] [MAIN ] CBZ: Adding 295 new records, updating 0 existing records. [2025-09-05T18:09:40.875110] [INFO ] [MAIN ] CBZ: Combined dataset has 25368 total records. [2025-09-05T18:09:41.061668] [WARN ] [VALIDATOR ] CBZ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:41.257135] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:09:41.423405] [INFO ] [MAIN ] CC: Adding 389 new records, updating 0 existing records. [2025-09-05T18:09:41.445708] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-05T18:09:41.455337] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-05T18:09:41.460241] [INFO ] [MAIN ] CC: Combined dataset has 40311 total records. [2025-09-05T18:09:41.460632] [WARN ] [VALIDATOR ] CBU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:41.492226] [INFO ] [MAIN ] CBU: Combined data validation passed. [2025-09-05T18:09:41.711425] [WARN ] [VALIDATOR ] CC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:41.735328] [INFO ] [MAIN ] CBU: Update completed successfully. [2025-09-05T18:09:41.752541] [INFO ] [MAIN ] Update Progress: 405/2363 symbols completed. CBU took 2.8s. Estimated remaining: 46m 34s. Rate: 42.0 symbols/min [2025-09-05T18:09:41.929407] [WARN ] [VALIDATOR ] CBZ: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:41.982685] [INFO ] [MAIN ] CBZ: Combined data validation passed. [2025-09-05T18:09:42.151897] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:42.259926] [INFO ] [MAIN ] CBZ: Update completed successfully. [2025-09-05T18:09:42.263818] [INFO ] [MAIN ] Update Progress: 406/2363 symbols completed. CBZ took 2.9s. Estimated remaining: 46m 28s. Rate: 42.1 symbols/min [2025-09-05T18:09:42.331717] [INFO ] [MAIN ] CCI: Loaded 25391 existing records. [2025-09-05T18:09:42.563760] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:42.636286] [INFO ] [MAIN ] CCI: Found 1 missing trading days. [2025-09-05T18:09:42.636636] [INFO ] [MAIN ] CCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:42.636961] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-05T18:09:42.639108] [INFO ] [MAIN ] CCIA: Loaded 649 existing records. [2025-09-05T18:09:42.750512] [WARN ] [VALIDATOR ] CC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:42.771276] [INFO ] [MAIN ] CC: Combined data validation passed. [2025-09-05T18:09:42.818895] [INFO ] [MAIN ] CCIA: Found 1 missing trading days. [2025-09-05T18:09:42.819324] [INFO ] [MAIN ] CCIA: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:42.819564] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-05T18:09:43.085806] [INFO ] [MAIN ] CC: Update completed successfully. [2025-09-05T18:09:43.091618] [INFO ] [MAIN ] Update Progress: 407/2363 symbols completed. CC took 3.3s. Estimated remaining: 46m 24s. Rate: 42.2 symbols/min [2025-09-05T18:09:43.093295] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-05T18:09:43.175662] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-05T18:09:43.274330] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:43.283067] [INFO ] [MAIN ] CCIF: Loaded 7311 existing records. [2025-09-05T18:09:43.371067] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:09:43.374815] [INFO ] [MAIN ] CCIA: Adding 5 new records, updating 0 existing records. [2025-09-05T18:09:43.393091] [INFO ] [MAIN ] CCIA: Combined dataset has 654 total records. [2025-09-05T18:09:43.480440] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:09:43.604281] [INFO ] [MAIN ] CCIF: Found 1 missing trading days. [2025-09-05T18:09:43.618258] [INFO ] [MAIN ] CCIF: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:43.623883] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-05T18:09:43.752786] [WARN ] [VALIDATOR ] CCIA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:43.872599] [INFO ] [MAIN ] CCI: Adding 389 new records, updating 0 existing records. [2025-09-05T18:09:43.975280] [INFO ] [MAIN ] CCI: Combined dataset has 25780 total records. [2025-09-05T18:09:44.155870] [WARN ] [VALIDATOR ] CCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:44.351470] [WARN ] [VALIDATOR ] CCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:44.351542] [WARN ] [VALIDATOR ] CCIA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:44.351750] [INFO ] [MAIN ] CCI: Combined data validation passed. [2025-09-05T18:09:44.352126] [INFO ] [MAIN ] CCIA: Combined data validation passed. [2025-09-05T18:09:44.357816] [INFO ] [MAIN ] CCIA: Update completed successfully. [2025-09-05T18:09:44.358027] [INFO ] [MAIN ] Update Progress: 408/2363 symbols completed. CCIA took 2.1s. Estimated remaining: 46m 22s. Rate: 42.2 symbols/min [2025-09-05T18:09:44.619920] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:44.662685] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-05T18:09:44.673096] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-05T18:09:44.683944] [INFO ] [MAIN ] CCJ: Loaded 25704 existing records. [2025-09-05T18:09:44.870115] [INFO ] [MAIN ] CCJ: Found 1 missing trading days. [2025-09-05T18:09:44.871451] [INFO ] [MAIN ] CCJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:44.872684] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-05T18:09:44.912233] [INFO ] [MAIN ] CCI: Update completed successfully. [2025-09-05T18:09:44.914884] [INFO ] [MAIN ] Update Progress: 409/2363 symbols completed. CCI took 3.2s. Estimated remaining: 46m 16s. Rate: 42.2 symbols/min [2025-09-05T18:09:45.019932] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T18:09:45.127540] [INFO ] [MAIN ] CCIF: Adding 88 new records, updating 0 existing records. [2025-09-05T18:09:45.130364] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:45.132678] [INFO ] [MAIN ] CCIF: Combined dataset has 7399 total records. [2025-09-05T18:09:45.326440] [WARN ] [VALIDATOR ] CCIF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:45.327069] [INFO ] [MAIN ] CCK: Loaded 21627 existing records. [2025-09-05T18:09:45.678510] [INFO ] [MAIN ] CCK: Found 1 missing trading days. [2025-09-05T18:09:45.678818] [INFO ] [MAIN ] CCK: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:45.679098] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-05T18:09:45.687168] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:09:45.835289] [INFO ] [MAIN ] CCJ: Adding 386 new records, updating 0 existing records. [2025-09-05T18:09:45.839740] [INFO ] [MAIN ] CCJ: Combined dataset has 26090 total records. [2025-09-05T18:09:46.039397] [WARN ] [VALIDATOR ] CCJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:46.236254] [WARN ] [VALIDATOR ] CCIF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:46.236787] [INFO ] [MAIN ] CCIF: Combined data validation passed. [2025-09-05T18:09:46.283160] [INFO ] [MAIN ] CCIF: Update completed successfully. [2025-09-05T18:09:46.284340] [INFO ] [MAIN ] Update Progress: 410/2363 symbols completed. CCIF took 3.2s. Estimated remaining: 46m 15s. Rate: 42.2 symbols/min [2025-09-05T18:09:46.437363] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:09:46.489716] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:46.518665] [WARN ] [VALIDATOR ] CCJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:46.524128] [INFO ] [MAIN ] CCJ: Combined data validation passed. [2025-09-05T18:09:46.665561] [INFO ] [MAIN ] CCK: Adding 358 new records, updating 0 existing records. [2025-09-05T18:09:46.740035] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-05T18:09:46.747904] [INFO ] [MAIN ] CCL: Loaded 25781 existing records. [2025-09-05T18:09:46.770135] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-05T18:09:46.760019] [INFO ] [MAIN ] CCK: Combined dataset has 21985 total records. [2025-09-05T18:09:47.097018] [INFO ] [MAIN ] CCL: Found 1 missing trading days. [2025-09-05T18:09:47.124164] [WARN ] [VALIDATOR ] CCK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:47.127379] [INFO ] [MAIN ] CCL: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:47.138583] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-05T18:09:47.350545] [INFO ] [MAIN ] CCJ: Update completed successfully. [2025-09-05T18:09:47.353627] [INFO ] [MAIN ] Update Progress: 411/2363 symbols completed. CCJ took 3.0s. Estimated remaining: 46m 11s. Rate: 42.3 symbols/min [2025-09-05T18:09:47.526026] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:47.539918] [WARN ] [VALIDATOR ] CCK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:47.540148] [INFO ] [MAIN ] CCK: Combined data validation passed. [2025-09-05T18:09:47.549100] [INFO ] [MAIN ] CCO: Loaded 23224 existing records. [2025-09-05T18:09:47.827080] [INFO ] [MAIN ] CCO: Found 1 missing trading days. [2025-09-05T18:09:47.829552] [INFO ] [MAIN ] CCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:47.831091] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-05T18:09:47.844962] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:09:47.961134] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-05T18:09:48.003272] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-05T18:09:48.050793] [INFO ] [MAIN ] CCL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:09:48.050900] [INFO ] [MAIN ] CCK: Update completed successfully. [2025-09-05T18:09:48.053158] [INFO ] [MAIN ] Update Progress: 412/2363 symbols completed. CCK took 3.1s. Estimated remaining: 46m 7s. Rate: 42.3 symbols/min [2025-09-05T18:09:48.204714] [INFO ] [MAIN ] CCL: Combined dataset has 26171 total records. [2025-09-05T18:09:48.231338] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:48.384520] [INFO ] [MAIN ] CCRD: Loaded 6166 existing records. [2025-09-05T18:09:48.421307] [WARN ] [VALIDATOR ] CCL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:48.542580] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:09:48.765358] [INFO ] [MAIN ] CCRD: Found 1 missing trading days. [2025-09-05T18:09:48.811298] [INFO ] [MAIN ] CCRD: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:48.833528] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-05T18:09:48.917364] [INFO ] [MAIN ] CCO: Adding 364 new records, updating 0 existing records. [2025-09-05T18:09:48.922071] [INFO ] [MAIN ] CCO: Combined dataset has 23588 total records. [2025-09-05T18:09:49.102841] [WARN ] [VALIDATOR ] CCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:49.365150] [WARN ] [VALIDATOR ] CCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:49.365069] [WARN ] [VALIDATOR ] CCL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:49.365600] [INFO ] [MAIN ] CCO: Combined data validation passed. [2025-09-05T18:09:49.365427] [INFO ] [MAIN ] CCL: Combined data validation passed. [2025-09-05T18:09:49.571190] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-05T18:09:49.587462] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-05T18:09:49.627823] [INFO ] [MAIN ] CCO: Update completed successfully. [2025-09-05T18:09:49.631346] [INFO ] [MAIN ] Update Progress: 413/2363 symbols completed. CCO took 2.3s. Estimated remaining: 46m 6s. Rate: 42.3 symbols/min [2025-09-05T18:09:49.817795] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:49.820886] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:09:49.860376] [INFO ] [MAIN ] CCRD: Adding 94 new records, updating 0 existing records. [2025-09-05T18:09:49.909270] [INFO ] [MAIN ] CCS: Loaded 14473 existing records. [2025-09-05T18:09:49.908905] [INFO ] [MAIN ] CCRD: Combined dataset has 6260 total records. [2025-09-05T18:09:50.121429] [INFO ] [MAIN ] CCL: Update completed successfully. [2025-09-05T18:09:50.124232] [INFO ] [MAIN ] Update Progress: 414/2363 symbols completed. CCL took 3.8s. Estimated remaining: 46m 0s. Rate: 42.4 symbols/min [2025-09-05T18:09:50.298816] [WARN ] [VALIDATOR ] CCRD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:50.373991] [INFO ] [MAIN ] CCS: Found 1 missing trading days. [2025-09-05T18:09:50.400456] [INFO ] [MAIN ] CCS: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:50.445483] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-05T18:09:50.635740] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:50.648946] [INFO ] [MAIN ] CCU: Loaded 10314 existing records. [2025-09-05T18:09:50.835052] [INFO ] [MAIN ] CCU: Found 1 missing trading days. [2025-09-05T18:09:50.835281] [INFO ] [MAIN ] CCU: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:50.835751] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-05T18:09:50.857357] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-05T18:09:50.865382] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-05T18:09:50.867249] [WARN ] [VALIDATOR ] CCRD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:50.867379] [INFO ] [MAIN ] CCRD: Combined data validation passed. [2025-09-05T18:09:50.906770] [INFO ] [MAIN ] CCRD: Update completed successfully. [2025-09-05T18:09:50.907720] [INFO ] [MAIN ] Update Progress: 415/2363 symbols completed. CCRD took 2.9s. Estimated remaining: 45m 56s. Rate: 42.4 symbols/min [2025-09-05T18:09:51.084027] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:51.109776] [INFO ] [MAIN ] CDE: Loaded 25632 existing records. [2025-09-05T18:09:51.267622] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:09:51.292271] [INFO ] [MAIN ] CDE: Found 1 missing trading days. [2025-09-05T18:09:51.306940] [INFO ] [MAIN ] CDE: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:51.307220] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-05T18:09:51.377663] [INFO ] [MAIN ] CCS: Adding 242 new records, updating 0 existing records. [2025-09-05T18:09:51.380167] [INFO ] [MAIN ] CCS: Combined dataset has 14715 total records. [2025-09-05T18:09:51.498891] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:09:51.549847] [INFO ] [REMOTE ] CBT: Full fetch complete (34826 records). [2025-09-05T18:09:51.577612] [WARN ] [VALIDATOR ] CCS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:51.953967] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:09:51.955625] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T18:09:52.164961] [INFO ] [MAIN ] CCU: Adding 153 new records, updating 0 existing records. [2025-09-05T18:09:52.338582] [INFO ] [MAIN ] CDE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:09:52.378530] [INFO ] [MAIN ] CCU: Combined dataset has 10467 total records. [2025-09-05T18:09:52.394399] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-05T18:09:52.508036] [INFO ] [MAIN ] CDE: Combined dataset has 26022 total records. [2025-09-05T18:09:52.715052] [WARN ] [VALIDATOR ] CCU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:53.000290] [WARN ] [VALIDATOR ] CDE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:53.291023] [WARN ] [VALIDATOR ] CCS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:53.293133] [INFO ] [MAIN ] CCS: Combined data validation passed. [2025-09-05T18:09:53.403310] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-05T18:09:53.405736] [INFO ] [MAIN ] Update Progress: 416/2363 symbols completed. CBT took 16.5s. Estimated remaining: 45m 59s. Rate: 42.3 symbols/min [2025-09-05T18:09:53.617687] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:53.618657] [INFO ] [MAIN ] CCS: Update completed successfully. [2025-09-05T18:09:53.621041] [INFO ] [MAIN ] Update Progress: 417/2363 symbols completed. CCS took 4.0s. Estimated remaining: 45m 52s. Rate: 42.4 symbols/min [2025-09-05T18:09:53.656014] [WARN ] [VALIDATOR ] CDE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:53.624228] [WARN ] [VALIDATOR ] CCU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:53.718532] [INFO ] [MAIN ] CDE: Combined data validation passed. [2025-09-05T18:09:53.733483] [INFO ] [MAIN ] CDLR: Loaded 7155 existing records. [2025-09-05T18:09:53.729849] [INFO ] [MAIN ] CCU: Combined data validation passed. [2025-09-05T18:09:54.029313] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:54.132786] [INFO ] [MAIN ] CDLR: Found 1 missing trading days. [2025-09-05T18:09:54.140103] [INFO ] [MAIN ] CDLR: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:54.145451] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-05T18:09:54.164562] [INFO ] [MAIN ] CCU: Update completed successfully. [2025-09-05T18:09:54.165244] [INFO ] [MAIN ] CDP: Loaded 20010 existing records. [2025-09-05T18:09:54.167553] [INFO ] [MAIN ] Update Progress: 418/2363 symbols completed. CCU took 4.0s. Estimated remaining: 45m 47s. Rate: 42.5 symbols/min [2025-09-05T18:09:54.564155] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:54.542735] [INFO ] [MAIN ] CDP: Found 1 missing trading days. [2025-09-05T18:09:54.571994] [INFO ] [MAIN ] CDP: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:54.572736] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-05T18:09:54.590551] [INFO ] [MAIN ] CDRE: Loaded 11960 existing records. [2025-09-05T18:09:54.613829] [INFO ] [MAIN ] CDE: Update completed successfully. [2025-09-05T18:09:54.639901] [INFO ] [MAIN ] Update Progress: 419/2363 symbols completed. CDE took 3.7s. Estimated remaining: 45m 41s. Rate: 42.6 symbols/min [2025-09-05T18:09:54.909152] [INFO ] [MAIN ] CDRE: Found 1 missing trading days. [2025-09-05T18:09:54.938874] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:54.938991] [INFO ] [MAIN ] CDRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:54.939259] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-05T18:09:54.942960] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:09:54.976246] [INFO ] [MAIN ] CDLR: Adding 109 new records, updating 0 existing records. [2025-09-05T18:09:54.978278] [INFO ] [MAIN ] CDLR: Combined dataset has 7264 total records. [2025-09-05T18:09:55.176947] [INFO ] [MAIN ] CE: Loaded 24284 existing records. [2025-09-05T18:09:55.176116] [WARN ] [VALIDATOR ] CDLR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:09:55.536538] [INFO ] [MAIN ] CE: Found 1 missing trading days. [2025-09-05T18:09:55.536841] [INFO ] [MAIN ] CE: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:55.537063] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-05T18:09:55.546922] [WARN ] [VALIDATOR ] CDLR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:09:55.547118] [INFO ] [MAIN ] CDLR: Combined data validation passed. [2025-09-05T18:09:55.590997] [INFO ] [MAIN ] CDLR: Update completed successfully. [2025-09-05T18:09:55.591949] [INFO ] [MAIN ] Update Progress: 420/2363 symbols completed. CDLR took 2.2s. Estimated remaining: 45m 38s. Rate: 42.6 symbols/min [2025-09-05T18:09:55.754734] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:09:55.773492] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:55.849823] [INFO ] [MAIN ] CEE: Loaded 2714 existing records. [2025-09-05T18:09:56.016119] [INFO ] [MAIN ] CDP: Adding 306 new records, updating 0 existing records. [2025-09-05T18:09:56.087835] [INFO ] [MAIN ] CEE: Found 1 missing trading days. [2025-09-05T18:09:56.088117] [INFO ] [MAIN ] CEE: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:56.088394] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-05T18:09:56.094348] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:09:56.094599] [INFO ] [MAIN ] CDP: Combined dataset has 20316 total records. [2025-09-05T18:09:56.263809] [INFO ] [MAIN ] CDRE: Adding 167 new records, updating 0 existing records. [2025-09-05T18:09:56.344059] [WARN ] [VALIDATOR ] CDP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:56.375720] [INFO ] [MAIN ] CDRE: Combined dataset has 12127 total records. [2025-09-05T18:09:56.508262] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:09:56.841197] [WARN ] [VALIDATOR ] CDRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:56.854736] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:09:56.906983] [INFO ] [MAIN ] CEE: Adding 18 new records, updating 0 existing records. [2025-09-05T18:09:56.942112] [INFO ] [MAIN ] CE: Adding 376 new records, updating 0 existing records. [2025-09-05T18:09:56.954113] [INFO ] [MAIN ] CEE: Combined dataset has 2732 total records. [2025-09-05T18:09:57.142304] [INFO ] [MAIN ] CE: Combined dataset has 24660 total records. [2025-09-05T18:09:57.392621] [WARN ] [VALIDATOR ] CEE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:57.594907] [WARN ] [VALIDATOR ] CE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:09:57.881529] [WARN ] [VALIDATOR ] CDRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:57.883064] [INFO ] [MAIN ] CDRE: Combined data validation passed. [2025-09-05T18:09:57.881698] [WARN ] [VALIDATOR ] CDP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:57.885025] [INFO ] [MAIN ] CDP: Combined data validation passed. [2025-09-05T18:09:57.953176] [WARN ] [VALIDATOR ] CEE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:57.951049] [WARN ] [VALIDATOR ] CE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:09:58.016754] [INFO ] [MAIN ] CEE: Combined data validation passed. [2025-09-05T18:09:58.013469] [INFO ] [MAIN ] CE: Combined data validation passed. [2025-09-05T18:09:58.162771] [INFO ] [MAIN ] CDRE: Update completed successfully. [2025-09-05T18:09:58.165241] [INFO ] [MAIN ] Update Progress: 421/2363 symbols completed. CDRE took 4.0s. Estimated remaining: 45m 42s. Rate: 42.5 symbols/min [2025-09-05T18:09:58.272675] [INFO ] [MAIN ] CEE: Update completed successfully. [2025-09-05T18:09:58.293364] [INFO ] [MAIN ] Update Progress: 422/2363 symbols completed. CEE took 2.7s. Estimated remaining: 45m 34s. Rate: 42.6 symbols/min [2025-09-05T18:09:58.431628] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:58.449224] [WARN ] [MAIN ] CEPU: No existing data found, performing full refresh instead. [2025-09-05T18:09:58.494703] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-05T18:09:58.520242] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-05T18:09:58.534847] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-05T18:09:58.622615] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:58.620666] [INFO ] [MAIN ] CDP: Update completed successfully. [2025-09-05T18:09:58.662767] [INFO ] [MAIN ] Update Progress: 423/2363 symbols completed. CDP took 5.0s. Estimated remaining: 45m 28s. Rate: 42.7 symbols/min [2025-09-05T18:09:58.998797] [INFO ] [MAIN ] CF: Loaded 24991 existing records. [2025-09-05T18:09:59.168069] [INFO ] [MAIN ] CE: Update completed successfully. [2025-09-05T18:09:59.313096] [INFO ] [MAIN ] Update Progress: 424/2363 symbols completed. CE took 4.6s. Estimated remaining: 45m 23s. Rate: 42.7 symbols/min [2025-09-05T18:09:59.334106] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:09:59.760549] [INFO ] [MAIN ] CF: Found 1 missing trading days. [2025-09-05T18:09:59.782684] [INFO ] [MAIN ] CF: Need to fetch 1 months: 2025-09 [2025-09-05T18:09:59.783453] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-05T18:09:59.782277] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:09:59.829230] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-05T18:09:59.836084] [INFO ] [MAIN ] CFG: Loaded 25619 existing records. [2025-09-05T18:09:59.948854] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:00.067058] [INFO ] [MAIN ] CFND: Loaded 1820 existing records. [2025-09-05T18:10:00.327978] [INFO ] [MAIN ] CFG: Found 1 missing trading days. [2025-09-05T18:10:00.352452] [INFO ] [MAIN ] CFG: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:00.352790] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-05T18:10:00.412605] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:10:00.448545] [INFO ] [MAIN ] CFND: Found 1 missing trading days. [2025-09-05T18:10:00.466611] [INFO ] [MAIN ] CFND: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:00.467222] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-05T18:10:00.596638] [INFO ] [MAIN ] CF: Adding 385 new records, updating 0 existing records. [2025-09-05T18:10:00.600470] [INFO ] [MAIN ] CF: Combined dataset has 25376 total records. [2025-09-05T18:10:00.780751] [WARN ] [VALIDATOR ] CF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:00.974406] [WARN ] [VALIDATOR ] CF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:00.974628] [INFO ] [MAIN ] CF: Combined data validation passed. [2025-09-05T18:10:01.136156] [INFO ] [MAIN ] CF: Update completed successfully. [2025-09-05T18:10:01.139337] [INFO ] [MAIN ] Update Progress: 425/2363 symbols completed. CF took 2.8s. Estimated remaining: 45m 24s. Rate: 42.7 symbols/min [2025-09-05T18:10:01.298357] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:10:01.351369] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:01.457470] [INFO ] [MAIN ] CFG: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:01.464817] [INFO ] [MAIN ] CFR: Loaded 15448 existing records. [2025-09-05T18:10:01.464871] [INFO ] [MAIN ] CFG: Combined dataset has 25619 total records. [2025-09-05T18:10:01.501363] [FATAL] [VALIDATOR ] CFG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:01.530970] [FATAL] [MAIN ] CFG: Combined data validation failed. [2025-09-05T18:10:01.568212] [WARN ] [MAIN ] CFG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:01.571590] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-05T18:10:01.582290] [INFO ] [LOCAL ] CFG: Starting deletion of derivative data. [2025-09-05T18:10:01.628369] [INFO ] [MAIN ] Update Progress: 426/2363 symbols completed. CFG took 2.9s. Estimated remaining: 45m 18s. Rate: 42.8 symbols/min [2025-09-05T18:10:01.661977] [INFO ] [MAIN ] CFR: Found 1 missing trading days. [2025-09-05T18:10:01.665014] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:10:01.665282] [INFO ] [MAIN ] CFR: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:01.720982] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-05T18:10:01.720678] [INFO ] [MAIN ] CFND: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:01.765807] [INFO ] [MAIN ] CFND: Combined dataset has 1820 total records. [2025-09-05T18:10:01.783784] [FATAL] [VALIDATOR ] CFND: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:01.819040] [FATAL] [MAIN ] CFND: Combined data validation failed. [2025-09-05T18:10:01.915178] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:01.919979] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:01.920553] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-05T18:10:01.924000] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-05T18:10:01.934343] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-05T18:10:01.936029] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-05T18:10:01.938169] [INFO ] [MAIN ] Update Progress: 427/2363 symbols completed. CFND took 2.6s. Estimated remaining: 45m 12s. Rate: 42.8 symbols/min [2025-09-05T18:10:02.144873] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:02.147723] [INFO ] [MAIN ] CGAU: Loaded 31677 existing records. [2025-09-05T18:10:02.235590] [INFO ] [MAIN ] CGV: Loaded 724 existing records. [2025-09-05T18:10:02.506033] [INFO ] [MAIN ] CGAU: Found 1 missing trading days. [2025-09-05T18:10:02.518989] [INFO ] [MAIN ] CGAU: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:02.519663] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-05T18:10:02.549172] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:10:02.659519] [INFO ] [MAIN ] CGV: Found 1 missing trading days. [2025-09-05T18:10:02.680581] [INFO ] [MAIN ] CGV: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:02.691856] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-05T18:10:02.721937] [INFO ] [MAIN ] CFR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:02.724613] [INFO ] [MAIN ] CFR: Combined dataset has 15448 total records. [2025-09-05T18:10:02.725194] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:02.725298] [FATAL] [MAIN ] CFR: Combined data validation failed. [2025-09-05T18:10:02.725524] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:02.725563] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-05T18:10:02.726063] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-09-05T18:10:02.728155] [INFO ] [MAIN ] Update Progress: 428/2363 symbols completed. CFR took 1.6s. Estimated remaining: 45m 8s. Rate: 42.9 symbols/min [2025-09-05T18:10:02.921094] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:02.933953] [INFO ] [MAIN ] CHCT: Loaded 11888 existing records. [2025-09-05T18:10:03.110184] [INFO ] [MAIN ] CHCT: Found 1 missing trading days. [2025-09-05T18:10:03.110335] [INFO ] [MAIN ] CHCT: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:03.110616] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-05T18:10:03.190617] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-05T18:10:03.196276] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-05T18:10:03.327610] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:10:03.472483] [INFO ] [MAIN ] CGAU: Adding 332 new records, updating 0 existing records. [2025-09-05T18:10:03.476072] [INFO ] [MAIN ] CGAU: Combined dataset has 32009 total records. [2025-09-05T18:10:03.578827] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:10:03.592969] [INFO ] [MAIN ] CGV: Adding 5 new records, updating 0 existing records. [2025-09-05T18:10:03.604637] [INFO ] [MAIN ] CGV: Combined dataset has 729 total records. [2025-09-05T18:10:03.773003] [WARN ] [VALIDATOR ] CGAU: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:10:03.971977] [WARN ] [VALIDATOR ] CGV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:04.252871] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-05T18:10:04.259755] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-05T18:10:04.271755] [WARN ] [VALIDATOR ] CGV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:04.271813] [WARN ] [VALIDATOR ] CGAU: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:10:04.272170] [INFO ] [MAIN ] CGAU: Combined data validation passed. [2025-09-05T18:10:04.272068] [INFO ] [MAIN ] CGV: Combined data validation passed. [2025-09-05T18:10:04.278606] [INFO ] [MAIN ] CGV: Update completed successfully. [2025-09-05T18:10:04.278968] [INFO ] [MAIN ] Update Progress: 429/2363 symbols completed. CGV took 2.3s. Estimated remaining: 45m 7s. Rate: 42.9 symbols/min [2025-09-05T18:10:04.448889] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T18:10:04.621894] [INFO ] [MAIN ] CHCT: Adding 169 new records, updating 0 existing records. [2025-09-05T18:10:04.626141] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:04.639855] [INFO ] [MAIN ] CHCT: Combined dataset has 12057 total records. [2025-09-05T18:10:04.744775] [INFO ] [MAIN ] CHD: Loaded 25092 existing records. [2025-09-05T18:10:04.968088] [WARN ] [VALIDATOR ] CHCT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:05.130379] [INFO ] [MAIN ] CHD: Found 1 missing trading days. [2025-09-05T18:10:05.148416] [INFO ] [MAIN ] CHD: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:05.155059] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-05T18:10:05.326397] [INFO ] [MAIN ] CGAU: Update completed successfully. [2025-09-05T18:10:05.330512] [INFO ] [MAIN ] Update Progress: 430/2363 symbols completed. CGAU took 3.7s. Estimated remaining: 45m 4s. Rate: 42.9 symbols/min [2025-09-05T18:10:05.504029] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:05.514950] [INFO ] [MAIN ] CHE: Loaded 7363 existing records. [2025-09-05T18:10:05.597420] [WARN ] [VALIDATOR ] CHCT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:05.608751] [INFO ] [MAIN ] CHCT: Combined data validation passed. [2025-09-05T18:10:05.736838] [INFO ] [MAIN ] CHE: Found 1 missing trading days. [2025-09-05T18:10:05.754136] [INFO ] [MAIN ] CHE: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:05.754496] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-05T18:10:05.778537] [INFO ] [MAIN ] CHCT: Update completed successfully. [2025-09-05T18:10:05.796884] [INFO ] [MAIN ] Update Progress: 431/2363 symbols completed. CHCT took 3.1s. Estimated remaining: 44m 58s. Rate: 43.0 symbols/min [2025-09-05T18:10:05.801590] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-05T18:10:05.873996] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-05T18:10:06.009634] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:06.036500] [INFO ] [MAIN ] CHGG: Loaded 23093 existing records. [2025-09-05T18:10:06.126679] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:10:06.400254] [INFO ] [MAIN ] CHGG: Found 1 missing trading days. [2025-09-05T18:10:06.418110] [INFO ] [MAIN ] CHGG: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:06.417957] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:10:06.423907] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-05T18:10:06.432590] [INFO ] [MAIN ] CHD: Adding 383 new records, updating 0 existing records. [2025-09-05T18:10:06.496378] [INFO ] [MAIN ] CHE: Adding 152 new records, updating 0 existing records. [2025-09-05T18:10:06.499522] [INFO ] [MAIN ] CHE: Combined dataset has 7515 total records. [2025-09-05T18:10:06.499591] [INFO ] [MAIN ] CHD: Combined dataset has 25475 total records. [2025-09-05T18:10:06.861063] [WARN ] [VALIDATOR ] CHE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:06.841836] [WARN ] [VALIDATOR ] CHD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:07.255350] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:10:07.436967] [INFO ] [MAIN ] CHGG: Adding 350 new records, updating 0 existing records. [2025-09-05T18:10:07.466370] [INFO ] [MAIN ] CHGG: Combined dataset has 23443 total records. [2025-09-05T18:10:07.454989] [WARN ] [VALIDATOR ] CHE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:07.466634] [INFO ] [MAIN ] CHE: Combined data validation passed. [2025-09-05T18:10:07.455286] [WARN ] [VALIDATOR ] CHD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:07.473479] [INFO ] [MAIN ] CHD: Combined data validation passed. [2025-09-05T18:10:07.505484] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-05T18:10:07.603682] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-05T18:10:07.809564] [WARN ] [VALIDATOR ] CHGG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:07.966846] [INFO ] [MAIN ] CHE: Update completed successfully. [2025-09-05T18:10:07.997486] [INFO ] [MAIN ] Update Progress: 432/2363 symbols completed. CHE took 2.7s. Estimated remaining: 45m 1s. Rate: 42.9 symbols/min [2025-09-05T18:10:08.247054] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:08.256284] [INFO ] [MAIN ] CHD: Update completed successfully. [2025-09-05T18:10:08.261634] [INFO ] [MAIN ] Update Progress: 433/2363 symbols completed. CHD took 4.0s. Estimated remaining: 44m 54s. Rate: 43.0 symbols/min [2025-09-05T18:10:08.340850] [INFO ] [MAIN ] CHH: Loaded 14636 existing records. [2025-09-05T18:10:08.597434] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:08.656680] [INFO ] [MAIN ] CHH: Found 1 missing trading days. [2025-09-05T18:10:08.657193] [INFO ] [MAIN ] CHH: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:08.657527] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-05T18:10:08.666255] [INFO ] [MAIN ] CHMI: Loaded 9690 existing records. [2025-09-05T18:10:08.841492] [INFO ] [MAIN ] CHMI: Found 1 missing trading days. [2025-09-05T18:10:08.841772] [INFO ] [MAIN ] CHMI: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:08.842300] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-05T18:10:08.861207] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-05T18:10:08.867335] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-05T18:10:08.869821] [WARN ] [VALIDATOR ] CHGG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:08.870132] [INFO ] [MAIN ] CHGG: Combined data validation passed. [2025-09-05T18:10:09.011890] [INFO ] [MAIN ] CHGG: Update completed successfully. [2025-09-05T18:10:09.014995] [INFO ] [MAIN ] Update Progress: 434/2363 symbols completed. CHGG took 3.2s. Estimated remaining: 44m 50s. Rate: 43.0 symbols/min [2025-09-05T18:10:09.186167] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:09.190759] [INFO ] [MAIN ] CHN: Loaded 2361 existing records. [2025-09-05T18:10:09.361100] [INFO ] [MAIN ] CHN: Found 1 missing trading days. [2025-09-05T18:10:09.366264] [INFO ] [MAIN ] CHN: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:09.366801] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-05T18:10:09.366478] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:10:09.442326] [INFO ] [MAIN ] CHH: Adding 167 new records, updating 0 existing records. [2025-09-05T18:10:09.445024] [INFO ] [MAIN ] CHH: Combined dataset has 14803 total records. [2025-09-05T18:10:09.624811] [WARN ] [VALIDATOR ] CHH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:09.816568] [WARN ] [VALIDATOR ] CHH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:09.817039] [INFO ] [MAIN ] CHH: Combined data validation passed. [2025-09-05T18:10:09.914952] [INFO ] [MAIN ] CHH: Update completed successfully. [2025-09-05T18:10:09.916448] [INFO ] [MAIN ] Update Progress: 435/2363 symbols completed. CHH took 1.9s. Estimated remaining: 44m 46s. Rate: 43.1 symbols/min [2025-09-05T18:10:10.027985] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-05T18:10:10.127043] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:10.157178] [INFO ] [MAIN ] CHMI: Adding 162 new records, updating 0 existing records. [2025-09-05T18:10:10.160237] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:10:10.181923] [INFO ] [MAIN ] CHN: Adding 51 new records, updating 0 existing records. [2025-09-05T18:10:10.190603] [INFO ] [MAIN ] CHMI: Combined dataset has 9852 total records. [2025-09-05T18:10:10.190754] [INFO ] [MAIN ] CHN: Combined dataset has 2412 total records. [2025-09-05T18:10:10.390218] [INFO ] [MAIN ] CHPT: Loaded 23123 existing records. [2025-09-05T18:10:10.505023] [WARN ] [VALIDATOR ] CHN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:10.578681] [WARN ] [VALIDATOR ] CHMI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:10.897106] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-05T18:10:11.063925] [INFO ] [MAIN ] CHPT: Found 1 missing trading days. [2025-09-05T18:10:11.064222] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-05T18:10:11.082239] [INFO ] [MAIN ] CHPT: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:11.083342] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-05T18:10:11.160441] [WARN ] [VALIDATOR ] CHN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:11.160816] [INFO ] [MAIN ] CHN: Combined data validation passed. [2025-09-05T18:10:11.160567] [WARN ] [VALIDATOR ] CHMI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:11.162320] [INFO ] [MAIN ] CHMI: Combined data validation passed. [2025-09-05T18:10:11.177369] [INFO ] [MAIN ] CHN: Update completed successfully. [2025-09-05T18:10:11.178249] [INFO ] [MAIN ] Update Progress: 436/2363 symbols completed. CHN took 2.2s. Estimated remaining: 44m 44s. Rate: 43.1 symbols/min [2025-09-05T18:10:11.408495] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:11.412080] [INFO ] [MAIN ] CHMI: Update completed successfully. [2025-09-05T18:10:11.413402] [INFO ] [MAIN ] Update Progress: 437/2363 symbols completed. CHMI took 3.2s. Estimated remaining: 44m 38s. Rate: 43.2 symbols/min [2025-09-05T18:10:11.422592] [INFO ] [MAIN ] CHT: Loaded 8869 existing records. [2025-09-05T18:10:11.593048] [INFO ] [MAIN ] CHT: Found 1 missing trading days. [2025-09-05T18:10:11.593192] [INFO ] [MAIN ] CHT: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:11.593400] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-05T18:10:11.646339] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:10:11.766957] [INFO ] [MAIN ] CHPT: Adding 298 new records, updating 0 existing records. [2025-09-05T18:10:11.770246] [INFO ] [MAIN ] CHPT: Combined dataset has 23421 total records. [2025-09-05T18:10:11.957397] [WARN ] [VALIDATOR ] CHPT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:12.074999] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:10:12.215245] [INFO ] [MAIN ] CHT: Adding 102 new records, updating 0 existing records. [2025-09-05T18:10:12.232478] [INFO ] [MAIN ] CHT: Combined dataset has 8971 total records. [2025-09-05T18:10:12.233720] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-05T18:10:12.324944] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-05T18:10:12.428179] [WARN ] [VALIDATOR ] CHT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:12.621702] [WARN ] [VALIDATOR ] CHPT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:12.622099] [INFO ] [MAIN ] CHPT: Combined data validation passed. [2025-09-05T18:10:12.621799] [WARN ] [VALIDATOR ] CHT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:12.622500] [INFO ] [MAIN ] CHT: Combined data validation passed. [2025-09-05T18:10:12.772095] [INFO ] [MAIN ] CHT: Update completed successfully. [2025-09-05T18:10:12.781062] [INFO ] [MAIN ] Update Progress: 438/2363 symbols completed. CHT took 1.6s. Estimated remaining: 44m 36s. Rate: 43.2 symbols/min [2025-09-05T18:10:12.825824] [INFO ] [MAIN ] CHPT: Update completed successfully. [2025-09-05T18:10:12.828370] [INFO ] [MAIN ] Update Progress: 439/2363 symbols completed. CHPT took 2.9s. Estimated remaining: 44m 29s. Rate: 43.3 symbols/min [2025-09-05T18:10:13.414406] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:10:13.416041] [INFO ] [REMOTE ] CEPU: Full fetch complete (27395 records). [2025-09-05T18:10:13.416675] [FATAL] [VALIDATOR ] CEPU: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:13.416753] [FATAL] [MAIN ] CEPU: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:10:13.416799] [WARN ] [MAIN ] CEPU: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:13.416837] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-05T18:10:13.416907] [INFO ] [LOCAL ] CEPU: Starting deletion of derivative data. [2025-09-05T18:10:13.416995] [INFO ] [MAIN ] Update Progress: 440/2363 symbols completed. CEPU took 15.3s. Estimated remaining: 44m 24s. Rate: 43.3 symbols/min [2025-09-05T18:10:14.061263] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:14.109944] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:14.114978] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:14.132469] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:14.159531] [INFO ] [MAIN ] CIA: Loaded 9278 existing records. [2025-09-05T18:10:14.166448] [INFO ] [MAIN ] CIB: Loaded 13634 existing records. [2025-09-05T18:10:14.263676] [INFO ] [MAIN ] CHWY: Loaded 25655 existing records. [2025-09-05T18:10:14.448318] [INFO ] [MAIN ] CI: Loaded 23996 existing records. [2025-09-05T18:10:14.676095] [INFO ] [MAIN ] CIB: Found 1 missing trading days. [2025-09-05T18:10:14.708705] [INFO ] [MAIN ] CIA: Found 1 missing trading days. [2025-09-05T18:10:14.714253] [INFO ] [MAIN ] CIA: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:14.714314] [INFO ] [MAIN ] CIB: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:14.782578] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-05T18:10:14.832165] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-05T18:10:14.875797] [INFO ] [MAIN ] CHWY: Found 1 missing trading days. [2025-09-05T18:10:14.877592] [INFO ] [MAIN ] CHWY: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:14.888326] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-05T18:10:14.957491] [INFO ] [MAIN ] CI: Found 1 missing trading days. [2025-09-05T18:10:14.957655] [INFO ] [MAIN ] CI: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:14.957865] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-05T18:10:15.507419] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:10:15.610425] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:10:15.734818] [INFO ] [MAIN ] CIA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:15.749915] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:10:15.761415] [INFO ] [MAIN ] CI: Adding 0 new records, updating 743 existing records. [2025-09-05T18:10:15.756613] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:10:15.805436] [INFO ] [MAIN ] CIA: Combined dataset has 9278 total records. [2025-09-05T18:10:15.833175] [FATAL] [VALIDATOR ] CIA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:15.890043] [FATAL] [MAIN ] CIA: Combined data validation failed. [2025-09-05T18:10:15.895332] [WARN ] [MAIN ] CIA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:15.931804] [INFO ] [MAIN ] CI: Combined dataset has 23996 total records. [2025-09-05T18:10:15.946936] [INFO ] [MAIN ] CIB: Adding 275 new records, updating 0 existing records. [2025-09-05T18:10:15.947073] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-05T18:10:15.968412] [FATAL] [VALIDATOR ] CI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:15.985094] [INFO ] [LOCAL ] CIA: Starting deletion of derivative data. [2025-09-05T18:10:15.985611] [INFO ] [MAIN ] CHWY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:15.985730] [FATAL] [MAIN ] CI: Combined data validation failed. [2025-09-05T18:10:15.985934] [WARN ] [MAIN ] CI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:15.986622] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-05T18:10:15.987975] [INFO ] [MAIN ] Update Progress: 441/2363 symbols completed. CIA took 2.6s. Estimated remaining: 44m 28s. Rate: 43.2 symbols/min [2025-09-05T18:10:15.988721] [INFO ] [MAIN ] CIB: Combined dataset has 13909 total records. [2025-09-05T18:10:16.018818] [INFO ] [LOCAL ] CI: Starting deletion of derivative data. [2025-09-05T18:10:16.018925] [INFO ] [MAIN ] CHWY: Combined dataset has 25655 total records. [2025-09-05T18:10:16.066422] [INFO ] [MAIN ] Update Progress: 442/2363 symbols completed. CI took 2.6s. Estimated remaining: 44m 21s. Rate: 43.3 symbols/min [2025-09-05T18:10:16.084516] [FATAL] [VALIDATOR ] CHWY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:16.152904] [FATAL] [MAIN ] CHWY: Combined data validation failed. [2025-09-05T18:10:16.161471] [WARN ] [MAIN ] CHWY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:16.197537] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-05T18:10:16.264032] [INFO ] [LOCAL ] CHWY: Starting deletion of derivative data. [2025-09-05T18:10:16.400570] [INFO ] [MAIN ] Update Progress: 443/2363 symbols completed. CHWY took 3.0s. Estimated remaining: 44m 15s. Rate: 43.4 symbols/min [2025-09-05T18:10:16.432561] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:16.459724] [WARN ] [VALIDATOR ] CIB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:16.591672] [INFO ] [MAIN ] CICB: Loaded 629 existing records. [2025-09-05T18:10:16.703683] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:16.970060] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:17.069953] [INFO ] [MAIN ] CICB: Found 1 missing trading days. [2025-09-05T18:10:17.073274] [INFO ] [MAIN ] CIEN: Loaded 24866 existing records. [2025-09-05T18:10:17.072255] [INFO ] [MAIN ] CIF: Loaded 1746 existing records. [2025-09-05T18:10:17.072454] [INFO ] [MAIN ] CICB: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:17.114095] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-05T18:10:17.406297] [INFO ] [MAIN ] CIF: Found 1 missing trading days. [2025-09-05T18:10:17.435837] [INFO ] [MAIN ] CIEN: Found 1 missing trading days. [2025-09-05T18:10:17.435948] [INFO ] [MAIN ] CIEN: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:17.435668] [INFO ] [MAIN ] CIF: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:17.436241] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-05T18:10:17.436566] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-05T18:10:17.445751] [WARN ] [VALIDATOR ] CIB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:17.445957] [INFO ] [MAIN ] CIB: Combined data validation passed. [2025-09-05T18:10:17.532987] [INFO ] [MAIN ] CIB: Update completed successfully. [2025-09-05T18:10:17.534392] [INFO ] [MAIN ] Update Progress: 444/2363 symbols completed. CIB took 4.1s. Estimated remaining: 44m 13s. Rate: 43.4 symbols/min [2025-09-05T18:10:17.703804] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:17.725415] [INFO ] [MAIN ] CIG: Loaded 21680 existing records. [2025-09-05T18:10:17.899433] [INFO ] [MAIN ] CIG: Found 1 missing trading days. [2025-09-05T18:10:17.899557] [INFO ] [MAIN ] CIG: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:17.899774] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-05T18:10:18.283485] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T18:10:18.287731] [INFO ] [MAIN ] CICB: Adding 6 new records, updating 0 existing records. [2025-09-05T18:10:18.290664] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:10:18.290975] [INFO ] [MAIN ] CICB: Combined dataset has 635 total records. [2025-09-05T18:10:18.308831] [INFO ] [MAIN ] CIF: Adding 39 new records, updating 0 existing records. [2025-09-05T18:10:18.376778] [INFO ] [MAIN ] CIF: Combined dataset has 1785 total records. [2025-09-05T18:10:18.602233] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:10:18.639247] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:10:18.633582] [WARN ] [VALIDATOR ] CICB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:18.778732] [WARN ] [VALIDATOR ] CIF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:19.110247] [INFO ] [MAIN ] CIG: Adding 303 new records, updating 0 existing records. [2025-09-05T18:10:19.223594] [INFO ] [MAIN ] CIEN: Adding 388 new records, updating 0 existing records. [2025-09-05T18:10:19.393244] [INFO ] [MAIN ] CIG: Combined dataset has 21983 total records. [2025-09-05T18:10:19.405288] [INFO ] [MAIN ] CIEN: Combined dataset has 25254 total records. [2025-09-05T18:10:19.704290] [WARN ] [VALIDATOR ] CIG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:19.825358] [WARN ] [VALIDATOR ] CIEN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:20.174073] [WARN ] [VALIDATOR ] CICB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:20.173971] [WARN ] [VALIDATOR ] CIF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:20.175310] [INFO ] [MAIN ] CICB: Combined data validation passed. [2025-09-05T18:10:20.175461] [INFO ] [MAIN ] CIF: Combined data validation passed. [2025-09-05T18:10:20.183036] [INFO ] [MAIN ] CICB: Update completed successfully. [2025-09-05T18:10:20.189178] [INFO ] [MAIN ] Update Progress: 445/2363 symbols completed. CICB took 4.2s. Estimated remaining: 44m 17s. Rate: 43.3 symbols/min [2025-09-05T18:10:20.197772] [INFO ] [MAIN ] CIF: Update completed successfully. [2025-09-05T18:10:20.203439] [INFO ] [MAIN ] Update Progress: 446/2363 symbols completed. CIF took 3.7s. Estimated remaining: 44m 9s. Rate: 43.4 symbols/min [2025-09-05T18:10:20.194952] [WARN ] [VALIDATOR ] CIEN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:20.223566] [WARN ] [VALIDATOR ] CIG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:20.223509] [INFO ] [MAIN ] CIEN: Combined data validation passed. [2025-09-05T18:10:20.261632] [INFO ] [MAIN ] CIG: Combined data validation passed. [2025-09-05T18:10:20.695195] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:20.733899] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:20.755261] [INFO ] [MAIN ] CII: Loaded 6204 existing records. [2025-09-05T18:10:20.792755] [INFO ] [MAIN ] CIM: Loaded 16719 existing records. [2025-09-05T18:10:21.070775] [INFO ] [MAIN ] CII: Found 1 missing trading days. [2025-09-05T18:10:21.092353] [INFO ] [MAIN ] CII: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:21.099000] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-05T18:10:21.129669] [INFO ] [MAIN ] CIM: Found 1 missing trading days. [2025-09-05T18:10:21.131853] [INFO ] [MAIN ] CIM: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:21.132099] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-05T18:10:21.191152] [INFO ] [MAIN ] CIG: Update completed successfully. [2025-09-05T18:10:21.194881] [INFO ] [MAIN ] Update Progress: 447/2363 symbols completed. CIG took 3.7s. Estimated remaining: 44m 6s. Rate: 43.4 symbols/min [2025-09-05T18:10:21.313937] [INFO ] [MAIN ] CIEN: Update completed successfully. [2025-09-05T18:10:21.327359] [INFO ] [MAIN ] Update Progress: 448/2363 symbols completed. CIEN took 5.2s. Estimated remaining: 43m 60s. Rate: 43.5 symbols/min [2025-09-05T18:10:21.454424] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:21.511279] [INFO ] [MAIN ] CIMN: Loaded 1132 existing records. [2025-09-05T18:10:21.624521] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:21.692995] [INFO ] [MAIN ] CIMO: Loaded 1260 existing records. [2025-09-05T18:10:21.755750] [INFO ] [MAIN ] CIMN: Found 1 missing trading days. [2025-09-05T18:10:21.772837] [INFO ] [MAIN ] CIMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:21.784890] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-05T18:10:21.847597] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:10:22.027383] [INFO ] [MAIN ] CIMO: Found 1 missing trading days. [2025-09-05T18:10:22.040689] [INFO ] [MAIN ] CIMO: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:22.041061] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-05T18:10:22.040614] [INFO ] [MAIN ] CIM: Adding 265 new records, updating 0 existing records. [2025-09-05T18:10:22.045016] [INFO ] [MAIN ] CIM: Combined dataset has 16984 total records. [2025-09-05T18:10:22.114105] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:10:22.193806] [INFO ] [MAIN ] CII: Adding 105 new records, updating 0 existing records. [2025-09-05T18:10:22.256466] [INFO ] [MAIN ] CII: Combined dataset has 6309 total records. [2025-09-05T18:10:22.276368] [WARN ] [VALIDATOR ] CIM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:22.440380] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:10:22.495379] [INFO ] [MAIN ] CIMN: Adding 8 new records, updating 0 existing records. [2025-09-05T18:10:22.558622] [INFO ] [MAIN ] CIMN: Combined dataset has 1140 total records. [2025-09-05T18:10:22.696402] [WARN ] [VALIDATOR ] CII: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:22.712742] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:10:22.750783] [INFO ] [MAIN ] CIMO: Adding 17 new records, updating 0 existing records. [2025-09-05T18:10:22.859507] [INFO ] [MAIN ] CIMO: Combined dataset has 1277 total records. [2025-09-05T18:10:23.145543] [WARN ] [VALIDATOR ] CIMN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:23.369506] [WARN ] [VALIDATOR ] CIMO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:23.668129] [WARN ] [VALIDATOR ] CIM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:23.668747] [INFO ] [MAIN ] CIM: Combined data validation passed. [2025-09-05T18:10:23.668498] [WARN ] [VALIDATOR ] CII: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:23.669324] [INFO ] [MAIN ] CII: Combined data validation passed. [2025-09-05T18:10:23.738143] [WARN ] [VALIDATOR ] CIMO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:23.741616] [WARN ] [VALIDATOR ] CIMN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:23.757510] [INFO ] [MAIN ] CIMO: Combined data validation passed. [2025-09-05T18:10:23.748587] [INFO ] [MAIN ] CIMN: Combined data validation passed. [2025-09-05T18:10:23.797684] [INFO ] [MAIN ] CIMO: Update completed successfully. [2025-09-05T18:10:23.803019] [INFO ] [MAIN ] Update Progress: 449/2363 symbols completed. CIMO took 2.5s. Estimated remaining: 44m 3s. Rate: 43.5 symbols/min [2025-09-05T18:10:23.802226] [INFO ] [MAIN ] CIMN: Update completed successfully. [2025-09-05T18:10:23.814464] [INFO ] [MAIN ] Update Progress: 450/2363 symbols completed. CIMN took 2.6s. Estimated remaining: 43m 56s. Rate: 43.5 symbols/min [2025-09-05T18:10:23.924502] [INFO ] [MAIN ] CII: Update completed successfully. [2025-09-05T18:10:23.967389] [INFO ] [MAIN ] Update Progress: 451/2363 symbols completed. CII took 3.8s. Estimated remaining: 43m 49s. Rate: 43.6 symbols/min [2025-09-05T18:10:24.334853] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:24.407961] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:24.414189] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:24.420113] [INFO ] [MAIN ] CIM: Update completed successfully. [2025-09-05T18:10:24.422554] [INFO ] [MAIN ] Update Progress: 452/2363 symbols completed. CIM took 4.2s. Estimated remaining: 43m 44s. Rate: 43.7 symbols/min [2025-09-05T18:10:24.503788] [INFO ] [MAIN ] CIO: Loaded 10271 existing records. [2025-09-05T18:10:24.504144] [INFO ] [MAIN ] CINT: Loaded 8694 existing records. [2025-09-05T18:10:24.671497] [INFO ] [MAIN ] CION: Loaded 13025 existing records. [2025-09-05T18:10:24.913495] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:25.065295] [INFO ] [MAIN ] CINT: Found 1 missing trading days. [2025-09-05T18:10:25.097016] [INFO ] [MAIN ] CINT: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:25.096920] [INFO ] [MAIN ] CIO: Found 1 missing trading days. [2025-09-05T18:10:25.102990] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-05T18:10:25.102670] [INFO ] [MAIN ] CIO: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:25.123818] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-05T18:10:25.179758] [INFO ] [MAIN ] CION: Found 1 missing trading days. [2025-09-05T18:10:25.180884] [INFO ] [MAIN ] CION: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:25.181138] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-05T18:10:25.193107] [INFO ] [MAIN ] CIVI: Loaded 25173 existing records. [2025-09-05T18:10:25.385973] [INFO ] [MAIN ] CIVI: Found 1 missing trading days. [2025-09-05T18:10:25.386117] [INFO ] [MAIN ] CIVI: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:25.386346] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-05T18:10:25.524937] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-05T18:10:25.588970] [INFO ] [MAIN ] CION: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:25.590691] [INFO ] [MAIN ] CION: Combined dataset has 13025 total records. [2025-09-05T18:10:25.591126] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:25.591221] [FATAL] [MAIN ] CION: Combined data validation failed. [2025-09-05T18:10:25.591274] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:25.591344] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-05T18:10:25.591833] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-09-05T18:10:25.593802] [INFO ] [MAIN ] Update Progress: 453/2363 symbols completed. CION took 1.6s. Estimated remaining: 43m 42s. Rate: 43.7 symbols/min [2025-09-05T18:10:25.697930] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:10:25.806963] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:25.826941] [INFO ] [MAIN ] CIO: Adding 129 new records, updating 0 existing records. [2025-09-05T18:10:25.829459] [INFO ] [MAIN ] CIO: Combined dataset has 10400 total records. [2025-09-05T18:10:26.027730] [WARN ] [VALIDATOR ] CIO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:26.028859] [INFO ] [MAIN ] CL: Loaded 25639 existing records. [2025-09-05T18:10:26.260906] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:10:26.422412] [INFO ] [MAIN ] CL: Found 1 missing trading days. [2025-09-05T18:10:26.428203] [INFO ] [MAIN ] CL: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:26.436118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-05T18:10:26.447791] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:10:26.463755] [INFO ] [MAIN ] CINT: Adding 149 new records, updating 0 existing records. [2025-09-05T18:10:26.549511] [INFO ] [MAIN ] CINT: Combined dataset has 8843 total records. [2025-09-05T18:10:26.680693] [INFO ] [MAIN ] CIVI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:10:26.827246] [WARN ] [VALIDATOR ] CINT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:26.849707] [INFO ] [MAIN ] CIVI: Combined dataset has 25563 total records. [2025-09-05T18:10:27.195272] [WARN ] [VALIDATOR ] CIVI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:27.302345] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:10:27.593877] [INFO ] [MAIN ] CL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:10:27.600505] [INFO ] [MAIN ] CL: Combined dataset has 26029 total records. [2025-09-05T18:10:27.606792] [WARN ] [VALIDATOR ] CIO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:27.622469] [INFO ] [MAIN ] CIO: Combined data validation passed. [2025-09-05T18:10:27.778196] [INFO ] [MAIN ] CIO: Update completed successfully. [2025-09-05T18:10:27.791218] [INFO ] [MAIN ] Update Progress: 454/2363 symbols completed. CIO took 4.0s. Estimated remaining: 43m 44s. Rate: 43.7 symbols/min [2025-09-05T18:10:27.918667] [WARN ] [VALIDATOR ] CIVI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:27.925111] [WARN ] [VALIDATOR ] CINT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:27.931331] [WARN ] [VALIDATOR ] CL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:27.936799] [INFO ] [MAIN ] CINT: Combined data validation passed. [2025-09-05T18:10:27.936987] [INFO ] [MAIN ] CIVI: Combined data validation passed. [2025-09-05T18:10:28.232507] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:28.404243] [INFO ] [MAIN ] CLB: Loaded 15409 existing records. [2025-09-05T18:10:28.449882] [INFO ] [MAIN ] CINT: Update completed successfully. [2025-09-05T18:10:28.462923] [INFO ] [MAIN ] Update Progress: 455/2363 symbols completed. CINT took 4.7s. Estimated remaining: 43m 39s. Rate: 43.7 symbols/min [2025-09-05T18:10:28.793127] [INFO ] [MAIN ] CLB: Found 1 missing trading days. [2025-09-05T18:10:28.807597] [INFO ] [MAIN ] CLB: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:28.827211] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:28.829185] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-05T18:10:28.839659] [INFO ] [MAIN ] CLCO: Loaded 4946 existing records. [2025-09-05T18:10:28.886705] [INFO ] [MAIN ] CIVI: Update completed successfully. [2025-09-05T18:10:28.910763] [INFO ] [MAIN ] Update Progress: 456/2363 symbols completed. CIVI took 4.5s. Estimated remaining: 43m 34s. Rate: 43.8 symbols/min [2025-09-05T18:10:29.125864] [INFO ] [MAIN ] CLCO: Found 1 missing trading days. [2025-09-05T18:10:29.136432] [INFO ] [MAIN ] CLCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:29.141908] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-05T18:10:29.200610] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:29.205365] [WARN ] [VALIDATOR ] CL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:29.205586] [INFO ] [MAIN ] CL: Combined data validation passed. [2025-09-05T18:10:29.270485] [INFO ] [MAIN ] CLDT: Loaded 10734 existing records. [2025-09-05T18:10:29.450388] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:10:29.531134] [INFO ] [MAIN ] CLDT: Found 1 missing trading days. [2025-09-05T18:10:29.560726] [INFO ] [MAIN ] CLDT: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:29.582632] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-05T18:10:29.619296] [INFO ] [MAIN ] CLB: Adding 252 new records, updating 0 existing records. [2025-09-05T18:10:29.654580] [INFO ] [MAIN ] CLB: Combined dataset has 15661 total records. [2025-09-05T18:10:29.782183] [INFO ] [MAIN ] CL: Update completed successfully. [2025-09-05T18:10:29.795351] [INFO ] [MAIN ] Update Progress: 457/2363 symbols completed. CL took 4.2s. Estimated remaining: 43m 31s. Rate: 43.8 symbols/min [2025-09-05T18:10:29.909307] [WARN ] [VALIDATOR ] CLB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:29.974007] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:10:30.147281] [INFO ] [MAIN ] CLDT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:30.188245] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:10:30.217978] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:30.239425] [INFO ] [MAIN ] CLDT: Combined dataset has 10734 total records. [2025-09-05T18:10:30.273078] [INFO ] [MAIN ] CLCO: Adding 53 new records, updating 0 existing records. [2025-09-05T18:10:30.282019] [FATAL] [VALIDATOR ] CLDT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:30.306763] [FATAL] [MAIN ] CLDT: Combined data validation failed. [2025-09-05T18:10:30.313175] [WARN ] [MAIN ] CLDT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:30.317479] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-05T18:10:30.318517] [INFO ] [LOCAL ] CLDT: Starting deletion of derivative data. [2025-09-05T18:10:30.318679] [INFO ] [MAIN ] CLCO: Combined dataset has 4999 total records. [2025-09-05T18:10:30.331007] [INFO ] [MAIN ] Update Progress: 458/2363 symbols completed. CLDT took 1.4s. Estimated remaining: 43m 26s. Rate: 43.9 symbols/min [2025-09-05T18:10:30.589574] [INFO ] [MAIN ] CLF: Loaded 25723 existing records. [2025-09-05T18:10:30.708295] [WARN ] [VALIDATOR ] CLCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:30.823181] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:30.881243] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-09-05T18:10:30.906397] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-05T18:10:30.921898] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-05T18:10:30.990879] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-05T18:10:31.089568] [INFO ] [MAIN ] CLF: Found 1 missing trading days. [2025-09-05T18:10:31.094916] [INFO ] [MAIN ] CLF: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:31.100413] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-05T18:10:31.439978] [INFO ] [REMOTE ] CLH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:10:31.441684] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-05T18:10:31.442602] [WARN ] [VALIDATOR ] CLB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:31.442928] [INFO ] [MAIN ] CLB: Combined data validation passed. [2025-09-05T18:10:31.442718] [WARN ] [VALIDATOR ] CLCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:31.443292] [INFO ] [MAIN ] CLCO: Combined data validation passed. [2025-09-05T18:10:31.544763] [INFO ] [MAIN ] CLCO: Update completed successfully. [2025-09-05T18:10:31.553746] [INFO ] [MAIN ] Update Progress: 459/2363 symbols completed. CLCO took 3.1s. Estimated remaining: 43m 24s. Rate: 43.9 symbols/min [2025-09-05T18:10:31.688236] [INFO ] [MAIN ] CLB: Update completed successfully. [2025-09-05T18:10:31.700547] [INFO ] [MAIN ] Update Progress: 460/2363 symbols completed. CLB took 3.9s. Estimated remaining: 43m 18s. Rate: 44.0 symbols/min [2025-09-05T18:10:31.792330] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:31.887180] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:10:31.982266] [INFO ] [MAIN ] CLPR: Loaded 5229 existing records. [2025-09-05T18:10:31.969287] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:32.060680] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-09-05T18:10:32.129926] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-05T18:10:32.161662] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-05T18:10:32.165483] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-05T18:10:32.165287] [INFO ] [MAIN ] CLF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:32.355872] [INFO ] [MAIN ] CLPR: Found 1 missing trading days. [2025-09-05T18:10:32.355987] [INFO ] [MAIN ] CLF: Combined dataset has 25723 total records. [2025-09-05T18:10:32.382032] [INFO ] [MAIN ] CLPR: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:32.407356] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-05T18:10:32.417481] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:32.441615] [FATAL] [MAIN ] CLF: Combined data validation failed. [2025-09-05T18:10:32.458072] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:32.473535] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-05T18:10:32.513952] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-09-05T18:10:32.542845] [INFO ] [MAIN ] Update Progress: 461/2363 symbols completed. CLF took 2.7s. Estimated remaining: 43m 14s. Rate: 44.0 symbols/min [2025-09-05T18:10:32.726168] [INFO ] [REMOTE ] CLS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:10:32.726920] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-05T18:10:32.798720] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:32.822510] [INFO ] [MAIN ] CLVT: Loaded 24917 existing records. [2025-09-05T18:10:32.906157] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:10:32.952554] [INFO ] [MAIN ] CLPR: Adding 52 new records, updating 0 existing records. [2025-09-05T18:10:33.025188] [INFO ] [MAIN ] CLPR: Combined dataset has 5281 total records. [2025-09-05T18:10:33.045851] [INFO ] [MAIN ] CLVT: Found 1 missing trading days. [2025-09-05T18:10:33.082875] [INFO ] [MAIN ] CLVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:33.105558] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-05T18:10:33.245081] [WARN ] [VALIDATOR ] CLPR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:33.246621] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-05T18:10:33.296483] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-05T18:10:33.460357] [WARN ] [VALIDATOR ] CLPR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:33.460633] [INFO ] [MAIN ] CLPR: Combined data validation passed. [2025-09-05T18:10:33.493452] [INFO ] [MAIN ] CLPR: Update completed successfully. [2025-09-05T18:10:33.494390] [INFO ] [MAIN ] Update Progress: 462/2363 symbols completed. CLPR took 1.9s. Estimated remaining: 43m 11s. Rate: 44.0 symbols/min [2025-09-05T18:10:33.668349] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:33.679064] [INFO ] [MAIN ] CLW: Loaded 9779 existing records. [2025-09-05T18:10:33.849161] [INFO ] [MAIN ] CLW: Found 1 missing trading days. [2025-09-05T18:10:33.849333] [INFO ] [MAIN ] CLW: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:33.849543] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-05T18:10:33.889826] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:10:34.038388] [INFO ] [MAIN ] CLVT: Adding 370 new records, updating 0 existing records. [2025-09-05T18:10:34.041747] [INFO ] [MAIN ] CLVT: Combined dataset has 25287 total records. [2025-09-05T18:10:34.164852] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:10:34.262296] [WARN ] [VALIDATOR ] CLVT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:34.422899] [INFO ] [MAIN ] CLW: Adding 160 new records, updating 0 existing records. [2025-09-05T18:10:34.510139] [INFO ] [MAIN ] CLW: Combined dataset has 9939 total records. [2025-09-05T18:10:34.700761] [WARN ] [VALIDATOR ] CLW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:34.912442] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-05T18:10:34.923733] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-05T18:10:34.937669] [WARN ] [VALIDATOR ] CLVT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:34.938085] [INFO ] [MAIN ] CLVT: Combined data validation passed. [2025-09-05T18:10:34.937786] [WARN ] [VALIDATOR ] CLW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:34.938543] [INFO ] [MAIN ] CLW: Combined data validation passed. [2025-09-05T18:10:35.080738] [INFO ] [MAIN ] CLW: Update completed successfully. [2025-09-05T18:10:35.083246] [INFO ] [MAIN ] Update Progress: 463/2363 symbols completed. CLW took 1.6s. Estimated remaining: 43m 10s. Rate: 44.0 symbols/min [2025-09-05T18:10:35.279675] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:35.370293] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-05T18:10:35.383246] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-05T18:10:35.385326] [INFO ] [MAIN ] CLX: Loaded 25013 existing records. [2025-09-05T18:10:35.483364] [INFO ] [MAIN ] CLVT: Update completed successfully. [2025-09-05T18:10:35.497144] [INFO ] [MAIN ] Update Progress: 464/2363 symbols completed. CLVT took 3.0s. Estimated remaining: 43m 5s. Rate: 44.1 symbols/min [2025-09-05T18:10:35.689452] [INFO ] [MAIN ] CLX: Found 1 missing trading days. [2025-09-05T18:10:35.713442] [INFO ] [MAIN ] CLX: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:35.719912] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-05T18:10:35.743795] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:35.766241] [INFO ] [MAIN ] CM: Loaded 23720 existing records. [2025-09-05T18:10:35.940851] [INFO ] [MAIN ] CM: Found 1 missing trading days. [2025-09-05T18:10:35.941065] [INFO ] [MAIN ] CM: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:35.941288] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-05T18:10:36.243275] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-05T18:10:36.250905] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-05T18:10:36.303925] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:10:36.462381] [INFO ] [MAIN ] CLX: Adding 388 new records, updating 0 existing records. [2025-09-05T18:10:36.470169] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:10:36.530490] [INFO ] [MAIN ] CLX: Combined dataset has 25401 total records. [2025-09-05T18:10:36.695156] [INFO ] [MAIN ] CM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:36.768854] [INFO ] [MAIN ] CM: Combined dataset has 23720 total records. [2025-09-05T18:10:36.787190] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:36.804762] [FATAL] [MAIN ] CM: Combined data validation failed. [2025-09-05T18:10:36.807968] [WARN ] [VALIDATOR ] CLX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:36.808146] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:36.850543] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-05T18:10:36.872538] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-05T18:10:36.910653] [INFO ] [MAIN ] Update Progress: 465/2363 symbols completed. CM took 1.4s. Estimated remaining: 43m 4s. Rate: 44.1 symbols/min [2025-09-05T18:10:37.174944] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:37.184920] [WARN ] [VALIDATOR ] CLX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:37.187328] [INFO ] [MAIN ] CLX: Combined data validation passed. [2025-09-05T18:10:37.320167] [INFO ] [MAIN ] CMA: Loaded 37743 existing records. [2025-09-05T18:10:37.541562] [INFO ] [MAIN ] CMA: Found 1 missing trading days. [2025-09-05T18:10:37.551871] [INFO ] [MAIN ] CMA: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:37.555748] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-05T18:10:37.581238] [INFO ] [MAIN ] CLX: Update completed successfully. [2025-09-05T18:10:37.597170] [INFO ] [MAIN ] Update Progress: 466/2363 symbols completed. CLX took 2.5s. Estimated remaining: 42m 60s. Rate: 44.1 symbols/min [2025-09-05T18:10:37.632183] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-05T18:10:37.715400] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-05T18:10:37.728517] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-05T18:10:37.795521] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-05T18:10:37.826545] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:37.843321] [INFO ] [MAIN ] CMBT: Loaded 15211 existing records. [2025-09-05T18:10:38.016055] [INFO ] [MAIN ] CMBT: Found 1 missing trading days. [2025-09-05T18:10:38.016198] [INFO ] [MAIN ] CMBT: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:38.016407] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-05T18:10:38.168971] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:10:38.328813] [INFO ] [MAIN ] CMA: Adding 355 new records, updating 0 existing records. [2025-09-05T18:10:38.337245] [INFO ] [MAIN ] CMA: Combined dataset has 38098 total records. [2025-09-05T18:10:38.516505] [WARN ] [VALIDATOR ] CMA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:10:38.721276] [WARN ] [VALIDATOR ] CMA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:10:38.721503] [INFO ] [MAIN ] CMA: Combined data validation passed. [2025-09-05T18:10:38.957551] [INFO ] [MAIN ] CMA: Update completed successfully. [2025-09-05T18:10:38.962985] [INFO ] [MAIN ] Update Progress: 467/2363 symbols completed. CMA took 2.0s. Estimated remaining: 42m 59s. Rate: 44.1 symbols/min [2025-09-05T18:10:39.138029] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:39.159458] [INFO ] [MAIN ] CMC: Loaded 21451 existing records. [2025-09-05T18:10:39.327316] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-05T18:10:39.366399] [INFO ] [MAIN ] CMC: Found 1 missing trading days. [2025-09-05T18:10:39.366741] [INFO ] [MAIN ] CMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:39.366971] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-05T18:10:39.368946] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-05T18:10:39.734467] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-05T18:10:39.927111] [INFO ] [MAIN ] CMBT: Adding 377 new records, updating 0 existing records. [2025-09-05T18:10:39.930888] [INFO ] [MAIN ] CMBT: Combined dataset has 15588 total records. [2025-09-05T18:10:40.114253] [WARN ] [VALIDATOR ] CMBT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:10:40.126567] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:10:40.370631] [INFO ] [MAIN ] CMC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:10:40.413218] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-05T18:10:40.448840] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-05T18:10:40.450247] [INFO ] [MAIN ] CMC: Combined dataset has 21451 total records. [2025-09-05T18:10:40.451078] [FATAL] [VALIDATOR ] CMC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:40.451403] [FATAL] [MAIN ] CMC: Combined data validation failed. [2025-09-05T18:10:40.451695] [WARN ] [MAIN ] CMC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:40.451919] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-05T18:10:40.452934] [INFO ] [LOCAL ] CMC: Starting deletion of derivative data. [2025-09-05T18:10:40.455766] [INFO ] [MAIN ] Update Progress: 468/2363 symbols completed. CMC took 1.5s. Estimated remaining: 42m 58s. Rate: 44.1 symbols/min [2025-09-05T18:10:40.541444] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-05T18:10:40.578075] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-05T18:10:40.654556] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:40.659035] [INFO ] [MAIN ] CMCM: Loaded 2267 existing records. [2025-09-05T18:10:40.833155] [INFO ] [MAIN ] CMCM: Found 1 missing trading days. [2025-09-05T18:10:40.833472] [INFO ] [MAIN ] CMCM: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:40.833813] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-05T18:10:40.838949] [WARN ] [VALIDATOR ] CMBT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:10:40.839093] [INFO ] [MAIN ] CMBT: Combined data validation passed. [2025-09-05T18:10:40.931884] [INFO ] [MAIN ] CMBT: Update completed successfully. [2025-09-05T18:10:40.933766] [INFO ] [MAIN ] Update Progress: 469/2363 symbols completed. CMBT took 3.3s. Estimated remaining: 42m 53s. Rate: 44.2 symbols/min [2025-09-05T18:10:41.124550] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:41.126825] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-05T18:10:41.142185] [INFO ] [MAIN ] CMCM: Adding 62 new records, updating 0 existing records. [2025-09-05T18:10:41.146350] [INFO ] [MAIN ] CMCM: Combined dataset has 2329 total records. [2025-09-05T18:10:41.231303] [INFO ] [MAIN ] CMDB: Loaded 6983 existing records. [2025-09-05T18:10:41.487522] [WARN ] [VALIDATOR ] CMCM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:41.518284] [INFO ] [MAIN ] CMDB: Found 1 missing trading days. [2025-09-05T18:10:41.560300] [INFO ] [MAIN ] CMDB: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:41.586577] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-05T18:10:41.705691] [WARN ] [VALIDATOR ] CMCM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:41.705902] [INFO ] [MAIN ] CMCM: Combined data validation passed. [2025-09-05T18:10:41.719831] [INFO ] [MAIN ] CMCM: Update completed successfully. [2025-09-05T18:10:41.720255] [INFO ] [MAIN ] Update Progress: 470/2363 symbols completed. CMCM took 1.3s. Estimated remaining: 42m 49s. Rate: 44.2 symbols/min [2025-09-05T18:10:41.895951] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:41.922160] [INFO ] [MAIN ] CMG: Loaded 25708 existing records. [2025-09-05T18:10:42.102676] [INFO ] [MAIN ] CMG: Found 1 missing trading days. [2025-09-05T18:10:42.102876] [INFO ] [MAIN ] CMG: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:42.103170] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-05T18:10:42.122858] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-05T18:10:42.129525] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-05T18:10:42.398885] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-05T18:10:42.410171] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-05T18:10:42.475692] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:10:42.518706] [INFO ] [MAIN ] CMDB: Adding 185 new records, updating 0 existing records. [2025-09-05T18:10:42.520830] [INFO ] [MAIN ] CMDB: Combined dataset has 7168 total records. [2025-09-05T18:10:42.706957] [WARN ] [VALIDATOR ] CMDB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:42.777805] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:10:43.051346] [INFO ] [MAIN ] CMG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:10:43.056032] [INFO ] [MAIN ] CMG: Combined dataset has 26098 total records. [2025-09-05T18:10:43.238391] [WARN ] [VALIDATOR ] CMG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:43.372156] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-05T18:10:43.453319] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-05T18:10:43.469906] [WARN ] [VALIDATOR ] CMDB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:43.470230] [INFO ] [MAIN ] CMDB: Combined data validation passed. [2025-09-05T18:10:43.512561] [WARN ] [VALIDATOR ] CMG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:43.515030] [INFO ] [MAIN ] CMG: Combined data validation passed. [2025-09-05T18:10:43.619856] [INFO ] [MAIN ] CMDB: Update completed successfully. [2025-09-05T18:10:43.641802] [INFO ] [MAIN ] Update Progress: 471/2363 symbols completed. CMDB took 2.7s. Estimated remaining: 42m 50s. Rate: 44.2 symbols/min [2025-09-05T18:10:43.805204] [INFO ] [MAIN ] CMG: Update completed successfully. [2025-09-05T18:10:43.827030] [INFO ] [MAIN ] Update Progress: 472/2363 symbols completed. CMG took 2.1s. Estimated remaining: 42m 44s. Rate: 44.2 symbols/min [2025-09-05T18:10:43.859232] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:44.037982] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:44.044786] [INFO ] [MAIN ] CMI: Loaded 19194 existing records. [2025-09-05T18:10:44.196754] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:10:44.237288] [INFO ] [MAIN ] CMI: Found 1 missing trading days. [2025-09-05T18:10:44.239017] [INFO ] [MAIN ] CMI: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:44.239324] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-05T18:10:44.240172] [INFO ] [MAIN ] CMP: Loaded 17464 existing records. [2025-09-05T18:10:44.252197] [INFO ] [REMOTE ] CLH: Full fetch complete (31941 records). [2025-09-05T18:10:44.622626] [INFO ] [MAIN ] CMP: Found 1 missing trading days. [2025-09-05T18:10:44.650832] [INFO ] [MAIN ] CMP: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:44.684798] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-05T18:10:44.795978] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-05T18:10:44.934280] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-05T18:10:44.948504] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-05T18:10:44.975894] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-05T18:10:44.976017] [INFO ] [MAIN ] Update Progress: 473/2363 symbols completed. CLH took 14.6s. Estimated remaining: 42m 42s. Rate: 44.3 symbols/min [2025-09-05T18:10:45.152439] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:45.153133] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:10:45.279358] [INFO ] [MAIN ] CMI: Adding 310 new records, updating 0 existing records. [2025-09-05T18:10:45.279843] [INFO ] [MAIN ] CMRE: Loaded 17067 existing records. [2025-09-05T18:10:45.360118] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:10:45.460077] [INFO ] [MAIN ] CMI: Combined dataset has 19504 total records. [2025-09-05T18:10:45.544214] [INFO ] [MAIN ] CMRE: Found 1 missing trading days. [2025-09-05T18:10:45.603376] [INFO ] [MAIN ] CMRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:45.603329] [INFO ] [MAIN ] CMP: Adding 194 new records, updating 0 existing records. [2025-09-05T18:10:45.608832] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-05T18:10:45.726678] [WARN ] [VALIDATOR ] CMI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:45.726862] [INFO ] [MAIN ] CMP: Combined dataset has 17658 total records. [2025-09-05T18:10:46.085490] [WARN ] [VALIDATOR ] CMP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:46.290787] [WARN ] [VALIDATOR ] CMI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:46.291170] [INFO ] [MAIN ] CMI: Combined data validation passed. [2025-09-05T18:10:46.290911] [WARN ] [VALIDATOR ] CMP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:46.291910] [INFO ] [MAIN ] CMP: Combined data validation passed. [2025-09-05T18:10:46.490494] [INFO ] [MAIN ] CMP: Update completed successfully. [2025-09-05T18:10:46.507305] [INFO ] [MAIN ] Update Progress: 474/2363 symbols completed. CMP took 2.7s. Estimated remaining: 42m 41s. Rate: 44.3 symbols/min [2025-09-05T18:10:46.514576] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:10:46.743659] [INFO ] [MAIN ] CMRE: Adding 256 new records, updating 0 existing records. [2025-09-05T18:10:46.822630] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:46.832904] [INFO ] [MAIN ] CMI: Update completed successfully. [2025-09-05T18:10:46.835283] [INFO ] [MAIN ] Update Progress: 475/2363 symbols completed. CMI took 3.2s. Estimated remaining: 42m 36s. Rate: 44.3 symbols/min [2025-09-05T18:10:46.841248] [INFO ] [MAIN ] CMRE: Combined dataset has 17323 total records. [2025-09-05T18:10:47.129878] [INFO ] [MAIN ] CMS: Loaded 24780 existing records. [2025-09-05T18:10:47.265346] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:47.244815] [WARN ] [VALIDATOR ] CMRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:47.437540] [INFO ] [MAIN ] CMSA: Loaded 1628 existing records. [2025-09-05T18:10:47.609352] [INFO ] [MAIN ] CMS: Found 2 missing trading days. [2025-09-05T18:10:47.705248] [INFO ] [MAIN ] CMS: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:47.747236] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-05T18:10:47.784980] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-05T18:10:47.841684] [INFO ] [MAIN ] CMSA: Found 1 missing trading days. [2025-09-05T18:10:47.842939] [INFO ] [MAIN ] CMSA: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:47.843292] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-05T18:10:47.853996] [WARN ] [VALIDATOR ] CMRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:47.854313] [INFO ] [MAIN ] CMRE: Combined data validation passed. [2025-09-05T18:10:47.900243] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-05T18:10:47.962338] [INFO ] [MAIN ] CMRE: Update completed successfully. [2025-09-05T18:10:47.964117] [INFO ] [MAIN ] Update Progress: 476/2363 symbols completed. CMRE took 3.0s. Estimated remaining: 42m 34s. Rate: 44.3 symbols/min [2025-09-05T18:10:48.135676] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:48.141404] [INFO ] [MAIN ] CMSC: Loaded 3789 existing records. [2025-09-05T18:10:48.315174] [INFO ] [MAIN ] CMSC: Found 1 missing trading days. [2025-09-05T18:10:48.315325] [INFO ] [MAIN ] CMSC: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:48.431039] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:10:48.440135] [INFO ] [MAIN ] CMSA: Adding 21 new records, updating 0 existing records. [2025-09-05T18:10:48.441598] [INFO ] [MAIN ] CMSA: Combined dataset has 1649 total records. [2025-09-05T18:10:48.629340] [WARN ] [VALIDATOR ] CMSA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:48.674140] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-05T18:10:48.719668] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:10:48.940015] [INFO ] [MAIN ] CMS: Adding 378 new records, updating 0 existing records. [2025-09-05T18:10:48.948205] [INFO ] [MAIN ] CMS: Combined dataset has 25158 total records. [2025-09-05T18:10:48.949756] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:10:48.950676] [FATAL] [MAIN ] CMS: Combined data validation failed. [2025-09-05T18:10:48.951322] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:10:48.951452] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-05T18:10:48.952510] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-09-05T18:10:48.955720] [INFO ] [MAIN ] Update Progress: 477/2363 symbols completed. CMS took 2.4s. Estimated remaining: 42m 31s. Rate: 44.4 symbols/min [2025-09-05T18:10:48.955833] [WARN ] [VALIDATOR ] CMSA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:48.956101] [INFO ] [MAIN ] CMSA: Combined data validation passed. [2025-09-05T18:10:48.967178] [INFO ] [MAIN ] CMSA: Update completed successfully. [2025-09-05T18:10:48.967567] [INFO ] [MAIN ] Update Progress: 478/2363 symbols completed. CMSA took 2.1s. Estimated remaining: 42m 24s. Rate: 44.5 symbols/min [2025-09-05T18:10:49.696184] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:10:49.708528] [INFO ] [MAIN ] CMSC: Adding 33 new records, updating 0 existing records. [2025-09-05T18:10:49.709914] [INFO ] [MAIN ] CMSC: Combined dataset has 3822 total records. [2025-09-05T18:10:49.886529] [WARN ] [VALIDATOR ] CMSC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:10:50.071814] [WARN ] [VALIDATOR ] CMSC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:10:50.072024] [INFO ] [MAIN ] CMSC: Combined data validation passed. [2025-09-05T18:10:50.095762] [INFO ] [MAIN ] CMSC: Update completed successfully. [2025-09-05T18:10:50.096317] [INFO ] [MAIN ] Update Progress: 479/2363 symbols completed. CMSC took 2.1s. Estimated remaining: 42m 22s. Rate: 44.5 symbols/min [2025-09-05T18:10:50.299291] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-05T18:10:50.311020] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-05T18:10:52.663954] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-05T18:10:52.677754] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-05T18:10:53.293627] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:10:53.296623] [INFO ] [REMOTE ] CLS: Full fetch complete (58327 records). [2025-09-05T18:10:53.673049] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-05T18:10:53.943072] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-05T18:10:53.943209] [INFO ] [MAIN ] Update Progress: 480/2363 symbols completed. CLS took 22.2s. Estimated remaining: 42m 30s. Rate: 44.3 symbols/min [2025-09-05T18:10:54.834599] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:54.835966] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:54.907221] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-09-05T18:10:54.909362] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-05T18:10:54.909444] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-05T18:10:54.915201] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-05T18:10:55.057099] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:55.047310] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:55.184803] [INFO ] [MAIN ] CMSD: Loaded 3634 existing records. [2025-09-05T18:10:55.259253] [INFO ] [MAIN ] CMTG: Loaded 16667 existing records. [2025-09-05T18:10:55.327119] [INFO ] [MAIN ] CNA: Loaded 25108 existing records. [2025-09-05T18:10:55.799302] [INFO ] [MAIN ] CMSD: Found 1 missing trading days. [2025-09-05T18:10:55.810554] [INFO ] [MAIN ] CMSD: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:55.831611] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-05T18:10:56.040311] [INFO ] [REMOTE ] CMU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:10:56.045802] [INFO ] [MAIN ] CMTG: Found 1 missing trading days. [2025-09-05T18:10:56.063080] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-05T18:10:56.063187] [INFO ] [MAIN ] CMTG: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:56.067034] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-05T18:10:56.076012] [INFO ] [MAIN ] CNA: Found 1 missing trading days. [2025-09-05T18:10:56.076217] [INFO ] [MAIN ] CNA: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:56.076495] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-05T18:10:56.752626] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:10:56.810628] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:10:56.875513] [INFO ] [MAIN ] CNA: Adding 241 new records, updating 0 existing records. [2025-09-05T18:10:56.881266] [INFO ] [MAIN ] CMSD: Adding 56 new records, updating 0 existing records. [2025-09-05T18:10:56.885847] [INFO ] [MAIN ] CMSD: Combined dataset has 3690 total records. [2025-09-05T18:10:56.921100] [INFO ] [MAIN ] CNA: Combined dataset has 25349 total records. [2025-09-05T18:10:57.099536] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-05T18:10:57.131012] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-05T18:10:57.186489] [WARN ] [VALIDATOR ] CMSD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:57.391606] [WARN ] [VALIDATOR ] CNA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:10:57.552704] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-05T18:10:57.763216] [INFO ] [MAIN ] CMTG: Adding 254 new records, updating 0 existing records. [2025-09-05T18:10:57.770012] [INFO ] [MAIN ] CMTG: Combined dataset has 16921 total records. [2025-09-05T18:10:57.905489] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-05T18:10:57.961341] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-05T18:10:57.965925] [WARN ] [VALIDATOR ] CMTG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:10:58.161348] [WARN ] [VALIDATOR ] CMSD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:58.161884] [INFO ] [MAIN ] CMSD: Combined data validation passed. [2025-09-05T18:10:58.163247] [WARN ] [VALIDATOR ] CNA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:10:58.164063] [INFO ] [MAIN ] CNA: Combined data validation passed. [2025-09-05T18:10:58.191362] [INFO ] [MAIN ] CMSD: Update completed successfully. [2025-09-05T18:10:58.194288] [INFO ] [MAIN ] Update Progress: 481/2363 symbols completed. CMSD took 4.3s. Estimated remaining: 42m 40s. Rate: 44.1 symbols/min [2025-09-05T18:10:58.488258] [WARN ] [VALIDATOR ] CMTG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:10:58.497096] [INFO ] [MAIN ] CMTG: Combined data validation passed. [2025-09-05T18:10:58.529435] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:58.650687] [INFO ] [MAIN ] CNA: Update completed successfully. [2025-09-05T18:10:58.667698] [INFO ] [MAIN ] Update Progress: 482/2363 symbols completed. CNA took 4.7s. Estimated remaining: 42m 36s. Rate: 44.2 symbols/min [2025-09-05T18:10:58.677838] [INFO ] [MAIN ] CMTG: Update completed successfully. [2025-09-05T18:10:58.684460] [INFO ] [MAIN ] Update Progress: 483/2363 symbols completed. CMTG took 4.7s. Estimated remaining: 42m 29s. Rate: 44.3 symbols/min [2025-09-05T18:10:58.724069] [INFO ] [MAIN ] CNC: Loaded 25782 existing records. [2025-09-05T18:10:58.984306] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-05T18:10:59.004726] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-05T18:10:59.181221] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:59.233240] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:10:59.266551] [INFO ] [MAIN ] CNC: Found 1 missing trading days. [2025-09-05T18:10:59.266859] [INFO ] [MAIN ] CNC: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:59.267181] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-05T18:10:59.273910] [INFO ] [MAIN ] CNF: Loaded 6536 existing records. [2025-09-05T18:10:59.467978] [INFO ] [MAIN ] CNH: Loaded 25562 existing records. [2025-09-05T18:10:59.466999] [INFO ] [MAIN ] CNF: Found 1 missing trading days. [2025-09-05T18:10:59.468120] [INFO ] [MAIN ] CNF: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:59.499008] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-05T18:10:59.644828] [INFO ] [MAIN ] CNH: Found 1 missing trading days. [2025-09-05T18:10:59.644971] [INFO ] [MAIN ] CNH: Need to fetch 1 months: 2025-09 [2025-09-05T18:10:59.645205] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-05T18:10:59.893469] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:11:00.045953] [INFO ] [MAIN ] CNC: Adding 390 new records, updating 0 existing records. [2025-09-05T18:11:00.049747] [INFO ] [MAIN ] CNC: Combined dataset has 26172 total records. [2025-09-05T18:11:00.182627] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-05T18:11:00.215979] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-05T18:11:00.256120] [WARN ] [VALIDATOR ] CNC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:00.447219] [WARN ] [VALIDATOR ] CNC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:00.447440] [INFO ] [MAIN ] CNC: Combined data validation passed. [2025-09-05T18:11:00.606844] [INFO ] [MAIN ] CNC: Update completed successfully. [2025-09-05T18:11:00.610292] [INFO ] [MAIN ] Update Progress: 484/2363 symbols completed. CNC took 2.4s. Estimated remaining: 42m 30s. Rate: 44.2 symbols/min [2025-09-05T18:11:00.722190] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T18:11:00.856972] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:00.861630] [INFO ] [MAIN ] CNF: Adding 123 new records, updating 0 existing records. [2025-09-05T18:11:00.864431] [INFO ] [MAIN ] CNF: Combined dataset has 6659 total records. [2025-09-05T18:11:01.065996] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-05T18:11:01.065627] [WARN ] [VALIDATOR ] CNF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:01.080286] [INFO ] [MAIN ] CNI: Loaded 24723 existing records. [2025-09-05T18:11:01.090527] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-05T18:11:01.314914] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T18:11:01.580615] [INFO ] [MAIN ] CNI: Found 1 missing trading days. [2025-09-05T18:11:01.603044] [INFO ] [MAIN ] CNI: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:01.619483] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-05T18:11:01.659148] [INFO ] [MAIN ] CNH: Adding 390 new records, updating 0 existing records. [2025-09-05T18:11:01.664357] [INFO ] [MAIN ] CNH: Combined dataset has 25952 total records. [2025-09-05T18:11:01.858308] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-05T18:11:01.864178] [WARN ] [VALIDATOR ] CNH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:01.866296] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-05T18:11:02.067788] [WARN ] [VALIDATOR ] CNF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:02.068346] [INFO ] [MAIN ] CNF: Combined data validation passed. [2025-09-05T18:11:02.110249] [INFO ] [MAIN ] CNF: Update completed successfully. [2025-09-05T18:11:02.111559] [INFO ] [MAIN ] Update Progress: 485/2363 symbols completed. CNF took 3.4s. Estimated remaining: 42m 29s. Rate: 44.2 symbols/min [2025-09-05T18:11:02.298328] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:02.301880] [WARN ] [VALIDATOR ] CNH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:02.302059] [INFO ] [MAIN ] CNH: Combined data validation passed. [2025-09-05T18:11:02.433503] [INFO ] [MAIN ] CNK: Loaded 25378 existing records. [2025-09-05T18:11:02.631931] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:11:02.680898] [INFO ] [MAIN ] CNK: Found 1 missing trading days. [2025-09-05T18:11:02.697484] [INFO ] [MAIN ] CNK: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:02.702288] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-05T18:11:02.758960] [INFO ] [MAIN ] CNH: Update completed successfully. [2025-09-05T18:11:02.772286] [INFO ] [MAIN ] Update Progress: 486/2363 symbols completed. CNH took 4.1s. Estimated remaining: 42m 25s. Rate: 44.3 symbols/min [2025-09-05T18:11:02.917175] [INFO ] [MAIN ] CNI: Adding 378 new records, updating 0 existing records. [2025-09-05T18:11:02.948804] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-05T18:11:03.026961] [INFO ] [MAIN ] CNI: Combined dataset has 25101 total records. [2025-09-05T18:11:03.028446] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:03.073284] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-05T18:11:03.224015] [WARN ] [VALIDATOR ] CNI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:03.336989] [INFO ] [MAIN ] CNM: Loaded 24172 existing records. [2025-09-05T18:11:03.453984] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:11:03.696965] [INFO ] [MAIN ] CNM: Found 1 missing trading days. [2025-09-05T18:11:03.717783] [INFO ] [MAIN ] CNM: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:03.746710] [INFO ] [MAIN ] CNK: Adding 0 new records, updating 0 existing records. [2025-09-05T18:11:03.749375] [INFO ] [MAIN ] CNK: Combined dataset has 25378 total records. [2025-09-05T18:11:03.750083] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:11:03.750418] [FATAL] [MAIN ] CNK: Combined data validation failed. [2025-09-05T18:11:03.750718] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:11:03.750973] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-05T18:11:03.751760] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-09-05T18:11:03.755122] [INFO ] [MAIN ] Update Progress: 487/2363 symbols completed. CNK took 1.6s. Estimated remaining: 42m 22s. Rate: 44.3 symbols/min [2025-09-05T18:11:03.864267] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-05T18:11:03.906330] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-05T18:11:03.939128] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:03.946248] [WARN ] [VALIDATOR ] CNI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:03.946495] [INFO ] [MAIN ] CNI: Combined data validation passed. [2025-09-05T18:11:04.021609] [INFO ] [MAIN ] CNMD: Loaded 15513 existing records. [2025-09-05T18:11:04.233847] [INFO ] [MAIN ] CNMD: Found 1 missing trading days. [2025-09-05T18:11:04.238059] [INFO ] [MAIN ] CNMD: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:04.284988] [INFO ] [MAIN ] CNI: Update completed successfully. [2025-09-05T18:11:04.287883] [INFO ] [MAIN ] Update Progress: 488/2363 symbols completed. CNI took 3.7s. Estimated remaining: 42m 18s. Rate: 44.3 symbols/min [2025-09-05T18:11:04.465111] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:04.484316] [INFO ] [MAIN ] CNNE: Loaded 18048 existing records. [2025-09-05T18:11:04.596053] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:11:04.679064] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-05T18:11:04.746803] [INFO ] [MAIN ] CNNE: Found 1 missing trading days. [2025-09-05T18:11:04.757250] [INFO ] [MAIN ] CNNE: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:04.815635] [INFO ] [MAIN ] CNM: Adding 386 new records, updating 0 existing records. [2025-09-05T18:11:04.819031] [INFO ] [MAIN ] CNM: Combined dataset has 24558 total records. [2025-09-05T18:11:04.996989] [WARN ] [VALIDATOR ] CNM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:05.190525] [WARN ] [VALIDATOR ] CNM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:05.190808] [INFO ] [MAIN ] CNM: Combined data validation passed. [2025-09-05T18:11:05.291632] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:11:05.383674] [INFO ] [MAIN ] CNMD: Adding 0 new records, updating 0 existing records. [2025-09-05T18:11:05.388072] [INFO ] [MAIN ] CNMD: Combined dataset has 15513 total records. [2025-09-05T18:11:05.395249] [FATAL] [VALIDATOR ] CNMD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:11:05.400362] [FATAL] [MAIN ] CNMD: Combined data validation failed. [2025-09-05T18:11:05.401693] [WARN ] [MAIN ] CNMD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:11:05.405240] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-05T18:11:05.420094] [INFO ] [LOCAL ] CNMD: Starting deletion of derivative data. [2025-09-05T18:11:05.432592] [INFO ] [MAIN ] Update Progress: 489/2363 symbols completed. CNMD took 1.7s. Estimated remaining: 42m 15s. Rate: 44.3 symbols/min [2025-09-05T18:11:05.465101] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-05T18:11:05.523459] [INFO ] [MAIN ] CNM: Update completed successfully. [2025-09-05T18:11:05.548951] [INFO ] [MAIN ] Update Progress: 490/2363 symbols completed. CNM took 2.8s. Estimated remaining: 42m 9s. Rate: 44.4 symbols/min [2025-09-05T18:11:05.753377] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:05.835184] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:05.842817] [INFO ] [MAIN ] CNO: Loaded 19327 existing records. [2025-09-05T18:11:06.042530] [INFO ] [MAIN ] CNO: Found 1 missing trading days. [2025-09-05T18:11:06.044081] [INFO ] [MAIN ] CNP: Loaded 25556 existing records. [2025-09-05T18:11:06.076982] [INFO ] [MAIN ] CNO: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:06.223965] [INFO ] [MAIN ] CNP: Found 1 missing trading days. [2025-09-05T18:11:06.224162] [INFO ] [MAIN ] CNP: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:06.263446] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-05T18:11:06.267347] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:11:06.268272] [INFO ] [REMOTE ] CMU: Full fetch complete (7701 records). [2025-09-05T18:11:06.632206] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-05T18:11:06.664202] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-05T18:11:06.664298] [INFO ] [MAIN ] Update Progress: 491/2363 symbols completed. CMU took 12.7s. Estimated remaining: 42m 7s. Rate: 44.4 symbols/min [2025-09-05T18:11:06.835030] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:06.835229] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-09-05T18:11:06.835375] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-05T18:11:06.835418] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-05T18:11:06.835464] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-05T18:11:07.073760] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-05T18:11:07.211521] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:11:07.210993] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:11:07.364468] [INFO ] [MAIN ] CNP: Adding 388 new records, updating 0 existing records. [2025-09-05T18:11:07.368397] [INFO ] [MAIN ] CNP: Combined dataset has 25944 total records. [2025-09-05T18:11:07.562085] [WARN ] [VALIDATOR ] CNP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:07.765174] [WARN ] [VALIDATOR ] CNP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:07.765393] [INFO ] [MAIN ] CNP: Combined data validation passed. [2025-09-05T18:11:07.872682] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-05T18:11:07.929794] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:11:08.028769] [INFO ] [MAIN ] CNP: Update completed successfully. [2025-09-05T18:11:08.047466] [INFO ] [MAIN ] Update Progress: 492/2363 symbols completed. CNP took 2.5s. Estimated remaining: 42m 6s. Rate: 44.4 symbols/min [2025-09-05T18:11:08.051508] [INFO ] [MAIN ] CNO: Adding 302 new records, updating 0 existing records. [2025-09-05T18:11:08.215741] [INFO ] [MAIN ] CNO: Combined dataset has 19629 total records. [2025-09-05T18:11:08.234470] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:08.429398] [WARN ] [VALIDATOR ] CNO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:08.470523] [INFO ] [MAIN ] CNR: Loaded 21021 existing records. [2025-09-05T18:11:08.676121] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-05T18:11:08.824803] [INFO ] [MAIN ] CNR: Found 1 missing trading days. [2025-09-05T18:11:08.825093] [INFO ] [MAIN ] CNR: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:08.836389] [WARN ] [VALIDATOR ] CNO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:08.836588] [INFO ] [MAIN ] CNO: Combined data validation passed. [2025-09-05T18:11:08.953625] [INFO ] [MAIN ] CNO: Update completed successfully. [2025-09-05T18:11:08.955352] [INFO ] [MAIN ] Update Progress: 493/2363 symbols completed. CNO took 3.5s. Estimated remaining: 42m 3s. Rate: 44.5 symbols/min [2025-09-05T18:11:09.164007] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:09.175364] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:11:09.222773] [INFO ] [MAIN ] CNS: Loaded 9643 existing records. [2025-09-05T18:11:09.414931] [INFO ] [MAIN ] CNNE: Adding 251 new records, updating 0 existing records. [2025-09-05T18:11:09.481441] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-05T18:11:09.481253] [INFO ] [MAIN ] CNS: Found 1 missing trading days. [2025-09-05T18:11:09.482635] [INFO ] [MAIN ] CNS: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:09.484159] [INFO ] [MAIN ] CNNE: Combined dataset has 18299 total records. [2025-09-05T18:11:09.666876] [WARN ] [VALIDATOR ] CNNE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:09.859054] [WARN ] [VALIDATOR ] CNNE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:09.859268] [INFO ] [MAIN ] CNNE: Combined data validation passed. [2025-09-05T18:11:09.988290] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-05T18:11:10.010869] [INFO ] [MAIN ] CNNE: Update completed successfully. [2025-09-05T18:11:10.012538] [INFO ] [MAIN ] Update Progress: 494/2363 symbols completed. CNNE took 5.7s. Estimated remaining: 42m 0s. Rate: 44.5 symbols/min [2025-09-05T18:11:10.184457] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:10.206994] [INFO ] [MAIN ] CNX: Loaded 24470 existing records. [2025-09-05T18:11:10.269926] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-05T18:11:10.386290] [INFO ] [MAIN ] CNX: Found 1 missing trading days. [2025-09-05T18:11:10.386524] [INFO ] [MAIN ] CNX: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:10.392702] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:11:10.509658] [INFO ] [MAIN ] CNR: Adding 351 new records, updating 0 existing records. [2025-09-05T18:11:10.513318] [INFO ] [MAIN ] CNR: Combined dataset has 21372 total records. [2025-09-05T18:11:10.690985] [WARN ] [VALIDATOR ] CNR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:10.883903] [WARN ] [VALIDATOR ] CNR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:10.884158] [INFO ] [MAIN ] CNR: Combined data validation passed. [2025-09-05T18:11:11.018012] [INFO ] [MAIN ] CNR: Update completed successfully. [2025-09-05T18:11:11.020706] [INFO ] [MAIN ] Update Progress: 495/2363 symbols completed. CNR took 3.0s. Estimated remaining: 41m 58s. Rate: 44.5 symbols/min [2025-09-05T18:11:11.074968] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-05T18:11:11.194905] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:11.216548] [INFO ] [MAIN ] CODI: Loaded 21123 existing records. [2025-09-05T18:11:11.395864] [INFO ] [MAIN ] CODI: Found 1 missing trading days. [2025-09-05T18:11:11.396034] [INFO ] [MAIN ] CODI: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:11.682988] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:11:11.796274] [INFO ] [MAIN ] CNX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:11:11.797884] [INFO ] [MAIN ] CNX: Combined dataset has 24470 total records. [2025-09-05T18:11:11.798293] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:11:11.798370] [FATAL] [MAIN ] CNX: Combined data validation failed. [2025-09-05T18:11:11.798407] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:11:11.798447] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-05T18:11:11.798975] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-09-05T18:11:11.801618] [INFO ] [MAIN ] Update Progress: 496/2363 symbols completed. CNX took 1.8s. Estimated remaining: 41m 54s. Rate: 44.6 symbols/min [2025-09-05T18:11:11.868663] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-05T18:11:11.974518] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:12.000381] [INFO ] [MAIN ] COF: Loaded 25641 existing records. [2025-09-05T18:11:12.185625] [INFO ] [MAIN ] COF: Found 1 missing trading days. [2025-09-05T18:11:12.185967] [INFO ] [MAIN ] COF: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:12.214063] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-05T18:11:12.454131] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:11:12.548638] [INFO ] [MAIN ] CODI: Adding 261 new records, updating 0 existing records. [2025-09-05T18:11:12.551550] [INFO ] [MAIN ] CODI: Combined dataset has 21384 total records. [2025-09-05T18:11:12.668579] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-05T18:11:12.740602] [WARN ] [VALIDATOR ] CODI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:12.933056] [WARN ] [VALIDATOR ] CODI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:12.933280] [INFO ] [MAIN ] CODI: Combined data validation passed. [2025-09-05T18:11:13.057300] [INFO ] [MAIN ] CODI: Update completed successfully. [2025-09-05T18:11:13.060180] [INFO ] [MAIN ] Update Progress: 497/2363 symbols completed. CODI took 2.0s. Estimated remaining: 41m 53s. Rate: 44.6 symbols/min [2025-09-05T18:11:13.239568] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:13.268484] [INFO ] [MAIN ] COHR: Loaded 25481 existing records. [2025-09-05T18:11:13.443567] [INFO ] [MAIN ] COHR: Found 1 missing trading days. [2025-09-05T18:11:13.443767] [INFO ] [MAIN ] COHR: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:13.463442] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-05T18:11:13.494081] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:11:13.548323] [INFO ] [MAIN ] CNS: Adding 121 new records, updating 0 existing records. [2025-09-05T18:11:13.550560] [INFO ] [MAIN ] CNS: Combined dataset has 9764 total records. [2025-09-05T18:11:13.735411] [WARN ] [VALIDATOR ] CNS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:13.945190] [WARN ] [VALIDATOR ] CNS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:13.945413] [INFO ] [MAIN ] CNS: Combined data validation passed. [2025-09-05T18:11:14.025902] [INFO ] [MAIN ] CNS: Update completed successfully. [2025-09-05T18:11:14.028479] [INFO ] [MAIN ] Update Progress: 498/2363 symbols completed. CNS took 5.1s. Estimated remaining: 41m 50s. Rate: 44.6 symbols/min [2025-09-05T18:11:14.220539] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:14.230557] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:11:14.263458] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-05T18:11:14.402369] [INFO ] [MAIN ] COHR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:11:14.411925] [INFO ] [MAIN ] COLD: Loaded 25148 existing records. [2025-09-05T18:11:14.586228] [INFO ] [MAIN ] COHR: Combined dataset has 25871 total records. [2025-09-05T18:11:14.650046] [INFO ] [MAIN ] COLD: Found 1 missing trading days. [2025-09-05T18:11:14.683164] [INFO ] [MAIN ] COLD: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:14.796839] [WARN ] [VALIDATOR ] COHR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:14.993043] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:11:15.066590] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-05T18:11:15.127254] [INFO ] [MAIN ] COF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:11:15.132586] [INFO ] [MAIN ] COF: Combined dataset has 25641 total records. [2025-09-05T18:11:15.133315] [FATAL] [VALIDATOR ] COF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:11:15.133500] [FATAL] [MAIN ] COF: Combined data validation failed. [2025-09-05T18:11:15.133704] [WARN ] [MAIN ] COF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:11:15.133864] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-05T18:11:15.135123] [INFO ] [LOCAL ] COF: Starting deletion of derivative data. [2025-09-05T18:11:15.137960] [INFO ] [MAIN ] Update Progress: 499/2363 symbols completed. COF took 3.3s. Estimated remaining: 41m 48s. Rate: 44.6 symbols/min [2025-09-05T18:11:15.313212] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:15.317530] [WARN ] [VALIDATOR ] COHR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:15.317747] [INFO ] [MAIN ] COHR: Combined data validation passed. [2025-09-05T18:11:15.483149] [INFO ] [MAIN ] COMP: Loaded 25459 existing records. [2025-09-05T18:11:15.614187] [INFO ] [MAIN ] COHR: Update completed successfully. [2025-09-05T18:11:15.627405] [INFO ] [MAIN ] Update Progress: 500/2363 symbols completed. COHR took 2.6s. Estimated remaining: 41m 43s. Rate: 44.7 symbols/min [2025-09-05T18:11:15.712973] [INFO ] [MAIN ] COMP: Found 1 missing trading days. [2025-09-05T18:11:15.750415] [INFO ] [MAIN ] COMP: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:15.858239] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:15.858976] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:11:15.868541] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-05T18:11:15.994863] [INFO ] [MAIN ] CON: Loaded 18946 existing records. [2025-09-05T18:11:16.091765] [INFO ] [MAIN ] COLD: Adding 387 new records, updating 0 existing records. [2025-09-05T18:11:16.194250] [INFO ] [MAIN ] COLD: Combined dataset has 25535 total records. [2025-09-05T18:11:16.199003] [INFO ] [MAIN ] CON: Found 1 missing trading days. [2025-09-05T18:11:16.199142] [INFO ] [MAIN ] CON: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:16.375784] [WARN ] [VALIDATOR ] COLD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:16.570860] [WARN ] [VALIDATOR ] COLD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:16.571121] [INFO ] [MAIN ] COLD: Combined data validation passed. [2025-09-05T18:11:16.667905] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-05T18:11:16.736342] [INFO ] [MAIN ] COLD: Update completed successfully. [2025-09-05T18:11:16.739782] [INFO ] [MAIN ] Update Progress: 501/2363 symbols completed. COLD took 2.7s. Estimated remaining: 41m 41s. Rate: 44.7 symbols/min [2025-09-05T18:11:16.911516] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:16.924587] [INFO ] [MAIN ] COOK: Loaded 12206 existing records. [2025-09-05T18:11:17.106249] [INFO ] [MAIN ] COOK: Found 1 missing trading days. [2025-09-05T18:11:17.106395] [INFO ] [MAIN ] COOK: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:17.463488] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-05T18:11:17.867082] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-05T18:11:18.109401] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:11:18.140531] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T18:11:18.212973] [INFO ] [MAIN ] COOK: Adding 282 new records, updating 0 existing records. [2025-09-05T18:11:18.266759] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-05T18:11:18.318199] [INFO ] [MAIN ] CON: Adding 367 new records, updating 0 existing records. [2025-09-05T18:11:18.318550] [INFO ] [MAIN ] COOK: Combined dataset has 12488 total records. [2025-09-05T18:11:18.428897] [INFO ] [MAIN ] CON: Combined dataset has 19313 total records. [2025-09-05T18:11:18.553174] [WARN ] [VALIDATOR ] COOK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:18.883832] [WARN ] [VALIDATOR ] CON: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:19.018421] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:11:19.067693] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-05T18:11:19.263413] [INFO ] [MAIN ] COMP: Adding 389 new records, updating 0 existing records. [2025-09-05T18:11:19.275767] [INFO ] [MAIN ] COMP: Combined dataset has 25848 total records. [2025-09-05T18:11:19.325028] [WARN ] [VALIDATOR ] COOK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:19.351088] [INFO ] [MAIN ] COOK: Combined data validation passed. [2025-09-05T18:11:19.324874] [WARN ] [VALIDATOR ] CON: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:19.381877] [INFO ] [MAIN ] CON: Combined data validation passed. [2025-09-05T18:11:19.520448] [WARN ] [VALIDATOR ] COMP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:19.849155] [INFO ] [MAIN ] COOK: Update completed successfully. [2025-09-05T18:11:19.857271] [INFO ] [MAIN ] Update Progress: 502/2363 symbols completed. COOK took 3.1s. Estimated remaining: 41m 46s. Rate: 44.6 symbols/min [2025-09-05T18:11:19.987687] [INFO ] [MAIN ] CON: Update completed successfully. [2025-09-05T18:11:20.030660] [INFO ] [MAIN ] Update Progress: 503/2363 symbols completed. CON took 4.4s. Estimated remaining: 41m 40s. Rate: 44.6 symbols/min [2025-09-05T18:11:20.066172] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:20.092987] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-09-05T18:11:20.167264] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-05T18:11:20.183252] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-05T18:11:20.238295] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:20.238421] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-05T18:11:20.468005] [INFO ] [MAIN ] COR: Loaded 21459 existing records. [2025-09-05T18:11:20.738875] [INFO ] [REMOTE ] COP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:11:20.782164] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-05T18:11:20.788019] [INFO ] [MAIN ] COR: Found 1 missing trading days. [2025-09-05T18:11:20.788147] [INFO ] [MAIN ] COR: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:20.789385] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-05T18:11:20.793200] [WARN ] [VALIDATOR ] COMP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:20.793342] [INFO ] [MAIN ] COMP: Combined data validation passed. [2025-09-05T18:11:20.952302] [INFO ] [MAIN ] COMP: Update completed successfully. [2025-09-05T18:11:20.955199] [INFO ] [MAIN ] Update Progress: 504/2363 symbols completed. COMP took 5.8s. Estimated remaining: 41m 38s. Rate: 44.7 symbols/min [2025-09-05T18:11:21.132893] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:21.158575] [INFO ] [MAIN ] COTY: Loaded 25529 existing records. [2025-09-05T18:11:21.350918] [INFO ] [MAIN ] COTY: Found 1 missing trading days. [2025-09-05T18:11:21.351196] [INFO ] [MAIN ] COTY: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:21.463533] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-05T18:11:21.519215] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-05T18:11:21.644622] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:11:21.767921] [INFO ] [MAIN ] COR: Adding 304 new records, updating 0 existing records. [2025-09-05T18:11:21.771058] [INFO ] [MAIN ] COR: Combined dataset has 21763 total records. [2025-09-05T18:11:22.019198] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:11:22.023140] [WARN ] [VALIDATOR ] COR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:22.281389] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-05T18:11:22.389408] [INFO ] [MAIN ] COTY: Adding 387 new records, updating 0 existing records. [2025-09-05T18:11:22.399264] [INFO ] [MAIN ] COTY: Combined dataset has 25916 total records. [2025-09-05T18:11:22.600901] [WARN ] [VALIDATOR ] COTY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:22.798765] [WARN ] [VALIDATOR ] COR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:22.819378] [INFO ] [MAIN ] COR: Combined data validation passed. [2025-09-05T18:11:22.978634] [INFO ] [MAIN ] COR: Update completed successfully. [2025-09-05T18:11:22.982478] [INFO ] [MAIN ] Update Progress: 505/2363 symbols completed. COR took 2.9s. Estimated remaining: 41m 39s. Rate: 44.6 symbols/min [2025-09-05T18:11:23.184216] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:23.186704] [WARN ] [VALIDATOR ] COTY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:23.187177] [INFO ] [MAIN ] COTY: Combined data validation passed. [2025-09-05T18:11:23.366720] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-05T18:11:23.380509] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-05T18:11:23.389479] [INFO ] [MAIN ] COTY: Update completed successfully. [2025-09-05T18:11:23.392836] [INFO ] [MAIN ] Update Progress: 506/2363 symbols completed. COTY took 2.4s. Estimated remaining: 41m 34s. Rate: 44.7 symbols/min [2025-09-05T18:11:23.469198] [INFO ] [MAIN ] COUR: Loaded 23551 existing records. [2025-09-05T18:11:23.714175] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:23.768698] [INFO ] [MAIN ] COUR: Found 1 missing trading days. [2025-09-05T18:11:23.768870] [INFO ] [MAIN ] COUR: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:23.790991] [INFO ] [MAIN ] CP: Loaded 25396 existing records. [2025-09-05T18:11:23.868665] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-05T18:11:23.969857] [INFO ] [MAIN ] CP: Found 1 missing trading days. [2025-09-05T18:11:23.969998] [INFO ] [MAIN ] CP: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:24.294164] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-05T18:11:24.663499] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-05T18:11:24.721885] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:11:24.870489] [INFO ] [MAIN ] COUR: Adding 356 new records, updating 0 existing records. [2025-09-05T18:11:24.874059] [INFO ] [MAIN ] COUR: Combined dataset has 23907 total records. [2025-09-05T18:11:25.078356] [WARN ] [VALIDATOR ] COUR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:25.182440] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:11:25.450959] [INFO ] [MAIN ] CP: Adding 388 new records, updating 0 existing records. [2025-09-05T18:11:25.457535] [INFO ] [MAIN ] CP: Combined dataset has 25784 total records. [2025-09-05T18:11:25.469981] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-05T18:11:25.622169] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-05T18:11:25.695763] [WARN ] [VALIDATOR ] CP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:25.695868] [WARN ] [VALIDATOR ] COUR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:25.738003] [INFO ] [MAIN ] COUR: Combined data validation passed. [2025-09-05T18:11:26.026095] [INFO ] [MAIN ] COUR: Update completed successfully. [2025-09-05T18:11:26.028714] [INFO ] [MAIN ] Update Progress: 507/2363 symbols completed. COUR took 3.0s. Estimated remaining: 41m 37s. Rate: 44.6 symbols/min [2025-09-05T18:11:26.201114] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:26.205791] [WARN ] [VALIDATOR ] CP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:26.206025] [INFO ] [MAIN ] CP: Combined data validation passed. [2025-09-05T18:11:26.268269] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-05T18:11:26.268923] [INFO ] [MAIN ] CPA: Loaded 13464 existing records. [2025-09-05T18:11:26.536741] [INFO ] [MAIN ] CP: Update completed successfully. [2025-09-05T18:11:26.559881] [INFO ] [MAIN ] Update Progress: 508/2363 symbols completed. CP took 3.2s. Estimated remaining: 41m 33s. Rate: 44.6 symbols/min [2025-09-05T18:11:26.556574] [INFO ] [MAIN ] CPA: Found 1 missing trading days. [2025-09-05T18:11:26.560229] [INFO ] [MAIN ] CPA: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:26.740159] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:26.743226] [INFO ] [MAIN ] CPAC: Loaded 618 existing records. [2025-09-05T18:11:26.924544] [INFO ] [MAIN ] CPAC: Found 1 missing trading days. [2025-09-05T18:11:26.924755] [INFO ] [MAIN ] CPAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:27.063596] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-05T18:11:27.365121] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-05T18:11:27.754740] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:11:27.760369] [INFO ] [MAIN ] CPAC: Adding 7 new records, updating 0 existing records. [2025-09-05T18:11:27.761814] [INFO ] [MAIN ] CPAC: Combined dataset has 625 total records. [2025-09-05T18:11:27.868996] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-05T18:11:27.961421] [WARN ] [VALIDATOR ] CPAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:28.166366] [WARN ] [VALIDATOR ] CPAC: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-07-16 [2025-09-05T18:11:28.166683] [INFO ] [MAIN ] CPAC: Combined data validation passed. [2025-09-05T18:11:28.171736] [INFO ] [MAIN ] CPAC: Update completed successfully. [2025-09-05T18:11:28.171975] [INFO ] [MAIN ] Update Progress: 509/2363 symbols completed. CPAC took 1.6s. Estimated remaining: 41m 33s. Rate: 44.6 symbols/min [2025-09-05T18:11:28.350962] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:28.389255] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-05T18:11:28.411467] [INFO ] [MAIN ] CPAY: Loaded 14354 existing records. [2025-09-05T18:11:28.585331] [INFO ] [MAIN ] CPAY: Found 1 missing trading days. [2025-09-05T18:11:28.585503] [INFO ] [MAIN ] CPAY: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:28.663474] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-05T18:11:29.055618] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:11:29.126426] [INFO ] [MAIN ] CPAY: Adding 202 new records, updating 0 existing records. [2025-09-05T18:11:29.129105] [INFO ] [MAIN ] CPAY: Combined dataset has 14556 total records. [2025-09-05T18:11:29.325887] [WARN ] [VALIDATOR ] CPAY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:29.470415] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-05T18:11:29.526341] [WARN ] [VALIDATOR ] CPAY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:29.526573] [INFO ] [MAIN ] CPAY: Combined data validation passed. [2025-09-05T18:11:29.650679] [INFO ] [MAIN ] CPAY: Update completed successfully. [2025-09-05T18:11:29.652620] [INFO ] [MAIN ] Update Progress: 510/2363 symbols completed. CPAY took 1.5s. Estimated remaining: 41m 32s. Rate: 44.6 symbols/min [2025-09-05T18:11:29.653995] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-05T18:11:29.835209] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:29.843251] [INFO ] [MAIN ] CPF: Loaded 7217 existing records. [2025-09-05T18:11:30.033967] [INFO ] [MAIN ] CPF: Found 1 missing trading days. [2025-09-05T18:11:30.034220] [INFO ] [MAIN ] CPF: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:30.198015] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:11:30.269621] [INFO ] [MAIN ] CPA: Adding 177 new records, updating 0 existing records. [2025-09-05T18:11:30.268633] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-05T18:11:30.273846] [INFO ] [MAIN ] CPA: Combined dataset has 13641 total records. [2025-09-05T18:11:30.453943] [WARN ] [VALIDATOR ] CPA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:30.644810] [WARN ] [VALIDATOR ] CPA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:30.645029] [INFO ] [MAIN ] CPA: Combined data validation passed. [2025-09-05T18:11:30.734462] [INFO ] [MAIN ] CPA: Update completed successfully. [2025-09-05T18:11:30.736753] [INFO ] [MAIN ] Update Progress: 511/2363 symbols completed. CPA took 4.7s. Estimated remaining: 41m 30s. Rate: 44.6 symbols/min [2025-09-05T18:11:30.915494] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:30.923051] [INFO ] [MAIN ] CPK: Loaded 5946 existing records. [2025-09-05T18:11:31.068097] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-05T18:11:31.099556] [INFO ] [MAIN ] CPK: Found 1 missing trading days. [2025-09-05T18:11:31.099820] [INFO ] [MAIN ] CPK: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:31.701467] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-05T18:11:31.863508] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-05T18:11:32.227321] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-05T18:11:32.255127] [INFO ] [MAIN ] CPK: Adding 57 new records, updating 0 existing records. [2025-09-05T18:11:32.256886] [INFO ] [MAIN ] CPK: Combined dataset has 6003 total records. [2025-09-05T18:11:32.442628] [WARN ] [VALIDATOR ] CPK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:32.637035] [WARN ] [VALIDATOR ] CPK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:32.637263] [INFO ] [MAIN ] CPK: Combined data validation passed. [2025-09-05T18:11:32.665809] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-05T18:11:32.677167] [INFO ] [MAIN ] CPK: Update completed successfully. [2025-09-05T18:11:32.678069] [INFO ] [MAIN ] Update Progress: 512/2363 symbols completed. CPK took 1.9s. Estimated remaining: 41m 30s. Rate: 44.6 symbols/min [2025-09-05T18:11:32.859938] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:32.885986] [INFO ] [MAIN ] CPNG: Loaded 25678 existing records. [2025-09-05T18:11:33.069491] [INFO ] [MAIN ] CPNG: Found 1 missing trading days. [2025-09-05T18:11:33.069625] [INFO ] [MAIN ] CPNG: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:33.088027] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:11:33.130281] [INFO ] [MAIN ] CPF: Adding 139 new records, updating 0 existing records. [2025-09-05T18:11:33.132143] [INFO ] [MAIN ] CPF: Combined dataset has 7356 total records. [2025-09-05T18:11:33.313519] [WARN ] [VALIDATOR ] CPF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:33.464543] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-05T18:11:33.550329] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-05T18:11:33.566354] [WARN ] [VALIDATOR ] CPF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:33.566525] [INFO ] [MAIN ] CPF: Combined data validation passed. [2025-09-05T18:11:33.611545] [INFO ] [MAIN ] CPF: Update completed successfully. [2025-09-05T18:11:33.612612] [INFO ] [MAIN ] Update Progress: 513/2363 symbols completed. CPF took 4.0s. Estimated remaining: 41m 28s. Rate: 44.6 symbols/min [2025-09-05T18:11:33.785775] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:33.809549] [INFO ] [MAIN ] CPRI: Loaded 24956 existing records. [2025-09-05T18:11:33.993541] [INFO ] [MAIN ] CPRI: Found 1 missing trading days. [2025-09-05T18:11:33.993716] [INFO ] [MAIN ] CPRI: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:34.056187] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:11:34.190140] [INFO ] [MAIN ] CPNG: Adding 0 new records, updating 0 existing records. [2025-09-05T18:11:34.192361] [INFO ] [MAIN ] CPNG: Combined dataset has 25678 total records. [2025-09-05T18:11:34.193000] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:11:34.193121] [FATAL] [MAIN ] CPNG: Combined data validation failed. [2025-09-05T18:11:34.193170] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:11:34.193235] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-05T18:11:34.194101] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-09-05T18:11:34.197374] [INFO ] [MAIN ] Update Progress: 514/2363 symbols completed. CPNG took 1.5s. Estimated remaining: 41m 23s. Rate: 44.7 symbols/min [2025-09-05T18:11:34.268710] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-05T18:11:34.384316] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:34.396269] [INFO ] [MAIN ] CPS: Loaded 11090 existing records. [2025-09-05T18:11:34.572442] [INFO ] [MAIN ] CPS: Found 1 missing trading days. [2025-09-05T18:11:34.572614] [INFO ] [MAIN ] CPS: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:35.063489] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-05T18:11:35.168587] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:11:35.171727] [INFO ] [REMOTE ] CNQ: Full fetch complete (58267 records). [2025-09-05T18:11:35.550136] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-05T18:11:35.812831] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-05T18:11:35.812998] [INFO ] [MAIN ] Update Progress: 515/2363 symbols completed. CNQ took 29.1s. Estimated remaining: 41m 23s. Rate: 44.7 symbols/min [2025-09-05T18:11:35.874514] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-05T18:11:35.977778] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:11:35.995727] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:36.146334] [INFO ] [MAIN ] CPRI: Adding 377 new records, updating 0 existing records. [2025-09-05T18:11:36.153399] [INFO ] [MAIN ] CPT: Loaded 20977 existing records. [2025-09-05T18:11:36.326268] [INFO ] [MAIN ] CPRI: Combined dataset has 25333 total records. [2025-09-05T18:11:36.334886] [INFO ] [MAIN ] CPT: Found 1 missing trading days. [2025-09-05T18:11:36.335071] [INFO ] [MAIN ] CPT: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:36.515997] [WARN ] [VALIDATOR ] CPRI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:36.601116] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:11:36.671814] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-05T18:11:36.780882] [INFO ] [MAIN ] CPS: Adding 177 new records, updating 0 existing records. [2025-09-05T18:11:36.784305] [INFO ] [MAIN ] CPS: Combined dataset has 11267 total records. [2025-09-05T18:11:36.965987] [WARN ] [VALIDATOR ] CPS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:37.170957] [WARN ] [VALIDATOR ] CPS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:37.171041] [WARN ] [VALIDATOR ] CPRI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:37.171323] [INFO ] [MAIN ] CPS: Combined data validation passed. [2025-09-05T18:11:37.171441] [INFO ] [MAIN ] CPRI: Combined data validation passed. [2025-09-05T18:11:37.331985] [INFO ] [MAIN ] CPS: Update completed successfully. [2025-09-05T18:11:37.335865] [INFO ] [MAIN ] Update Progress: 516/2363 symbols completed. CPS took 3.1s. Estimated remaining: 41m 22s. Rate: 44.6 symbols/min [2025-09-05T18:11:37.463904] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-05T18:11:37.563079] [INFO ] [MAIN ] CPRI: Update completed successfully. [2025-09-05T18:11:37.564441] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:37.567482] [INFO ] [MAIN ] Update Progress: 517/2363 symbols completed. CPRI took 4.0s. Estimated remaining: 41m 17s. Rate: 44.7 symbols/min [2025-09-05T18:11:37.574808] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:11:37.713635] [INFO ] [MAIN ] CQP: Loaded 10142 existing records. [2025-09-05T18:11:37.814295] [INFO ] [MAIN ] CPT: Adding 329 new records, updating 0 existing records. [2025-09-05T18:11:37.920502] [INFO ] [MAIN ] CQP: Found 1 missing trading days. [2025-09-05T18:11:37.920791] [INFO ] [MAIN ] CQP: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:37.920731] [INFO ] [MAIN ] CPT: Combined dataset has 21306 total records. [2025-09-05T18:11:38.097616] [WARN ] [VALIDATOR ] CPT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:38.269682] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-05T18:11:38.290009] [WARN ] [VALIDATOR ] CPT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:38.290242] [INFO ] [MAIN ] CPT: Combined data validation passed. [2025-09-05T18:11:38.428037] [INFO ] [MAIN ] CPT: Update completed successfully. [2025-09-05T18:11:38.430854] [INFO ] [MAIN ] Update Progress: 518/2363 symbols completed. CPT took 2.6s. Estimated remaining: 41m 14s. Rate: 44.7 symbols/min [2025-09-05T18:11:38.617692] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-05T18:11:38.658817] [INFO ] [MAIN ] CQP: Adding 93 new records, updating 0 existing records. [2025-09-05T18:11:38.661311] [INFO ] [MAIN ] CQP: Combined dataset has 10235 total records. [2025-09-05T18:11:38.839287] [WARN ] [VALIDATOR ] CQP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:39.027445] [WARN ] [VALIDATOR ] CQP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:39.027672] [INFO ] [MAIN ] CQP: Combined data validation passed. [2025-09-05T18:11:39.090665] [INFO ] [MAIN ] CQP: Update completed successfully. [2025-09-05T18:11:39.091991] [INFO ] [MAIN ] Update Progress: 519/2363 symbols completed. CQP took 1.8s. Estimated remaining: 41m 10s. Rate: 44.8 symbols/min [2025-09-05T18:11:39.275509] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-05T18:11:39.287040] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-05T18:11:41.146735] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-05T18:11:41.159470] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-05T18:11:43.488827] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-05T18:11:43.500900] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-05T18:11:45.107654] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-05T18:11:45.119120] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-05T18:11:45.848288] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:11:45.850843] [INFO ] [REMOTE ] COP: Full fetch complete (58017 records). [2025-09-05T18:11:45.851716] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:11:45.851807] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:11:45.851869] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:11:45.851931] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-05T18:11:45.852006] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-09-05T18:11:45.852116] [INFO ] [MAIN ] Update Progress: 520/2363 symbols completed. COP took 26.0s. Estimated remaining: 41m 28s. Rate: 44.4 symbols/min [2025-09-05T18:11:46.374209] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:46.543212] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:46.598453] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:46.597620] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:46.598821] [WARN ] [MAIN ] CRC: No existing data found, performing full refresh instead. [2025-09-05T18:11:46.605858] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-05T18:11:46.605931] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-05T18:11:46.606558] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-05T18:11:46.693047] [INFO ] [MAIN ] CRBD: Loaded 4698 existing records. [2025-09-05T18:11:46.739379] [INFO ] [MAIN ] CRBG: Loaded 25055 existing records. [2025-09-05T18:11:46.817714] [INFO ] [MAIN ] CR: Loaded 11342 existing records. [2025-09-05T18:11:47.351140] [INFO ] [MAIN ] CRBD: Found 1 missing trading days. [2025-09-05T18:11:47.444685] [INFO ] [MAIN ] CRBD: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:47.516232] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-05T18:11:47.541024] [INFO ] [MAIN ] CRBG: Found 1 missing trading days. [2025-09-05T18:11:47.581376] [INFO ] [MAIN ] CRBG: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:47.606512] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-05T18:11:47.670105] [INFO ] [MAIN ] CR: Found 1 missing trading days. [2025-09-05T18:11:47.705864] [INFO ] [MAIN ] CR: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:47.709802] [INFO ] [REMOTE ] CRC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:11:47.710292] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-05T18:11:47.710986] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-05T18:11:48.253216] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:11:48.382134] [INFO ] [MAIN ] CR: Adding 180 new records, updating 0 existing records. [2025-09-05T18:11:48.385253] [INFO ] [MAIN ] CR: Combined dataset has 11522 total records. [2025-09-05T18:11:48.514633] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:11:48.596423] [INFO ] [MAIN ] CRBD: Adding 46 new records, updating 0 existing records. [2025-09-05T18:11:48.629587] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:11:48.672808] [INFO ] [MAIN ] CRBD: Combined dataset has 4744 total records. [2025-09-05T18:11:48.770219] [WARN ] [VALIDATOR ] CR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:49.081715] [INFO ] [MAIN ] CRBG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:11:49.212764] [WARN ] [VALIDATOR ] CRBD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:49.434988] [INFO ] [MAIN ] CRBG: Combined dataset has 25445 total records. [2025-09-05T18:11:49.717085] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-05T18:11:49.725431] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-05T18:11:49.715704] [WARN ] [VALIDATOR ] CRBG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:49.945606] [WARN ] [VALIDATOR ] CRBD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:49.945693] [WARN ] [VALIDATOR ] CR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:49.946225] [INFO ] [MAIN ] CRBD: Combined data validation passed. [2025-09-05T18:11:49.946379] [INFO ] [MAIN ] CR: Combined data validation passed. [2025-09-05T18:11:50.038196] [INFO ] [MAIN ] CRBD: Update completed successfully. [2025-09-05T18:11:50.040523] [INFO ] [MAIN ] Update Progress: 521/2363 symbols completed. CRBD took 4.2s. Estimated remaining: 41m 37s. Rate: 44.3 symbols/min [2025-09-05T18:11:50.230992] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:50.246059] [INFO ] [MAIN ] CR: Update completed successfully. [2025-09-05T18:11:50.252726] [INFO ] [MAIN ] Update Progress: 522/2363 symbols completed. CR took 4.4s. Estimated remaining: 41m 31s. Rate: 44.3 symbols/min [2025-09-05T18:11:50.347118] [INFO ] [MAIN ] CRCL: Loaded 24427 existing records. [2025-09-05T18:11:50.520090] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:50.615532] [INFO ] [MAIN ] CRCL: Found 1 missing trading days. [2025-09-05T18:11:50.622566] [INFO ] [MAIN ] CRCL: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:50.623030] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-05T18:11:50.634928] [INFO ] [MAIN ] CRGY: Loaded 24859 existing records. [2025-09-05T18:11:50.814537] [INFO ] [MAIN ] CRGY: Found 1 missing trading days. [2025-09-05T18:11:50.814662] [INFO ] [MAIN ] CRGY: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:50.814905] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-05T18:11:50.808369] [WARN ] [VALIDATOR ] CRBG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:50.815988] [INFO ] [MAIN ] CRBG: Combined data validation passed. [2025-09-05T18:11:50.972821] [INFO ] [MAIN ] CRBG: Update completed successfully. [2025-09-05T18:11:50.975621] [INFO ] [MAIN ] Update Progress: 523/2363 symbols completed. CRBG took 5.1s. Estimated remaining: 41m 28s. Rate: 44.4 symbols/min [2025-09-05T18:11:51.145867] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:51.146168] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-09-05T18:11:51.146411] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-05T18:11:51.146509] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-05T18:11:51.146592] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-05T18:11:51.404409] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-05T18:11:51.463170] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-05T18:11:51.544342] [INFO ] [REMOTE ] CRH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:11:51.545165] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-05T18:11:51.554744] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:11:51.708338] [INFO ] [MAIN ] CRGY: Adding 389 new records, updating 0 existing records. [2025-09-05T18:11:51.713630] [INFO ] [MAIN ] CRGY: Combined dataset has 25248 total records. [2025-09-05T18:11:51.905551] [WARN ] [VALIDATOR ] CRGY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:52.105678] [WARN ] [VALIDATOR ] CRGY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:52.105914] [INFO ] [MAIN ] CRGY: Combined data validation passed. [2025-09-05T18:11:52.276702] [INFO ] [MAIN ] CRGY: Update completed successfully. [2025-09-05T18:11:52.281080] [INFO ] [MAIN ] Update Progress: 524/2363 symbols completed. CRGY took 2.0s. Estimated remaining: 41m 26s. Rate: 44.4 symbols/min [2025-09-05T18:11:52.455224] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:52.478030] [INFO ] [MAIN ] CRI: Loaded 23950 existing records. [2025-09-05T18:11:52.654010] [INFO ] [MAIN ] CRI: Found 1 missing trading days. [2025-09-05T18:11:52.654164] [INFO ] [MAIN ] CRI: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:52.654399] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-05T18:11:53.191197] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-05T18:11:53.201614] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-05T18:11:53.290860] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:11:53.432441] [INFO ] [MAIN ] CRI: Adding 344 new records, updating 0 existing records. [2025-09-05T18:11:53.441411] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-09-05T18:11:53.573306] [INFO ] [MAIN ] CRI: Combined dataset has 24294 total records. [2025-09-05T18:11:53.608011] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-05T18:11:53.689098] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-05T18:11:53.689393] [INFO ] [MAIN ] CRCL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:11:53.837834] [WARN ] [VALIDATOR ] CRI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:53.937288] [INFO ] [MAIN ] CRCL: Combined dataset has 24817 total records. [2025-09-05T18:11:54.222814] [WARN ] [VALIDATOR ] CRCL: Not fatal, but first date in data (2025-06-05) does not match expected start date (2025-01-31) [2025-09-05T18:11:54.444445] [WARN ] [VALIDATOR ] CRCL: Missing days changed. Total missing: 86 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04 [2025-09-05T18:11:54.444546] [WARN ] [VALIDATOR ] CRI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:54.445157] [INFO ] [MAIN ] CRI: Combined data validation passed. [2025-09-05T18:11:54.444904] [INFO ] [MAIN ] CRCL: Combined data validation passed. [2025-09-05T18:11:54.778575] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-05T18:11:54.798562] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-05T18:11:54.798733] [INFO ] [MAIN ] CRCL: Update completed successfully. [2025-09-05T18:11:54.800310] [INFO ] [MAIN ] CRI: Update completed successfully. [2025-09-05T18:11:54.803076] [INFO ] [MAIN ] Update Progress: 525/2363 symbols completed. CRCL took 4.8s. Estimated remaining: 41m 29s. Rate: 44.3 symbols/min [2025-09-05T18:11:54.812058] [INFO ] [MAIN ] Update Progress: 526/2363 symbols completed. CRI took 2.5s. Estimated remaining: 41m 23s. Rate: 44.4 symbols/min [2025-09-05T18:11:55.150979] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:55.152340] [WARN ] [MAIN ] CRK: No existing data found, performing full refresh instead. [2025-09-05T18:11:55.168707] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:55.168881] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-05T18:11:55.169073] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-05T18:11:55.169447] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-05T18:11:55.362416] [INFO ] [MAIN ] CRL: Loaded 19036 existing records. [2025-09-05T18:11:55.671948] [INFO ] [REMOTE ] CRK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:11:55.714356] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-05T18:11:55.739582] [INFO ] [MAIN ] CRL: Found 1 missing trading days. [2025-09-05T18:11:55.740657] [INFO ] [MAIN ] CRL: Need to fetch 1 months: 2025-09 [2025-09-05T18:11:55.741018] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-05T18:11:55.780514] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-05T18:11:55.790799] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-05T18:11:56.516765] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:11:56.620537] [INFO ] [MAIN ] CRL: Adding 287 new records, updating 0 existing records. [2025-09-05T18:11:56.623705] [INFO ] [MAIN ] CRL: Combined dataset has 19323 total records. [2025-09-05T18:11:56.756984] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-05T18:11:56.815827] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-05T18:11:56.846770] [WARN ] [VALIDATOR ] CRL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:11:57.040006] [WARN ] [VALIDATOR ] CRL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:11:57.040219] [INFO ] [MAIN ] CRL: Combined data validation passed. [2025-09-05T18:11:57.157501] [INFO ] [MAIN ] CRL: Update completed successfully. [2025-09-05T18:11:57.159518] [INFO ] [MAIN ] Update Progress: 527/2363 symbols completed. CRL took 2.3s. Estimated remaining: 41m 25s. Rate: 44.3 symbols/min [2025-09-05T18:11:57.330195] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:11:57.330346] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-09-05T18:11:57.330469] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-05T18:11:57.330508] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-05T18:11:57.330554] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-05T18:11:57.695978] [INFO ] [REMOTE ] CRM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:11:57.696467] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-05T18:11:57.730755] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-05T18:11:57.741381] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-05T18:11:57.859426] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-05T18:11:57.870828] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-05T18:11:58.493061] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-05T18:11:58.502346] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-05T18:11:59.555172] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-05T18:11:59.565204] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-05T18:11:59.878810] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-05T18:11:59.890403] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-05T18:11:59.965586] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-05T18:12:00.300586] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-05T18:12:00.663527] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-05T18:12:01.377143] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-05T18:12:01.463500] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-05T18:12:01.765571] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-05T18:12:02.216495] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-05T18:12:02.263509] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-05T18:12:02.684695] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-05T18:12:03.063487] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-05T18:12:03.591027] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:12:03.593776] [INFO ] [REMOTE ] CRC: Full fetch complete (47438 records). [2025-09-05T18:12:03.870808] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-05T18:12:03.969933] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-05T18:12:04.184224] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-05T18:12:04.184371] [INFO ] [MAIN ] Update Progress: 528/2363 symbols completed. CRC took 18.3s. Estimated remaining: 41m 44s. Rate: 44.0 symbols/min [2025-09-05T18:12:04.337564] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-05T18:12:04.412004] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:04.412173] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-09-05T18:12:04.412307] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-05T18:12:04.412406] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-05T18:12:04.412459] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-05T18:12:04.668607] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-05T18:12:04.788885] [INFO ] [REMOTE ] CRS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:12:05.095691] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-05T18:12:05.463475] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-05T18:12:06.263493] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-05T18:12:06.539573] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-05T18:12:07.064149] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-05T18:12:07.067876] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-05T18:12:07.863509] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-05T18:12:08.487198] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-05T18:12:08.663501] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-05T18:12:08.865100] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-05T18:12:09.463435] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-05T18:12:10.003801] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-05T18:12:10.263495] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-05T18:12:10.931950] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-05T18:12:10.981059] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-05T18:12:11.063515] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-05T18:12:11.863479] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-05T18:12:12.137195] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-05T18:12:12.573816] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-05T18:12:12.663430] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-05T18:12:13.277071] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-05T18:12:13.463473] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-05T18:12:14.221693] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:12:14.224929] [INFO ] [REMOTE ] CRH: Full fetch complete (58177 records). [2025-09-05T18:12:14.268784] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-05T18:12:14.610429] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-05T18:12:14.760069] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-05T18:12:14.776273] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:12:14.781209] [INFO ] [REMOTE ] CRK: Full fetch complete (56308 records). [2025-09-05T18:12:14.784111] [FATAL] [VALIDATOR ] CRK: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:12:14.785250] [FATAL] [MAIN ] CRK: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:12:14.786777] [WARN ] [MAIN ] CRK: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:12:14.789851] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-05T18:12:14.789942] [INFO ] [LOCAL ] CRK: Starting deletion of derivative data. [2025-09-05T18:12:14.790042] [INFO ] [MAIN ] Update Progress: 529/2363 symbols completed. CRK took 20.0s. Estimated remaining: 42m 14s. Rate: 43.4 symbols/min [2025-09-05T18:12:15.055884] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:15.088285] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-05T18:12:15.096989] [INFO ] [MAIN ] CRT: Loaded 2310 existing records. [2025-09-05T18:12:15.294936] [INFO ] [MAIN ] CRT: Found 1 missing trading days. [2025-09-05T18:12:15.296570] [INFO ] [MAIN ] CRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:15.322336] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-05T18:12:15.322499] [INFO ] [MAIN ] Update Progress: 530/2363 symbols completed. CRH took 24.3s. Estimated remaining: 42m 10s. Rate: 43.5 symbols/min [2025-09-05T18:12:15.493432] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:15.512476] [INFO ] [MAIN ] CSAN: Loaded 20018 existing records. [2025-09-05T18:12:15.689816] [INFO ] [MAIN ] CSAN: Found 1 missing trading days. [2025-09-05T18:12:15.689981] [INFO ] [MAIN ] CSAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:15.863475] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-05T18:12:16.405740] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:12:16.509750] [INFO ] [MAIN ] CSAN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:12:16.511499] [INFO ] [MAIN ] CSAN: Combined dataset has 20018 total records. [2025-09-05T18:12:16.511972] [FATAL] [VALIDATOR ] CSAN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:12:16.512105] [FATAL] [MAIN ] CSAN: Combined data validation failed. [2025-09-05T18:12:16.512162] [WARN ] [MAIN ] CSAN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:12:16.512216] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-05T18:12:16.512967] [INFO ] [LOCAL ] CSAN: Starting deletion of derivative data. [2025-09-05T18:12:16.515954] [INFO ] [MAIN ] Update Progress: 531/2363 symbols completed. CSAN took 1.2s. Estimated remaining: 42m 8s. Rate: 43.5 symbols/min [2025-09-05T18:12:16.675678] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-05T18:12:16.710585] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:16.726758] [INFO ] [MAIN ] CSL: Loaded 14365 existing records. [2025-09-05T18:12:16.901016] [INFO ] [MAIN ] CSL: Found 1 missing trading days. [2025-09-05T18:12:16.901167] [INFO ] [MAIN ] CSL: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:17.202340] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-05T18:12:17.463485] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-05T18:12:18.023341] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:12:18.037274] [INFO ] [MAIN ] CRT: Adding 31 new records, updating 0 existing records. [2025-09-05T18:12:18.038802] [INFO ] [MAIN ] CRT: Combined dataset has 2341 total records. [2025-09-05T18:12:18.221747] [WARN ] [VALIDATOR ] CRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:18.264448] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-05T18:12:18.431321] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-05T18:12:18.454346] [WARN ] [VALIDATOR ] CRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:18.454799] [INFO ] [MAIN ] CRT: Combined data validation passed. [2025-09-05T18:12:18.471111] [INFO ] [MAIN ] CRT: Update completed successfully. [2025-09-05T18:12:18.471565] [INFO ] [MAIN ] Update Progress: 532/2363 symbols completed. CRT took 3.7s. Estimated remaining: 42m 8s. Rate: 43.4 symbols/min [2025-09-05T18:12:18.640349] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:18.648396] [INFO ] [MAIN ] CSR: Loaded 6079 existing records. [2025-09-05T18:12:18.819847] [INFO ] [MAIN ] CSR: Found 1 missing trading days. [2025-09-05T18:12:18.820017] [INFO ] [MAIN ] CSR: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:19.063484] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-05T18:12:19.683323] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:12:19.723200] [INFO ] [MAIN ] CSR: Adding 122 new records, updating 0 existing records. [2025-09-05T18:12:19.725050] [INFO ] [MAIN ] CSR: Combined dataset has 6201 total records. [2025-09-05T18:12:19.868733] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-05T18:12:19.903788] [WARN ] [VALIDATOR ] CSR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:20.094742] [WARN ] [VALIDATOR ] CSR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:20.094947] [INFO ] [MAIN ] CSR: Combined data validation passed. [2025-09-05T18:12:20.132670] [INFO ] [MAIN ] CSR: Update completed successfully. [2025-09-05T18:12:20.133525] [INFO ] [MAIN ] Update Progress: 533/2363 symbols completed. CSR took 1.7s. Estimated remaining: 42m 8s. Rate: 43.4 symbols/min [2025-09-05T18:12:20.304808] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:20.326588] [INFO ] [MAIN ] CSTM: Loaded 22505 existing records. [2025-09-05T18:12:20.506095] [INFO ] [MAIN ] CSTM: Found 1 missing trading days. [2025-09-05T18:12:20.506236] [INFO ] [MAIN ] CSTM: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:20.637102] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:12:20.668547] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-05T18:12:20.716869] [INFO ] [MAIN ] CSL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:12:20.718588] [INFO ] [MAIN ] CSL: Combined dataset has 14365 total records. [2025-09-05T18:12:20.719013] [FATAL] [VALIDATOR ] CSL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:12:20.719091] [FATAL] [MAIN ] CSL: Combined data validation failed. [2025-09-05T18:12:20.719128] [WARN ] [MAIN ] CSL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:12:20.719165] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-05T18:12:20.719707] [INFO ] [LOCAL ] CSL: Starting deletion of derivative data. [2025-09-05T18:12:20.721478] [INFO ] [MAIN ] Update Progress: 534/2363 symbols completed. CSL took 4.2s. Estimated remaining: 42m 4s. Rate: 43.5 symbols/min [2025-09-05T18:12:20.906487] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:20.906765] [WARN ] [MAIN ] CSV: No existing data found, performing full refresh instead. [2025-09-05T18:12:20.907034] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-05T18:12:20.907081] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-05T18:12:20.907167] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-05T18:12:21.271692] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-09-05T18:12:21.320261] [INFO ] [REMOTE ] CSV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:12:21.463484] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-05T18:12:22.237776] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-05T18:12:22.263478] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-05T18:12:23.063523] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-05T18:12:23.838944] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:12:23.863455] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-05T18:12:23.973897] [INFO ] [MAIN ] CSTM: Adding 369 new records, updating 0 existing records. [2025-09-05T18:12:23.977853] [INFO ] [MAIN ] CSTM: Combined dataset has 22874 total records. [2025-09-05T18:12:24.212580] [WARN ] [VALIDATOR ] CSTM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:24.220178] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-05T18:12:24.274623] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-05T18:12:24.438104] [WARN ] [VALIDATOR ] CSTM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:24.438313] [INFO ] [MAIN ] CSTM: Combined data validation passed. [2025-09-05T18:12:24.575953] [INFO ] [MAIN ] CSTM: Update completed successfully. [2025-09-05T18:12:24.578715] [INFO ] [MAIN ] Update Progress: 535/2363 symbols completed. CSTM took 4.4s. Estimated remaining: 42m 11s. Rate: 43.3 symbols/min [2025-09-05T18:12:24.671410] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-05T18:12:24.760615] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:24.769630] [INFO ] [MAIN ] CSW: Loaded 6489 existing records. [2025-09-05T18:12:24.942045] [INFO ] [MAIN ] CSW: Found 1 missing trading days. [2025-09-05T18:12:24.942203] [INFO ] [MAIN ] CSW: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:24.993083] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-05T18:12:25.463514] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-05T18:12:26.263473] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-05T18:12:26.302819] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-05T18:12:26.417596] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:12:26.469300] [INFO ] [MAIN ] CSW: Adding 143 new records, updating 0 existing records. [2025-09-05T18:12:26.471068] [INFO ] [MAIN ] CSW: Combined dataset has 6632 total records. [2025-09-05T18:12:26.665292] [WARN ] [VALIDATOR ] CSW: Not fatal, but first date in data (2025-06-09) does not match expected start date (2025-01-31) [2025-09-05T18:12:26.859726] [WARN ] [VALIDATOR ] CSW: Missing days changed. Total missing: 88 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06 [2025-09-05T18:12:26.859967] [INFO ] [MAIN ] CSW: Combined data validation passed. [2025-09-05T18:12:26.902361] [INFO ] [MAIN ] CSW: Update completed successfully. [2025-09-05T18:12:26.903471] [INFO ] [MAIN ] Update Progress: 536/2363 symbols completed. CSW took 2.3s. Estimated remaining: 42m 13s. Rate: 43.3 symbols/min [2025-09-05T18:12:27.069774] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-05T18:12:27.072196] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:27.078268] [INFO ] [MAIN ] CTBB: Loaded 3266 existing records. [2025-09-05T18:12:27.249808] [INFO ] [MAIN ] CTBB: Found 1 missing trading days. [2025-09-05T18:12:27.249973] [INFO ] [MAIN ] CTBB: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:27.863463] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-05T18:12:28.152162] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-05T18:12:28.663486] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-05T18:12:28.751262] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-05T18:12:28.775320] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:12:28.778755] [INFO ] [REMOTE ] CRS: Full fetch complete (47539 records). [2025-09-05T18:12:29.154546] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-05T18:12:29.342946] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-05T18:12:29.388343] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-05T18:12:29.388491] [INFO ] [MAIN ] Update Progress: 537/2363 symbols completed. CRS took 25.2s. Estimated remaining: 42m 15s. Rate: 43.2 symbols/min [2025-09-05T18:12:29.468623] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-05T18:12:29.562992] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:29.567935] [INFO ] [MAIN ] CTDD: Loaded 2658 existing records. [2025-09-05T18:12:29.736567] [INFO ] [MAIN ] CTDD: Found 1 missing trading days. [2025-09-05T18:12:29.736741] [INFO ] [MAIN ] CTDD: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:30.263474] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-05T18:12:30.983712] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-05T18:12:31.063466] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-05T18:12:31.818325] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-05T18:12:31.863424] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-05T18:12:32.155241] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-05T18:12:32.485008] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:12:32.487951] [INFO ] [REMOTE ] CRM: Full fetch complete (58447 records). [2025-09-05T18:12:32.669074] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-05T18:12:32.866516] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-05T18:12:33.145284] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-05T18:12:33.145447] [INFO ] [MAIN ] Update Progress: 538/2363 symbols completed. CRM took 36.0s. Estimated remaining: 42m 22s. Rate: 43.1 symbols/min [2025-09-05T18:12:33.317051] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:33.325146] [INFO ] [MAIN ] CTEV: Loaded 6676 existing records. [2025-09-05T18:12:33.472957] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-05T18:12:33.501531] [INFO ] [MAIN ] CTEV: Found 1 missing trading days. [2025-09-05T18:12:33.501673] [INFO ] [MAIN ] CTEV: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:33.541718] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-05T18:12:34.123999] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:12:34.140824] [INFO ] [MAIN ] CTDD: Adding 56 new records, updating 0 existing records. [2025-09-05T18:12:34.142295] [INFO ] [MAIN ] CTDD: Combined dataset has 2714 total records. [2025-09-05T18:12:34.268722] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-05T18:12:34.324287] [WARN ] [VALIDATOR ] CTDD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:34.514350] [WARN ] [VALIDATOR ] CTDD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:34.514607] [INFO ] [MAIN ] CTDD: Combined data validation passed. [2025-09-05T18:12:34.531747] [INFO ] [MAIN ] CTDD: Update completed successfully. [2025-09-05T18:12:34.532213] [INFO ] [MAIN ] Update Progress: 539/2363 symbols completed. CTDD took 5.1s. Estimated remaining: 42m 20s. Rate: 43.1 symbols/min [2025-09-05T18:12:34.716036] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:34.729728] [INFO ] [MAIN ] CTO: Loaded 13077 existing records. [2025-09-05T18:12:34.932376] [INFO ] [MAIN ] CTO: Found 1 missing trading days. [2025-09-05T18:12:34.932529] [INFO ] [MAIN ] CTO: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:35.063450] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-05T18:12:35.390310] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-05T18:12:35.782100] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:12:35.810554] [INFO ] [MAIN ] CTEV: Adding 62 new records, updating 0 existing records. [2025-09-05T18:12:35.812148] [INFO ] [MAIN ] CTEV: Combined dataset has 6738 total records. [2025-09-05T18:12:35.868632] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-05T18:12:36.001330] [WARN ] [VALIDATOR ] CTEV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:36.190882] [WARN ] [VALIDATOR ] CTEV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:36.191092] [INFO ] [MAIN ] CTEV: Combined data validation passed. [2025-09-05T18:12:36.231741] [INFO ] [MAIN ] CTEV: Update completed successfully. [2025-09-05T18:12:36.232566] [INFO ] [MAIN ] Update Progress: 540/2363 symbols completed. CTEV took 3.1s. Estimated remaining: 42m 20s. Rate: 43.1 symbols/min [2025-09-05T18:12:36.403494] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:36.429723] [INFO ] [MAIN ] CTOS: Loaded 27896 existing records. [2025-09-05T18:12:36.607426] [INFO ] [MAIN ] CTOS: Found 1 missing trading days. [2025-09-05T18:12:36.607575] [INFO ] [MAIN ] CTOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:36.663423] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-05T18:12:36.966618] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T18:12:37.028846] [INFO ] [MAIN ] CTO: Adding 160 new records, updating 0 existing records. [2025-09-05T18:12:37.031078] [INFO ] [MAIN ] CTO: Combined dataset has 13237 total records. [2025-09-05T18:12:37.212399] [WARN ] [VALIDATOR ] CTO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:37.330203] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:12:37.464428] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-05T18:12:37.510301] [INFO ] [MAIN ] CTOS: Adding 305 new records, updating 0 existing records. [2025-09-05T18:12:37.515425] [INFO ] [MAIN ] CTOS: Combined dataset has 28201 total records. [2025-09-05T18:12:37.700962] [WARN ] [VALIDATOR ] CTOS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:12:37.912942] [WARN ] [VALIDATOR ] CTO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:37.913036] [WARN ] [VALIDATOR ] CTOS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:12:37.913299] [INFO ] [MAIN ] CTO: Combined data validation passed. [2025-09-05T18:12:37.913509] [INFO ] [MAIN ] CTOS: Combined data validation passed. [2025-09-05T18:12:38.083126] [INFO ] [MAIN ] CTO: Update completed successfully. [2025-09-05T18:12:38.088354] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:12:38.088183] [INFO ] [MAIN ] Update Progress: 541/2363 symbols completed. CTO took 3.6s. Estimated remaining: 42m 20s. Rate: 43.0 symbols/min [2025-09-05T18:12:38.128575] [INFO ] [MAIN ] CTBB: Adding 65 new records, updating 0 existing records. [2025-09-05T18:12:38.218503] [INFO ] [MAIN ] CTBB: Combined dataset has 3331 total records. [2025-09-05T18:12:38.273198] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-05T18:12:38.416169] [INFO ] [MAIN ] CTOS: Update completed successfully. [2025-09-05T18:12:38.450258] [INFO ] [MAIN ] Update Progress: 542/2363 symbols completed. CTOS took 2.2s. Estimated remaining: 42m 15s. Rate: 43.1 symbols/min [2025-09-05T18:12:38.485196] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:38.647526] [WARN ] [VALIDATOR ] CTBB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:38.860355] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:38.951415] [INFO ] [MAIN ] CTRA: Loaded 25638 existing records. [2025-09-05T18:12:39.140635] [INFO ] [MAIN ] CTRE: Loaded 23800 existing records. [2025-09-05T18:12:39.150684] [INFO ] [MAIN ] CTRA: Found 1 missing trading days. [2025-09-05T18:12:39.172094] [INFO ] [MAIN ] CTRA: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:39.200670] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-05T18:12:39.339834] [INFO ] [MAIN ] CTRE: Found 1 missing trading days. [2025-09-05T18:12:39.340204] [INFO ] [MAIN ] CTRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:39.351809] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-05T18:12:39.360271] [WARN ] [VALIDATOR ] CTBB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:39.360465] [INFO ] [MAIN ] CTBB: Combined data validation passed. [2025-09-05T18:12:39.381671] [INFO ] [MAIN ] CTBB: Update completed successfully. [2025-09-05T18:12:39.382264] [INFO ] [MAIN ] Update Progress: 543/2363 symbols completed. CTBB took 12.5s. Estimated remaining: 42m 12s. Rate: 43.1 symbols/min [2025-09-05T18:12:39.559181] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:39.578757] [INFO ] [MAIN ] CTRI: Loaded 19746 existing records. [2025-09-05T18:12:39.754091] [INFO ] [MAIN ] CTRI: Found 1 missing trading days. [2025-09-05T18:12:39.754268] [INFO ] [MAIN ] CTRI: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:39.863441] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-05T18:12:40.162210] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:12:40.316612] [INFO ] [MAIN ] CTRA: Adding 390 new records, updating 0 existing records. [2025-09-05T18:12:40.320447] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:12:40.322267] [INFO ] [REMOTE ] CSV: Full fetch complete (14535 records). [2025-09-05T18:12:40.441460] [INFO ] [MAIN ] CTRA: Combined dataset has 26028 total records. [2025-09-05T18:12:40.667503] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-05T18:12:40.860021] [WARN ] [VALIDATOR ] CTRA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:40.894297] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-05T18:12:41.147117] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-05T18:12:41.147428] [INFO ] [MAIN ] Update Progress: 544/2363 symbols completed. CSV took 20.4s. Estimated remaining: 42m 12s. Rate: 43.1 symbols/min [2025-09-05T18:12:41.330006] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:41.342210] [INFO ] [MAIN ] CTS: Loaded 9046 existing records. [2025-09-05T18:12:41.465590] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-05T18:12:41.450152] [WARN ] [VALIDATOR ] CTRA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:41.471846] [INFO ] [MAIN ] CTRA: Combined data validation passed. [2025-09-05T18:12:41.523372] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:12:41.527284] [INFO ] [MAIN ] CTS: Found 1 missing trading days. [2025-09-05T18:12:41.527497] [INFO ] [MAIN ] CTS: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:41.829123] [INFO ] [MAIN ] CTRE: Adding 374 new records, updating 0 existing records. [2025-09-05T18:12:41.877907] [INFO ] [MAIN ] CTRA: Update completed successfully. [2025-09-05T18:12:41.881982] [INFO ] [MAIN ] Update Progress: 545/2363 symbols completed. CTRA took 3.8s. Estimated remaining: 42m 9s. Rate: 43.1 symbols/min [2025-09-05T18:12:41.882798] [INFO ] [MAIN ] CTRE: Combined dataset has 24174 total records. [2025-09-05T18:12:42.329204] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:42.270589] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-05T18:12:42.333469] [WARN ] [VALIDATOR ] CTRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:42.620079] [INFO ] [MAIN ] CTVA: Loaded 25483 existing records. [2025-09-05T18:12:42.919112] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-05T18:12:42.921988] [INFO ] [MAIN ] CTVA: Found 1 missing trading days. [2025-09-05T18:12:42.926846] [INFO ] [MAIN ] CTVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:42.956556] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:12:43.062243] [INFO ] [MAIN ] CTS: Adding 111 new records, updating 0 existing records. [2025-09-05T18:12:43.067527] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-05T18:12:43.151962] [INFO ] [MAIN ] CTS: Combined dataset has 9157 total records. [2025-09-05T18:12:43.170634] [INFO ] [MAIN ] CTRI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:12:43.294182] [INFO ] [MAIN ] CTRI: Combined dataset has 20136 total records. [2025-09-05T18:12:43.357270] [WARN ] [VALIDATOR ] CTS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:43.742406] [WARN ] [VALIDATOR ] CTRI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:43.940504] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:12:43.987605] [WARN ] [VALIDATOR ] CTS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:44.003809] [WARN ] [VALIDATOR ] CTRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:44.009338] [INFO ] [MAIN ] CTS: Combined data validation passed. [2025-09-05T18:12:44.025688] [INFO ] [MAIN ] CTRE: Combined data validation passed. [2025-09-05T18:12:44.221765] [INFO ] [MAIN ] CTVA: Adding 384 new records, updating 0 existing records. [2025-09-05T18:12:44.325814] [INFO ] [MAIN ] CTRE: Update completed successfully. [2025-09-05T18:12:44.329855] [INFO ] [MAIN ] Update Progress: 546/2363 symbols completed. CTRE took 5.8s. Estimated remaining: 42m 11s. Rate: 43.1 symbols/min [2025-09-05T18:12:44.344082] [INFO ] [MAIN ] CTVA: Combined dataset has 25867 total records. [2025-09-05T18:12:44.381295] [INFO ] [MAIN ] CTS: Update completed successfully. [2025-09-05T18:12:44.428338] [INFO ] [MAIN ] Update Progress: 547/2363 symbols completed. CTS took 3.3s. Estimated remaining: 42m 5s. Rate: 43.1 symbols/min [2025-09-05T18:12:44.817246] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:44.866980] [WARN ] [VALIDATOR ] CTVA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:44.908808] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:44.949005] [INFO ] [MAIN ] CUBB: Loaded 328 existing records. [2025-09-05T18:12:45.292275] [INFO ] [MAIN ] CUBB: Found 1 missing trading days. [2025-09-05T18:12:45.293413] [INFO ] [MAIN ] CUBB: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:45.293971] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-05T18:12:45.311619] [INFO ] [MAIN ] CUBE: Loaded 38346 existing records. [2025-09-05T18:12:45.499607] [INFO ] [MAIN ] CUBE: Found 1 missing trading days. [2025-09-05T18:12:45.500355] [INFO ] [MAIN ] CUBE: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:45.500789] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-05T18:12:45.507888] [WARN ] [VALIDATOR ] CTRI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:45.508359] [INFO ] [MAIN ] CTRI: Combined data validation passed. [2025-09-05T18:12:45.513830] [WARN ] [VALIDATOR ] CTVA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:45.514005] [INFO ] [MAIN ] CTVA: Combined data validation passed. [2025-09-05T18:12:45.764227] [INFO ] [MAIN ] CTVA: Update completed successfully. [2025-09-05T18:12:45.767861] [INFO ] [MAIN ] Update Progress: 548/2363 symbols completed. CTVA took 3.9s. Estimated remaining: 42m 4s. Rate: 43.2 symbols/min [2025-09-05T18:12:45.809526] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:12:45.831293] [INFO ] [MAIN ] CUBB: Adding 0 new records, updating 0 existing records. [2025-09-05T18:12:45.857598] [INFO ] [MAIN ] CUBB: Combined dataset has 328 total records. [2025-09-05T18:12:45.863875] [FATAL] [VALIDATOR ] CUBB: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:12:45.878608] [FATAL] [MAIN ] CUBB: Combined data validation failed. [2025-09-05T18:12:45.882316] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:12:45.882993] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-05T18:12:45.883842] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-05T18:12:45.910417] [INFO ] [MAIN ] Update Progress: 549/2363 symbols completed. CUBB took 1.6s. Estimated remaining: 41m 58s. Rate: 43.2 symbols/min [2025-09-05T18:12:45.990346] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:46.089679] [INFO ] [MAIN ] CTRI: Update completed successfully. [2025-09-05T18:12:46.118727] [INFO ] [MAIN ] Update Progress: 550/2363 symbols completed. CTRI took 6.7s. Estimated remaining: 41m 53s. Rate: 43.3 symbols/min [2025-09-05T18:12:46.140017] [INFO ] [MAIN ] CUBI: Loaded 13177 existing records. [2025-09-05T18:12:46.206092] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:46.381473] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:12:46.486587] [INFO ] [MAIN ] CUBI: Found 1 missing trading days. [2025-09-05T18:12:46.525997] [INFO ] [MAIN ] CUBI: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:46.533155] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-05T18:12:46.654718] [INFO ] [MAIN ] CUK: Loaded 24250 existing records. [2025-09-05T18:12:46.661337] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:46.817002] [INFO ] [MAIN ] CUBE: Adding 362 new records, updating 0 existing records. [2025-09-05T18:12:46.848223] [INFO ] [MAIN ] CULP: Loaded 1291 existing records. [2025-09-05T18:12:47.016151] [INFO ] [MAIN ] CUK: Found 1 missing trading days. [2025-09-05T18:12:47.034864] [INFO ] [MAIN ] CUK: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:47.035793] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-05T18:12:47.057816] [INFO ] [MAIN ] CUBE: Combined dataset has 38708 total records. [2025-09-05T18:12:47.109127] [INFO ] [MAIN ] CULP: Found 1 missing trading days. [2025-09-05T18:12:47.109395] [INFO ] [MAIN ] CULP: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:47.109631] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-05T18:12:47.308750] [WARN ] [VALIDATOR ] CUBE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:12:47.386701] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:12:47.598606] [INFO ] [MAIN ] CUBI: Adding 294 new records, updating 0 existing records. [2025-09-05T18:12:47.623897] [INFO ] [MAIN ] CUBI: Combined dataset has 13471 total records. [2025-09-05T18:12:47.634264] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:12:47.729097] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:12:47.842594] [INFO ] [MAIN ] CULP: Adding 7 new records, updating 0 existing records. [2025-09-05T18:12:47.890171] [INFO ] [MAIN ] CULP: Combined dataset has 1298 total records. [2025-09-05T18:12:47.962989] [INFO ] [MAIN ] CUK: Adding 364 new records, updating 0 existing records. [2025-09-05T18:12:48.093138] [WARN ] [VALIDATOR ] CUBI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:48.280797] [INFO ] [MAIN ] CUK: Combined dataset has 24614 total records. [2025-09-05T18:12:48.355305] [WARN ] [VALIDATOR ] CULP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:48.832060] [WARN ] [VALIDATOR ] CUK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:49.032758] [WARN ] [VALIDATOR ] CUBE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:12:49.036694] [INFO ] [MAIN ] CUBE: Combined data validation passed. [2025-09-05T18:12:49.047030] [WARN ] [VALIDATOR ] CUK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:49.046200] [WARN ] [VALIDATOR ] CUBI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:49.048777] [INFO ] [MAIN ] CUK: Combined data validation passed. [2025-09-05T18:12:49.049312] [INFO ] [MAIN ] CUBI: Combined data validation passed. [2025-09-05T18:12:49.049381] [WARN ] [VALIDATOR ] CULP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:49.049661] [INFO ] [MAIN ] CULP: Combined data validation passed. [2025-09-05T18:12:49.113899] [INFO ] [MAIN ] CULP: Update completed successfully. [2025-09-05T18:12:49.158680] [INFO ] [MAIN ] Update Progress: 551/2363 symbols completed. CULP took 3.0s. Estimated remaining: 41m 57s. Rate: 43.2 symbols/min [2025-09-05T18:12:49.395465] [INFO ] [MAIN ] CUBI: Update completed successfully. [2025-09-05T18:12:49.414680] [INFO ] [MAIN ] Update Progress: 552/2363 symbols completed. CUBI took 3.6s. Estimated remaining: 41m 52s. Rate: 43.3 symbols/min [2025-09-05T18:12:49.615970] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:49.725110] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:49.762288] [INFO ] [MAIN ] CURB: Loaded 15748 existing records. [2025-09-05T18:12:49.843834] [INFO ] [MAIN ] CUK: Update completed successfully. [2025-09-05T18:12:49.889018] [INFO ] [MAIN ] CURV: Loaded 14012 existing records. [2025-09-05T18:12:49.897630] [INFO ] [MAIN ] Update Progress: 553/2363 symbols completed. CUK took 4.0s. Estimated remaining: 41m 47s. Rate: 43.3 symbols/min [2025-09-05T18:12:50.050048] [INFO ] [MAIN ] CURB: Found 1 missing trading days. [2025-09-05T18:12:50.083184] [INFO ] [MAIN ] CURB: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:50.110595] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-05T18:12:50.266756] [INFO ] [MAIN ] CURV: Found 1 missing trading days. [2025-09-05T18:12:50.267483] [INFO ] [MAIN ] CURV: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:50.267768] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-05T18:12:50.344724] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:50.452539] [INFO ] [MAIN ] CUZ: Loaded 23734 existing records. [2025-09-05T18:12:50.642435] [INFO ] [MAIN ] CUZ: Found 1 missing trading days. [2025-09-05T18:12:50.643093] [INFO ] [MAIN ] CUZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:50.643607] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-05T18:12:50.657594] [INFO ] [MAIN ] CUBE: Update completed successfully. [2025-09-05T18:12:50.661591] [INFO ] [MAIN ] Update Progress: 554/2363 symbols completed. CUBE took 6.2s. Estimated remaining: 41m 44s. Rate: 43.3 symbols/min [2025-09-05T18:12:50.831136] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:50.861145] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:12:50.878763] [INFO ] [MAIN ] CVE: Loaded 25588 existing records. [2025-09-05T18:12:51.081027] [INFO ] [MAIN ] CURV: Adding 385 new records, updating 0 existing records. [2025-09-05T18:12:51.156356] [INFO ] [MAIN ] CVE: Found 1 missing trading days. [2025-09-05T18:12:51.156569] [INFO ] [MAIN ] CVE: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:51.156851] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-05T18:12:51.158327] [INFO ] [MAIN ] CURV: Combined dataset has 14397 total records. [2025-09-05T18:12:51.344804] [WARN ] [VALIDATOR ] CURV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:51.400914] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:12:51.559865] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-05T18:12:51.795942] [INFO ] [MAIN ] CUZ: Adding 385 new records, updating 0 existing records. [2025-09-05T18:12:51.827431] [INFO ] [MAIN ] CURB: Adding 249 new records, updating 0 existing records. [2025-09-05T18:12:51.842211] [INFO ] [MAIN ] CUZ: Combined dataset has 24119 total records. [2025-09-05T18:12:51.844105] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:12:51.843617] [INFO ] [MAIN ] CURB: Combined dataset has 15997 total records. [2025-09-05T18:12:52.299035] [WARN ] [VALIDATOR ] CUZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:52.315576] [INFO ] [MAIN ] CVE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:12:52.456658] [WARN ] [VALIDATOR ] CURB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:52.576433] [INFO ] [MAIN ] CVE: Combined dataset has 25978 total records. [2025-09-05T18:12:52.955148] [WARN ] [VALIDATOR ] CVE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:52.961241] [WARN ] [VALIDATOR ] CURV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:52.990203] [INFO ] [MAIN ] CURV: Combined data validation passed. [2025-09-05T18:12:53.240082] [INFO ] [MAIN ] CURV: Update completed successfully. [2025-09-05T18:12:53.242058] [INFO ] [MAIN ] Update Progress: 555/2363 symbols completed. CURV took 3.8s. Estimated remaining: 41m 47s. Rate: 43.3 symbols/min [2025-09-05T18:12:53.353905] [WARN ] [VALIDATOR ] CUZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:53.341049] [WARN ] [VALIDATOR ] CURB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:53.357442] [INFO ] [MAIN ] CURB: Combined data validation passed. [2025-09-05T18:12:53.357688] [INFO ] [MAIN ] CUZ: Combined data validation passed. [2025-09-05T18:12:53.538090] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:53.538477] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-09-05T18:12:53.596995] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-05T18:12:53.597749] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-05T18:12:53.606916] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-05T18:12:53.750758] [WARN ] [VALIDATOR ] CVE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:53.764255] [INFO ] [MAIN ] CVE: Combined data validation passed. [2025-09-05T18:12:54.041330] [INFO ] [MAIN ] CURB: Update completed successfully. [2025-09-05T18:12:54.067245] [INFO ] [MAIN ] Update Progress: 556/2363 symbols completed. CURB took 4.8s. Estimated remaining: 41m 43s. Rate: 43.3 symbols/min [2025-09-05T18:12:54.143546] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:12:54.157615] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-05T18:12:54.284553] [INFO ] [MAIN ] CUZ: Update completed successfully. [2025-09-05T18:12:54.293038] [INFO ] [MAIN ] Update Progress: 557/2363 symbols completed. CUZ took 4.3s. Estimated remaining: 41m 38s. Rate: 43.4 symbols/min [2025-09-05T18:12:54.367370] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:12:54.390477] [INFO ] [MAIN ] CVE: Update completed successfully. [2025-09-05T18:12:54.393445] [INFO ] [MAIN ] Update Progress: 558/2363 symbols completed. CVE took 3.7s. Estimated remaining: 41m 33s. Rate: 43.4 symbols/min [2025-09-05T18:12:54.409585] [INFO ] [MAIN ] CVI: Loaded 22062 existing records. [2025-09-05T18:12:54.587128] [INFO ] [MAIN ] CVI: Found 1 missing trading days. [2025-09-05T18:12:54.587310] [INFO ] [MAIN ] CVI: Need to fetch 1 months: 2025-09 [2025-09-05T18:12:54.587534] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-05T18:12:54.706179] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-05T18:12:54.708353] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-05T18:12:55.320468] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:12:55.445116] [INFO ] [MAIN ] CVI: Adding 314 new records, updating 0 existing records. [2025-09-05T18:12:55.448109] [INFO ] [MAIN ] CVI: Combined dataset has 22376 total records. [2025-09-05T18:12:55.630329] [WARN ] [VALIDATOR ] CVI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:12:55.707159] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-05T18:12:55.742159] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-05T18:12:55.835712] [WARN ] [VALIDATOR ] CVI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:12:55.835928] [INFO ] [MAIN ] CVI: Combined data validation passed. [2025-09-05T18:12:55.965128] [INFO ] [MAIN ] CVI: Update completed successfully. [2025-09-05T18:12:55.967571] [INFO ] [MAIN ] Update Progress: 559/2363 symbols completed. CVI took 1.9s. Estimated remaining: 41m 32s. Rate: 43.4 symbols/min [2025-09-05T18:12:57.077274] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-05T18:12:57.081058] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-05T18:12:58.145274] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-05T18:12:58.148806] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-05T18:12:59.452263] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-05T18:12:59.457300] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-05T18:13:00.603441] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-05T18:13:00.607485] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-05T18:13:01.669387] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-05T18:13:01.672909] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-05T18:13:02.624216] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-05T18:13:02.628441] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-05T18:13:03.108787] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:13:03.110030] [INFO ] [REMOTE ] CVEO: Full fetch complete (16629 records). [2025-09-05T18:13:03.470904] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-05T18:13:03.539074] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-05T18:13:03.539229] [INFO ] [MAIN ] Update Progress: 560/2363 symbols completed. CVEO took 10.3s. Estimated remaining: 41m 50s. Rate: 43.1 symbols/min [2025-09-05T18:13:04.087679] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:04.205869] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:04.207901] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:04.268096] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:04.273283] [INFO ] [MAIN ] CVLG: Loaded 6897 existing records. [2025-09-05T18:13:04.490375] [INFO ] [MAIN ] CVLG: Found 1 missing trading days. [2025-09-05T18:13:04.501324] [INFO ] [MAIN ] CVNA: Loaded 25296 existing records. [2025-09-05T18:13:04.506673] [INFO ] [MAIN ] CVLG: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:04.535501] [INFO ] [MAIN ] CVX: Loaded 25740 existing records. [2025-09-05T18:13:04.535079] [INFO ] [MAIN ] CVS: Loaded 25680 existing records. [2025-09-05T18:13:04.551410] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-05T18:13:05.023988] [INFO ] [MAIN ] CVS: Found 1 missing trading days. [2025-09-05T18:13:05.069148] [INFO ] [MAIN ] CVNA: Found 1 missing trading days. [2025-09-05T18:13:05.075577] [INFO ] [MAIN ] CVNA: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:05.075951] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-05T18:13:05.075517] [INFO ] [MAIN ] CVX: Found 1 missing trading days. [2025-09-05T18:13:05.075328] [INFO ] [MAIN ] CVS: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:05.076276] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-05T18:13:05.077843] [INFO ] [MAIN ] CVX: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:05.078085] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-05T18:13:05.112987] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:13:05.142584] [INFO ] [MAIN ] CVLG: Adding 61 new records, updating 0 existing records. [2025-09-05T18:13:05.144347] [INFO ] [MAIN ] CVLG: Combined dataset has 6958 total records. [2025-09-05T18:13:05.322998] [WARN ] [VALIDATOR ] CVLG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:05.520519] [WARN ] [VALIDATOR ] CVLG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:05.520765] [INFO ] [MAIN ] CVLG: Combined data validation passed. [2025-09-05T18:13:05.563326] [INFO ] [MAIN ] CVLG: Update completed successfully. [2025-09-05T18:13:05.564210] [INFO ] [MAIN ] Update Progress: 561/2363 symbols completed. CVLG took 2.0s. Estimated remaining: 41m 51s. Rate: 43.1 symbols/min [2025-09-05T18:13:05.735062] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:05.742544] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:13:05.839825] [INFO ] [MAIN ] CW: Loaded 10583 existing records. [2025-09-05T18:13:05.934325] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:13:05.980435] [INFO ] [MAIN ] CVS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:13:06.184675] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:13:06.216506] [INFO ] [MAIN ] CW: Found 1 missing trading days. [2025-09-05T18:13:06.243290] [INFO ] [MAIN ] CVS: Combined dataset has 26070 total records. [2025-09-05T18:13:06.256856] [INFO ] [MAIN ] CVNA: Adding 385 new records, updating 0 existing records. [2025-09-05T18:13:06.256007] [INFO ] [MAIN ] CW: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:06.286478] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-05T18:13:06.552858] [INFO ] [MAIN ] CVX: Adding 390 new records, updating 0 existing records. [2025-09-05T18:13:06.531766] [INFO ] [MAIN ] CVNA: Combined dataset has 25681 total records. [2025-09-05T18:13:06.641396] [WARN ] [VALIDATOR ] CVS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:06.825569] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:13:06.919279] [INFO ] [MAIN ] CVX: Combined dataset has 26130 total records. [2025-09-05T18:13:07.051052] [INFO ] [MAIN ] CW: Adding 150 new records, updating 0 existing records. [2025-09-05T18:13:07.018771] [WARN ] [VALIDATOR ] CVNA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:07.246344] [INFO ] [MAIN ] CW: Combined dataset has 10733 total records. [2025-09-05T18:13:07.517374] [WARN ] [VALIDATOR ] CVX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:07.781912] [WARN ] [VALIDATOR ] CW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:08.099749] [WARN ] [VALIDATOR ] CVS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:08.099477] [WARN ] [VALIDATOR ] CVNA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:08.100080] [INFO ] [MAIN ] CVS: Combined data validation passed. [2025-09-05T18:13:08.099815] [WARN ] [VALIDATOR ] CW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:08.100177] [INFO ] [MAIN ] CVNA: Combined data validation passed. [2025-09-05T18:13:08.099550] [WARN ] [VALIDATOR ] CVX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:08.101977] [INFO ] [MAIN ] CVX: Combined data validation passed. [2025-09-05T18:13:08.100707] [INFO ] [MAIN ] CW: Combined data validation passed. [2025-09-05T18:13:08.537975] [INFO ] [MAIN ] CVX: Update completed successfully. [2025-09-05T18:13:08.543063] [INFO ] [MAIN ] Update Progress: 562/2363 symbols completed. CVX took 5.0s. Estimated remaining: 41m 55s. Rate: 43.0 symbols/min [2025-09-05T18:13:08.760998] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:08.773503] [INFO ] [MAIN ] CW: Update completed successfully. [2025-09-05T18:13:08.777515] [INFO ] [MAIN ] Update Progress: 563/2363 symbols completed. CW took 3.2s. Estimated remaining: 41m 50s. Rate: 43.0 symbols/min [2025-09-05T18:13:08.907152] [INFO ] [MAIN ] CWAN: Loaded 25231 existing records. [2025-09-05T18:13:09.125477] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:09.235878] [INFO ] [MAIN ] CVS: Update completed successfully. [2025-09-05T18:13:09.245653] [INFO ] [MAIN ] CWAN: Found 1 missing trading days. [2025-09-05T18:13:09.246506] [INFO ] [MAIN ] CWAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:09.249424] [INFO ] [MAIN ] Update Progress: 564/2363 symbols completed. CVS took 5.7s. Estimated remaining: 41m 45s. Rate: 43.1 symbols/min [2025-09-05T18:13:09.249788] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-05T18:13:09.378375] [INFO ] [MAIN ] CWEN: Loaded 21515 existing records. [2025-09-05T18:13:09.406086] [INFO ] [MAIN ] CVNA: Update completed successfully. [2025-09-05T18:13:09.435761] [INFO ] [MAIN ] Update Progress: 565/2363 symbols completed. CVNA took 5.9s. Estimated remaining: 41m 40s. Rate: 43.2 symbols/min [2025-09-05T18:13:09.640509] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:09.783838] [INFO ] [MAIN ] CWEN: Found 1 missing trading days. [2025-09-05T18:13:09.809164] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:09.809254] [INFO ] [MAIN ] CWEN: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:09.809904] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-05T18:13:09.837894] [INFO ] [MAIN ] CWH: Loaded 24560 existing records. [2025-09-05T18:13:09.954799] [INFO ] [MAIN ] CWK: Loaded 23574 existing records. [2025-09-05T18:13:10.140294] [INFO ] [MAIN ] CWH: Found 1 missing trading days. [2025-09-05T18:13:10.140929] [INFO ] [MAIN ] CWH: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:10.167281] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-05T18:13:10.225119] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:13:10.225439] [INFO ] [MAIN ] CWK: Found 1 missing trading days. [2025-09-05T18:13:10.244302] [INFO ] [MAIN ] CWK: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:10.253746] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-05T18:13:10.360169] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:13:10.359971] [INFO ] [MAIN ] CWAN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:10.419258] [INFO ] [MAIN ] CWAN: Combined dataset has 25231 total records. [2025-09-05T18:13:10.455974] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:10.470639] [INFO ] [MAIN ] CWEN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:10.471014] [FATAL] [MAIN ] CWAN: Combined data validation failed. [2025-09-05T18:13:10.471297] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:10.471360] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-05T18:13:10.472667] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-09-05T18:13:10.476178] [INFO ] [MAIN ] Update Progress: 566/2363 symbols completed. CWAN took 1.9s. Estimated remaining: 41m 38s. Rate: 43.2 symbols/min [2025-09-05T18:13:10.472965] [INFO ] [MAIN ] CWEN: Combined dataset has 21515 total records. [2025-09-05T18:13:10.540194] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:10.556750] [FATAL] [MAIN ] CWEN: Combined data validation failed. [2025-09-05T18:13:10.556943] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:10.556998] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-05T18:13:10.568002] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-09-05T18:13:10.581226] [INFO ] [MAIN ] Update Progress: 567/2363 symbols completed. CWEN took 1.8s. Estimated remaining: 41m 32s. Rate: 43.2 symbols/min [2025-09-05T18:13:10.651480] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:10.836107] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:10.841909] [INFO ] [MAIN ] CWT: Loaded 12785 existing records. [2025-09-05T18:13:10.877026] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:13:10.977135] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:13:11.228037] [INFO ] [MAIN ] CWH: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:11.268600] [INFO ] [MAIN ] CWT: Found 1 missing trading days. [2025-09-05T18:13:11.296485] [INFO ] [MAIN ] CX: Loaded 25163 existing records. [2025-09-05T18:13:11.306863] [INFO ] [MAIN ] CWT: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:11.335472] [INFO ] [MAIN ] CWK: Adding 380 new records, updating 0 existing records. [2025-09-05T18:13:11.358926] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-05T18:13:11.374838] [INFO ] [MAIN ] CWH: Combined dataset has 24560 total records. [2025-09-05T18:13:11.400415] [FATAL] [VALIDATOR ] CWH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:11.407045] [FATAL] [MAIN ] CWH: Combined data validation failed. [2025-09-05T18:13:11.424727] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:11.428240] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-05T18:13:11.439079] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-09-05T18:13:11.469694] [INFO ] [MAIN ] CWK: Combined dataset has 23954 total records. [2025-09-05T18:13:11.478680] [INFO ] [MAIN ] Update Progress: 568/2363 symbols completed. CWH took 2.2s. Estimated remaining: 41m 29s. Rate: 43.3 symbols/min [2025-09-05T18:13:11.510254] [INFO ] [MAIN ] CX: Found 1 missing trading days. [2025-09-05T18:13:11.515590] [INFO ] [MAIN ] CX: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:11.536931] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-05T18:13:11.918684] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:11.925039] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:13:11.929003] [WARN ] [VALIDATOR ] CWK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:12.101704] [INFO ] [MAIN ] CWT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:12.103999] [INFO ] [MAIN ] CXE: Loaded 2731 existing records. [2025-09-05T18:13:12.137148] [INFO ] [MAIN ] CWT: Combined dataset has 12785 total records. [2025-09-05T18:13:12.182776] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:12.226586] [FATAL] [MAIN ] CWT: Combined data validation failed. [2025-09-05T18:13:12.245515] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:12.259826] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-05T18:13:12.272326] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-09-05T18:13:12.292779] [INFO ] [MAIN ] Update Progress: 569/2363 symbols completed. CWT took 1.8s. Estimated remaining: 41m 26s. Rate: 43.3 symbols/min [2025-09-05T18:13:12.476111] [INFO ] [MAIN ] CXE: Found 1 missing trading days. [2025-09-05T18:13:12.489772] [INFO ] [MAIN ] CXE: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:12.490717] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:13:12.493816] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-05T18:13:12.634624] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:12.724117] [INFO ] [MAIN ] CXH: Loaded 2972 existing records. [2025-09-05T18:13:12.723881] [INFO ] [MAIN ] CX: Adding 389 new records, updating 0 existing records. [2025-09-05T18:13:12.845966] [INFO ] [MAIN ] CX: Combined dataset has 25552 total records. [2025-09-05T18:13:12.919963] [INFO ] [MAIN ] CXH: Found 1 missing trading days. [2025-09-05T18:13:12.953918] [INFO ] [MAIN ] CXH: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:12.982172] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-05T18:13:13.099783] [WARN ] [VALIDATOR ] CX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:13.295538] [WARN ] [VALIDATOR ] CWK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:13.296219] [INFO ] [MAIN ] CWK: Combined data validation passed. [2025-09-05T18:13:13.386055] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:13:13.403861] [INFO ] [MAIN ] CXE: Adding 52 new records, updating 0 existing records. [2025-09-05T18:13:13.408806] [INFO ] [MAIN ] CXE: Combined dataset has 2783 total records. [2025-09-05T18:13:13.594450] [WARN ] [VALIDATOR ] CXE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:13.680509] [WARN ] [VALIDATOR ] CX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:13.703987] [INFO ] [MAIN ] CX: Combined data validation passed. [2025-09-05T18:13:13.885552] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:13:13.920463] [INFO ] [MAIN ] CXH: Adding 11 new records, updating 0 existing records. [2025-09-05T18:13:13.934284] [INFO ] [MAIN ] CXH: Combined dataset has 2983 total records. [2025-09-05T18:13:14.034878] [INFO ] [MAIN ] CWK: Update completed successfully. [2025-09-05T18:13:14.054266] [INFO ] [MAIN ] Update Progress: 570/2363 symbols completed. CWK took 4.6s. Estimated remaining: 41m 26s. Rate: 43.3 symbols/min [2025-09-05T18:13:14.247167] [WARN ] [VALIDATOR ] CXH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:14.432819] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:14.600474] [INFO ] [MAIN ] CX: Update completed successfully. [2025-09-05T18:13:14.601249] [INFO ] [MAIN ] CXM: Loaded 23124 existing records. [2025-09-05T18:13:14.604988] [INFO ] [MAIN ] Update Progress: 571/2363 symbols completed. CX took 4.0s. Estimated remaining: 41m 22s. Rate: 43.3 symbols/min [2025-09-05T18:13:14.823218] [WARN ] [VALIDATOR ] CXE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:14.833904] [INFO ] [MAIN ] CXE: Combined data validation passed. [2025-09-05T18:13:14.945381] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:14.977262] [INFO ] [MAIN ] CXM: Found 1 missing trading days. [2025-09-05T18:13:14.979744] [INFO ] [MAIN ] CXM: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:14.980983] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-05T18:13:14.982195] [WARN ] [VALIDATOR ] CXH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:14.983696] [INFO ] [MAIN ] CXH: Combined data validation passed. [2025-09-05T18:13:15.009830] [INFO ] [MAIN ] CXH: Update completed successfully. [2025-09-05T18:13:15.009693] [INFO ] [MAIN ] CXE: Update completed successfully. [2025-09-05T18:13:15.010398] [INFO ] [MAIN ] Update Progress: 572/2363 symbols completed. CXH took 2.7s. Estimated remaining: 41m 17s. Rate: 43.4 symbols/min [2025-09-05T18:13:15.016551] [INFO ] [MAIN ] Update Progress: 573/2363 symbols completed. CXE took 3.5s. Estimated remaining: 41m 12s. Rate: 43.5 symbols/min [2025-09-05T18:13:15.022337] [INFO ] [MAIN ] CXT: Loaded 14834 existing records. [2025-09-05T18:13:15.502593] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:15.552838] [INFO ] [MAIN ] CXT: Found 1 missing trading days. [2025-09-05T18:13:15.548437] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:15.553324] [INFO ] [MAIN ] CXT: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:15.553604] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-05T18:13:15.561722] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:13:15.667794] [INFO ] [MAIN ] CXW: Loaded 20932 existing records. [2025-09-05T18:13:15.689876] [INFO ] [MAIN ] CYD: Loaded 12585 existing records. [2025-09-05T18:13:15.821601] [INFO ] [MAIN ] CXM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:15.942959] [INFO ] [MAIN ] CXM: Combined dataset has 23124 total records. [2025-09-05T18:13:16.004089] [FATAL] [VALIDATOR ] CXM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:16.061277] [INFO ] [MAIN ] CYD: Found 1 missing trading days. [2025-09-05T18:13:16.069399] [INFO ] [MAIN ] CXW: Found 1 missing trading days. [2025-09-05T18:13:16.069207] [FATAL] [MAIN ] CXM: Combined data validation failed. [2025-09-05T18:13:16.069582] [INFO ] [MAIN ] CXW: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:16.069671] [WARN ] [MAIN ] CXM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:16.070019] [INFO ] [MAIN ] CYD: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:16.070289] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-05T18:13:16.069954] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-05T18:13:16.070082] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-05T18:13:16.072214] [INFO ] [LOCAL ] CXM: Starting deletion of derivative data. [2025-09-05T18:13:16.075626] [INFO ] [MAIN ] Update Progress: 574/2363 symbols completed. CXM took 2.0s. Estimated remaining: 41m 9s. Rate: 43.5 symbols/min [2025-09-05T18:13:16.248312] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:16.270433] [INFO ] [MAIN ] CYH: Loaded 22876 existing records. [2025-09-05T18:13:16.455289] [INFO ] [MAIN ] CYH: Found 1 missing trading days. [2025-09-05T18:13:16.455460] [INFO ] [MAIN ] CYH: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:16.455735] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-05T18:13:16.680995] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:13:16.727436] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:13:16.850265] [INFO ] [MAIN ] CYD: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:16.856874] [INFO ] [MAIN ] CXW: Adding 275 new records, updating 0 existing records. [2025-09-05T18:13:16.864563] [INFO ] [MAIN ] CYD: Combined dataset has 12585 total records. [2025-09-05T18:13:16.865312] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-05T18:13:16.874446] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:16.887300] [FATAL] [MAIN ] CYD: Combined data validation failed. [2025-09-05T18:13:16.918860] [INFO ] [MAIN ] CXW: Combined dataset has 21207 total records. [2025-09-05T18:13:16.903298] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:16.924154] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-05T18:13:16.968889] [INFO ] [MAIN ] CXT: Adding 253 new records, updating 0 existing records. [2025-09-05T18:13:16.975546] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-09-05T18:13:17.004046] [INFO ] [MAIN ] Update Progress: 575/2363 symbols completed. CYD took 2.0s. Estimated remaining: 41m 6s. Rate: 43.5 symbols/min [2025-09-05T18:13:17.092382] [INFO ] [MAIN ] CXT: Combined dataset has 15087 total records. [2025-09-05T18:13:17.354935] [WARN ] [VALIDATOR ] CXW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:17.443302] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:13:17.569305] [WARN ] [VALIDATOR ] CXT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:17.620207] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:18.006237] [INFO ] [MAIN ] CYH: Adding 379 new records, updating 0 existing records. [2025-09-05T18:13:18.052006] [INFO ] [MAIN ] D: Loaded 25642 existing records. [2025-09-05T18:13:18.090779] [INFO ] [MAIN ] CYH: Combined dataset has 23255 total records. [2025-09-05T18:13:18.399277] [WARN ] [VALIDATOR ] CYH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:18.464395] [INFO ] [MAIN ] D: Found 1 missing trading days. [2025-09-05T18:13:18.484493] [INFO ] [MAIN ] D: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:18.493943] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-05T18:13:18.550490] [WARN ] [VALIDATOR ] CXT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:18.561120] [INFO ] [MAIN ] CXT: Combined data validation passed. [2025-09-05T18:13:18.555656] [WARN ] [VALIDATOR ] CXW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:18.595387] [INFO ] [MAIN ] CXW: Combined data validation passed. [2025-09-05T18:13:18.830278] [INFO ] [MAIN ] CXW: Update completed successfully. [2025-09-05T18:13:18.835584] [INFO ] [MAIN ] Update Progress: 576/2363 symbols completed. CXW took 3.8s. Estimated remaining: 41m 6s. Rate: 43.5 symbols/min [2025-09-05T18:13:18.965094] [INFO ] [MAIN ] CXT: Update completed successfully. [2025-09-05T18:13:18.973593] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:13:18.975321] [INFO ] [MAIN ] Update Progress: 577/2363 symbols completed. CXT took 4.4s. Estimated remaining: 41m 1s. Rate: 43.5 symbols/min [2025-09-05T18:13:19.178957] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:19.429138] [INFO ] [MAIN ] DAC: Loaded 6087 existing records. [2025-09-05T18:13:19.415814] [INFO ] [MAIN ] D: Adding 390 new records, updating 0 existing records. [2025-09-05T18:13:19.446590] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:19.452867] [WARN ] [VALIDATOR ] CYH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:19.453473] [INFO ] [MAIN ] CYH: Combined data validation passed. [2025-09-05T18:13:19.663424] [INFO ] [MAIN ] D: Combined dataset has 26032 total records. [2025-09-05T18:13:19.806189] [INFO ] [MAIN ] DAL: Loaded 25735 existing records. [2025-09-05T18:13:19.901975] [INFO ] [MAIN ] DAC: Found 1 missing trading days. [2025-09-05T18:13:19.922803] [INFO ] [MAIN ] DAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:19.949061] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-05T18:13:20.099533] [INFO ] [MAIN ] CYH: Update completed successfully. [2025-09-05T18:13:20.099361] [WARN ] [VALIDATOR ] D: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:20.106057] [INFO ] [MAIN ] Update Progress: 578/2363 symbols completed. CYH took 4.0s. Estimated remaining: 40m 59s. Rate: 43.6 symbols/min [2025-09-05T18:13:20.416175] [INFO ] [MAIN ] DAL: Found 1 missing trading days. [2025-09-05T18:13:20.426681] [INFO ] [MAIN ] DAL: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:20.427277] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-05T18:13:20.573971] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:20.486606] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:13:20.618354] [INFO ] [MAIN ] DAC: Adding 65 new records, updating 0 existing records. [2025-09-05T18:13:20.623814] [INFO ] [MAIN ] DAC: Combined dataset has 6152 total records. [2025-09-05T18:13:20.755902] [INFO ] [MAIN ] DAN: Loaded 23558 existing records. [2025-09-05T18:13:20.906874] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:13:20.852570] [WARN ] [VALIDATOR ] D: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:20.959275] [INFO ] [MAIN ] D: Combined data validation passed. [2025-09-05T18:13:20.988048] [WARN ] [VALIDATOR ] DAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:21.405370] [INFO ] [MAIN ] DAL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:21.405551] [INFO ] [MAIN ] DAN: Found 1 missing trading days. [2025-09-05T18:13:21.445478] [INFO ] [MAIN ] DAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:21.485588] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-05T18:13:21.507363] [INFO ] [MAIN ] DAL: Combined dataset has 25735 total records. [2025-09-05T18:13:21.509317] [FATAL] [VALIDATOR ] DAL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:21.515368] [FATAL] [MAIN ] DAL: Combined data validation failed. [2025-09-05T18:13:21.515578] [WARN ] [MAIN ] DAL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:21.515971] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-05T18:13:21.522050] [INFO ] [LOCAL ] DAL: Starting deletion of derivative data. [2025-09-05T18:13:21.553388] [INFO ] [MAIN ] Update Progress: 579/2363 symbols completed. DAL took 2.5s. Estimated remaining: 40m 58s. Rate: 43.5 symbols/min [2025-09-05T18:13:21.662196] [INFO ] [MAIN ] D: Update completed successfully. [2025-09-05T18:13:21.682301] [INFO ] [MAIN ] Update Progress: 580/2363 symbols completed. D took 4.6s. Estimated remaining: 40m 53s. Rate: 43.6 symbols/min [2025-09-05T18:13:21.818578] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:21.946449] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:21.947154] [INFO ] [MAIN ] DAO: Loaded 7887 existing records. [2025-09-05T18:13:22.145203] [INFO ] [MAIN ] DAO: Found 1 missing trading days. [2025-09-05T18:13:22.146117] [INFO ] [MAIN ] DAR: Loaded 24843 existing records. [2025-09-05T18:13:22.157297] [INFO ] [MAIN ] DAO: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:22.157637] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-05T18:13:22.330041] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:13:22.336497] [INFO ] [MAIN ] DAR: Found 1 missing trading days. [2025-09-05T18:13:22.339102] [WARN ] [VALIDATOR ] DAC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:22.348948] [INFO ] [MAIN ] DAR: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:22.365106] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-05T18:13:22.365228] [INFO ] [MAIN ] DAC: Combined data validation passed. [2025-09-05T18:13:22.510396] [INFO ] [MAIN ] DAN: Adding 376 new records, updating 0 existing records. [2025-09-05T18:13:22.522701] [INFO ] [MAIN ] DAN: Combined dataset has 23934 total records. [2025-09-05T18:13:22.523989] [INFO ] [MAIN ] DAC: Update completed successfully. [2025-09-05T18:13:22.588443] [INFO ] [MAIN ] Update Progress: 581/2363 symbols completed. DAC took 3.8s. Estimated remaining: 40m 50s. Rate: 43.6 symbols/min [2025-09-05T18:13:22.714715] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:13:22.842626] [WARN ] [VALIDATOR ] DAN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:22.998254] [INFO ] [MAIN ] DAO: Adding 186 new records, updating 0 existing records. [2025-09-05T18:13:22.989524] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:23.108083] [INFO ] [MAIN ] DAO: Combined dataset has 8073 total records. [2025-09-05T18:13:23.107884] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:13:23.305886] [INFO ] [MAIN ] DAVA: Loaded 19363 existing records. [2025-09-05T18:13:23.584990] [WARN ] [VALIDATOR ] DAO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:23.670789] [INFO ] [MAIN ] DAR: Adding 381 new records, updating 0 existing records. [2025-09-05T18:13:23.824419] [INFO ] [MAIN ] DAVA: Found 1 missing trading days. [2025-09-05T18:13:23.850736] [INFO ] [MAIN ] DAVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:23.851780] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-05T18:13:23.857387] [INFO ] [MAIN ] DAR: Combined dataset has 25224 total records. [2025-09-05T18:13:24.119760] [WARN ] [VALIDATOR ] DAR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:24.314082] [WARN ] [VALIDATOR ] DAN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:24.315111] [INFO ] [MAIN ] DAN: Combined data validation passed. [2025-09-05T18:13:24.443292] [WARN ] [VALIDATOR ] DAO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:24.443384] [WARN ] [VALIDATOR ] DAR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:24.448936] [INFO ] [MAIN ] DAO: Combined data validation passed. [2025-09-05T18:13:24.449220] [INFO ] [MAIN ] DAR: Combined data validation passed. [2025-09-05T18:13:24.521874] [INFO ] [MAIN ] DAN: Update completed successfully. [2025-09-05T18:13:24.627847] [INFO ] [MAIN ] DAO: Update completed successfully. [2025-09-05T18:13:24.610713] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:13:24.614129] [INFO ] [MAIN ] Update Progress: 582/2363 symbols completed. DAN took 4.5s. Estimated remaining: 40m 51s. Rate: 43.6 symbols/min [2025-09-05T18:13:24.644168] [INFO ] [MAIN ] Update Progress: 583/2363 symbols completed. DAO took 3.1s. Estimated remaining: 40m 45s. Rate: 43.7 symbols/min [2025-09-05T18:13:24.992268] [INFO ] [MAIN ] DAVA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:13:25.047098] [INFO ] [MAIN ] DAVA: Combined dataset has 19363 total records. [2025-09-05T18:13:25.108475] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:25.101632] [INFO ] [MAIN ] DAR: Update completed successfully. [2025-09-05T18:13:25.124439] [FATAL] [VALIDATOR ] DAVA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:25.149529] [INFO ] [MAIN ] Update Progress: 584/2363 symbols completed. DAR took 3.5s. Estimated remaining: 40m 41s. Rate: 43.7 symbols/min [2025-09-05T18:13:25.145306] [FATAL] [MAIN ] DAVA: Combined data validation failed. [2025-09-05T18:13:25.124686] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-09-05T18:13:25.180113] [WARN ] [MAIN ] DAVA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:25.191545] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-05T18:13:25.202713] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:25.216877] [INFO ] [LOCAL ] DAVA: Starting deletion of derivative data. [2025-09-05T18:13:25.211671] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-05T18:13:25.249960] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-05T18:13:25.277137] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-05T18:13:25.263675] [INFO ] [MAIN ] Update Progress: 585/2363 symbols completed. DAVA took 2.6s. Estimated remaining: 40m 36s. Rate: 43.8 symbols/min [2025-09-05T18:13:25.551061] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:25.608985] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-05T18:13:25.665105] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-05T18:13:25.705293] [INFO ] [MAIN ] DB: Loaded 24970 existing records. [2025-09-05T18:13:25.694672] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-05T18:13:25.811632] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-05T18:13:25.882288] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:25.892862] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-09-05T18:13:25.981452] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-05T18:13:26.002246] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-05T18:13:26.028220] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-05T18:13:26.185484] [INFO ] [REMOTE ] DAY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:13:26.264365] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-05T18:13:26.360300] [INFO ] [MAIN ] DB: Found 1 missing trading days. [2025-09-05T18:13:26.417929] [INFO ] [MAIN ] DB: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:26.463004] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-05T18:13:26.829091] [INFO ] [REMOTE ] DBD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:13:26.849475] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-05T18:13:26.888664] [INFO ] [REMOTE ] DBI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:13:26.888992] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-05T18:13:27.429109] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:13:27.581768] [INFO ] [MAIN ] DB: Adding 379 new records, updating 0 existing records. [2025-09-05T18:13:27.593931] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-05T18:13:27.597804] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-05T18:13:27.601564] [INFO ] [MAIN ] DB: Combined dataset has 25349 total records. [2025-09-05T18:13:27.780062] [WARN ] [VALIDATOR ] DB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:27.987359] [WARN ] [VALIDATOR ] DB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:27.987610] [INFO ] [MAIN ] DB: Combined data validation passed. [2025-09-05T18:13:28.150682] [INFO ] [MAIN ] DB: Update completed successfully. [2025-09-05T18:13:28.153846] [INFO ] [MAIN ] Update Progress: 586/2363 symbols completed. DB took 3.4s. Estimated remaining: 40m 39s. Rate: 43.7 symbols/min [2025-09-05T18:13:28.328173] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:28.328377] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-09-05T18:13:28.328824] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-05T18:13:28.328920] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-05T18:13:28.328974] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-05T18:13:28.728598] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-05T18:13:28.733740] [INFO ] [REMOTE ] DBL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:13:28.743478] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-05T18:13:28.744478] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-05T18:13:28.744763] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-05T18:13:28.748870] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-05T18:13:28.863868] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-05T18:13:28.873206] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-05T18:13:29.459527] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-05T18:13:29.461786] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-05T18:13:29.880135] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-05T18:13:29.884846] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-05T18:13:30.199728] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-05T18:13:30.202019] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-05T18:13:30.351378] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-05T18:13:30.360959] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-05T18:13:30.584553] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-05T18:13:30.593591] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-05T18:13:30.899768] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-05T18:13:30.901810] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-05T18:13:31.126444] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-05T18:13:31.131738] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-05T18:13:31.347432] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-05T18:13:31.874477] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-05T18:13:31.895054] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-05T18:13:31.990002] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-05T18:13:32.564798] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-05T18:13:32.663487] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-05T18:13:32.927790] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-05T18:13:33.463541] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-05T18:13:34.263504] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-05T18:13:34.476805] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-05T18:13:35.063465] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-05T18:13:35.132982] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-05T18:13:35.192561] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-05T18:13:35.863545] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-05T18:13:36.338957] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-05T18:13:36.663513] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-05T18:13:37.096756] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-05T18:13:37.463521] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-05T18:13:38.252911] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-05T18:13:38.263418] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-05T18:13:38.790552] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-05T18:13:39.063495] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-05T18:13:39.863542] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-05T18:13:40.040985] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-05T18:13:40.663535] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-05T18:13:40.720981] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-05T18:13:40.810531] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-05T18:13:41.463480] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-05T18:13:42.261605] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-05T18:13:42.271540] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-05T18:13:42.774234] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-05T18:13:43.063481] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-05T18:13:43.808969] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:13:43.811727] [INFO ] [REMOTE ] DAY: Full fetch complete (54783 records). [2025-09-05T18:13:43.874330] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-05T18:13:44.205279] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-05T18:13:44.206675] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-05T18:13:44.446972] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-05T18:13:44.447130] [INFO ] [MAIN ] Update Progress: 587/2363 symbols completed. DAY took 19.8s. Estimated remaining: 41m 23s. Rate: 42.9 symbols/min [2025-09-05T18:13:44.632918] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:44.642112] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-05T18:13:44.666394] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-05T18:13:44.667914] [INFO ] [MAIN ] DBRG: Loaded 23693 existing records. [2025-09-05T18:13:44.863156] [INFO ] [MAIN ] DBRG: Found 1 missing trading days. [2025-09-05T18:13:44.863314] [INFO ] [MAIN ] DBRG: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:45.463458] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-05T18:13:45.580274] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-05T18:13:46.104061] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:13:46.250712] [INFO ] [MAIN ] DBRG: Adding 336 new records, updating 0 existing records. [2025-09-05T18:13:46.253972] [INFO ] [MAIN ] DBRG: Combined dataset has 24029 total records. [2025-09-05T18:13:46.268564] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-05T18:13:46.435623] [WARN ] [VALIDATOR ] DBRG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:46.687702] [WARN ] [VALIDATOR ] DBRG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:46.687923] [INFO ] [MAIN ] DBRG: Combined data validation passed. [2025-09-05T18:13:46.832933] [INFO ] [MAIN ] DBRG: Update completed successfully. [2025-09-05T18:13:46.835401] [INFO ] [MAIN ] Update Progress: 588/2363 symbols completed. DBRG took 2.4s. Estimated remaining: 41m 24s. Rate: 42.9 symbols/min [2025-09-05T18:13:47.005857] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:47.024219] [INFO ] [MAIN ] DCI: Loaded 18069 existing records. [2025-09-05T18:13:47.068558] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-05T18:13:47.202414] [INFO ] [MAIN ] DCI: Found 1 missing trading days. [2025-09-05T18:13:47.202573] [INFO ] [MAIN ] DCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:47.285638] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:13:47.286696] [INFO ] [REMOTE ] DBL: Full fetch complete (9876 records). [2025-09-05T18:13:47.642628] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-05T18:13:47.687910] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-05T18:13:47.688144] [INFO ] [MAIN ] Update Progress: 589/2363 symbols completed. DBL took 19.5s. Estimated remaining: 41m 21s. Rate: 42.9 symbols/min [2025-09-05T18:13:47.797063] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:13:47.839921] [INFO ] [REMOTE ] DBI: Full fetch complete (49360 records). [2025-09-05T18:13:47.872176] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:47.872376] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-05T18:13:47.991822] [INFO ] [MAIN ] DCO: Loaded 7968 existing records. [2025-09-05T18:13:48.395865] [INFO ] [MAIN ] DCO: Found 1 missing trading days. [2025-09-05T18:13:48.412334] [INFO ] [MAIN ] DCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:48.428359] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-05T18:13:48.526583] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:13:48.639571] [INFO ] [MAIN ] DCI: Adding 237 new records, updating 0 existing records. [2025-09-05T18:13:48.647160] [INFO ] [MAIN ] DCI: Combined dataset has 18306 total records. [2025-09-05T18:13:48.672092] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-05T18:13:48.841011] [WARN ] [VALIDATOR ] DCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:49.111502] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-05T18:13:49.111814] [INFO ] [MAIN ] Update Progress: 590/2363 symbols completed. DBI took 23.8s. Estimated remaining: 41m 20s. Rate: 42.9 symbols/min [2025-09-05T18:13:49.284988] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:49.290857] [WARN ] [VALIDATOR ] DCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:49.291163] [INFO ] [MAIN ] DCI: Combined data validation passed. [2025-09-05T18:13:49.395525] [INFO ] [MAIN ] DD: Loaded 25216 existing records. [2025-09-05T18:13:49.464018] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-05T18:13:49.591878] [INFO ] [MAIN ] DCI: Update completed successfully. [2025-09-05T18:13:49.601110] [INFO ] [MAIN ] Update Progress: 591/2363 symbols completed. DCI took 2.8s. Estimated remaining: 41m 16s. Rate: 42.9 symbols/min [2025-09-05T18:13:49.599578] [INFO ] [MAIN ] DD: Found 1 missing trading days. [2025-09-05T18:13:49.601361] [INFO ] [MAIN ] DD: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:49.776901] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:49.777063] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-09-05T18:13:49.777192] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-05T18:13:49.777232] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-05T18:13:49.777281] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-05T18:13:50.012743] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:13:50.116593] [INFO ] [MAIN ] DCO: Adding 88 new records, updating 0 existing records. [2025-09-05T18:13:50.187711] [INFO ] [REMOTE ] DDD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:13:50.189885] [INFO ] [MAIN ] DCO: Combined dataset has 8056 total records. [2025-09-05T18:13:50.267679] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-05T18:13:50.353838] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-05T18:13:50.409939] [WARN ] [VALIDATOR ] DCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:50.613587] [WARN ] [VALIDATOR ] DCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:50.613834] [INFO ] [MAIN ] DCO: Combined data validation passed. [2025-09-05T18:13:50.662362] [INFO ] [MAIN ] DCO: Update completed successfully. [2025-09-05T18:13:50.663373] [INFO ] [MAIN ] Update Progress: 592/2363 symbols completed. DCO took 3.0s. Estimated remaining: 41m 14s. Rate: 43.0 symbols/min [2025-09-05T18:13:50.843139] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:50.843342] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-09-05T18:13:50.843473] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-05T18:13:50.843517] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-05T18:13:50.843575] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-05T18:13:51.068633] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-05T18:13:51.215474] [INFO ] [REMOTE ] DDL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:13:51.654905] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:13:51.656521] [INFO ] [REMOTE ] DBD: Full fetch complete (24553 records). [2025-09-05T18:13:51.657279] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:13:51.657360] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:13:51.657410] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:13:51.657461] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-05T18:13:51.657524] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-05T18:13:51.657615] [INFO ] [MAIN ] Update Progress: 593/2363 symbols completed. DBD took 26.5s. Estimated remaining: 41m 11s. Rate: 43.0 symbols/min [2025-09-05T18:13:51.835251] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:51.844876] [INFO ] [MAIN ] DDS: Loaded 6093 existing records. [2025-09-05T18:13:51.868714] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-05T18:13:52.017674] [INFO ] [MAIN ] DDS: Found 1 missing trading days. [2025-09-05T18:13:52.017826] [INFO ] [MAIN ] DDS: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:52.122342] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-05T18:13:52.663465] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-05T18:13:53.449377] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-05T18:13:53.463419] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-05T18:13:53.477831] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:13:53.628924] [INFO ] [MAIN ] DD: Adding 389 new records, updating 0 existing records. [2025-09-05T18:13:53.632148] [INFO ] [MAIN ] DD: Combined dataset has 25605 total records. [2025-09-05T18:13:53.810015] [WARN ] [VALIDATOR ] DD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:54.002691] [WARN ] [VALIDATOR ] DD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:54.002930] [INFO ] [MAIN ] DD: Combined data validation passed. [2025-09-05T18:13:54.168848] [INFO ] [MAIN ] DD: Update completed successfully. [2025-09-05T18:13:54.172346] [INFO ] [MAIN ] Update Progress: 594/2363 symbols completed. DD took 5.1s. Estimated remaining: 41m 13s. Rate: 42.9 symbols/min [2025-09-05T18:13:54.272801] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-05T18:13:54.360608] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:54.363369] [INFO ] [MAIN ] DDT: Loaded 961 existing records. [2025-09-05T18:13:54.536954] [INFO ] [MAIN ] DDT: Found 1 missing trading days. [2025-09-05T18:13:54.537118] [INFO ] [MAIN ] DDT: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:54.672124] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-05T18:13:55.063478] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-05T18:13:55.665268] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:13:55.673439] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-05T18:13:55.671380] [INFO ] [MAIN ] DDT: Adding 8 new records, updating 0 existing records. [2025-09-05T18:13:55.684299] [INFO ] [MAIN ] DDT: Combined dataset has 969 total records. [2025-09-05T18:13:55.866567] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-05T18:13:55.870194] [WARN ] [VALIDATOR ] DDT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:56.068907] [WARN ] [VALIDATOR ] DDT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:56.069127] [INFO ] [MAIN ] DDT: Combined data validation passed. [2025-09-05T18:13:56.076591] [INFO ] [MAIN ] DDT: Update completed successfully. [2025-09-05T18:13:56.076888] [INFO ] [MAIN ] Update Progress: 595/2363 symbols completed. DDT took 1.9s. Estimated remaining: 41m 13s. Rate: 42.9 symbols/min [2025-09-05T18:13:56.261863] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:56.285370] [INFO ] [MAIN ] DE: Loaded 22610 existing records. [2025-09-05T18:13:56.466784] [INFO ] [MAIN ] DE: Found 1 missing trading days. [2025-09-05T18:13:56.466960] [INFO ] [MAIN ] DE: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:56.494745] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:13:56.533410] [INFO ] [MAIN ] DDS: Adding 137 new records, updating 0 existing records. [2025-09-05T18:13:56.535307] [INFO ] [MAIN ] DDS: Combined dataset has 6230 total records. [2025-09-05T18:13:56.668603] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-05T18:13:56.722285] [WARN ] [VALIDATOR ] DDS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:56.907842] [WARN ] [VALIDATOR ] DDS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:56.908050] [INFO ] [MAIN ] DDS: Combined data validation passed. [2025-09-05T18:13:56.949196] [INFO ] [MAIN ] DDS: Update completed successfully. [2025-09-05T18:13:56.950196] [INFO ] [MAIN ] Update Progress: 596/2363 symbols completed. DDS took 5.3s. Estimated remaining: 41m 10s. Rate: 42.9 symbols/min [2025-09-05T18:13:57.128281] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:13:57.147659] [INFO ] [MAIN ] DEA: Loaded 18271 existing records. [2025-09-05T18:13:57.330230] [INFO ] [MAIN ] DEA: Found 1 missing trading days. [2025-09-05T18:13:57.330441] [INFO ] [MAIN ] DEA: Need to fetch 1 months: 2025-09 [2025-09-05T18:13:57.463539] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-05T18:13:58.051054] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:13:58.210558] [INFO ] [MAIN ] DE: Adding 343 new records, updating 0 existing records. [2025-09-05T18:13:58.214233] [INFO ] [MAIN ] DE: Combined dataset has 22953 total records. [2025-09-05T18:13:58.275856] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-05T18:13:58.466148] [WARN ] [VALIDATOR ] DE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:13:58.698953] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-05T18:13:58.715836] [WARN ] [VALIDATOR ] DE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:13:58.716095] [INFO ] [MAIN ] DE: Combined data validation passed. [2025-09-05T18:13:58.865771] [INFO ] [MAIN ] DE: Update completed successfully. [2025-09-05T18:13:58.869073] [INFO ] [MAIN ] Update Progress: 597/2363 symbols completed. DE took 2.8s. Estimated remaining: 41m 10s. Rate: 42.9 symbols/min [2025-09-05T18:13:59.063500] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-05T18:13:59.863525] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-05T18:13:59.918840] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-05T18:14:00.459742] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:14:00.577493] [INFO ] [MAIN ] DEA: Adding 306 new records, updating 0 existing records. [2025-09-05T18:14:00.581333] [INFO ] [MAIN ] DEA: Combined dataset has 18577 total records. [2025-09-05T18:14:00.682319] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-05T18:14:00.743738] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-05T18:14:00.811510] [WARN ] [VALIDATOR ] DEA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:01.001492] [WARN ] [VALIDATOR ] DEA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:01.001737] [INFO ] [MAIN ] DEA: Combined data validation passed. [2025-09-05T18:14:01.123441] [INFO ] [MAIN ] DEA: Update completed successfully. [2025-09-05T18:14:01.125659] [INFO ] [MAIN ] Update Progress: 598/2363 symbols completed. DEA took 4.2s. Estimated remaining: 41m 11s. Rate: 42.9 symbols/min [2025-09-05T18:14:01.463557] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-05T18:14:02.492040] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-05T18:14:02.502993] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-05T18:14:03.351753] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-05T18:14:03.362664] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-05T18:14:04.416156] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-05T18:14:04.425841] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-05T18:14:05.126979] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-05T18:14:05.133837] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-05T18:14:05.163291] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-05T18:14:05.463484] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-05T18:14:06.361838] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-05T18:14:06.368782] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-05T18:14:06.829397] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-05T18:14:07.063484] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-05T18:14:07.478393] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-05T18:14:07.863491] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-05T18:14:08.839743] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-05T18:14:08.850943] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-05T18:14:09.067177] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:14:09.070213] [INFO ] [REMOTE ] DDL: Full fetch complete (39188 records). [2025-09-05T18:14:09.438008] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-05T18:14:09.593233] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-05T18:14:09.593379] [INFO ] [MAIN ] Update Progress: 599/2363 symbols completed. DDL took 18.9s. Estimated remaining: 41m 31s. Rate: 42.5 symbols/min [2025-09-05T18:14:09.638244] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:14:09.640990] [INFO ] [REMOTE ] DDD: Full fetch complete (55296 records). [2025-09-05T18:14:10.016954] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-05T18:14:10.236503] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-05T18:14:10.236687] [INFO ] [MAIN ] Update Progress: 600/2363 symbols completed. DDD took 20.6s. Estimated remaining: 41m 27s. Rate: 42.5 symbols/min [2025-09-05T18:14:10.786586] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:10.934562] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:10.963416] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-09-05T18:14:10.983625] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:10.965898] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:10.982233] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-05T18:14:10.984365] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-05T18:14:10.985008] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-05T18:14:11.242882] [INFO ] [MAIN ] DELL: Loaded 25720 existing records. [2025-09-05T18:14:11.243945] [INFO ] [MAIN ] DEI: Loaded 22779 existing records. [2025-09-05T18:14:11.341212] [INFO ] [MAIN ] DECK: Loaded 25518 existing records. [2025-09-05T18:14:11.702621] [INFO ] [REMOTE ] DEC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:14:11.800055] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-05T18:14:11.929271] [INFO ] [MAIN ] DEI: Found 1 missing trading days. [2025-09-05T18:14:11.953957] [INFO ] [MAIN ] DELL: Found 1 missing trading days. [2025-09-05T18:14:11.960196] [INFO ] [MAIN ] DELL: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:11.960253] [INFO ] [MAIN ] DEI: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:11.960139] [INFO ] [MAIN ] DECK: Found 1 missing trading days. [2025-09-05T18:14:11.960927] [INFO ] [MAIN ] DECK: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:11.961132] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-05T18:14:11.960846] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-05T18:14:11.960478] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-05T18:14:12.274109] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:14:12.434822] [INFO ] [MAIN ] DELL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:14:12.438863] [INFO ] [MAIN ] DELL: Combined dataset has 26110 total records. [2025-09-05T18:14:12.614502] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:14:12.635402] [WARN ] [VALIDATOR ] DELL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:12.894056] [INFO ] [MAIN ] DEI: Adding 359 new records, updating 0 existing records. [2025-09-05T18:14:12.899915] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:14:13.079460] [INFO ] [MAIN ] DEI: Combined dataset has 23138 total records. [2025-09-05T18:14:13.209900] [INFO ] [MAIN ] DECK: Adding 383 new records, updating 0 existing records. [2025-09-05T18:14:13.316440] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-05T18:14:13.347438] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-05T18:14:13.350893] [WARN ] [VALIDATOR ] DEI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:13.372662] [INFO ] [MAIN ] DECK: Combined dataset has 25901 total records. [2025-09-05T18:14:13.740676] [WARN ] [VALIDATOR ] DECK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:13.946990] [WARN ] [VALIDATOR ] DELL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:13.947109] [WARN ] [VALIDATOR ] DEI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:13.947697] [INFO ] [MAIN ] DEI: Combined data validation passed. [2025-09-05T18:14:13.952562] [INFO ] [MAIN ] DELL: Combined data validation passed. [2025-09-05T18:14:13.952681] [WARN ] [VALIDATOR ] DECK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:13.954256] [INFO ] [MAIN ] DECK: Combined data validation passed. [2025-09-05T18:14:14.370944] [INFO ] [MAIN ] DECK: Update completed successfully. [2025-09-05T18:14:14.374567] [INFO ] [MAIN ] Update Progress: 601/2363 symbols completed. DECK took 4.1s. Estimated remaining: 41m 34s. Rate: 42.4 symbols/min [2025-09-05T18:14:14.473311] [INFO ] [MAIN ] DEI: Update completed successfully. [2025-09-05T18:14:14.495477] [INFO ] [MAIN ] Update Progress: 602/2363 symbols completed. DEI took 4.3s. Estimated remaining: 41m 28s. Rate: 42.5 symbols/min [2025-09-05T18:14:14.645988] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:14.741936] [INFO ] [MAIN ] DELL: Update completed successfully. [2025-09-05T18:14:14.786842] [INFO ] [MAIN ] Update Progress: 603/2363 symbols completed. DELL took 4.5s. Estimated remaining: 41m 24s. Rate: 42.5 symbols/min [2025-09-05T18:14:14.829037] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:14.915502] [INFO ] [MAIN ] DEO: Loaded 23653 existing records. [2025-09-05T18:14:15.127876] [INFO ] [MAIN ] DFH: Loaded 15585 existing records. [2025-09-05T18:14:15.127228] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:15.159901] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-05T18:14:15.275396] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-05T18:14:15.337064] [INFO ] [MAIN ] DFIN: Loaded 9805 existing records. [2025-09-05T18:14:15.343151] [INFO ] [MAIN ] DEO: Found 1 missing trading days. [2025-09-05T18:14:15.343518] [INFO ] [MAIN ] DEO: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:15.388616] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-05T18:14:15.509548] [INFO ] [MAIN ] DFH: Found 1 missing trading days. [2025-09-05T18:14:15.517065] [INFO ] [MAIN ] DFH: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:15.520668] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-05T18:14:15.594000] [INFO ] [MAIN ] DFIN: Found 1 missing trading days. [2025-09-05T18:14:15.594155] [INFO ] [MAIN ] DFIN: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:15.863488] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-05T18:14:16.045858] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:14:16.112092] [INFO ] [MAIN ] DFH: Adding 0 new records, updating 0 existing records. [2025-09-05T18:14:16.113815] [INFO ] [MAIN ] DFH: Combined dataset has 15585 total records. [2025-09-05T18:14:16.114309] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:14:16.114406] [FATAL] [MAIN ] DFH: Combined data validation failed. [2025-09-05T18:14:16.114445] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:14:16.114485] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-05T18:14:16.114946] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-09-05T18:14:16.117069] [INFO ] [MAIN ] Update Progress: 604/2363 symbols completed. DFH took 1.6s. Estimated remaining: 41m 22s. Rate: 42.5 symbols/min [2025-09-05T18:14:16.249381] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:14:16.261103] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:14:16.372125] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:16.438062] [INFO ] [MAIN ] DFIN: Adding 116 new records, updating 0 existing records. [2025-09-05T18:14:16.512808] [INFO ] [MAIN ] DEO: Adding 341 new records, updating 0 existing records. [2025-09-05T18:14:16.513488] [INFO ] [MAIN ] DFIN: Combined dataset has 9921 total records. [2025-09-05T18:14:16.516778] [INFO ] [MAIN ] DFP: Loaded 5584 existing records. [2025-09-05T18:14:16.725354] [INFO ] [MAIN ] DEO: Combined dataset has 23994 total records. [2025-09-05T18:14:16.935738] [INFO ] [MAIN ] DFP: Found 1 missing trading days. [2025-09-05T18:14:16.971738] [INFO ] [MAIN ] DFP: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:16.966477] [WARN ] [VALIDATOR ] DFIN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:16.974582] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-05T18:14:17.175310] [WARN ] [VALIDATOR ] DEO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:17.465171] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-05T18:14:17.474428] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-05T18:14:17.489588] [WARN ] [VALIDATOR ] DEO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:17.489654] [WARN ] [VALIDATOR ] DFIN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:17.489876] [INFO ] [MAIN ] DEO: Combined data validation passed. [2025-09-05T18:14:17.490008] [INFO ] [MAIN ] DFIN: Combined data validation passed. [2025-09-05T18:14:17.646596] [INFO ] [MAIN ] DFIN: Update completed successfully. [2025-09-05T18:14:17.651125] [INFO ] [MAIN ] Update Progress: 605/2363 symbols completed. DFIN took 2.8s. Estimated remaining: 41m 21s. Rate: 42.5 symbols/min [2025-09-05T18:14:17.839491] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:17.870117] [INFO ] [MAIN ] DEO: Update completed successfully. [2025-09-05T18:14:17.873285] [INFO ] [MAIN ] Update Progress: 606/2363 symbols completed. DEO took 3.5s. Estimated remaining: 41m 16s. Rate: 42.6 symbols/min [2025-09-05T18:14:18.014727] [INFO ] [MAIN ] DG: Loaded 25405 existing records. [2025-09-05T18:14:18.151598] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:18.255172] [INFO ] [MAIN ] DG: Found 1 missing trading days. [2025-09-05T18:14:18.255341] [INFO ] [MAIN ] DG: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:18.264456] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-05T18:14:18.265816] [INFO ] [MAIN ] DGX: Loaded 21157 existing records. [2025-09-05T18:14:18.373533] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T18:14:18.458515] [INFO ] [MAIN ] DFP: Adding 126 new records, updating 0 existing records. [2025-09-05T18:14:18.496963] [INFO ] [MAIN ] DGX: Found 1 missing trading days. [2025-09-05T18:14:18.497074] [INFO ] [MAIN ] DGX: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:18.497818] [INFO ] [MAIN ] DFP: Combined dataset has 5710 total records. [2025-09-05T18:14:18.676870] [WARN ] [VALIDATOR ] DFP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:18.907818] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-05T18:14:18.934263] [WARN ] [VALIDATOR ] DFP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:18.934513] [INFO ] [MAIN ] DFP: Combined data validation passed. [2025-09-05T18:14:18.975149] [INFO ] [MAIN ] DFP: Update completed successfully. [2025-09-05T18:14:18.976413] [INFO ] [MAIN ] Update Progress: 607/2363 symbols completed. DFP took 2.9s. Estimated remaining: 41m 14s. Rate: 42.6 symbols/min [2025-09-05T18:14:19.066956] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-05T18:14:19.098959] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:14:19.255739] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:19.333069] [INFO ] [MAIN ] DG: Adding 383 new records, updating 0 existing records. [2025-09-05T18:14:19.339465] [INFO ] [MAIN ] DHF: Loaded 10736 existing records. [2025-09-05T18:14:19.443329] [INFO ] [MAIN ] DG: Combined dataset has 25788 total records. [2025-09-05T18:14:19.607412] [INFO ] [MAIN ] DHF: Found 1 missing trading days. [2025-09-05T18:14:19.617895] [INFO ] [MAIN ] DHF: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:19.700918] [WARN ] [VALIDATOR ] DG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:19.873565] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-05T18:14:19.898338] [WARN ] [VALIDATOR ] DG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:19.898549] [INFO ] [MAIN ] DG: Combined data validation passed. [2025-09-05T18:14:20.067986] [INFO ] [MAIN ] DG: Update completed successfully. [2025-09-05T18:14:20.072043] [INFO ] [MAIN ] Update Progress: 608/2363 symbols completed. DG took 2.4s. Estimated remaining: 41m 12s. Rate: 42.6 symbols/min [2025-09-05T18:14:20.242899] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:20.269571] [INFO ] [MAIN ] DHI: Loaded 25547 existing records. [2025-09-05T18:14:20.472768] [INFO ] [MAIN ] DHI: Found 1 missing trading days. [2025-09-05T18:14:20.473072] [INFO ] [MAIN ] DHI: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:20.535592] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-05T18:14:20.556927] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:14:20.668609] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-05T18:14:20.678738] [INFO ] [MAIN ] DGX: Adding 295 new records, updating 0 existing records. [2025-09-05T18:14:20.685319] [INFO ] [MAIN ] DGX: Combined dataset has 21452 total records. [2025-09-05T18:14:20.869341] [WARN ] [VALIDATOR ] DGX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:21.062501] [WARN ] [VALIDATOR ] DGX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:21.062753] [INFO ] [MAIN ] DGX: Combined data validation passed. [2025-09-05T18:14:21.202341] [INFO ] [MAIN ] DGX: Update completed successfully. [2025-09-05T18:14:21.204885] [INFO ] [MAIN ] Update Progress: 609/2363 symbols completed. DGX took 3.3s. Estimated remaining: 41m 9s. Rate: 42.6 symbols/min [2025-09-05T18:14:21.376692] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:21.402891] [INFO ] [MAIN ] DHR: Loaded 25481 existing records. [2025-09-05T18:14:21.468629] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-05T18:14:21.585410] [INFO ] [MAIN ] DHR: Found 1 missing trading days. [2025-09-05T18:14:21.585725] [INFO ] [MAIN ] DHR: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:21.593458] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:14:21.739966] [INFO ] [MAIN ] DHI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:14:21.743251] [INFO ] [MAIN ] DHI: Combined dataset has 25937 total records. [2025-09-05T18:14:21.919044] [WARN ] [VALIDATOR ] DHI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:22.109144] [WARN ] [VALIDATOR ] DHI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:22.109350] [INFO ] [MAIN ] DHI: Combined data validation passed. [2025-09-05T18:14:22.263915] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-05T18:14:22.274598] [INFO ] [MAIN ] DHI: Update completed successfully. [2025-09-05T18:14:22.277633] [INFO ] [MAIN ] Update Progress: 610/2363 symbols completed. DHI took 2.2s. Estimated remaining: 41m 7s. Rate: 42.6 symbols/min [2025-09-05T18:14:22.448126] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:22.469784] [INFO ] [MAIN ] DHT: Loaded 22468 existing records. [2025-09-05T18:14:22.652100] [INFO ] [MAIN ] DHT: Found 1 missing trading days. [2025-09-05T18:14:22.652252] [INFO ] [MAIN ] DHT: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:22.671591] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:14:22.717940] [INFO ] [MAIN ] DHF: Adding 90 new records, updating 0 existing records. [2025-09-05T18:14:22.720182] [INFO ] [MAIN ] DHF: Combined dataset has 10826 total records. [2025-09-05T18:14:22.895682] [WARN ] [VALIDATOR ] DHF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:23.072166] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-05T18:14:23.083058] [WARN ] [VALIDATOR ] DHF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:23.083250] [INFO ] [MAIN ] DHF: Combined data validation passed. [2025-09-05T18:14:23.148999] [INFO ] [MAIN ] DHF: Update completed successfully. [2025-09-05T18:14:23.150433] [INFO ] [MAIN ] Update Progress: 611/2363 symbols completed. DHF took 4.2s. Estimated remaining: 41m 4s. Rate: 42.7 symbols/min [2025-09-05T18:14:23.319765] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:23.326347] [INFO ] [MAIN ] DHX: Loaded 5266 existing records. [2025-09-05T18:14:23.497049] [INFO ] [MAIN ] DHX: Found 1 missing trading days. [2025-09-05T18:14:23.497209] [INFO ] [MAIN ] DHX: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:23.732587] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-05T18:14:23.746838] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:14:23.868542] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-05T18:14:23.896394] [INFO ] [MAIN ] DHR: Adding 384 new records, updating 0 existing records. [2025-09-05T18:14:23.899850] [INFO ] [MAIN ] DHR: Combined dataset has 25865 total records. [2025-09-05T18:14:24.135723] [WARN ] [VALIDATOR ] DHR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:24.326792] [WARN ] [VALIDATOR ] DHR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:24.326986] [INFO ] [MAIN ] DHR: Combined data validation passed. [2025-09-05T18:14:24.489008] [INFO ] [MAIN ] DHR: Update completed successfully. [2025-09-05T18:14:24.491980] [INFO ] [MAIN ] Update Progress: 612/2363 symbols completed. DHR took 3.3s. Estimated remaining: 41m 2s. Rate: 42.7 symbols/min [2025-09-05T18:14:24.671841] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-05T18:14:24.674329] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:24.682423] [INFO ] [MAIN ] DIAX: Loaded 5961 existing records. [2025-09-05T18:14:24.852440] [INFO ] [MAIN ] DIAX: Found 1 missing trading days. [2025-09-05T18:14:24.852592] [INFO ] [MAIN ] DIAX: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:24.998818] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-05T18:14:25.213796] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:14:25.268277] [INFO ] [MAIN ] DHX: Adding 120 new records, updating 0 existing records. [2025-09-05T18:14:25.269944] [INFO ] [MAIN ] DHX: Combined dataset has 5386 total records. [2025-09-05T18:14:25.446852] [WARN ] [VALIDATOR ] DHX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:25.468690] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-05T18:14:25.636753] [WARN ] [VALIDATOR ] DHX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:25.636952] [INFO ] [MAIN ] DHX: Combined data validation passed. [2025-09-05T18:14:25.669520] [INFO ] [MAIN ] DHX: Update completed successfully. [2025-09-05T18:14:25.670444] [INFO ] [MAIN ] Update Progress: 613/2363 symbols completed. DHX took 2.5s. Estimated remaining: 41m 0s. Rate: 42.7 symbols/min [2025-09-05T18:14:25.840690] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:25.858059] [INFO ] [MAIN ] DIN: Loaded 17235 existing records. [2025-09-05T18:14:26.031294] [INFO ] [MAIN ] DIN: Found 1 missing trading days. [2025-09-05T18:14:26.031482] [INFO ] [MAIN ] DIN: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:26.263419] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-05T18:14:26.717722] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-05T18:14:26.834549] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:14:26.943489] [INFO ] [MAIN ] DIN: Adding 316 new records, updating 0 existing records. [2025-09-05T18:14:26.946185] [INFO ] [MAIN ] DIN: Combined dataset has 17551 total records. [2025-09-05T18:14:27.068543] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-05T18:14:27.127504] [WARN ] [VALIDATOR ] DIN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:27.322051] [WARN ] [VALIDATOR ] DIN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:27.322283] [INFO ] [MAIN ] DIN: Combined data validation passed. [2025-09-05T18:14:27.430616] [INFO ] [MAIN ] DIN: Update completed successfully. [2025-09-05T18:14:27.432841] [INFO ] [MAIN ] Update Progress: 614/2363 symbols completed. DIN took 1.8s. Estimated remaining: 41m 0s. Rate: 42.7 symbols/min [2025-09-05T18:14:27.603667] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:27.629320] [INFO ] [MAIN ] DINO: Loaded 25274 existing records. [2025-09-05T18:14:27.807533] [INFO ] [MAIN ] DINO: Found 1 missing trading days. [2025-09-05T18:14:27.807735] [INFO ] [MAIN ] DINO: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:27.863458] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-05T18:14:28.292988] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T18:14:28.295357] [INFO ] [REMOTE ] DEC: Full fetch complete (33954 records). [2025-09-05T18:14:28.602392] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:14:28.666162] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-05T18:14:28.757698] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-05T18:14:28.831778] [INFO ] [MAIN ] DHT: Adding 368 new records, updating 0 existing records. [2025-09-05T18:14:28.928870] [INFO ] [MAIN ] DHT: Combined dataset has 22836 total records. [2025-09-05T18:14:29.122675] [WARN ] [VALIDATOR ] DHT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:29.345425] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-05T18:14:29.346163] [INFO ] [MAIN ] Update Progress: 615/2363 symbols completed. DEC took 19.1s. Estimated remaining: 41m 0s. Rate: 42.6 symbols/min [2025-09-05T18:14:29.435074] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:14:29.484600] [INFO ] [MAIN ] DIAX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:14:29.479773] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-05T18:14:29.515346] [INFO ] [MAIN ] DIAX: Combined dataset has 5961 total records. [2025-09-05T18:14:29.536174] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:14:29.550806] [FATAL] [MAIN ] DIAX: Combined data validation failed. [2025-09-05T18:14:29.570743] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:14:29.570967] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-05T18:14:29.575300] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:29.576230] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-05T18:14:29.577721] [INFO ] [MAIN ] Update Progress: 616/2363 symbols completed. DIAX took 5.1s. Estimated remaining: 40m 55s. Rate: 42.7 symbols/min [2025-09-05T18:14:29.704878] [WARN ] [VALIDATOR ] DHT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:29.746379] [INFO ] [MAIN ] DHT: Combined data validation passed. [2025-09-05T18:14:29.783218] [INFO ] [MAIN ] DIS: Loaded 25768 existing records. [2025-09-05T18:14:29.781160] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:29.974237] [INFO ] [MAIN ] DIVY: Loaded 483 existing records. [2025-09-05T18:14:30.149779] [INFO ] [MAIN ] DIS: Found 1 missing trading days. [2025-09-05T18:14:30.184719] [INFO ] [MAIN ] DIS: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:30.217607] [INFO ] [MAIN ] DHT: Update completed successfully. [2025-09-05T18:14:30.229953] [INFO ] [MAIN ] Update Progress: 617/2363 symbols completed. DHT took 8.0s. Estimated remaining: 40m 52s. Rate: 42.7 symbols/min [2025-09-05T18:14:30.240606] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:14:30.269713] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-05T18:14:30.481915] [INFO ] [MAIN ] DIVY: Found 1 missing trading days. [2025-09-05T18:14:30.507612] [INFO ] [MAIN ] DIVY: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:30.617425] [INFO ] [MAIN ] DINO: Adding 378 new records, updating 0 existing records. [2025-09-05T18:14:30.635599] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:30.639607] [INFO ] [MAIN ] DINO: Combined dataset has 25652 total records. [2025-09-05T18:14:30.841310] [INFO ] [MAIN ] DK: Loaded 23677 existing records. [2025-09-05T18:14:30.844742] [WARN ] [VALIDATOR ] DINO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:31.063463] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-05T18:14:31.219072] [INFO ] [MAIN ] DK: Found 1 missing trading days. [2025-09-05T18:14:31.237867] [INFO ] [MAIN ] DK: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:31.239207] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:14:31.394391] [INFO ] [MAIN ] DIS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:14:31.399175] [INFO ] [MAIN ] DIS: Combined dataset has 26158 total records. [2025-09-05T18:14:31.584955] [WARN ] [VALIDATOR ] DIS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:31.671972] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:14:31.691078] [INFO ] [MAIN ] DIVY: Adding 6 new records, updating 0 existing records. [2025-09-05T18:14:31.698059] [INFO ] [MAIN ] DIVY: Combined dataset has 489 total records. [2025-09-05T18:14:31.864202] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-05T18:14:31.989903] [WARN ] [VALIDATOR ] DIVY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:32.170868] [WARN ] [VALIDATOR ] DINO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:32.171014] [INFO ] [MAIN ] DINO: Combined data validation passed. [2025-09-05T18:14:32.342600] [WARN ] [VALIDATOR ] DIVY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:32.344295] [WARN ] [VALIDATOR ] DIS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:32.345965] [INFO ] [MAIN ] DIS: Combined data validation passed. [2025-09-05T18:14:32.345878] [INFO ] [MAIN ] DIVY: Combined data validation passed. [2025-09-05T18:14:32.348014] [INFO ] [MAIN ] DINO: Update completed successfully. [2025-09-05T18:14:32.354420] [INFO ] [MAIN ] Update Progress: 618/2363 symbols completed. DINO took 4.9s. Estimated remaining: 40m 52s. Rate: 42.7 symbols/min [2025-09-05T18:14:32.355576] [INFO ] [MAIN ] DIVY: Update completed successfully. [2025-09-05T18:14:32.356157] [INFO ] [MAIN ] Update Progress: 619/2363 symbols completed. DIVY took 2.8s. Estimated remaining: 40m 47s. Rate: 42.8 symbols/min [2025-09-05T18:14:32.761603] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:32.825307] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:32.838710] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:14:32.896884] [INFO ] [MAIN ] DKL: Loaded 6970 existing records. [2025-09-05T18:14:33.128669] [INFO ] [MAIN ] DKS: Loaded 23971 existing records. [2025-09-05T18:14:33.154222] [INFO ] [MAIN ] DK: Adding 379 new records, updating 0 existing records. [2025-09-05T18:14:33.319035] [INFO ] [MAIN ] DKL: Found 1 missing trading days. [2025-09-05T18:14:33.336234] [INFO ] [MAIN ] DK: Combined dataset has 24056 total records. [2025-09-05T18:14:33.347387] [INFO ] [MAIN ] DKL: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:33.348856] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-05T18:14:33.508043] [INFO ] [MAIN ] DIS: Update completed successfully. [2025-09-05T18:14:33.525396] [INFO ] [MAIN ] Update Progress: 620/2363 symbols completed. DIS took 4.2s. Estimated remaining: 40m 45s. Rate: 42.8 symbols/min [2025-09-05T18:14:33.536145] [INFO ] [MAIN ] DKS: Found 1 missing trading days. [2025-09-05T18:14:33.536494] [INFO ] [MAIN ] DKS: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:33.567051] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-05T18:14:33.693726] [WARN ] [VALIDATOR ] DK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:33.870515] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:33.890372] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:14:34.007387] [INFO ] [MAIN ] DKL: Adding 126 new records, updating 0 existing records. [2025-09-05T18:14:34.025528] [INFO ] [MAIN ] DLB: Loaded 14437 existing records. [2025-09-05T18:14:34.070057] [INFO ] [MAIN ] DKL: Combined dataset has 7096 total records. [2025-09-05T18:14:34.384412] [INFO ] [MAIN ] DLB: Found 1 missing trading days. [2025-09-05T18:14:34.389813] [INFO ] [MAIN ] DLB: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:34.389494] [WARN ] [VALIDATOR ] DKL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:34.390591] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-05T18:14:34.431337] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:14:34.737760] [INFO ] [MAIN ] DKS: Adding 372 new records, updating 0 existing records. [2025-09-05T18:14:34.743092] [INFO ] [MAIN ] DKS: Combined dataset has 24343 total records. [2025-09-05T18:14:34.930045] [WARN ] [VALIDATOR ] DKS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:34.988858] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:14:35.172494] [WARN ] [VALIDATOR ] DKL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:35.222767] [INFO ] [MAIN ] DLB: Adding 238 new records, updating 0 existing records. [2025-09-05T18:14:35.172560] [WARN ] [VALIDATOR ] DK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:35.223687] [INFO ] [MAIN ] DK: Combined data validation passed. [2025-09-05T18:14:35.223556] [INFO ] [MAIN ] DKL: Combined data validation passed. [2025-09-05T18:14:35.229171] [INFO ] [MAIN ] DLB: Combined dataset has 14675 total records. [2025-09-05T18:14:35.474623] [INFO ] [MAIN ] DKL: Update completed successfully. [2025-09-05T18:14:35.534523] [INFO ] [MAIN ] Update Progress: 621/2363 symbols completed. DKL took 3.2s. Estimated remaining: 40m 45s. Rate: 42.7 symbols/min [2025-09-05T18:14:35.562891] [WARN ] [VALIDATOR ] DLB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:35.783279] [INFO ] [MAIN ] DK: Update completed successfully. [2025-09-05T18:14:35.811535] [INFO ] [MAIN ] Update Progress: 622/2363 symbols completed. DK took 5.6s. Estimated remaining: 40m 41s. Rate: 42.8 symbols/min [2025-09-05T18:14:36.031043] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:36.103189] [INFO ] [MAIN ] DLNG: Loaded 2318 existing records. [2025-09-05T18:14:36.152552] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:36.307734] [WARN ] [VALIDATOR ] DKS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:36.347065] [INFO ] [MAIN ] DLNG: Found 1 missing trading days. [2025-09-05T18:14:36.347279] [INFO ] [MAIN ] DLNG: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:36.347598] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-05T18:14:36.347836] [INFO ] [MAIN ] DKS: Combined data validation passed. [2025-09-05T18:14:36.347355] [WARN ] [VALIDATOR ] DLB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:36.349058] [INFO ] [MAIN ] DLB: Combined data validation passed. [2025-09-05T18:14:36.519634] [INFO ] [MAIN ] DLR: Loaded 24062 existing records. [2025-09-05T18:14:36.719052] [INFO ] [MAIN ] DLR: Found 1 missing trading days. [2025-09-05T18:14:36.721929] [INFO ] [MAIN ] DLR: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:36.723325] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-05T18:14:36.740593] [INFO ] [MAIN ] DLB: Update completed successfully. [2025-09-05T18:14:36.742509] [INFO ] [MAIN ] Update Progress: 623/2363 symbols completed. DLB took 3.2s. Estimated remaining: 40m 38s. Rate: 42.8 symbols/min [2025-09-05T18:14:36.832932] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:14:36.887963] [INFO ] [MAIN ] DLNG: Adding 61 new records, updating 0 existing records. [2025-09-05T18:14:36.939639] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:36.942022] [INFO ] [MAIN ] DLNG: Combined dataset has 2379 total records. [2025-09-05T18:14:37.099838] [INFO ] [MAIN ] DLX: Loaded 13954 existing records. [2025-09-05T18:14:37.175869] [WARN ] [VALIDATOR ] DLNG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:37.251977] [INFO ] [MAIN ] DKS: Update completed successfully. [2025-09-05T18:14:37.273656] [INFO ] [MAIN ] Update Progress: 624/2363 symbols completed. DKS took 4.8s. Estimated remaining: 40m 34s. Rate: 42.9 symbols/min [2025-09-05T18:14:37.342697] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:14:37.580518] [INFO ] [MAIN ] DLX: Found 1 missing trading days. [2025-09-05T18:14:37.621700] [INFO ] [MAIN ] DLX: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:37.643110] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-05T18:14:37.849092] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:37.879532] [INFO ] [MAIN ] DLR: Adding 372 new records, updating 0 existing records. [2025-09-05T18:14:37.890686] [INFO ] [MAIN ] DLY: Loaded 9323 existing records. [2025-09-05T18:14:37.890905] [INFO ] [MAIN ] DLR: Combined dataset has 24434 total records. [2025-09-05T18:14:38.171840] [INFO ] [MAIN ] DLY: Found 1 missing trading days. [2025-09-05T18:14:38.187627] [INFO ] [MAIN ] DLY: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:38.187895] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-05T18:14:38.246181] [WARN ] [VALIDATOR ] DLR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:38.352858] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:14:38.510109] [INFO ] [MAIN ] DLX: Adding 191 new records, updating 0 existing records. [2025-09-05T18:14:38.514390] [INFO ] [MAIN ] DLX: Combined dataset has 14145 total records. [2025-09-05T18:14:38.695704] [WARN ] [VALIDATOR ] DLX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:38.885353] [WARN ] [VALIDATOR ] DLNG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:38.885821] [INFO ] [MAIN ] DLNG: Combined data validation passed. [2025-09-05T18:14:38.902738] [INFO ] [MAIN ] DLNG: Update completed successfully. [2025-09-05T18:14:38.903488] [INFO ] [MAIN ] Update Progress: 625/2363 symbols completed. DLNG took 3.3s. Estimated remaining: 40m 33s. Rate: 42.9 symbols/min [2025-09-05T18:14:39.081155] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:39.090957] [INFO ] [MAIN ] DMA: Loaded 2093 existing records. [2025-09-05T18:14:39.092695] [WARN ] [VALIDATOR ] DLX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:39.104151] [WARN ] [VALIDATOR ] DLR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:39.129128] [INFO ] [MAIN ] DLX: Combined data validation passed. [2025-09-05T18:14:39.148177] [INFO ] [MAIN ] DLR: Combined data validation passed. [2025-09-05T18:14:39.371212] [INFO ] [MAIN ] DMA: Found 1 missing trading days. [2025-09-05T18:14:39.379758] [INFO ] [MAIN ] DMA: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:39.423606] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-05T18:14:39.461002] [INFO ] [MAIN ] DLX: Update completed successfully. [2025-09-05T18:14:39.463321] [INFO ] [MAIN ] Update Progress: 626/2363 symbols completed. DLX took 2.7s. Estimated remaining: 40m 30s. Rate: 42.9 symbols/min [2025-09-05T18:14:39.582186] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-05T18:14:39.711125] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:39.717122] [INFO ] [MAIN ] DLY: Adding 226 new records, updating 0 existing records. [2025-09-05T18:14:39.729443] [INFO ] [MAIN ] DLY: Combined dataset has 9549 total records. [2025-09-05T18:14:39.729135] [INFO ] [MAIN ] DMB: Loaded 5125 existing records. [2025-09-05T18:14:40.074576] [WARN ] [VALIDATOR ] DLY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:40.123275] [INFO ] [MAIN ] DMB: Found 1 missing trading days. [2025-09-05T18:14:40.148860] [INFO ] [MAIN ] DMB: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:40.157383] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-05T18:14:40.163636] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:14:40.214504] [INFO ] [MAIN ] DMA: Adding 139 new records, updating 0 existing records. [2025-09-05T18:14:40.234947] [INFO ] [MAIN ] DLR: Update completed successfully. [2025-09-05T18:14:40.228942] [INFO ] [MAIN ] DMA: Combined dataset has 2232 total records. [2025-09-05T18:14:40.242996] [INFO ] [MAIN ] Update Progress: 627/2363 symbols completed. DLR took 4.4s. Estimated remaining: 40m 27s. Rate: 42.9 symbols/min [2025-09-05T18:14:40.622527] [WARN ] [VALIDATOR ] DMA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:40.804739] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:40.884586] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:14:40.942772] [INFO ] [MAIN ] DMO: Loaded 4773 existing records. [2025-09-05T18:14:40.942480] [INFO ] [MAIN ] DMB: Adding 118 new records, updating 0 existing records. [2025-09-05T18:14:41.026869] [INFO ] [MAIN ] DMB: Combined dataset has 5243 total records. [2025-09-05T18:14:41.089822] [WARN ] [VALIDATOR ] DLY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:41.117910] [INFO ] [MAIN ] DLY: Combined data validation passed. [2025-09-05T18:14:41.138580] [WARN ] [VALIDATOR ] DMA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:41.173991] [INFO ] [MAIN ] DMA: Combined data validation passed. [2025-09-05T18:14:41.251613] [INFO ] [MAIN ] DMO: Found 1 missing trading days. [2025-09-05T18:14:41.253002] [INFO ] [MAIN ] DMO: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:41.269928] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-05T18:14:41.391926] [WARN ] [VALIDATOR ] DMB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:41.454376] [INFO ] [MAIN ] DMA: Update completed successfully. [2025-09-05T18:14:41.468627] [INFO ] [MAIN ] Update Progress: 628/2363 symbols completed. DMA took 2.6s. Estimated remaining: 40m 25s. Rate: 42.9 symbols/min [2025-09-05T18:14:41.765913] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:41.771593] [INFO ] [MAIN ] DLY: Update completed successfully. [2025-09-05T18:14:41.773164] [INFO ] [MAIN ] Update Progress: 629/2363 symbols completed. DLY took 4.5s. Estimated remaining: 40m 20s. Rate: 43.0 symbols/min [2025-09-05T18:14:41.917874] [INFO ] [MAIN ] DNA: Loaded 23177 existing records. [2025-09-05T18:14:41.998878] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:42.157282] [INFO ] [MAIN ] DNA: Found 1 missing trading days. [2025-09-05T18:14:42.158666] [INFO ] [MAIN ] DNA: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:42.164927] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-05T18:14:42.168709] [INFO ] [MAIN ] DNOW: Loaded 20778 existing records. [2025-09-05T18:14:42.213199] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:14:42.297115] [INFO ] [MAIN ] DMO: Adding 35 new records, updating 0 existing records. [2025-09-05T18:14:42.349593] [INFO ] [MAIN ] DMO: Combined dataset has 4808 total records. [2025-09-05T18:14:42.384667] [INFO ] [MAIN ] DNOW: Found 1 missing trading days. [2025-09-05T18:14:42.410590] [INFO ] [MAIN ] DNOW: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:42.411011] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-05T18:14:42.563430] [WARN ] [VALIDATOR ] DMO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:42.663871] [WARN ] [VALIDATOR ] DMB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:42.664089] [INFO ] [MAIN ] DMB: Combined data validation passed. [2025-09-05T18:14:42.775821] [INFO ] [MAIN ] DMB: Update completed successfully. [2025-09-05T18:14:42.777070] [INFO ] [MAIN ] Update Progress: 630/2363 symbols completed. DMB took 3.3s. Estimated remaining: 40m 18s. Rate: 43.0 symbols/min [2025-09-05T18:14:42.955422] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:42.956266] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:14:43.049974] [INFO ] [MAIN ] DNP: Loaded 15320 existing records. [2025-09-05T18:14:43.163034] [INFO ] [MAIN ] DNA: Adding 368 new records, updating 0 existing records. [2025-09-05T18:14:43.271941] [INFO ] [MAIN ] DNA: Combined dataset has 23545 total records. [2025-09-05T18:14:43.279307] [INFO ] [MAIN ] DNP: Found 1 missing trading days. [2025-09-05T18:14:43.279759] [INFO ] [MAIN ] DNP: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:43.290942] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-05T18:14:43.349665] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:14:43.566943] [WARN ] [VALIDATOR ] DNA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:43.604532] [INFO ] [MAIN ] DNOW: Adding 308 new records, updating 0 existing records. [2025-09-05T18:14:43.731745] [INFO ] [MAIN ] DNOW: Combined dataset has 21086 total records. [2025-09-05T18:14:43.958175] [WARN ] [VALIDATOR ] DNOW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:43.958918] [WARN ] [VALIDATOR ] DMO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:43.979969] [INFO ] [MAIN ] DMO: Combined data validation passed. [2025-09-05T18:14:44.136296] [INFO ] [MAIN ] DMO: Update completed successfully. [2025-09-05T18:14:44.173919] [INFO ] [MAIN ] Update Progress: 631/2363 symbols completed. DMO took 3.9s. Estimated remaining: 40m 16s. Rate: 43.0 symbols/min [2025-09-05T18:14:44.352947] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:44.373702] [WARN ] [VALIDATOR ] DNOW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:44.373996] [INFO ] [MAIN ] DNOW: Combined data validation passed. [2025-09-05T18:14:44.373800] [WARN ] [VALIDATOR ] DNA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:44.374688] [INFO ] [MAIN ] DNA: Combined data validation passed. [2025-09-05T18:14:44.384970] [INFO ] [MAIN ] DOC: Loaded 25572 existing records. [2025-09-05T18:14:44.740856] [INFO ] [MAIN ] DOC: Found 1 missing trading days. [2025-09-05T18:14:44.742325] [INFO ] [MAIN ] DOC: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:44.742943] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-05T18:14:44.752947] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:14:44.856106] [INFO ] [MAIN ] DNP: Adding 211 new records, updating 0 existing records. [2025-09-05T18:14:44.873806] [INFO ] [MAIN ] DNP: Combined dataset has 15531 total records. [2025-09-05T18:14:45.087994] [WARN ] [VALIDATOR ] DNP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:45.121366] [INFO ] [MAIN ] DNA: Update completed successfully. [2025-09-05T18:14:45.150072] [INFO ] [MAIN ] Update Progress: 632/2363 symbols completed. DNA took 3.7s. Estimated remaining: 40m 14s. Rate: 43.0 symbols/min [2025-09-05T18:14:45.389808] [INFO ] [MAIN ] DNOW: Update completed successfully. [2025-09-05T18:14:45.406706] [INFO ] [MAIN ] Update Progress: 633/2363 symbols completed. DNOW took 3.6s. Estimated remaining: 40m 9s. Rate: 43.1 symbols/min [2025-09-05T18:14:45.468562] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:45.539607] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:14:45.770341] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:45.827821] [INFO ] [MAIN ] DOC: Adding 389 new records, updating 0 existing records. [2025-09-05T18:14:45.841121] [INFO ] [MAIN ] DOCN: Loaded 38129 existing records. [2025-09-05T18:14:45.958499] [INFO ] [MAIN ] DOC: Combined dataset has 25961 total records. [2025-09-05T18:14:46.127889] [INFO ] [MAIN ] DOCS: Loaded 38625 existing records. [2025-09-05T18:14:46.129842] [INFO ] [MAIN ] DOCN: Found 1 missing trading days. [2025-09-05T18:14:46.151789] [INFO ] [MAIN ] DOCN: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:46.189797] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-05T18:14:46.328357] [WARN ] [VALIDATOR ] DOC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:46.516496] [INFO ] [MAIN ] DOCS: Found 1 missing trading days. [2025-09-05T18:14:46.527610] [INFO ] [MAIN ] DOCS: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:46.538384] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-05T18:14:46.615952] [WARN ] [VALIDATOR ] DNP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:46.616339] [INFO ] [MAIN ] DNP: Combined data validation passed. [2025-09-05T18:14:46.620433] [WARN ] [VALIDATOR ] DOC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:46.620547] [INFO ] [MAIN ] DOC: Combined data validation passed. [2025-09-05T18:14:46.863965] [INFO ] [MAIN ] DOC: Update completed successfully. [2025-09-05T18:14:46.871588] [INFO ] [MAIN ] Update Progress: 634/2363 symbols completed. DOC took 2.7s. Estimated remaining: 40m 8s. Rate: 43.1 symbols/min [2025-09-05T18:14:46.919941] [INFO ] [MAIN ] DNP: Update completed successfully. [2025-09-05T18:14:46.953530] [INFO ] [MAIN ] Update Progress: 635/2363 symbols completed. DNP took 4.2s. Estimated remaining: 40m 3s. Rate: 43.1 symbols/min [2025-09-05T18:14:47.127322] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:47.159067] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:14:47.299585] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:47.315244] [WARN ] [MAIN ] DOUG: No existing data found, performing full refresh instead. [2025-09-05T18:14:47.362932] [INFO ] [MAIN ] DOLE: Loaded 17679 existing records. [2025-09-05T18:14:47.357433] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-05T18:14:47.399958] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-05T18:14:47.476832] [INFO ] [MAIN ] DOCN: Adding 386 new records, updating 0 existing records. [2025-09-05T18:14:47.434872] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-05T18:14:47.660194] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T18:14:47.898602] [INFO ] [MAIN ] DOLE: Found 1 missing trading days. [2025-09-05T18:14:47.908998] [INFO ] [MAIN ] DOCN: Combined dataset has 38515 total records. [2025-09-05T18:14:47.914283] [INFO ] [MAIN ] DOLE: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:47.960849] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-05T18:14:48.222015] [INFO ] [MAIN ] DOCS: Adding 330 new records, updating 0 existing records. [2025-09-05T18:14:48.228170] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:14:48.228909] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-05T18:14:48.307879] [WARN ] [VALIDATOR ] DOCN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:14:48.399373] [INFO ] [MAIN ] DOCS: Combined dataset has 38955 total records. [2025-09-05T18:14:48.591371] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:14:48.847676] [INFO ] [MAIN ] DOLE: Adding 384 new records, updating 0 existing records. [2025-09-05T18:14:48.868684] [WARN ] [VALIDATOR ] DOCS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:14:48.987524] [INFO ] [MAIN ] DOLE: Combined dataset has 18063 total records. [2025-09-05T18:14:49.251408] [WARN ] [VALIDATOR ] DOLE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:49.472721] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-05T18:14:49.480857] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-05T18:14:49.483027] [WARN ] [VALIDATOR ] DOCN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:14:49.483869] [INFO ] [MAIN ] DOCN: Combined data validation passed. [2025-09-05T18:14:49.676811] [WARN ] [VALIDATOR ] DOLE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:49.676923] [WARN ] [VALIDATOR ] DOCS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:14:49.677153] [INFO ] [MAIN ] DOLE: Combined data validation passed. [2025-09-05T18:14:49.677268] [INFO ] [MAIN ] DOCS: Combined data validation passed. [2025-09-05T18:14:49.912510] [INFO ] [MAIN ] DOCN: Update completed successfully. [2025-09-05T18:14:49.919978] [INFO ] [MAIN ] Update Progress: 636/2363 symbols completed. DOCN took 4.8s. Estimated remaining: 40m 6s. Rate: 43.1 symbols/min [2025-09-05T18:14:50.139766] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:14:50.235790] [INFO ] [MAIN ] DOLE: Update completed successfully. [2025-09-05T18:14:50.268446] [INFO ] [MAIN ] Update Progress: 637/2363 symbols completed. DOLE took 3.4s. Estimated remaining: 40m 2s. Rate: 43.1 symbols/min [2025-09-05T18:14:50.292327] [INFO ] [MAIN ] DOV: Loaded 21355 existing records. [2025-09-05T18:14:50.624821] [INFO ] [MAIN ] DOCS: Update completed successfully. [2025-09-05T18:14:50.624663] [INFO ] [MAIN ] DOV: Found 1 missing trading days. [2025-09-05T18:14:50.630947] [INFO ] [MAIN ] Update Progress: 638/2363 symbols completed. DOCS took 5.2s. Estimated remaining: 39m 58s. Rate: 43.2 symbols/min [2025-09-05T18:14:50.631042] [INFO ] [MAIN ] DOV: Need to fetch 1 months: 2025-09 [2025-09-05T18:14:50.631626] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-05T18:14:51.086183] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-05T18:14:51.094887] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-05T18:14:51.397196] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:14:51.532945] [INFO ] [MAIN ] DOV: Adding 316 new records, updating 0 existing records. [2025-09-05T18:14:51.536356] [INFO ] [MAIN ] DOV: Combined dataset has 21671 total records. [2025-09-05T18:14:51.716493] [WARN ] [VALIDATOR ] DOV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:14:51.910339] [WARN ] [VALIDATOR ] DOV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:14:51.910546] [INFO ] [MAIN ] DOV: Combined data validation passed. [2025-09-05T18:14:52.046582] [INFO ] [MAIN ] DOV: Update completed successfully. [2025-09-05T18:14:52.048973] [INFO ] [MAIN ] Update Progress: 639/2363 symbols completed. DOV took 2.1s. Estimated remaining: 39m 56s. Rate: 43.2 symbols/min [2025-09-05T18:14:52.667750] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-05T18:14:52.675593] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-05T18:14:54.228883] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-05T18:14:54.237825] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-05T18:14:55.817159] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-05T18:14:55.826043] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-05T18:14:57.490322] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-05T18:14:57.498189] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-05T18:14:58.942711] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-05T18:14:58.950438] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-05T18:15:00.519407] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-05T18:15:00.527546] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-05T18:15:01.430582] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:15:01.432309] [INFO ] [REMOTE ] DOUG: Full fetch complete (38068 records). [2025-09-05T18:15:01.432965] [FATAL] [VALIDATOR ] DOUG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:15:01.433061] [FATAL] [MAIN ] DOUG: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:15:01.433099] [WARN ] [MAIN ] DOUG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:15:01.433139] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-05T18:15:01.433248] [INFO ] [LOCAL ] DOUG: Starting deletion of derivative data. [2025-09-05T18:15:01.433389] [INFO ] [MAIN ] Update Progress: 640/2363 symbols completed. DOUG took 14.5s. Estimated remaining: 40m 17s. Rate: 42.8 symbols/min [2025-09-05T18:15:02.163371] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:02.191185] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:02.243956] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:02.239743] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:02.255633] [INFO ] [MAIN ] DPG: Loaded 6420 existing records. [2025-09-05T18:15:02.418277] [INFO ] [MAIN ] DQ: Loaded 20726 existing records. [2025-09-05T18:15:02.419177] [INFO ] [MAIN ] DRD: Loaded 17320 existing records. [2025-09-05T18:15:02.432209] [INFO ] [MAIN ] DOW: Loaded 25713 existing records. [2025-09-05T18:15:02.742335] [INFO ] [MAIN ] DPG: Found 1 missing trading days. [2025-09-05T18:15:02.831912] [INFO ] [MAIN ] DPG: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:02.887171] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-05T18:15:02.997996] [INFO ] [MAIN ] DQ: Found 1 missing trading days. [2025-09-05T18:15:03.052794] [INFO ] [MAIN ] DQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:03.100731] [INFO ] [MAIN ] DRD: Found 1 missing trading days. [2025-09-05T18:15:03.103836] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-05T18:15:03.109522] [INFO ] [MAIN ] DRD: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:03.110988] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-05T18:15:03.110719] [INFO ] [MAIN ] DOW: Found 1 missing trading days. [2025-09-05T18:15:03.112501] [INFO ] [MAIN ] DOW: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:03.112892] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-05T18:15:03.721909] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:15:03.817027] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:15:03.810411] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:15:03.890084] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:15:03.996355] [INFO ] [MAIN ] DOW: Adding 390 new records, updating 0 existing records. [2025-09-05T18:15:04.045250] [INFO ] [MAIN ] DPG: Adding 77 new records, updating 0 existing records. [2025-09-05T18:15:04.182029] [INFO ] [MAIN ] DPG: Combined dataset has 6497 total records. [2025-09-05T18:15:04.182272] [INFO ] [MAIN ] DRD: Adding 333 new records, updating 0 existing records. [2025-09-05T18:15:04.229368] [INFO ] [MAIN ] DQ: Adding 385 new records, updating 0 existing records. [2025-09-05T18:15:04.297827] [INFO ] [MAIN ] DOW: Combined dataset has 26103 total records. [2025-09-05T18:15:04.429820] [INFO ] [MAIN ] DQ: Combined dataset has 21111 total records. [2025-09-05T18:15:04.390099] [INFO ] [MAIN ] DRD: Combined dataset has 17653 total records. [2025-09-05T18:15:04.540997] [WARN ] [VALIDATOR ] DPG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:04.825788] [WARN ] [VALIDATOR ] DOW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:05.098022] [WARN ] [VALIDATOR ] DQ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:05.202590] [WARN ] [VALIDATOR ] DRD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:05.784878] [WARN ] [VALIDATOR ] DPG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:05.784722] [WARN ] [VALIDATOR ] DOW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:05.787384] [INFO ] [MAIN ] DPG: Combined data validation passed. [2025-09-05T18:15:05.787903] [INFO ] [MAIN ] DOW: Combined data validation passed. [2025-09-05T18:15:05.788196] [WARN ] [VALIDATOR ] DQ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:05.790182] [INFO ] [MAIN ] DQ: Combined data validation passed. [2025-09-05T18:15:05.816942] [WARN ] [VALIDATOR ] DRD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:05.828548] [INFO ] [MAIN ] DRD: Combined data validation passed. [2025-09-05T18:15:06.104436] [INFO ] [MAIN ] DPG: Update completed successfully. [2025-09-05T18:15:06.109623] [INFO ] [MAIN ] Update Progress: 641/2363 symbols completed. DPG took 4.7s. Estimated remaining: 40m 24s. Rate: 42.6 symbols/min [2025-09-05T18:15:06.270853] [INFO ] [MAIN ] DRD: Update completed successfully. [2025-09-05T18:15:06.294966] [INFO ] [MAIN ] Update Progress: 642/2363 symbols completed. DRD took 4.8s. Estimated remaining: 40m 19s. Rate: 42.7 symbols/min [2025-09-05T18:15:06.375190] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:06.466301] [INFO ] [MAIN ] DQ: Update completed successfully. [2025-09-05T18:15:06.506318] [INFO ] [MAIN ] Update Progress: 643/2363 symbols completed. DQ took 5.1s. Estimated remaining: 40m 15s. Rate: 42.7 symbols/min [2025-09-05T18:15:06.669355] [INFO ] [MAIN ] DRH: Loaded 23880 existing records. [2025-09-05T18:15:06.693358] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:06.692242] [INFO ] [MAIN ] DOW: Update completed successfully. [2025-09-05T18:15:06.755660] [INFO ] [MAIN ] Update Progress: 644/2363 symbols completed. DOW took 5.3s. Estimated remaining: 40m 10s. Rate: 42.8 symbols/min [2025-09-05T18:15:06.935911] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:07.006056] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-09-05T18:15:07.006346] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-05T18:15:07.018014] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-05T18:15:07.059963] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-05T18:15:07.029147] [INFO ] [MAIN ] DRI: Loaded 22060 existing records. [2025-09-05T18:15:07.166784] [INFO ] [MAIN ] DRH: Found 1 missing trading days. [2025-09-05T18:15:07.237498] [INFO ] [MAIN ] DRH: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:07.305264] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-05T18:15:07.360535] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:07.666890] [INFO ] [MAIN ] DRI: Found 1 missing trading days. [2025-09-05T18:15:07.697336] [INFO ] [MAIN ] DRI: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:07.697839] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-05T18:15:07.711210] [INFO ] [MAIN ] DSL: Loaded 13430 existing records. [2025-09-05T18:15:07.846980] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:15:07.874325] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-05T18:15:07.959358] [INFO ] [MAIN ] DSL: Found 1 missing trading days. [2025-09-05T18:15:07.959489] [INFO ] [MAIN ] DSL: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:07.959714] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-05T18:15:08.067017] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:15:08.186604] [INFO ] [MAIN ] DRH: Adding 0 new records, updating 0 existing records. [2025-09-05T18:15:08.188353] [INFO ] [MAIN ] DRH: Combined dataset has 23880 total records. [2025-09-05T18:15:08.188830] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:15:08.188908] [FATAL] [MAIN ] DRH: Combined data validation failed. [2025-09-05T18:15:08.188946] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:15:08.188985] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-05T18:15:08.189795] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-09-05T18:15:08.192822] [INFO ] [MAIN ] Update Progress: 645/2363 symbols completed. DRH took 2.1s. Estimated remaining: 40m 9s. Rate: 42.8 symbols/min [2025-09-05T18:15:08.367817] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:08.367971] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-09-05T18:15:08.368096] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-05T18:15:08.368138] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-05T18:15:08.368187] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-05T18:15:08.502000] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:15:08.689995] [INFO ] [MAIN ] DSL: Adding 238 new records, updating 0 existing records. [2025-09-05T18:15:08.790215] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:15:08.864466] [INFO ] [REMOTE ] DSM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:15:08.886583] [INFO ] [MAIN ] DSL: Combined dataset has 13668 total records. [2025-09-05T18:15:08.907491] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-05T18:15:08.886493] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-05T18:15:08.932573] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-05T18:15:08.974359] [INFO ] [MAIN ] DRI: Adding 302 new records, updating 0 existing records. [2025-09-05T18:15:09.148715] [INFO ] [MAIN ] DRI: Combined dataset has 22362 total records. [2025-09-05T18:15:09.154508] [WARN ] [VALIDATOR ] DSL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:09.527374] [WARN ] [VALIDATOR ] DRI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:09.741818] [WARN ] [VALIDATOR ] DRI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:09.742067] [INFO ] [MAIN ] DRI: Combined data validation passed. [2025-09-05T18:15:09.741692] [WARN ] [VALIDATOR ] DSL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:09.742287] [INFO ] [MAIN ] DSL: Combined data validation passed. [2025-09-05T18:15:09.925223] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-05T18:15:09.929991] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-05T18:15:09.949215] [INFO ] [MAIN ] DSL: Update completed successfully. [2025-09-05T18:15:09.952838] [INFO ] [MAIN ] Update Progress: 646/2363 symbols completed. DSL took 3.1s. Estimated remaining: 40m 8s. Rate: 42.8 symbols/min [2025-09-05T18:15:10.130733] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:10.135852] [INFO ] [MAIN ] DSMC: Loaded 713 existing records. [2025-09-05T18:15:10.324682] [INFO ] [MAIN ] DSMC: Found 1 missing trading days. [2025-09-05T18:15:10.325471] [INFO ] [MAIN ] DSMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:10.326497] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-05T18:15:10.329892] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-05T18:15:10.334535] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-05T18:15:10.351182] [INFO ] [MAIN ] DRI: Update completed successfully. [2025-09-05T18:15:10.354146] [INFO ] [MAIN ] Update Progress: 647/2363 symbols completed. DRI took 4.0s. Estimated remaining: 40m 4s. Rate: 42.8 symbols/min [2025-09-05T18:15:10.525468] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:10.536267] [INFO ] [MAIN ] DSU: Loaded 10712 existing records. [2025-09-05T18:15:10.705402] [INFO ] [MAIN ] DSU: Found 1 missing trading days. [2025-09-05T18:15:10.705521] [INFO ] [MAIN ] DSU: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:10.705739] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-05T18:15:10.904452] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-05T18:15:10.908060] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-05T18:15:10.977719] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:15:10.984496] [INFO ] [MAIN ] DSMC: Adding 24 new records, updating 0 existing records. [2025-09-05T18:15:10.985721] [INFO ] [MAIN ] DSMC: Combined dataset has 737 total records. [2025-09-05T18:15:11.161798] [WARN ] [VALIDATOR ] DSMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:11.353521] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-05T18:15:11.359498] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-05T18:15:11.369391] [WARN ] [VALIDATOR ] DSMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:11.369600] [INFO ] [MAIN ] DSMC: Combined data validation passed. [2025-09-05T18:15:11.375514] [INFO ] [MAIN ] DSMC: Update completed successfully. [2025-09-05T18:15:11.375813] [INFO ] [MAIN ] Update Progress: 648/2363 symbols completed. DSMC took 1.4s. Estimated remaining: 40m 2s. Rate: 42.8 symbols/min [2025-09-05T18:15:11.544959] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:11.558150] [INFO ] [MAIN ] DSX: Loaded 11500 existing records. [2025-09-05T18:15:11.775586] [INFO ] [MAIN ] DSX: Found 1 missing trading days. [2025-09-05T18:15:11.775761] [INFO ] [MAIN ] DSX: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:11.775965] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-05T18:15:11.795998] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-05T18:15:11.799115] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-05T18:15:11.823913] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T18:15:11.873219] [INFO ] [MAIN ] DSU: Adding 0 new records, updating 0 existing records. [2025-09-05T18:15:11.874386] [INFO ] [MAIN ] DSU: Combined dataset has 10712 total records. [2025-09-05T18:15:11.874753] [FATAL] [VALIDATOR ] DSU: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:15:11.874839] [FATAL] [MAIN ] DSU: Combined data validation failed. [2025-09-05T18:15:11.874893] [WARN ] [MAIN ] DSU: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:15:11.874959] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-05T18:15:11.875289] [INFO ] [LOCAL ] DSU: Starting deletion of derivative data. [2025-09-05T18:15:11.876220] [INFO ] [MAIN ] Update Progress: 649/2363 symbols completed. DSU took 1.5s. Estimated remaining: 39m 58s. Rate: 42.9 symbols/min [2025-09-05T18:15:12.048314] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:12.071784] [INFO ] [MAIN ] DT: Loaded 25211 existing records. [2025-09-05T18:15:12.249304] [INFO ] [MAIN ] DT: Found 1 missing trading days. [2025-09-05T18:15:12.249437] [INFO ] [MAIN ] DT: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:12.249768] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-05T18:15:12.415339] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:15:12.466359] [INFO ] [MAIN ] DSX: Adding 174 new records, updating 0 existing records. [2025-09-05T18:15:12.468359] [INFO ] [MAIN ] DSX: Combined dataset has 11674 total records. [2025-09-05T18:15:12.647606] [WARN ] [VALIDATOR ] DSX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:12.733816] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-05T18:15:12.769161] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-05T18:15:12.775333] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:15:12.948988] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-05T18:15:12.992830] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-05T18:15:13.028360] [INFO ] [MAIN ] DT: Adding 388 new records, updating 0 existing records. [2025-09-05T18:15:13.032958] [INFO ] [MAIN ] DT: Combined dataset has 25599 total records. [2025-09-05T18:15:13.218246] [WARN ] [VALIDATOR ] DT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:13.408325] [WARN ] [VALIDATOR ] DSX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:13.408708] [INFO ] [MAIN ] DSX: Combined data validation passed. [2025-09-05T18:15:13.485273] [INFO ] [MAIN ] DSX: Update completed successfully. [2025-09-05T18:15:13.486850] [INFO ] [MAIN ] Update Progress: 650/2363 symbols completed. DSX took 2.1s. Estimated remaining: 39m 57s. Rate: 42.9 symbols/min [2025-09-05T18:15:13.664795] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:13.672700] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-05T18:15:13.675852] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-05T18:15:13.678853] [INFO ] [MAIN ] DTB: Loaded 2615 existing records. [2025-09-05T18:15:13.833451] [WARN ] [VALIDATOR ] DT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:13.852177] [INFO ] [MAIN ] DT: Combined data validation passed. [2025-09-05T18:15:13.852096] [INFO ] [MAIN ] DTB: Found 1 missing trading days. [2025-09-05T18:15:13.852352] [INFO ] [MAIN ] DTB: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:13.852563] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-05T18:15:13.952153] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-05T18:15:13.961245] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-05T18:15:14.022978] [INFO ] [MAIN ] DT: Update completed successfully. [2025-09-05T18:15:14.025896] [INFO ] [MAIN ] Update Progress: 651/2363 symbols completed. DT took 2.1s. Estimated remaining: 39m 54s. Rate: 42.9 symbols/min [2025-09-05T18:15:14.195895] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:14.196064] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-09-05T18:15:14.196190] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-05T18:15:14.196236] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-05T18:15:14.196281] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-05T18:15:14.542265] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-05T18:15:14.566506] [INFO ] [REMOTE ] DTE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:15:14.566792] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-05T18:15:14.567395] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-05T18:15:14.794362] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:15:14.809036] [INFO ] [MAIN ] DTB: Adding 35 new records, updating 0 existing records. [2025-09-05T18:15:14.819200] [INFO ] [MAIN ] DTB: Combined dataset has 2650 total records. [2025-09-05T18:15:14.876173] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-05T18:15:15.010663] [WARN ] [VALIDATOR ] DTB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:15.074167] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-05T18:15:15.200747] [WARN ] [VALIDATOR ] DTB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:15.200949] [INFO ] [MAIN ] DTB: Combined data validation passed. [2025-09-05T18:15:15.217820] [INFO ] [MAIN ] DTB: Update completed successfully. [2025-09-05T18:15:15.218300] [INFO ] [MAIN ] Update Progress: 652/2363 symbols completed. DTB took 1.7s. Estimated remaining: 39m 52s. Rate: 42.9 symbols/min [2025-09-05T18:15:15.388814] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:15.391338] [INFO ] [MAIN ] DTF: Loaded 907 existing records. [2025-09-05T18:15:15.545405] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-05T18:15:15.573184] [INFO ] [MAIN ] DTF: Found 1 missing trading days. [2025-09-05T18:15:15.573308] [INFO ] [MAIN ] DTF: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:15.863435] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-05T18:15:16.254550] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-05T18:15:16.511167] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-05T18:15:16.663540] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-05T18:15:16.762660] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:15:16.763744] [INFO ] [REMOTE ] DRLL: Full fetch complete (11340 records). [2025-09-05T18:15:17.125252] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-05T18:15:17.167788] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-05T18:15:17.167936] [INFO ] [MAIN ] Update Progress: 653/2363 symbols completed. DRLL took 10.6s. Estimated remaining: 39m 52s. Rate: 42.9 symbols/min [2025-09-05T18:15:17.342178] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:17.342367] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-09-05T18:15:17.342495] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-05T18:15:17.342535] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-05T18:15:17.342581] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-05T18:15:17.468586] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-05T18:15:17.576385] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-05T18:15:17.715356] [INFO ] [REMOTE ] DTG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:15:18.045370] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:15:18.052170] [INFO ] [MAIN ] DTF: Adding 11 new records, updating 0 existing records. [2025-09-05T18:15:18.053568] [INFO ] [MAIN ] DTF: Combined dataset has 918 total records. [2025-09-05T18:15:18.240162] [WARN ] [VALIDATOR ] DTF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:15:18.270107] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-05T18:15:18.440437] [WARN ] [VALIDATOR ] DTF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:15:18.440705] [INFO ] [MAIN ] DTF: Combined data validation passed. [2025-09-05T18:15:18.449244] [INFO ] [MAIN ] DTF: Update completed successfully. [2025-09-05T18:15:18.449572] [INFO ] [MAIN ] Update Progress: 654/2363 symbols completed. DTF took 3.2s. Estimated remaining: 39m 50s. Rate: 42.9 symbols/min [2025-09-05T18:15:18.651622] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:18.689563] [INFO ] [MAIN ] DTM: Loaded 32967 existing records. [2025-09-05T18:15:18.875633] [INFO ] [MAIN ] DTM: Found 1 missing trading days. [2025-09-05T18:15:18.880039] [INFO ] [MAIN ] DTM: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:18.880424] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-05T18:15:19.063463] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-05T18:15:19.863486] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-05T18:15:20.543935] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-05T18:15:20.663460] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-05T18:15:20.739425] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-05T18:15:21.261852] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-05T18:15:21.463467] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-05T18:15:22.173064] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:15:22.174201] [INFO ] [REMOTE ] DSM: Full fetch complete (18760 records). [2025-09-05T18:15:22.174717] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:15:22.174800] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:15:22.174839] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:15:22.174888] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-05T18:15:22.174954] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-09-05T18:15:22.175028] [INFO ] [MAIN ] Update Progress: 655/2363 symbols completed. DSM took 14.0s. Estimated remaining: 39m 55s. Rate: 42.8 symbols/min [2025-09-05T18:15:22.268629] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-05T18:15:22.348497] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:22.348679] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-09-05T18:15:22.348800] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-05T18:15:22.348839] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-05T18:15:22.348884] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-05T18:15:22.706469] [INFO ] [REMOTE ] DTW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:15:22.740890] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:15:22.882877] [INFO ] [MAIN ] DTM: Adding 303 new records, updating 0 existing records. [2025-09-05T18:15:22.887122] [INFO ] [MAIN ] DTM: Combined dataset has 33270 total records. [2025-09-05T18:15:23.063278] [WARN ] [VALIDATOR ] DTM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:15:23.063456] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-05T18:15:23.257232] [WARN ] [VALIDATOR ] DTM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:15:23.257435] [INFO ] [MAIN ] DTM: Combined data validation passed. [2025-09-05T18:15:23.467336] [INFO ] [MAIN ] DTM: Update completed successfully. [2025-09-05T18:15:23.470726] [INFO ] [MAIN ] Update Progress: 656/2363 symbols completed. DTM took 5.0s. Estimated remaining: 39m 53s. Rate: 42.8 symbols/min [2025-09-05T18:15:23.643913] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:23.685134] [INFO ] [MAIN ] DUK: Loaded 40256 existing records. [2025-09-05T18:15:23.863525] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-05T18:15:23.865506] [INFO ] [MAIN ] DUK: Found 1 missing trading days. [2025-09-05T18:15:23.866882] [INFO ] [MAIN ] DUK: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:23.872542] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-05T18:15:24.385286] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-05T18:15:24.663465] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-05T18:15:25.329703] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:15:25.468592] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-05T18:15:25.491170] [INFO ] [MAIN ] DUK: Adding 388 new records, updating 0 existing records. [2025-09-05T18:15:25.495453] [INFO ] [MAIN ] DUK: Combined dataset has 40644 total records. [2025-09-05T18:15:25.673736] [WARN ] [VALIDATOR ] DUK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:15:25.876476] [WARN ] [VALIDATOR ] DUK: Missing data for 45 trading days: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:15:25.876785] [INFO ] [MAIN ] DUK: Combined data validation passed. [2025-09-05T18:15:26.139255] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-05T18:15:26.146881] [INFO ] [MAIN ] DUK: Update completed successfully. [2025-09-05T18:15:26.152026] [INFO ] [MAIN ] Update Progress: 657/2363 symbols completed. DUK took 2.7s. Estimated remaining: 39m 55s. Rate: 42.7 symbols/min [2025-09-05T18:15:26.268549] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-05T18:15:26.325017] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:26.333220] [INFO ] [MAIN ] DUKB: Loaded 4953 existing records. [2025-09-05T18:15:26.508413] [INFO ] [MAIN ] DUKB: Found 1 missing trading days. [2025-09-05T18:15:26.508831] [INFO ] [MAIN ] DUKB: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:27.063487] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-05T18:15:27.863503] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-05T18:15:28.663480] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-05T18:15:28.692512] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-05T18:15:28.804558] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:15:28.823122] [INFO ] [MAIN ] DUKB: Adding 62 new records, updating 0 existing records. [2025-09-05T18:15:28.825418] [INFO ] [MAIN ] DUKB: Combined dataset has 5015 total records. [2025-09-05T18:15:29.017183] [WARN ] [VALIDATOR ] DUKB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:15:29.260328] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-05T18:15:29.277891] [WARN ] [VALIDATOR ] DUKB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:15:29.278179] [INFO ] [MAIN ] DUKB: Combined data validation passed. [2025-09-05T18:15:29.313350] [INFO ] [MAIN ] DUKB: Update completed successfully. [2025-09-05T18:15:29.314188] [INFO ] [MAIN ] Update Progress: 658/2363 symbols completed. DUKB took 3.2s. Estimated remaining: 39m 58s. Rate: 42.7 symbols/min [2025-09-05T18:15:29.425321] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-05T18:15:29.473099] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-05T18:15:29.510774] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:29.536342] [INFO ] [MAIN ] DV: Loaded 24263 existing records. [2025-09-05T18:15:29.718657] [INFO ] [MAIN ] DV: Found 1 missing trading days. [2025-09-05T18:15:29.718807] [INFO ] [MAIN ] DV: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:30.109874] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-05T18:15:30.263465] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-05T18:15:31.035036] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-05T18:15:31.063443] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-05T18:15:31.863472] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-05T18:15:31.883210] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-05T18:15:32.571469] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-05T18:15:32.663467] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-05T18:15:33.441580] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:15:33.468268] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-05T18:15:33.590742] [INFO ] [MAIN ] DV: Adding 376 new records, updating 0 existing records. [2025-09-05T18:15:33.594278] [INFO ] [MAIN ] DV: Combined dataset has 24639 total records. [2025-09-05T18:15:33.778207] [WARN ] [VALIDATOR ] DV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:33.973035] [WARN ] [VALIDATOR ] DV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:33.973265] [INFO ] [MAIN ] DV: Combined data validation passed. [2025-09-05T18:15:34.123821] [INFO ] [MAIN ] DV: Update completed successfully. [2025-09-05T18:15:34.127000] [INFO ] [MAIN ] Update Progress: 659/2363 symbols completed. DV took 4.8s. Estimated remaining: 40m 6s. Rate: 42.5 symbols/min [2025-09-05T18:15:34.268526] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-05T18:15:34.299604] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:34.319930] [INFO ] [MAIN ] DVA: Loaded 19669 existing records. [2025-09-05T18:15:34.497374] [INFO ] [MAIN ] DVA: Found 1 missing trading days. [2025-09-05T18:15:34.497566] [INFO ] [MAIN ] DVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:34.978265] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-05T18:15:34.993823] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-05T18:15:35.063445] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-05T18:15:35.863498] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-05T18:15:36.663505] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-05T18:15:36.696769] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-05T18:15:36.940136] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-05T18:15:37.292691] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-05T18:15:37.463449] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-05T18:15:38.263477] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-05T18:15:38.855350] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:15:38.975473] [INFO ] [MAIN ] DVA: Adding 315 new records, updating 0 existing records. [2025-09-05T18:15:38.978500] [INFO ] [MAIN ] DVA: Combined dataset has 19984 total records. [2025-09-05T18:15:39.069085] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-05T18:15:39.157515] [WARN ] [VALIDATOR ] DVA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:39.374785] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-05T18:15:39.393089] [WARN ] [VALIDATOR ] DVA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:39.393321] [INFO ] [MAIN ] DVA: Combined data validation passed. [2025-09-05T18:15:39.516675] [INFO ] [MAIN ] DVA: Update completed successfully. [2025-09-05T18:15:39.519522] [INFO ] [MAIN ] Update Progress: 660/2363 symbols completed. DVA took 5.4s. Estimated remaining: 40m 14s. Rate: 42.3 symbols/min [2025-09-05T18:15:39.722156] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:39.724613] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:15:39.725658] [INFO ] [REMOTE ] DTG: Full fetch complete (6394 records). [2025-09-05T18:15:39.865411] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-05T18:15:40.013547] [INFO ] [MAIN ] DVN: Loaded 25682 existing records. [2025-09-05T18:15:40.242008] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-05T18:15:40.291343] [INFO ] [MAIN ] DVN: Found 1 missing trading days. [2025-09-05T18:15:40.291590] [INFO ] [MAIN ] DVN: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:40.318395] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-05T18:15:40.318487] [INFO ] [MAIN ] Update Progress: 661/2363 symbols completed. DTG took 23.2s. Estimated remaining: 40m 11s. Rate: 42.3 symbols/min [2025-09-05T18:15:40.490350] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:40.490505] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-09-05T18:15:40.490628] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-05T18:15:40.490687] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-05T18:15:40.490735] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-05T18:15:40.668703] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-05T18:15:40.854378] [INFO ] [REMOTE ] DX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:15:40.859161] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-05T18:15:41.463467] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-05T18:15:41.559159] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:15:41.710064] [INFO ] [MAIN ] DVN: Adding 390 new records, updating 0 existing records. [2025-09-05T18:15:41.713813] [INFO ] [MAIN ] DVN: Combined dataset has 26072 total records. [2025-09-05T18:15:41.840210] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-05T18:15:41.908750] [WARN ] [VALIDATOR ] DVN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:42.100711] [WARN ] [VALIDATOR ] DVN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:42.100957] [INFO ] [MAIN ] DVN: Combined data validation passed. [2025-09-05T18:15:42.263517] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-05T18:15:42.266080] [INFO ] [MAIN ] DVN: Update completed successfully. [2025-09-05T18:15:42.269428] [INFO ] [MAIN ] Update Progress: 662/2363 symbols completed. DVN took 2.7s. Estimated remaining: 40m 11s. Rate: 42.3 symbols/min [2025-09-05T18:15:42.446105] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:42.471321] [INFO ] [MAIN ] DXC: Loaded 24019 existing records. [2025-09-05T18:15:42.651296] [INFO ] [MAIN ] DXC: Found 1 missing trading days. [2025-09-05T18:15:42.651456] [INFO ] [MAIN ] DXC: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:43.063509] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-05T18:15:43.467760] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:15:43.690536] [INFO ] [MAIN ] DXC: Adding 380 new records, updating 0 existing records. [2025-09-05T18:15:43.697346] [INFO ] [MAIN ] DXC: Combined dataset has 24399 total records. [2025-09-05T18:15:43.873693] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-05T18:15:44.022229] [WARN ] [VALIDATOR ] DXC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:44.327977] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-05T18:15:44.346476] [WARN ] [VALIDATOR ] DXC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:44.346908] [INFO ] [MAIN ] DXC: Combined data validation passed. [2025-09-05T18:15:44.519005] [INFO ] [MAIN ] DXC: Update completed successfully. [2025-09-05T18:15:44.525011] [INFO ] [MAIN ] Update Progress: 663/2363 symbols completed. DXC took 2.3s. Estimated remaining: 40m 12s. Rate: 42.3 symbols/min [2025-09-05T18:15:44.675779] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-05T18:15:44.715249] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:44.737297] [INFO ] [MAIN ] DXYZ: Loaded 16916 existing records. [2025-09-05T18:15:44.917983] [INFO ] [MAIN ] DXYZ: Found 1 missing trading days. [2025-09-05T18:15:44.918219] [INFO ] [MAIN ] DXYZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:45.463485] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-05T18:15:45.719255] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-05T18:15:46.263525] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-05T18:15:46.358933] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-05T18:15:47.063529] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-05T18:15:47.323155] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-05T18:15:47.425338] [INFO ] [MAIN ] DXYZ: Adding 242 new records, updating 0 existing records. [2025-09-05T18:15:47.428372] [INFO ] [MAIN ] DXYZ: Combined dataset has 17158 total records. [2025-09-05T18:15:47.629777] [WARN ] [VALIDATOR ] DXYZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:47.734932] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:15:47.738555] [INFO ] [REMOTE ] DTW: Full fetch complete (5172 records). [2025-09-05T18:15:47.874318] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-05T18:15:48.215291] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-05T18:15:48.275246] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-05T18:15:48.275606] [INFO ] [MAIN ] Update Progress: 664/2363 symbols completed. DTW took 26.1s. Estimated remaining: 40m 17s. Rate: 42.2 symbols/min [2025-09-05T18:15:48.289598] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-05T18:15:48.466510] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:48.470383] [WARN ] [VALIDATOR ] DXYZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:48.470846] [INFO ] [MAIN ] DXYZ: Combined data validation passed. [2025-09-05T18:15:48.559470] [INFO ] [MAIN ] DY: Loaded 13178 existing records. [2025-09-05T18:15:48.669788] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-05T18:15:48.756383] [INFO ] [MAIN ] DY: Found 1 missing trading days. [2025-09-05T18:15:48.761749] [INFO ] [MAIN ] DY: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:48.771710] [INFO ] [MAIN ] DXYZ: Update completed successfully. [2025-09-05T18:15:48.773334] [INFO ] [MAIN ] Update Progress: 665/2363 symbols completed. DXYZ took 4.2s. Estimated remaining: 40m 13s. Rate: 42.2 symbols/min [2025-09-05T18:15:48.947510] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:48.975902] [INFO ] [MAIN ] E: Loaded 25906 existing records. [2025-09-05T18:15:49.163496] [INFO ] [MAIN ] E: Found 1 missing trading days. [2025-09-05T18:15:49.163715] [INFO ] [MAIN ] E: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:49.299757] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:15:49.302793] [INFO ] [REMOTE ] DTE: Full fetch complete (52342 records). [2025-09-05T18:15:49.470449] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-05T18:15:49.704223] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-05T18:15:49.946584] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-05T18:15:49.946759] [INFO ] [MAIN ] Update Progress: 666/2363 symbols completed. DTE took 35.9s. Estimated remaining: 40m 11s. Rate: 42.2 symbols/min [2025-09-05T18:15:50.108390] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:15:50.140328] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:50.227787] [INFO ] [MAIN ] DY: Adding 214 new records, updating 0 existing records. [2025-09-05T18:15:50.263671] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-05T18:15:50.274323] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-05T18:15:50.285986] [INFO ] [MAIN ] EAF: Loaded 21121 existing records. [2025-09-05T18:15:50.285006] [INFO ] [MAIN ] DY: Combined dataset has 13392 total records. [2025-09-05T18:15:50.635575] [INFO ] [MAIN ] EAF: Found 1 missing trading days. [2025-09-05T18:15:50.661462] [INFO ] [MAIN ] EAF: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:50.667133] [WARN ] [VALIDATOR ] DY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:50.789453] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:15:50.976364] [INFO ] [MAIN ] E: Adding 228 new records, updating 0 existing records. [2025-09-05T18:15:50.983356] [INFO ] [MAIN ] E: Combined dataset has 26134 total records. [2025-09-05T18:15:51.063914] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-05T18:15:51.179532] [WARN ] [VALIDATOR ] E: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:15:51.393324] [WARN ] [VALIDATOR ] E: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:15:51.393423] [WARN ] [VALIDATOR ] DY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:51.393830] [INFO ] [MAIN ] E: Combined data validation passed. [2025-09-05T18:15:51.394198] [INFO ] [MAIN ] DY: Combined data validation passed. [2025-09-05T18:15:51.587614] [INFO ] [MAIN ] DY: Update completed successfully. [2025-09-05T18:15:51.589376] [INFO ] [MAIN ] Update Progress: 667/2363 symbols completed. DY took 3.3s. Estimated remaining: 40m 10s. Rate: 42.2 symbols/min [2025-09-05T18:15:51.785491] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:51.797331] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:15:51.840338] [INFO ] [MAIN ] EAI: Loaded 2977 existing records. [2025-09-05T18:15:51.868562] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-05T18:15:51.996147] [INFO ] [MAIN ] EAF: Adding 182 new records, updating 0 existing records. [2025-09-05T18:15:52.102312] [INFO ] [MAIN ] EAI: Found 1 missing trading days. [2025-09-05T18:15:52.102933] [INFO ] [MAIN ] EAI: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:52.103986] [INFO ] [MAIN ] EAF: Combined dataset has 21303 total records. [2025-09-05T18:15:52.335940] [WARN ] [VALIDATOR ] EAF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:52.406074] [INFO ] [MAIN ] E: Update completed successfully. [2025-09-05T18:15:52.425609] [INFO ] [MAIN ] Update Progress: 668/2363 symbols completed. E took 3.7s. Estimated remaining: 40m 7s. Rate: 42.3 symbols/min [2025-09-05T18:15:52.664965] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-05T18:15:52.728309] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:52.743375] [INFO ] [MAIN ] EARN: Loaded 11970 existing records. [2025-09-05T18:15:52.934140] [INFO ] [MAIN ] EARN: Found 1 missing trading days. [2025-09-05T18:15:52.934386] [INFO ] [MAIN ] EARN: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:52.938100] [WARN ] [VALIDATOR ] EAF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:52.938304] [INFO ] [MAIN ] EAF: Combined data validation passed. [2025-09-05T18:15:53.078771] [INFO ] [MAIN ] EAF: Update completed successfully. [2025-09-05T18:15:53.081197] [INFO ] [MAIN ] Update Progress: 669/2363 symbols completed. EAF took 3.1s. Estimated remaining: 40m 4s. Rate: 42.3 symbols/min [2025-09-05T18:15:53.280408] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:15:53.280202] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:53.295213] [INFO ] [MAIN ] EAI: Adding 34 new records, updating 0 existing records. [2025-09-05T18:15:53.297852] [INFO ] [MAIN ] EAI: Combined dataset has 3011 total records. [2025-09-05T18:15:53.468723] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-05T18:15:53.511734] [WARN ] [VALIDATOR ] EAI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:15:53.512999] [INFO ] [MAIN ] EAT: Loaded 23437 existing records. [2025-09-05T18:15:53.874874] [INFO ] [MAIN ] EAT: Found 1 missing trading days. [2025-09-05T18:15:53.875141] [INFO ] [MAIN ] EAT: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:53.895073] [WARN ] [VALIDATOR ] EAI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:15:53.895341] [INFO ] [MAIN ] EAI: Combined data validation passed. [2025-09-05T18:15:53.915392] [INFO ] [MAIN ] EAI: Update completed successfully. [2025-09-05T18:15:53.916056] [INFO ] [MAIN ] Update Progress: 670/2363 symbols completed. EAI took 2.3s. Estimated remaining: 40m 1s. Rate: 42.3 symbols/min [2025-09-05T18:15:54.090511] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:54.126207] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-05T18:15:54.150068] [INFO ] [MAIN ] EB: Loaded 17606 existing records. [2025-09-05T18:15:54.268591] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-05T18:15:54.332100] [INFO ] [MAIN ] EB: Found 1 missing trading days. [2025-09-05T18:15:54.332294] [INFO ] [MAIN ] EB: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:54.968719] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-05T18:15:55.045262] [INFO ] [MAIN ] EARN: Adding 220 new records, updating 0 existing records. [2025-09-05T18:15:55.048252] [INFO ] [MAIN ] EARN: Combined dataset has 12190 total records. [2025-09-05T18:15:55.072142] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-05T18:15:55.261574] [WARN ] [VALIDATOR ] EARN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:55.475581] [WARN ] [VALIDATOR ] EARN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:55.475861] [INFO ] [MAIN ] EARN: Combined data validation passed. [2025-09-05T18:15:55.553996] [INFO ] [MAIN ] EARN: Update completed successfully. [2025-09-05T18:15:55.556516] [INFO ] [MAIN ] Update Progress: 671/2363 symbols completed. EARN took 3.1s. Estimated remaining: 39m 60s. Rate: 42.3 symbols/min [2025-09-05T18:15:55.737676] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:55.751924] [INFO ] [MAIN ] EBF: Loaded 8988 existing records. [2025-09-05T18:15:55.868580] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-05T18:15:55.950658] [INFO ] [MAIN ] EBF: Found 1 missing trading days. [2025-09-05T18:15:55.951015] [INFO ] [MAIN ] EBF: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:55.958803] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:15:56.103327] [INFO ] [MAIN ] EAT: Adding 375 new records, updating 0 existing records. [2025-09-05T18:15:56.109328] [INFO ] [MAIN ] EAT: Combined dataset has 23812 total records. [2025-09-05T18:15:56.303532] [WARN ] [VALIDATOR ] EAT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:56.512539] [WARN ] [VALIDATOR ] EAT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:56.512817] [INFO ] [MAIN ] EAT: Combined data validation passed. [2025-09-05T18:15:56.667041] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:15:56.665337] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-05T18:15:56.698902] [INFO ] [MAIN ] EAT: Update completed successfully. [2025-09-05T18:15:56.701712] [INFO ] [MAIN ] Update Progress: 672/2363 symbols completed. EAT took 3.6s. Estimated remaining: 39m 58s. Rate: 42.3 symbols/min [2025-09-05T18:15:56.825265] [INFO ] [MAIN ] EB: Adding 271 new records, updating 0 existing records. [2025-09-05T18:15:57.026463] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:57.028456] [INFO ] [MAIN ] EB: Combined dataset has 17877 total records. [2025-09-05T18:15:57.109209] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-05T18:15:57.193684] [INFO ] [MAIN ] EBR: Loaded 20214 existing records. [2025-09-05T18:15:57.197109] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:15:57.374567] [WARN ] [VALIDATOR ] EB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:57.465669] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-05T18:15:57.453373] [INFO ] [MAIN ] EBF: Adding 131 new records, updating 0 existing records. [2025-09-05T18:15:57.670805] [INFO ] [MAIN ] EBF: Combined dataset has 9119 total records. [2025-09-05T18:15:57.676548] [INFO ] [MAIN ] EBR: Found 1 missing trading days. [2025-09-05T18:15:57.714416] [INFO ] [MAIN ] EBR: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:57.861371] [WARN ] [VALIDATOR ] EBF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:58.056617] [WARN ] [VALIDATOR ] EBF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:58.056523] [WARN ] [VALIDATOR ] EB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:58.056938] [INFO ] [MAIN ] EB: Combined data validation passed. [2025-09-05T18:15:58.056856] [INFO ] [MAIN ] EBF: Combined data validation passed. [2025-09-05T18:15:58.202162] [INFO ] [MAIN ] EB: Update completed successfully. [2025-09-05T18:15:58.205361] [INFO ] [MAIN ] Update Progress: 673/2363 symbols completed. EB took 4.3s. Estimated remaining: 39m 57s. Rate: 42.3 symbols/min [2025-09-05T18:15:58.276849] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-05T18:15:58.306230] [INFO ] [MAIN ] EBF: Update completed successfully. [2025-09-05T18:15:58.317829] [INFO ] [MAIN ] Update Progress: 674/2363 symbols completed. EBF took 2.8s. Estimated remaining: 39m 52s. Rate: 42.4 symbols/min [2025-09-05T18:15:58.488413] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:58.561118] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:58.577057] [INFO ] [MAIN ] EBS: Loaded 22725 existing records. [2025-09-05T18:15:58.765590] [INFO ] [MAIN ] EBS: Found 1 missing trading days. [2025-09-05T18:15:58.766378] [INFO ] [MAIN ] EC: Loaded 23174 existing records. [2025-09-05T18:15:58.808734] [INFO ] [MAIN ] EBS: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:58.942360] [INFO ] [MAIN ] EC: Found 1 missing trading days. [2025-09-05T18:15:58.942468] [INFO ] [MAIN ] EC: Need to fetch 1 months: 2025-09 [2025-09-05T18:15:58.948578] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:15:59.070511] [INFO ] [MAIN ] EBR: Adding 372 new records, updating 0 existing records. [2025-09-05T18:15:59.068606] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-05T18:15:59.074467] [INFO ] [MAIN ] EBR: Combined dataset has 20586 total records. [2025-09-05T18:15:59.252401] [WARN ] [VALIDATOR ] EBR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:15:59.465565] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-05T18:15:59.484314] [WARN ] [VALIDATOR ] EBR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:15:59.484517] [INFO ] [MAIN ] EBR: Combined data validation passed. [2025-09-05T18:15:59.607757] [INFO ] [MAIN ] EBR: Update completed successfully. [2025-09-05T18:15:59.610032] [INFO ] [MAIN ] Update Progress: 675/2363 symbols completed. EBR took 2.9s. Estimated remaining: 39m 50s. Rate: 42.4 symbols/min [2025-09-05T18:15:59.780170] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:15:59.796479] [INFO ] [MAIN ] ECAT: Loaded 14740 existing records. [2025-09-05T18:15:59.870806] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-05T18:15:59.979885] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:15:59.979448] [INFO ] [MAIN ] ECAT: Found 1 missing trading days. [2025-09-05T18:15:59.989099] [INFO ] [MAIN ] ECAT: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:00.103699] [INFO ] [MAIN ] EBS: Adding 333 new records, updating 0 existing records. [2025-09-05T18:16:00.107386] [INFO ] [MAIN ] EBS: Combined dataset has 23058 total records. [2025-09-05T18:16:00.286347] [WARN ] [VALIDATOR ] EBS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:00.480616] [WARN ] [VALIDATOR ] EBS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:00.480850] [INFO ] [MAIN ] EBS: Combined data validation passed. [2025-09-05T18:16:00.613718] [INFO ] [MAIN ] EBS: Update completed successfully. [2025-09-05T18:16:00.616593] [INFO ] [MAIN ] Update Progress: 676/2363 symbols completed. EBS took 2.4s. Estimated remaining: 39m 48s. Rate: 42.4 symbols/min [2025-09-05T18:16:00.671181] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-05T18:16:00.788101] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:00.807518] [INFO ] [MAIN ] ECC: Loaded 20519 existing records. [2025-09-05T18:16:00.980313] [INFO ] [MAIN ] ECC: Found 1 missing trading days. [2025-09-05T18:16:00.980483] [INFO ] [MAIN ] ECC: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:01.298319] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:16:01.410454] [INFO ] [MAIN ] EC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:16:01.412345] [INFO ] [MAIN ] EC: Combined dataset has 23174 total records. [2025-09-05T18:16:01.412865] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:01.412944] [FATAL] [MAIN ] EC: Combined data validation failed. [2025-09-05T18:16:01.412989] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:01.413035] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-05T18:16:01.413612] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-09-05T18:16:01.416870] [INFO ] [MAIN ] Update Progress: 677/2363 symbols completed. EC took 3.1s. Estimated remaining: 39m 45s. Rate: 42.4 symbols/min [2025-09-05T18:16:01.463442] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-05T18:16:02.013178] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-05T18:16:02.263475] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-05T18:16:03.063448] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-05T18:16:03.162852] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-05T18:16:03.278074] [INFO ] [MAIN ] ECC: Adding 327 new records, updating 0 existing records. [2025-09-05T18:16:03.280997] [INFO ] [MAIN ] ECC: Combined dataset has 20846 total records. [2025-09-05T18:16:03.456499] [WARN ] [VALIDATOR ] ECC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:03.648894] [WARN ] [VALIDATOR ] ECC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:03.649108] [INFO ] [MAIN ] ECC: Combined data validation passed. [2025-09-05T18:16:03.771417] [INFO ] [MAIN ] ECC: Update completed successfully. [2025-09-05T18:16:03.774202] [INFO ] [MAIN ] Update Progress: 678/2363 symbols completed. ECC took 3.2s. Estimated remaining: 39m 46s. Rate: 42.4 symbols/min [2025-09-05T18:16:04.235316] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-05T18:16:04.246530] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-05T18:16:04.796740] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-05T18:16:04.877170] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:16:04.878359] [INFO ] [MAIN ] ECAT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:16:04.882153] [INFO ] [REMOTE ] DX: Full fetch complete (56540 records). [2025-09-05T18:16:04.882794] [INFO ] [MAIN ] ECAT: Combined dataset has 14740 total records. [2025-09-05T18:16:04.883339] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:04.883851] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:04.884068] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:16:04.884153] [FATAL] [MAIN ] ECAT: Combined data validation failed. [2025-09-05T18:16:04.884210] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:04.884397] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-05T18:16:04.884343] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:04.884602] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-05T18:16:04.884558] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-09-05T18:16:04.884865] [INFO ] [MAIN ] Update Progress: 679/2363 symbols completed. DX took 24.6s. Estimated remaining: 39m 44s. Rate: 42.4 symbols/min [2025-09-05T18:16:04.885426] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-09-05T18:16:04.887935] [INFO ] [MAIN ] Update Progress: 680/2363 symbols completed. ECAT took 5.3s. Estimated remaining: 39m 39s. Rate: 42.5 symbols/min [2025-09-05T18:16:05.553914] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:05.554717] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:05.594663] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:05.627268] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:05.629276] [INFO ] [MAIN ] ECCU: Loaded 1049 existing records. [2025-09-05T18:16:05.631384] [INFO ] [MAIN ] ECCC: Loaded 398 existing records. [2025-09-05T18:16:05.728953] [INFO ] [MAIN ] ECCW: Loaded 564 existing records. [2025-09-05T18:16:05.769381] [INFO ] [MAIN ] ECCX: Loaded 477 existing records. [2025-09-05T18:16:06.191100] [INFO ] [MAIN ] ECCC: Found 1 missing trading days. [2025-09-05T18:16:06.226463] [INFO ] [MAIN ] ECCC: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:06.260091] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-05T18:16:06.334507] [INFO ] [MAIN ] ECCU: Found 1 missing trading days. [2025-09-05T18:16:06.335451] [INFO ] [MAIN ] ECCU: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:06.374822] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-05T18:16:06.374461] [INFO ] [MAIN ] ECCW: Found 1 missing trading days. [2025-09-05T18:16:06.393682] [INFO ] [MAIN ] ECCX: Found 1 missing trading days. [2025-09-05T18:16:06.377221] [INFO ] [MAIN ] ECCW: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:06.394438] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-05T18:16:06.395491] [INFO ] [MAIN ] ECCX: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:06.874728] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:16:06.878467] [INFO ] [MAIN ] ECCC: Adding 4 new records, updating 0 existing records. [2025-09-05T18:16:06.879625] [INFO ] [MAIN ] ECCC: Combined dataset has 402 total records. [2025-09-05T18:16:07.057277] [WARN ] [VALIDATOR ] ECCC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:07.070693] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-05T18:16:07.070786] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:16:07.111165] [INFO ] [MAIN ] ECCU: Adding 8 new records, updating 0 existing records. [2025-09-05T18:16:07.105114] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:16:07.139624] [INFO ] [MAIN ] ECCW: Adding 0 new records, updating 0 existing records. [2025-09-05T18:16:07.163833] [INFO ] [MAIN ] ECCU: Combined dataset has 1057 total records. [2025-09-05T18:16:07.181780] [INFO ] [MAIN ] ECCW: Combined dataset has 564 total records. [2025-09-05T18:16:07.246577] [FATAL] [VALIDATOR ] ECCW: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:07.255891] [FATAL] [MAIN ] ECCW: Combined data validation failed. [2025-09-05T18:16:07.300216] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:07.370456] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-05T18:16:07.376431] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-05T18:16:07.413422] [INFO ] [MAIN ] Update Progress: 681/2363 symbols completed. ECCW took 2.5s. Estimated remaining: 39m 40s. Rate: 42.4 symbols/min [2025-09-05T18:16:07.493806] [WARN ] [VALIDATOR ] ECCU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:07.598954] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:16:07.612406] [INFO ] [MAIN ] ECCX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:16:07.660612] [INFO ] [MAIN ] ECCX: Combined dataset has 477 total records. [2025-09-05T18:16:07.693574] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:07.732097] [FATAL] [MAIN ] ECCX: Combined data validation failed. [2025-09-05T18:16:07.741622] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:07.748351] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-05T18:16:07.789579] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-05T18:16:07.800266] [INFO ] [MAIN ] Update Progress: 682/2363 symbols completed. ECCX took 2.9s. Estimated remaining: 39m 36s. Rate: 42.4 symbols/min [2025-09-05T18:16:07.842042] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:07.977532] [INFO ] [MAIN ] ECG: Loaded 14717 existing records. [2025-09-05T18:16:08.098168] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:08.243409] [INFO ] [MAIN ] ECG: Found 1 missing trading days. [2025-09-05T18:16:08.243942] [INFO ] [MAIN ] ECG: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:08.244220] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-05T18:16:08.254588] [INFO ] [MAIN ] ECL: Loaded 21799 existing records. [2025-09-05T18:16:08.440397] [INFO ] [MAIN ] ECL: Found 1 missing trading days. [2025-09-05T18:16:08.440951] [INFO ] [MAIN ] ECL: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:08.444203] [WARN ] [VALIDATOR ] ECCC: Missing days changed. Total missing: 85 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-25, 2025-07-09 [2025-09-05T18:16:08.444428] [INFO ] [MAIN ] ECCC: Combined data validation passed. [2025-09-05T18:16:08.444325] [WARN ] [VALIDATOR ] ECCU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:08.445373] [INFO ] [MAIN ] ECCU: Combined data validation passed. [2025-09-05T18:16:08.449145] [INFO ] [MAIN ] ECCC: Update completed successfully. [2025-09-05T18:16:08.449397] [INFO ] [MAIN ] Update Progress: 683/2363 symbols completed. ECCC took 3.6s. Estimated remaining: 39m 33s. Rate: 42.5 symbols/min [2025-09-05T18:16:08.558051] [INFO ] [MAIN ] ECCU: Update completed successfully. [2025-09-05T18:16:08.560988] [INFO ] [MAIN ] Update Progress: 684/2363 symbols completed. ECCU took 3.7s. Estimated remaining: 39m 28s. Rate: 42.5 symbols/min [2025-09-05T18:16:08.674421] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-05T18:16:08.744209] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:08.825094] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:08.825622] [INFO ] [MAIN ] ECO: Loaded 8919 existing records. [2025-09-05T18:16:09.008929] [INFO ] [MAIN ] ECO: Found 1 missing trading days. [2025-09-05T18:16:09.017165] [INFO ] [MAIN ] ECO: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:09.018110] [INFO ] [MAIN ] ECVT: Loaded 20483 existing records. [2025-09-05T18:16:09.194791] [INFO ] [MAIN ] ECVT: Found 1 missing trading days. [2025-09-05T18:16:09.194932] [INFO ] [MAIN ] ECVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:09.463469] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-05T18:16:09.498482] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:16:09.633608] [INFO ] [MAIN ] ECL: Adding 362 new records, updating 0 existing records. [2025-09-05T18:16:09.641390] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T18:16:09.678276] [INFO ] [MAIN ] ECL: Combined dataset has 22161 total records. [2025-09-05T18:16:09.828196] [INFO ] [MAIN ] ECG: Adding 285 new records, updating 0 existing records. [2025-09-05T18:16:09.903069] [INFO ] [MAIN ] ECG: Combined dataset has 15002 total records. [2025-09-05T18:16:09.923991] [WARN ] [VALIDATOR ] ECL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:10.266694] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-05T18:16:10.308349] [WARN ] [VALIDATOR ] ECG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:10.508878] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:16:10.642340] [INFO ] [MAIN ] ECVT: Adding 299 new records, updating 0 existing records. [2025-09-05T18:16:10.648675] [INFO ] [MAIN ] ECVT: Combined dataset has 20782 total records. [2025-09-05T18:16:10.840221] [WARN ] [VALIDATOR ] ECVT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:10.915509] [WARN ] [VALIDATOR ] ECL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:10.957511] [INFO ] [MAIN ] ECL: Combined data validation passed. [2025-09-05T18:16:10.915584] [WARN ] [VALIDATOR ] ECG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:10.957932] [INFO ] [MAIN ] ECG: Combined data validation passed. [2025-09-05T18:16:11.272674] [INFO ] [MAIN ] ECG: Update completed successfully. [2025-09-05T18:16:11.274420] [INFO ] [MAIN ] Update Progress: 685/2363 symbols completed. ECG took 3.8s. Estimated remaining: 39m 30s. Rate: 42.5 symbols/min [2025-09-05T18:16:11.319264] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:16:11.376996] [INFO ] [MAIN ] ECL: Update completed successfully. [2025-09-05T18:16:11.446660] [INFO ] [MAIN ] ECO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:16:11.440093] [INFO ] [MAIN ] Update Progress: 686/2363 symbols completed. ECL took 3.6s. Estimated remaining: 39m 25s. Rate: 42.5 symbols/min [2025-09-05T18:16:11.459988] [INFO ] [MAIN ] ECO: Combined dataset has 8919 total records. [2025-09-05T18:16:11.526914] [FATAL] [VALIDATOR ] ECO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:11.566144] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:11.577975] [FATAL] [MAIN ] ECO: Combined data validation failed. [2025-09-05T18:16:11.596408] [WARN ] [MAIN ] ECO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:11.613220] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-05T18:16:11.636606] [WARN ] [VALIDATOR ] ECVT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:11.641276] [INFO ] [MAIN ] ECVT: Combined data validation passed. [2025-09-05T18:16:11.641684] [INFO ] [LOCAL ] ECO: Starting deletion of derivative data. [2025-09-05T18:16:11.688188] [INFO ] [MAIN ] Update Progress: 687/2363 symbols completed. ECO took 3.2s. Estimated remaining: 39m 21s. Rate: 42.6 symbols/min [2025-09-05T18:16:11.832005] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:11.994071] [INFO ] [MAIN ] EDD: Loaded 13469 existing records. [2025-09-05T18:16:12.056310] [INFO ] [MAIN ] ED: Loaded 39760 existing records. [2025-09-05T18:16:12.235243] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:12.515741] [INFO ] [MAIN ] EDF: Loaded 5831 existing records. [2025-09-05T18:16:12.520550] [INFO ] [MAIN ] EDD: Found 1 missing trading days. [2025-09-05T18:16:12.529815] [INFO ] [MAIN ] EDD: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:12.535917] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-05T18:16:12.605092] [INFO ] [MAIN ] ED: Found 1 missing trading days. [2025-09-05T18:16:12.629788] [INFO ] [MAIN ] ED: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:12.638205] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-05T18:16:12.651723] [INFO ] [MAIN ] ECVT: Update completed successfully. [2025-09-05T18:16:12.653999] [INFO ] [MAIN ] Update Progress: 688/2363 symbols completed. ECVT took 4.1s. Estimated remaining: 39m 19s. Rate: 42.6 symbols/min [2025-09-05T18:16:12.816572] [INFO ] [MAIN ] EDF: Found 1 missing trading days. [2025-09-05T18:16:12.826914] [INFO ] [MAIN ] EDF: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:12.827178] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-05T18:16:12.897899] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:12.907306] [INFO ] [MAIN ] EDN: Loaded 8116 existing records. [2025-09-05T18:16:13.082141] [INFO ] [MAIN ] EDN: Found 1 missing trading days. [2025-09-05T18:16:13.082333] [INFO ] [MAIN ] EDN: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:13.463426] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-05T18:16:13.554214] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:16:13.694343] [INFO ] [MAIN ] ED: Adding 0 new records, updating 0 existing records. [2025-09-05T18:16:13.696687] [INFO ] [MAIN ] ED: Combined dataset has 39760 total records. [2025-09-05T18:16:13.697180] [FATAL] [VALIDATOR ] ED: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:13.697261] [FATAL] [MAIN ] ED: Combined data validation failed. [2025-09-05T18:16:13.697297] [WARN ] [MAIN ] ED: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:13.697343] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-05T18:16:13.698242] [INFO ] [LOCAL ] ED: Starting deletion of derivative data. [2025-09-05T18:16:13.702034] [INFO ] [MAIN ] Update Progress: 689/2363 symbols completed. ED took 2.4s. Estimated remaining: 39m 16s. Rate: 42.6 symbols/min [2025-09-05T18:16:13.883370] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:13.888581] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T18:16:13.965301] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:16:13.993228] [INFO ] [MAIN ] EDD: Adding 188 new records, updating 0 existing records. [2025-09-05T18:16:14.030163] [INFO ] [MAIN ] EDF: Adding 73 new records, updating 0 existing records. [2025-09-05T18:16:14.031578] [INFO ] [MAIN ] EDU: Loaded 21021 existing records. [2025-09-05T18:16:14.110486] [INFO ] [MAIN ] EDF: Combined dataset has 5904 total records. [2025-09-05T18:16:14.145627] [INFO ] [MAIN ] EDD: Combined dataset has 13657 total records. [2025-09-05T18:16:14.437766] [INFO ] [MAIN ] EDU: Found 1 missing trading days. [2025-09-05T18:16:14.460148] [INFO ] [MAIN ] EDU: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:14.490356] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-05T18:16:14.601144] [WARN ] [VALIDATOR ] EDF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:14.715471] [WARN ] [VALIDATOR ] EDD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:14.855302] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-05T18:16:15.089758] [INFO ] [MAIN ] EDN: Adding 139 new records, updating 0 existing records. [2025-09-05T18:16:15.158538] [INFO ] [MAIN ] EDN: Combined dataset has 8255 total records. [2025-09-05T18:16:15.351864] [WARN ] [VALIDATOR ] EDN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:15.561476] [WARN ] [VALIDATOR ] EDF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:15.567896] [INFO ] [MAIN ] EDF: Combined data validation passed. [2025-09-05T18:16:15.567747] [WARN ] [VALIDATOR ] EDN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:15.570298] [INFO ] [MAIN ] EDN: Combined data validation passed. [2025-09-05T18:16:15.569289] [WARN ] [VALIDATOR ] EDD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:15.570940] [INFO ] [MAIN ] EDD: Combined data validation passed. [2025-09-05T18:16:15.724861] [INFO ] [MAIN ] EDF: Update completed successfully. [2025-09-05T18:16:15.726371] [INFO ] [MAIN ] Update Progress: 690/2363 symbols completed. EDF took 3.9s. Estimated remaining: 39m 17s. Rate: 42.6 symbols/min [2025-09-05T18:16:15.724747] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T18:16:16.019372] [INFO ] [MAIN ] EDU: Adding 309 new records, updating 0 existing records. [2025-09-05T18:16:16.091283] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:16.095715] [INFO ] [MAIN ] EDN: Update completed successfully. [2025-09-05T18:16:16.096095] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-09-05T18:16:16.098021] [INFO ] [MAIN ] Update Progress: 691/2363 symbols completed. EDN took 3.4s. Estimated remaining: 39m 13s. Rate: 42.6 symbols/min [2025-09-05T18:16:16.100666] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-05T18:16:16.124055] [INFO ] [MAIN ] EDU: Combined dataset has 21330 total records. [2025-09-05T18:16:16.133523] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-05T18:16:16.133760] [INFO ] [MAIN ] EDD: Update completed successfully. [2025-09-05T18:16:16.139587] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-05T18:16:16.143065] [INFO ] [MAIN ] Update Progress: 692/2363 symbols completed. EDD took 4.7s. Estimated remaining: 39m 8s. Rate: 42.7 symbols/min [2025-09-05T18:16:16.750987] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:16.884735] [WARN ] [VALIDATOR ] EDU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:17.040021] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:17.068834] [INFO ] [MAIN ] EEA: Loaded 1362 existing records. [2025-09-05T18:16:17.244447] [INFO ] [MAIN ] EEX: Loaded 4414 existing records. [2025-09-05T18:16:17.424496] [INFO ] [REMOTE ] EE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:16:17.436419] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-05T18:16:17.674184] [INFO ] [MAIN ] EEA: Found 1 missing trading days. [2025-09-05T18:16:17.700856] [INFO ] [MAIN ] EEA: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:17.729205] [INFO ] [MAIN ] EEX: Found 1 missing trading days. [2025-09-05T18:16:17.724447] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-05T18:16:17.729432] [INFO ] [MAIN ] EEX: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:17.730701] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-05T18:16:17.743249] [WARN ] [VALIDATOR ] EDU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:17.743462] [INFO ] [MAIN ] EDU: Combined data validation passed. [2025-09-05T18:16:17.874544] [INFO ] [MAIN ] EDU: Update completed successfully. [2025-09-05T18:16:17.876865] [INFO ] [MAIN ] Update Progress: 693/2363 symbols completed. EDU took 4.2s. Estimated remaining: 39m 7s. Rate: 42.7 symbols/min [2025-09-05T18:16:18.051415] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:18.075238] [INFO ] [MAIN ] EFC: Loaded 21721 existing records. [2025-09-05T18:16:18.258287] [INFO ] [MAIN ] EFC: Found 1 missing trading days. [2025-09-05T18:16:18.258429] [INFO ] [MAIN ] EFC: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:18.258873] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-05T18:16:18.313473] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:16:18.337581] [INFO ] [MAIN ] EEX: Adding 42 new records, updating 0 existing records. [2025-09-05T18:16:18.339313] [INFO ] [MAIN ] EEX: Combined dataset has 4456 total records. [2025-09-05T18:16:18.521415] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:16:18.525106] [WARN ] [VALIDATOR ] EEX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:18.533143] [INFO ] [MAIN ] EEA: Adding 19 new records, updating 0 existing records. [2025-09-05T18:16:18.614521] [INFO ] [MAIN ] EEA: Combined dataset has 1381 total records. [2025-09-05T18:16:18.958706] [WARN ] [VALIDATOR ] EEA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:19.121872] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-05T18:16:19.127748] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-05T18:16:19.180998] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:16:19.382622] [INFO ] [MAIN ] EFC: Adding 311 new records, updating 0 existing records. [2025-09-05T18:16:19.391769] [INFO ] [MAIN ] EFC: Combined dataset has 22032 total records. [2025-09-05T18:16:19.592311] [WARN ] [VALIDATOR ] EFC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:19.771657] [WARN ] [VALIDATOR ] EEA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:19.805422] [INFO ] [MAIN ] EEA: Combined data validation passed. [2025-09-05T18:16:19.804922] [WARN ] [VALIDATOR ] EEX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:19.806820] [INFO ] [MAIN ] EEX: Combined data validation passed. [2025-09-05T18:16:19.818477] [INFO ] [MAIN ] EEA: Update completed successfully. [2025-09-05T18:16:19.819073] [INFO ] [MAIN ] Update Progress: 694/2363 symbols completed. EEA took 3.7s. Estimated remaining: 39m 7s. Rate: 42.7 symbols/min [2025-09-05T18:16:19.975554] [INFO ] [MAIN ] EEX: Update completed successfully. [2025-09-05T18:16:19.992192] [INFO ] [MAIN ] Update Progress: 695/2363 symbols completed. EEX took 3.7s. Estimated remaining: 39m 3s. Rate: 42.7 symbols/min [2025-09-05T18:16:20.078767] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:20.188485] [INFO ] [MAIN ] EFR: Loaded 7141 existing records. [2025-09-05T18:16:20.293332] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:20.407706] [INFO ] [MAIN ] EFT: Loaded 5961 existing records. [2025-09-05T18:16:20.506012] [INFO ] [MAIN ] EFR: Found 1 missing trading days. [2025-09-05T18:16:20.511734] [INFO ] [MAIN ] EFR: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:20.544338] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-05T18:16:20.611622] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-05T18:16:20.634438] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-05T18:16:20.701663] [INFO ] [MAIN ] EFT: Found 1 missing trading days. [2025-09-05T18:16:20.702115] [INFO ] [MAIN ] EFT: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:20.702472] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-05T18:16:20.705238] [WARN ] [VALIDATOR ] EFC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:20.705431] [INFO ] [MAIN ] EFC: Combined data validation passed. [2025-09-05T18:16:20.846731] [INFO ] [MAIN ] EFC: Update completed successfully. [2025-09-05T18:16:20.849110] [INFO ] [MAIN ] Update Progress: 696/2363 symbols completed. EFC took 3.0s. Estimated remaining: 39m 0s. Rate: 42.7 symbols/min [2025-09-05T18:16:21.018071] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:21.038823] [INFO ] [MAIN ] EFX: Loaded 20982 existing records. [2025-09-05T18:16:21.216593] [INFO ] [MAIN ] EFX: Found 1 missing trading days. [2025-09-05T18:16:21.216791] [INFO ] [MAIN ] EFX: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:21.463466] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-05T18:16:21.629049] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:16:21.668028] [INFO ] [MAIN ] EFT: Adding 113 new records, updating 0 existing records. [2025-09-05T18:16:21.670742] [INFO ] [MAIN ] EFT: Combined dataset has 6074 total records. [2025-09-05T18:16:21.860634] [WARN ] [VALIDATOR ] EFT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:21.954331] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-05T18:16:22.077304] [INFO ] [MAIN ] EFR: Adding 152 new records, updating 0 existing records. [2025-09-05T18:16:22.102400] [INFO ] [MAIN ] EFR: Combined dataset has 7293 total records. [2025-09-05T18:16:22.281599] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-05T18:16:22.329527] [WARN ] [VALIDATOR ] EFR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:22.341770] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-05T18:16:22.536427] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:16:22.686182] [INFO ] [MAIN ] EFX: Adding 366 new records, updating 0 existing records. [2025-09-05T18:16:22.689263] [WARN ] [VALIDATOR ] EFT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:22.689910] [INFO ] [MAIN ] EFT: Combined data validation passed. [2025-09-05T18:16:22.720442] [INFO ] [MAIN ] EFX: Combined dataset has 21348 total records. [2025-09-05T18:16:22.732362] [INFO ] [MAIN ] EFT: Update completed successfully. [2025-09-05T18:16:22.733540] [INFO ] [MAIN ] Update Progress: 697/2363 symbols completed. EFT took 2.7s. Estimated remaining: 38m 60s. Rate: 42.7 symbols/min [2025-09-05T18:16:22.968208] [WARN ] [VALIDATOR ] EFR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:22.980258] [INFO ] [MAIN ] EFR: Combined data validation passed. [2025-09-05T18:16:23.145298] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:23.175356] [WARN ] [VALIDATOR ] EFX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:23.270590] [INFO ] [MAIN ] EFR: Update completed successfully. [2025-09-05T18:16:23.301837] [INFO ] [MAIN ] Update Progress: 698/2363 symbols completed. EFR took 3.5s. Estimated remaining: 38m 56s. Rate: 42.8 symbols/min [2025-09-05T18:16:23.308283] [INFO ] [MAIN ] EFXT: Loaded 13753 existing records. [2025-09-05T18:16:23.737945] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:23.846963] [INFO ] [MAIN ] EFXT: Found 1 missing trading days. [2025-09-05T18:16:23.849513] [INFO ] [MAIN ] EFXT: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:23.851408] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-05T18:16:23.858394] [INFO ] [MAIN ] EG: Loaded 12709 existing records. [2025-09-05T18:16:24.042062] [INFO ] [MAIN ] EG: Found 1 missing trading days. [2025-09-05T18:16:24.042432] [INFO ] [MAIN ] EG: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:24.042847] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-05T18:16:24.044932] [WARN ] [VALIDATOR ] EFX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:24.045245] [INFO ] [MAIN ] EFX: Combined data validation passed. [2025-09-05T18:16:24.168347] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-05T18:16:24.236751] [INFO ] [MAIN ] EFX: Update completed successfully. [2025-09-05T18:16:24.239836] [INFO ] [MAIN ] Update Progress: 699/2363 symbols completed. EFX took 3.4s. Estimated remaining: 38m 54s. Rate: 42.8 symbols/min [2025-09-05T18:16:24.421029] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:24.447865] [INFO ] [MAIN ] EGO: Loaded 24466 existing records. [2025-09-05T18:16:24.627797] [INFO ] [MAIN ] EGO: Found 1 missing trading days. [2025-09-05T18:16:24.627983] [INFO ] [MAIN ] EGO: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:24.663485] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-05T18:16:25.029199] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:16:25.173984] [INFO ] [MAIN ] EGO: Adding 380 new records, updating 0 existing records. [2025-09-05T18:16:25.182625] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T18:16:25.215424] [INFO ] [MAIN ] EGO: Combined dataset has 24846 total records. [2025-09-05T18:16:25.378877] [INFO ] [MAIN ] EFXT: Adding 257 new records, updating 0 existing records. [2025-09-05T18:16:25.467419] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-05T18:16:25.479102] [WARN ] [VALIDATOR ] EGO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:25.480280] [INFO ] [MAIN ] EFXT: Combined dataset has 14010 total records. [2025-09-05T18:16:25.486167] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-05T18:16:25.876366] [INFO ] [MAIN ] EG: Adding 131 new records, updating 0 existing records. [2025-09-05T18:16:26.054080] [INFO ] [MAIN ] EG: Combined dataset has 12840 total records. [2025-09-05T18:16:26.057565] [WARN ] [VALIDATOR ] EFXT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:26.378471] [WARN ] [VALIDATOR ] EG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:26.670572] [WARN ] [VALIDATOR ] EG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:26.671491] [INFO ] [MAIN ] EG: Combined data validation passed. [2025-09-05T18:16:26.671150] [WARN ] [VALIDATOR ] EGO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:26.670954] [WARN ] [VALIDATOR ] EFXT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:26.671847] [INFO ] [MAIN ] EGO: Combined data validation passed. [2025-09-05T18:16:26.671990] [INFO ] [MAIN ] EFXT: Combined data validation passed. [2025-09-05T18:16:26.928449] [INFO ] [MAIN ] EFXT: Update completed successfully. [2025-09-05T18:16:26.931563] [INFO ] [MAIN ] Update Progress: 700/2363 symbols completed. EFXT took 4.2s. Estimated remaining: 38m 56s. Rate: 42.7 symbols/min [2025-09-05T18:16:27.058285] [INFO ] [MAIN ] EG: Update completed successfully. [2025-09-05T18:16:27.059805] [INFO ] [MAIN ] Update Progress: 701/2363 symbols completed. EG took 3.7s. Estimated remaining: 38m 51s. Rate: 42.8 symbols/min [2025-09-05T18:16:27.179587] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:27.346637] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:27.360975] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-05T18:16:27.391505] [INFO ] [MAIN ] EGP: Loaded 14273 existing records. [2025-09-05T18:16:27.398311] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-05T18:16:27.418321] [INFO ] [MAIN ] EGO: Update completed successfully. [2025-09-05T18:16:27.440955] [INFO ] [MAIN ] Update Progress: 702/2363 symbols completed. EGO took 3.2s. Estimated remaining: 38m 47s. Rate: 42.8 symbols/min [2025-09-05T18:16:27.638874] [INFO ] [MAIN ] EGY: Loaded 19592 existing records. [2025-09-05T18:16:27.872996] [INFO ] [MAIN ] EGP: Found 1 missing trading days. [2025-09-05T18:16:27.895426] [INFO ] [MAIN ] EGP: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:27.896924] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:27.902744] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-05T18:16:27.979442] [INFO ] [MAIN ] EGY: Found 1 missing trading days. [2025-09-05T18:16:27.979731] [INFO ] [MAIN ] EGY: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:27.980196] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-05T18:16:27.986993] [INFO ] [MAIN ] EHAB: Loaded 15363 existing records. [2025-09-05T18:16:28.177547] [INFO ] [MAIN ] EHAB: Found 1 missing trading days. [2025-09-05T18:16:28.177712] [INFO ] [MAIN ] EHAB: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:28.282011] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-05T18:16:28.397094] [INFO ] [MAIN ] EGY: Adding 283 new records, updating 0 existing records. [2025-09-05T18:16:28.400333] [INFO ] [MAIN ] EGY: Combined dataset has 19875 total records. [2025-09-05T18:16:28.523886] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:16:28.639601] [WARN ] [VALIDATOR ] EGY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:28.685730] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-05T18:16:28.719023] [INFO ] [MAIN ] EGP: Adding 346 new records, updating 0 existing records. [2025-09-05T18:16:28.798417] [INFO ] [MAIN ] EGP: Combined dataset has 14619 total records. [2025-09-05T18:16:29.052184] [WARN ] [VALIDATOR ] EGP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:29.290827] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-05T18:16:29.297884] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:16:29.372205] [INFO ] [MAIN ] EHAB: Adding 178 new records, updating 0 existing records. [2025-09-05T18:16:29.377826] [INFO ] [MAIN ] EHAB: Combined dataset has 15541 total records. [2025-09-05T18:16:29.467349] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-05T18:16:29.594935] [WARN ] [VALIDATOR ] EHAB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:29.702173] [WARN ] [VALIDATOR ] EGP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:29.703036] [INFO ] [MAIN ] EGP: Combined data validation passed. [2025-09-05T18:16:29.690665] [WARN ] [VALIDATOR ] EGY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:29.725257] [INFO ] [MAIN ] EGY: Combined data validation passed. [2025-09-05T18:16:30.002332] [INFO ] [MAIN ] EGP: Update completed successfully. [2025-09-05T18:16:30.011409] [INFO ] [MAIN ] Update Progress: 703/2363 symbols completed. EGP took 3.1s. Estimated remaining: 38m 49s. Rate: 42.8 symbols/min [2025-09-05T18:16:30.011743] [INFO ] [MAIN ] EGY: Update completed successfully. [2025-09-05T18:16:30.026198] [INFO ] [MAIN ] Update Progress: 704/2363 symbols completed. EGY took 3.0s. Estimated remaining: 38m 44s. Rate: 42.8 symbols/min [2025-09-05T18:16:30.352937] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:30.377804] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:30.378795] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-09-05T18:16:30.379359] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-05T18:16:30.379724] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-05T18:16:30.380003] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-05T18:16:30.511444] [WARN ] [VALIDATOR ] EHAB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:30.570771] [INFO ] [MAIN ] EHC: Loaded 19820 existing records. [2025-09-05T18:16:30.555202] [INFO ] [MAIN ] EHAB: Combined data validation passed. [2025-09-05T18:16:30.958310] [INFO ] [MAIN ] EHC: Found 1 missing trading days. [2025-09-05T18:16:30.969275] [INFO ] [MAIN ] EHC: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:31.021383] [INFO ] [REMOTE ] EHI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:16:31.023607] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-05T18:16:31.043128] [INFO ] [MAIN ] EHAB: Update completed successfully. [2025-09-05T18:16:31.045009] [INFO ] [MAIN ] Update Progress: 705/2363 symbols completed. EHAB took 3.6s. Estimated remaining: 38m 42s. Rate: 42.8 symbols/min [2025-09-05T18:16:31.068598] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-05T18:16:31.218099] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:31.246213] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-05T18:16:31.259297] [INFO ] [MAIN ] EIC: Loaded 11898 existing records. [2025-09-05T18:16:31.431894] [INFO ] [MAIN ] EIC: Found 1 missing trading days. [2025-09-05T18:16:31.432139] [INFO ] [MAIN ] EIC: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:31.510513] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:16:31.630363] [INFO ] [MAIN ] EHC: Adding 280 new records, updating 0 existing records. [2025-09-05T18:16:31.635306] [INFO ] [MAIN ] EHC: Combined dataset has 20100 total records. [2025-09-05T18:16:31.821249] [WARN ] [VALIDATOR ] EHC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:31.868565] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-05T18:16:32.023236] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-05T18:16:32.039009] [WARN ] [VALIDATOR ] EHC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:32.039262] [INFO ] [MAIN ] EHC: Combined data validation passed. [2025-09-05T18:16:32.173946] [INFO ] [MAIN ] EHC: Update completed successfully. [2025-09-05T18:16:32.176312] [INFO ] [MAIN ] Update Progress: 706/2363 symbols completed. EHC took 2.2s. Estimated remaining: 38m 40s. Rate: 42.9 symbols/min [2025-09-05T18:16:32.349349] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:32.351438] [INFO ] [MAIN ] EICA: Loaded 435 existing records. [2025-09-05T18:16:32.521483] [INFO ] [MAIN ] EICA: Found 1 missing trading days. [2025-09-05T18:16:32.521910] [INFO ] [MAIN ] EICA: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:32.663458] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-05T18:16:32.939882] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:16:32.994241] [INFO ] [MAIN ] EIC: Adding 127 new records, updating 0 existing records. [2025-09-05T18:16:32.997044] [INFO ] [MAIN ] EIC: Combined dataset has 12025 total records. [2025-09-05T18:16:33.183221] [WARN ] [VALIDATOR ] EIC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:33.377761] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-05T18:16:33.392962] [WARN ] [VALIDATOR ] EIC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:33.393191] [INFO ] [MAIN ] EIC: Combined data validation passed. [2025-09-05T18:16:33.463606] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-05T18:16:33.469402] [INFO ] [MAIN ] EIC: Update completed successfully. [2025-09-05T18:16:33.470891] [INFO ] [MAIN ] Update Progress: 707/2363 symbols completed. EIC took 2.4s. Estimated remaining: 38m 38s. Rate: 42.9 symbols/min [2025-09-05T18:16:33.646245] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:33.649165] [INFO ] [MAIN ] EICB: Loaded 1061 existing records. [2025-09-05T18:16:33.820143] [INFO ] [MAIN ] EICB: Found 1 missing trading days. [2025-09-05T18:16:33.820322] [INFO ] [MAIN ] EICB: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:34.112569] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-05T18:16:34.263435] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-05T18:16:34.785712] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:16:34.794091] [INFO ] [MAIN ] EICB: Adding 26 new records, updating 0 existing records. [2025-09-05T18:16:34.795388] [INFO ] [MAIN ] EICB: Combined dataset has 1087 total records. [2025-09-05T18:16:34.972979] [WARN ] [VALIDATOR ] EICB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:35.070026] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-05T18:16:35.159701] [WARN ] [VALIDATOR ] EICB: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-05 [2025-09-05T18:16:35.159905] [INFO ] [MAIN ] EICB: Combined data validation passed. [2025-09-05T18:16:35.167984] [INFO ] [MAIN ] EICB: Update completed successfully. [2025-09-05T18:16:35.168250] [INFO ] [MAIN ] Update Progress: 708/2363 symbols completed. EICB took 1.7s. Estimated remaining: 38m 37s. Rate: 42.9 symbols/min [2025-09-05T18:16:35.343157] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:35.343376] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-05T18:16:35.343529] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-05T18:16:35.343573] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-05T18:16:35.343627] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-05T18:16:35.704318] [INFO ] [REMOTE ] EICC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:16:35.863459] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-05T18:16:36.507943] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-05T18:16:36.668085] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-05T18:16:36.672690] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-05T18:16:37.077591] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-05T18:16:37.463536] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-05T18:16:38.263536] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-05T18:16:38.349910] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-05T18:16:38.783713] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:16:38.787545] [INFO ] [MAIN ] EICA: Adding 5 new records, updating 0 existing records. [2025-09-05T18:16:38.788821] [INFO ] [MAIN ] EICA: Combined dataset has 440 total records. [2025-09-05T18:16:38.979057] [WARN ] [VALIDATOR ] EICA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:39.068636] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-05T18:16:39.179174] [WARN ] [VALIDATOR ] EICA: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-08-06 [2025-09-05T18:16:39.179375] [INFO ] [MAIN ] EICA: Combined data validation passed. [2025-09-05T18:16:39.183385] [INFO ] [MAIN ] EICA: Update completed successfully. [2025-09-05T18:16:39.183607] [INFO ] [MAIN ] Update Progress: 709/2363 symbols completed. EICA took 7.0s. Estimated remaining: 38m 42s. Rate: 42.7 symbols/min [2025-09-05T18:16:39.392508] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:39.403893] [INFO ] [MAIN ] EIG: Loaded 10215 existing records. [2025-09-05T18:16:39.606132] [INFO ] [MAIN ] EIG: Found 1 missing trading days. [2025-09-05T18:16:39.606479] [INFO ] [MAIN ] EIG: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:39.766507] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-05T18:16:39.863464] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-05T18:16:40.389786] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:16:40.452541] [INFO ] [MAIN ] EIG: Adding 140 new records, updating 0 existing records. [2025-09-05T18:16:40.454723] [INFO ] [MAIN ] EIG: Combined dataset has 10355 total records. [2025-09-05T18:16:40.635886] [WARN ] [VALIDATOR ] EIG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:40.668549] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-05T18:16:40.837435] [WARN ] [VALIDATOR ] EIG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:40.837738] [INFO ] [MAIN ] EIG: Combined data validation passed. [2025-09-05T18:16:40.906109] [INFO ] [MAIN ] EIG: Update completed successfully. [2025-09-05T18:16:40.907744] [INFO ] [MAIN ] Update Progress: 710/2363 symbols completed. EIG took 1.7s. Estimated remaining: 38m 41s. Rate: 42.7 symbols/min [2025-09-05T18:16:41.081918] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:41.106633] [INFO ] [MAIN ] EIX: Loaded 25578 existing records. [2025-09-05T18:16:41.282427] [INFO ] [MAIN ] EIX: Found 1 missing trading days. [2025-09-05T18:16:41.282571] [INFO ] [MAIN ] EIX: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:41.463490] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-05T18:16:41.625384] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-05T18:16:42.232748] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-05T18:16:42.263475] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-05T18:16:43.063525] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-05T18:16:43.503120] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-05T18:16:43.707088] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-05T18:16:43.863476] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-05T18:16:44.385199] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:16:44.387227] [INFO ] [REMOTE ] EE: Full fetch complete (34164 records). [2025-09-05T18:16:44.669220] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-05T18:16:44.760066] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-05T18:16:44.920801] [INFO ] [MAIN ] EE: Full history saved. [2025-09-05T18:16:44.920953] [INFO ] [MAIN ] Update Progress: 711/2363 symbols completed. EE took 29.2s. Estimated remaining: 38m 46s. Rate: 42.6 symbols/min [2025-09-05T18:16:45.099525] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:45.125979] [INFO ] [MAIN ] EL: Loaded 25608 existing records. [2025-09-05T18:16:45.304233] [INFO ] [MAIN ] EL: Found 1 missing trading days. [2025-09-05T18:16:45.304424] [INFO ] [MAIN ] EL: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:45.370577] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:16:45.468566] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-05T18:16:45.522689] [INFO ] [MAIN ] EIX: Adding 385 new records, updating 0 existing records. [2025-09-05T18:16:45.525945] [INFO ] [MAIN ] EIX: Combined dataset has 25963 total records. [2025-09-05T18:16:45.706373] [WARN ] [VALIDATOR ] EIX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:45.911412] [WARN ] [VALIDATOR ] EIX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:45.911625] [INFO ] [MAIN ] EIX: Combined data validation passed. [2025-09-05T18:16:46.075636] [INFO ] [MAIN ] EIX: Update completed successfully. [2025-09-05T18:16:46.078520] [INFO ] [MAIN ] Update Progress: 712/2363 symbols completed. EIX took 5.2s. Estimated remaining: 38m 44s. Rate: 42.6 symbols/min [2025-09-05T18:16:46.252009] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:46.273788] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-05T18:16:46.294494] [INFO ] [MAIN ] ELAN: Loaded 40095 existing records. [2025-09-05T18:16:46.495947] [INFO ] [MAIN ] ELAN: Found 1 missing trading days. [2025-09-05T18:16:46.496190] [INFO ] [MAIN ] ELAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:46.504986] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T18:16:46.715127] [INFO ] [MAIN ] EL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:16:46.718521] [INFO ] [MAIN ] EL: Combined dataset has 25998 total records. [2025-09-05T18:16:46.899126] [WARN ] [VALIDATOR ] EL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:47.073611] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-05T18:16:47.099029] [WARN ] [VALIDATOR ] EL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:47.099236] [INFO ] [MAIN ] EL: Combined data validation passed. [2025-09-05T18:16:47.197871] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-05T18:16:47.271458] [INFO ] [MAIN ] EL: Update completed successfully. [2025-09-05T18:16:47.274750] [INFO ] [MAIN ] Update Progress: 713/2363 symbols completed. EL took 2.4s. Estimated remaining: 38m 42s. Rate: 42.6 symbols/min [2025-09-05T18:16:47.447476] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:47.450837] [INFO ] [MAIN ] ELC: Loaded 1793 existing records. [2025-09-05T18:16:47.633683] [INFO ] [MAIN ] ELC: Found 1 missing trading days. [2025-09-05T18:16:47.633931] [INFO ] [MAIN ] ELC: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:47.863487] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-05T18:16:47.902689] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:16:48.065294] [INFO ] [MAIN ] ELAN: Adding 390 new records, updating 0 existing records. [2025-09-05T18:16:48.069634] [INFO ] [MAIN ] ELAN: Combined dataset has 40485 total records. [2025-09-05T18:16:48.248673] [WARN ] [VALIDATOR ] ELAN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:16:48.445272] [WARN ] [VALIDATOR ] ELAN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:16:48.445490] [INFO ] [MAIN ] ELAN: Combined data validation passed. [2025-09-05T18:16:48.675174] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-05T18:16:48.689199] [INFO ] [MAIN ] ELAN: Update completed successfully. [2025-09-05T18:16:48.696841] [INFO ] [MAIN ] Update Progress: 714/2363 symbols completed. ELAN took 2.6s. Estimated remaining: 38m 41s. Rate: 42.6 symbols/min [2025-09-05T18:16:48.801319] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:16:48.821706] [INFO ] [MAIN ] ELC: Adding 25 new records, updating 0 existing records. [2025-09-05T18:16:48.873009] [INFO ] [MAIN ] ELC: Combined dataset has 1818 total records. [2025-09-05T18:16:48.892469] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:49.078221] [WARN ] [VALIDATOR ] ELC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:49.210296] [INFO ] [MAIN ] ELF: Loaded 24879 existing records. [2025-09-05T18:16:49.463872] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-05T18:16:49.474891] [INFO ] [MAIN ] ELF: Found 1 missing trading days. [2025-09-05T18:16:49.475289] [INFO ] [MAIN ] ELF: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:49.485279] [WARN ] [VALIDATOR ] ELC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:49.485533] [INFO ] [MAIN ] ELC: Combined data validation passed. [2025-09-05T18:16:49.498475] [INFO ] [MAIN ] ELC: Update completed successfully. [2025-09-05T18:16:49.498921] [INFO ] [MAIN ] Update Progress: 715/2363 symbols completed. ELC took 2.2s. Estimated remaining: 38m 38s. Rate: 42.7 symbols/min [2025-09-05T18:16:49.675965] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-05T18:16:49.693953] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:49.697046] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-09-05T18:16:49.697180] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-05T18:16:49.697552] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-05T18:16:49.697608] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-05T18:16:50.081845] [INFO ] [REMOTE ] ELME: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:16:50.263491] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-05T18:16:50.281713] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-05T18:16:51.063502] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-05T18:16:51.874764] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-05T18:16:51.877407] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-05T18:16:52.079838] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:16:52.226915] [INFO ] [MAIN ] ELF: Adding 384 new records, updating 0 existing records. [2025-09-05T18:16:52.232319] [INFO ] [MAIN ] ELF: Combined dataset has 25263 total records. [2025-09-05T18:16:52.413579] [WARN ] [VALIDATOR ] ELF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:52.608841] [WARN ] [VALIDATOR ] ELF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:52.609087] [INFO ] [MAIN ] ELF: Combined data validation passed. [2025-09-05T18:16:52.670620] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-05T18:16:52.777564] [INFO ] [MAIN ] ELF: Update completed successfully. [2025-09-05T18:16:52.780877] [INFO ] [MAIN ] Update Progress: 716/2363 symbols completed. ELF took 4.1s. Estimated remaining: 38m 41s. Rate: 42.6 symbols/min [2025-09-05T18:16:52.865281] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:16:52.888237] [INFO ] [REMOTE ] EHI: Full fetch complete (11708 records). [2025-09-05T18:16:53.052410] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:16:53.252557] [INFO ] [MAIN ] ELP: Loaded 12678 existing records. [2025-09-05T18:16:53.433875] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-05T18:16:53.486259] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-05T18:16:53.508670] [INFO ] [MAIN ] ELP: Found 1 missing trading days. [2025-09-05T18:16:53.509751] [INFO ] [MAIN ] ELP: Need to fetch 1 months: 2025-09 [2025-09-05T18:16:53.557234] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-05T18:16:53.557367] [INFO ] [MAIN ] Update Progress: 717/2363 symbols completed. EHI took 23.5s. Estimated remaining: 38m 38s. Rate: 42.6 symbols/min [2025-09-05T18:16:54.263440] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-05T18:16:54.285822] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-05T18:16:54.345942] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-05T18:16:54.731850] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:16:54.797030] [INFO ] [MAIN ] ELP: Adding 178 new records, updating 0 existing records. [2025-09-05T18:16:54.799532] [INFO ] [MAIN ] ELP: Combined dataset has 12856 total records. [2025-09-05T18:16:54.978799] [WARN ] [VALIDATOR ] ELP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:16:55.070719] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-05T18:16:55.192869] [WARN ] [VALIDATOR ] ELP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:16:55.193107] [INFO ] [MAIN ] ELP: Combined data validation passed. [2025-09-05T18:16:55.269984] [INFO ] [MAIN ] ELP: Update completed successfully. [2025-09-05T18:16:55.271622] [INFO ] [MAIN ] Update Progress: 718/2363 symbols completed. ELP took 2.5s. Estimated remaining: 38m 37s. Rate: 42.6 symbols/min [2025-09-05T18:16:55.826837] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-05T18:16:55.863460] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-05T18:16:56.317980] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:16:56.319382] [INFO ] [REMOTE ] EICC: Full fetch complete (6196 records). [2025-09-05T18:16:56.320007] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:16:56.320119] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:16:56.320186] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:16:56.320263] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-05T18:16:56.320363] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-05T18:16:56.320615] [INFO ] [MAIN ] Update Progress: 719/2363 symbols completed. EICC took 21.2s. Estimated remaining: 38m 35s. Rate: 42.6 symbols/min [2025-09-05T18:16:56.663482] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-05T18:16:58.204103] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-05T18:16:58.215448] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-05T18:16:59.706557] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-05T18:16:59.715033] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-05T18:17:01.514856] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-05T18:17:01.523172] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-05T18:17:02.995270] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-05T18:17:03.002954] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-05T18:17:04.571541] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-05T18:17:04.580492] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-05T18:17:05.937870] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-05T18:17:05.947243] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-05T18:17:07.178410] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T18:17:07.180823] [INFO ] [REMOTE ] ELME: Full fetch complete (42195 records). [2025-09-05T18:17:07.543226] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-05T18:17:07.722896] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-05T18:17:07.723042] [INFO ] [MAIN ] Update Progress: 720/2363 symbols completed. ELME took 18.2s. Estimated remaining: 38m 56s. Rate: 42.2 symbols/min [2025-09-05T18:17:08.339189] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:08.415501] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:08.416374] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:08.438045] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:08.441260] [INFO ] [MAIN ] ELPC: Loaded 396 existing records. [2025-09-05T18:17:08.493286] [INFO ] [MAIN ] EMA: Loaded 6498 existing records. [2025-09-05T18:17:08.753241] [INFO ] [MAIN ] ELS: Loaded 23584 existing records. [2025-09-05T18:17:08.752133] [INFO ] [MAIN ] ELPC: Found 1 missing trading days. [2025-09-05T18:17:08.805775] [INFO ] [MAIN ] ELPC: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:08.830873] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-05T18:17:08.851873] [INFO ] [MAIN ] ELV: Loaded 24432 existing records. [2025-09-05T18:17:08.922474] [INFO ] [MAIN ] EMA: Found 1 missing trading days. [2025-09-05T18:17:08.974117] [INFO ] [MAIN ] EMA: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:08.997152] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-05T18:17:09.157697] [INFO ] [MAIN ] ELS: Found 1 missing trading days. [2025-09-05T18:17:09.186106] [INFO ] [MAIN ] ELS: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:09.193853] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-05T18:17:09.193545] [INFO ] [MAIN ] ELV: Found 1 missing trading days. [2025-09-05T18:17:09.194696] [INFO ] [MAIN ] ELV: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:09.194907] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-05T18:17:09.325082] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:17:09.326586] [INFO ] [MAIN ] ELPC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:17:09.327456] [INFO ] [MAIN ] ELPC: Combined dataset has 396 total records. [2025-09-05T18:17:09.327807] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:17:09.327900] [FATAL] [MAIN ] ELPC: Combined data validation failed. [2025-09-05T18:17:09.327938] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:17:09.327981] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-05T18:17:09.328176] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-05T18:17:09.328470] [INFO ] [MAIN ] Update Progress: 721/2363 symbols completed. ELPC took 1.6s. Estimated remaining: 38m 55s. Rate: 42.2 symbols/min [2025-09-05T18:17:09.505966] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:09.516502] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:17:09.609933] [INFO ] [MAIN ] EMD: Loaded 10005 existing records. [2025-09-05T18:17:09.726939] [INFO ] [MAIN ] ELS: Adding 0 new records, updating 0 existing records. [2025-09-05T18:17:09.777755] [INFO ] [MAIN ] ELS: Combined dataset has 23584 total records. [2025-09-05T18:17:09.788780] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:17:09.838737] [INFO ] [MAIN ] EMD: Found 1 missing trading days. [2025-09-05T18:17:09.817173] [FATAL] [MAIN ] ELS: Combined data validation failed. [2025-09-05T18:17:09.839062] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:17:09.839182] [INFO ] [MAIN ] EMD: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:09.839586] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-05T18:17:09.839354] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-05T18:17:09.846119] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:17:09.855450] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-05T18:17:09.874918] [INFO ] [MAIN ] Update Progress: 722/2363 symbols completed. ELS took 2.2s. Estimated remaining: 38m 52s. Rate: 42.2 symbols/min [2025-09-05T18:17:10.024369] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:17:10.105756] [INFO ] [MAIN ] ELV: Adding 0 new records, updating 0 existing records. [2025-09-05T18:17:10.140948] [INFO ] [MAIN ] EMA: Adding 115 new records, updating 0 existing records. [2025-09-05T18:17:10.179175] [INFO ] [MAIN ] ELV: Combined dataset has 24432 total records. [2025-09-05T18:17:10.207270] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:10.208061] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:17:10.208727] [FATAL] [MAIN ] ELV: Combined data validation failed. [2025-09-05T18:17:10.209380] [INFO ] [MAIN ] EMA: Combined dataset has 6613 total records. [2025-09-05T18:17:10.209130] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:17:10.209885] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-05T18:17:10.241978] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-05T18:17:10.278729] [INFO ] [MAIN ] Update Progress: 723/2363 symbols completed. ELV took 2.6s. Estimated remaining: 38m 48s. Rate: 42.3 symbols/min [2025-09-05T18:17:10.357921] [INFO ] [MAIN ] EME: Loaded 13526 existing records. [2025-09-05T18:17:10.567620] [WARN ] [VALIDATOR ] EMA: Not fatal, but first date in data (2025-05-28) does not match expected start date (2025-01-31) [2025-09-05T18:17:10.878273] [INFO ] [MAIN ] EME: Found 1 missing trading days. [2025-09-05T18:17:10.895302] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:10.912477] [INFO ] [MAIN ] EME: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:10.913580] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-05T18:17:10.939963] [INFO ] [MAIN ] EMF: Loaded 1549 existing records. [2025-09-05T18:17:11.117354] [INFO ] [MAIN ] EMF: Found 1 missing trading days. [2025-09-05T18:17:11.120884] [INFO ] [MAIN ] EMF: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:11.121258] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-05T18:17:11.122907] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-05T18:17:11.185615] [INFO ] [MAIN ] EMD: Adding 135 new records, updating 0 existing records. [2025-09-05T18:17:11.188541] [INFO ] [MAIN ] EMD: Combined dataset has 10140 total records. [2025-09-05T18:17:11.368262] [WARN ] [VALIDATOR ] EMD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:11.561826] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:17:11.631540] [INFO ] [MAIN ] EME: Adding 195 new records, updating 0 existing records. [2025-09-05T18:17:11.635879] [INFO ] [MAIN ] EME: Combined dataset has 13721 total records. [2025-09-05T18:17:11.816956] [WARN ] [VALIDATOR ] EME: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:12.004409] [WARN ] [VALIDATOR ] EMA: Missing days changed. Total missing: 80 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27 [2025-09-05T18:17:12.004552] [INFO ] [MAIN ] EMA: Combined data validation passed. [2025-09-05T18:17:12.047730] [INFO ] [MAIN ] EMA: Update completed successfully. [2025-09-05T18:17:12.049137] [INFO ] [MAIN ] Update Progress: 724/2363 symbols completed. EMA took 4.3s. Estimated remaining: 38m 48s. Rate: 42.2 symbols/min [2025-09-05T18:17:12.130180] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:17:12.160675] [INFO ] [MAIN ] EMF: Adding 12 new records, updating 0 existing records. [2025-09-05T18:17:12.171484] [INFO ] [MAIN ] EMF: Combined dataset has 1561 total records. [2025-09-05T18:17:12.301038] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:12.425950] [WARN ] [VALIDATOR ] EMF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:12.555364] [INFO ] [MAIN ] EMN: Loaded 24172 existing records. [2025-09-05T18:17:12.743934] [WARN ] [VALIDATOR ] EMD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:12.755140] [INFO ] [MAIN ] EMD: Combined data validation passed. [2025-09-05T18:17:12.819474] [INFO ] [MAIN ] EMN: Found 1 missing trading days. [2025-09-05T18:17:12.819742] [INFO ] [MAIN ] EMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:12.820517] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-05T18:17:12.819917] [WARN ] [VALIDATOR ] EME: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:12.847847] [INFO ] [MAIN ] EME: Combined data validation passed. [2025-09-05T18:17:12.948708] [INFO ] [MAIN ] EMD: Update completed successfully. [2025-09-05T18:17:12.951144] [INFO ] [MAIN ] Update Progress: 725/2363 symbols completed. EMD took 3.6s. Estimated remaining: 38m 45s. Rate: 42.3 symbols/min [2025-09-05T18:17:13.083508] [INFO ] [MAIN ] EME: Update completed successfully. [2025-09-05T18:17:13.100858] [INFO ] [MAIN ] Update Progress: 726/2363 symbols completed. EME took 3.2s. Estimated remaining: 38m 41s. Rate: 42.3 symbols/min [2025-09-05T18:17:13.205176] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:13.340489] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:17:13.395631] [INFO ] [MAIN ] EMO: Loaded 6512 existing records. [2025-09-05T18:17:13.395228] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:13.426741] [WARN ] [VALIDATOR ] EMF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:13.587204] [INFO ] [MAIN ] EMF: Combined data validation passed. [2025-09-05T18:17:13.670566] [INFO ] [MAIN ] EMN: Adding 371 new records, updating 0 existing records. [2025-09-05T18:17:13.691526] [INFO ] [MAIN ] EMP: Loaded 1372 existing records. [2025-09-05T18:17:13.733952] [INFO ] [MAIN ] EMO: Found 1 missing trading days. [2025-09-05T18:17:13.734571] [INFO ] [MAIN ] EMO: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:13.772101] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-05T18:17:13.750966] [INFO ] [MAIN ] EMF: Update completed successfully. [2025-09-05T18:17:13.787931] [INFO ] [MAIN ] Update Progress: 727/2363 symbols completed. EMF took 3.5s. Estimated remaining: 38m 38s. Rate: 42.4 symbols/min [2025-09-05T18:17:13.926189] [INFO ] [MAIN ] EMN: Combined dataset has 24543 total records. [2025-09-05T18:17:14.091290] [INFO ] [MAIN ] EMP: Found 1 missing trading days. [2025-09-05T18:17:14.125704] [INFO ] [MAIN ] EMP: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:14.143869] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-05T18:17:14.180314] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:14.277858] [WARN ] [VALIDATOR ] EMN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:14.422031] [INFO ] [MAIN ] EMR: Loaded 25383 existing records. [2025-09-05T18:17:14.671540] [INFO ] [MAIN ] EMR: Found 1 missing trading days. [2025-09-05T18:17:14.671980] [INFO ] [MAIN ] EMR: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:14.672438] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-05T18:17:14.682942] [WARN ] [VALIDATOR ] EMN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:14.683191] [INFO ] [MAIN ] EMN: Combined data validation passed. [2025-09-05T18:17:14.779430] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:17:14.791863] [INFO ] [MAIN ] EMP: Adding 27 new records, updating 0 existing records. [2025-09-05T18:17:14.800122] [INFO ] [MAIN ] EMP: Combined dataset has 1399 total records. [2025-09-05T18:17:15.027362] [WARN ] [VALIDATOR ] EMP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:15.096711] [INFO ] [MAIN ] EMN: Update completed successfully. [2025-09-05T18:17:15.120159] [INFO ] [MAIN ] Update Progress: 728/2363 symbols completed. EMN took 3.1s. Estimated remaining: 38m 36s. Rate: 42.4 symbols/min [2025-09-05T18:17:15.389736] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-05T18:17:15.417979] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:15.476380] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:17:15.495508] [INFO ] [MAIN ] EMO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:17:15.527905] [INFO ] [MAIN ] EMO: Combined dataset has 6512 total records. [2025-09-05T18:17:15.544263] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:17:15.577974] [FATAL] [MAIN ] EMO: Combined data validation failed. [2025-09-05T18:17:15.594008] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:17:15.594433] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-05T18:17:15.610305] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-09-05T18:17:15.648695] [INFO ] [MAIN ] Update Progress: 729/2363 symbols completed. EMO took 2.7s. Estimated remaining: 38m 33s. Rate: 42.4 symbols/min [2025-09-05T18:17:15.675745] [INFO ] [MAIN ] EMR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:17:15.707794] [INFO ] [MAIN ] ENB: Loaded 25583 existing records. [2025-09-05T18:17:15.906162] [INFO ] [MAIN ] EMR: Combined dataset has 25773 total records. [2025-09-05T18:17:16.005564] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:16.093897] [INFO ] [MAIN ] ENB: Found 1 missing trading days. [2025-09-05T18:17:16.108838] [INFO ] [MAIN ] ENB: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:16.126732] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-05T18:17:16.115984] [INFO ] [MAIN ] ENFY: Loaded 2042 existing records. [2025-09-05T18:17:16.330784] [WARN ] [VALIDATOR ] EMR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:16.485233] [INFO ] [MAIN ] ENFY: Found 1 missing trading days. [2025-09-05T18:17:16.499565] [INFO ] [MAIN ] ENFY: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:16.513192] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-05T18:17:16.604336] [WARN ] [VALIDATOR ] EMP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:16.604881] [INFO ] [MAIN ] EMP: Combined data validation passed. [2025-09-05T18:17:16.615930] [INFO ] [MAIN ] EMP: Update completed successfully. [2025-09-05T18:17:16.616390] [INFO ] [MAIN ] Update Progress: 730/2363 symbols completed. EMP took 3.5s. Estimated remaining: 38m 30s. Rate: 42.4 symbols/min [2025-09-05T18:17:16.787844] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:16.801089] [WARN ] [VALIDATOR ] EMR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:16.807634] [INFO ] [MAIN ] ENIC: Loaded 17398 existing records. [2025-09-05T18:17:16.807837] [INFO ] [MAIN ] EMR: Combined data validation passed. [2025-09-05T18:17:17.094228] [INFO ] [MAIN ] ENIC: Found 1 missing trading days. [2025-09-05T18:17:17.103768] [INFO ] [MAIN ] ENIC: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:17.129888] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-05T18:17:17.152618] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:17:17.275393] [INFO ] [MAIN ] EMR: Update completed successfully. [2025-09-05T18:17:17.293862] [INFO ] [MAIN ] Update Progress: 731/2363 symbols completed. EMR took 3.5s. Estimated remaining: 38m 27s. Rate: 42.4 symbols/min [2025-09-05T18:17:17.420236] [INFO ] [MAIN ] ENB: Adding 389 new records, updating 0 existing records. [2025-09-05T18:17:17.540051] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:17.540486] [INFO ] [MAIN ] ENB: Combined dataset has 25972 total records. [2025-09-05T18:17:17.544678] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:17:17.633975] [INFO ] [MAIN ] ENO: Loaded 839 existing records. [2025-09-05T18:17:17.620427] [INFO ] [MAIN ] ENFY: Adding 5 new records, updating 0 existing records. [2025-09-05T18:17:17.737705] [INFO ] [MAIN ] ENFY: Combined dataset has 2047 total records. [2025-09-05T18:17:17.893157] [WARN ] [VALIDATOR ] ENB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:18.143888] [INFO ] [MAIN ] ENO: Found 1 missing trading days. [2025-09-05T18:17:18.144381] [INFO ] [MAIN ] ENO: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:18.155845] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-05T18:17:18.311924] [WARN ] [VALIDATOR ] ENFY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:18.420058] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:17:18.615229] [INFO ] [MAIN ] ENIC: Adding 240 new records, updating 0 existing records. [2025-09-05T18:17:18.621103] [INFO ] [MAIN ] ENIC: Combined dataset has 17638 total records. [2025-09-05T18:17:18.809746] [WARN ] [VALIDATOR ] ENIC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:18.831347] [WARN ] [VALIDATOR ] ENB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:18.866328] [INFO ] [MAIN ] ENB: Combined data validation passed. [2025-09-05T18:17:19.068923] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:17:19.104468] [INFO ] [MAIN ] ENO: Adding 26 new records, updating 0 existing records. [2025-09-05T18:17:19.068793] [WARN ] [VALIDATOR ] ENFY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:19.106791] [INFO ] [MAIN ] ENFY: Combined data validation passed. [2025-09-05T18:17:19.114854] [INFO ] [MAIN ] ENO: Combined dataset has 865 total records. [2025-09-05T18:17:19.174267] [INFO ] [MAIN ] ENFY: Update completed successfully. [2025-09-05T18:17:19.189216] [INFO ] [MAIN ] Update Progress: 732/2363 symbols completed. ENFY took 3.5s. Estimated remaining: 38m 27s. Rate: 42.4 symbols/min [2025-09-05T18:17:19.524162] [WARN ] [VALIDATOR ] ENO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:19.576243] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:19.604089] [INFO ] [MAIN ] ENB: Update completed successfully. [2025-09-05T18:17:19.633054] [INFO ] [MAIN ] Update Progress: 733/2363 symbols completed. ENB took 4.5s. Estimated remaining: 38m 23s. Rate: 42.5 symbols/min [2025-09-05T18:17:19.816024] [INFO ] [MAIN ] ENOV: Loaded 22754 existing records. [2025-09-05T18:17:19.822632] [WARN ] [VALIDATOR ] ENIC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:19.848886] [INFO ] [MAIN ] ENIC: Combined data validation passed. [2025-09-05T18:17:20.135610] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:20.198386] [INFO ] [MAIN ] ENIC: Update completed successfully. [2025-09-05T18:17:20.206735] [INFO ] [MAIN ] Update Progress: 734/2363 symbols completed. ENIC took 3.6s. Estimated remaining: 38m 20s. Rate: 42.5 symbols/min [2025-09-05T18:17:20.392541] [INFO ] [MAIN ] ENOV: Found 1 missing trading days. [2025-09-05T18:17:20.421787] [INFO ] [MAIN ] ENOV: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:20.441725] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-05T18:17:20.453191] [INFO ] [MAIN ] ENR: Loaded 21719 existing records. [2025-09-05T18:17:20.489380] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:20.625291] [INFO ] [MAIN ] ENS: Loaded 14196 existing records. [2025-09-05T18:17:20.738785] [INFO ] [MAIN ] ENR: Found 1 missing trading days. [2025-09-05T18:17:20.759421] [INFO ] [MAIN ] ENR: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:20.765033] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-05T18:17:20.863119] [INFO ] [MAIN ] ENS: Found 1 missing trading days. [2025-09-05T18:17:20.863451] [INFO ] [MAIN ] ENS: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:20.863707] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-05T18:17:20.867843] [WARN ] [VALIDATOR ] ENO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:20.868031] [INFO ] [MAIN ] ENO: Combined data validation passed. [2025-09-05T18:17:20.874881] [INFO ] [MAIN ] ENO: Update completed successfully. [2025-09-05T18:17:20.875202] [INFO ] [MAIN ] Update Progress: 735/2363 symbols completed. ENO took 3.6s. Estimated remaining: 38m 17s. Rate: 42.5 symbols/min [2025-09-05T18:17:21.046057] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:21.059827] [INFO ] [MAIN ] ENVA: Loaded 12004 existing records. [2025-09-05T18:17:21.228542] [INFO ] [MAIN ] ENVA: Found 1 missing trading days. [2025-09-05T18:17:21.228698] [INFO ] [MAIN ] ENVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:21.228904] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-05T18:17:21.267163] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:17:21.314191] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:17:21.473913] [INFO ] [MAIN ] ENOV: Adding 303 new records, updating 0 existing records. [2025-09-05T18:17:21.495862] [INFO ] [MAIN ] ENS: Adding 235 new records, updating 0 existing records. [2025-09-05T18:17:21.499958] [INFO ] [MAIN ] ENS: Combined dataset has 14431 total records. [2025-09-05T18:17:21.593950] [INFO ] [MAIN ] ENOV: Combined dataset has 23057 total records. [2025-09-05T18:17:21.793137] [WARN ] [VALIDATOR ] ENS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:21.806594] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:17:21.865756] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T18:17:22.015903] [WARN ] [VALIDATOR ] ENOV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:22.094460] [INFO ] [MAIN ] ENVA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:17:22.213284] [INFO ] [MAIN ] ENVA: Combined dataset has 12004 total records. [2025-09-05T18:17:22.255054] [FATAL] [VALIDATOR ] ENVA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:17:22.295073] [INFO ] [MAIN ] ENR: Adding 311 new records, updating 0 existing records. [2025-09-05T18:17:22.295226] [FATAL] [MAIN ] ENVA: Combined data validation failed. [2025-09-05T18:17:22.347913] [WARN ] [MAIN ] ENVA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:17:22.404310] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-05T18:17:22.434717] [INFO ] [MAIN ] ENR: Combined dataset has 22030 total records. [2025-09-05T18:17:22.434628] [INFO ] [LOCAL ] ENVA: Starting deletion of derivative data. [2025-09-05T18:17:22.459826] [INFO ] [MAIN ] Update Progress: 736/2363 symbols completed. ENVA took 1.6s. Estimated remaining: 38m 16s. Rate: 42.5 symbols/min [2025-09-05T18:17:22.784797] [WARN ] [VALIDATOR ] ENR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:22.845701] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:22.856614] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-09-05T18:17:22.871250] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-05T18:17:22.890657] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-05T18:17:22.912467] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-05T18:17:23.385681] [INFO ] [REMOTE ] EOD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:17:23.386354] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-05T18:17:23.386543] [WARN ] [VALIDATOR ] ENS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:23.387452] [INFO ] [MAIN ] ENS: Combined data validation passed. [2025-09-05T18:17:23.387816] [WARN ] [VALIDATOR ] ENOV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:23.388158] [INFO ] [MAIN ] ENOV: Combined data validation passed. [2025-09-05T18:17:23.594085] [INFO ] [MAIN ] ENS: Update completed successfully. [2025-09-05T18:17:23.599776] [INFO ] [MAIN ] Update Progress: 737/2363 symbols completed. ENS took 3.4s. Estimated remaining: 38m 14s. Rate: 42.5 symbols/min [2025-09-05T18:17:23.692426] [INFO ] [MAIN ] ENOV: Update completed successfully. [2025-09-05T18:17:23.712890] [INFO ] [MAIN ] Update Progress: 738/2363 symbols completed. ENOV took 4.5s. Estimated remaining: 38m 10s. Rate: 42.6 symbols/min [2025-09-05T18:17:23.888636] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:23.957672] [WARN ] [VALIDATOR ] ENR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:24.004045] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:24.004458] [INFO ] [MAIN ] ENR: Combined data validation passed. [2025-09-05T18:17:24.019043] [INFO ] [MAIN ] EOI: Loaded 4365 existing records. [2025-09-05T18:17:24.221085] [INFO ] [MAIN ] EOG: Loaded 25453 existing records. [2025-09-05T18:17:24.349749] [INFO ] [MAIN ] EOI: Found 1 missing trading days. [2025-09-05T18:17:24.371949] [INFO ] [MAIN ] EOI: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:24.388816] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-05T18:17:24.489508] [INFO ] [MAIN ] EOG: Found 1 missing trading days. [2025-09-05T18:17:24.490246] [INFO ] [MAIN ] EOG: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:24.490613] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-05T18:17:24.505126] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-05T18:17:24.510737] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-05T18:17:24.548580] [INFO ] [MAIN ] ENR: Update completed successfully. [2025-09-05T18:17:24.551247] [INFO ] [MAIN ] Update Progress: 739/2363 symbols completed. ENR took 4.9s. Estimated remaining: 38m 7s. Rate: 42.6 symbols/min [2025-09-05T18:17:24.727094] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:24.735768] [INFO ] [MAIN ] EOS: Loaded 6770 existing records. [2025-09-05T18:17:24.910824] [INFO ] [MAIN ] EOS: Found 1 missing trading days. [2025-09-05T18:17:24.910973] [INFO ] [MAIN ] EOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:24.911189] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-05T18:17:25.201446] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:17:25.406568] [INFO ] [MAIN ] EOG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:17:25.409807] [INFO ] [MAIN ] EOG: Combined dataset has 25843 total records. [2025-09-05T18:17:25.485668] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T18:17:25.544277] [INFO ] [MAIN ] EOI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:17:25.627552] [INFO ] [MAIN ] EOI: Combined dataset has 4365 total records. [2025-09-05T18:17:25.633913] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-05T18:17:25.632851] [WARN ] [VALIDATOR ] EOG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:25.637835] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-05T18:17:25.634478] [FATAL] [VALIDATOR ] EOI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:17:25.649156] [FATAL] [MAIN ] EOI: Combined data validation failed. [2025-09-05T18:17:25.663747] [WARN ] [MAIN ] EOI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:17:25.681797] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-05T18:17:25.742094] [INFO ] [LOCAL ] EOI: Starting deletion of derivative data. [2025-09-05T18:17:25.743095] [INFO ] [MAIN ] Update Progress: 740/2363 symbols completed. EOI took 2.0s. Estimated remaining: 38m 5s. Rate: 42.6 symbols/min [2025-09-05T18:17:26.006799] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:26.012173] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T18:17:26.051556] [INFO ] [MAIN ] EOS: Adding 81 new records, updating 0 existing records. [2025-09-05T18:17:26.054620] [INFO ] [MAIN ] EOT: Loaded 5019 existing records. [2025-09-05T18:17:26.139202] [INFO ] [MAIN ] EOS: Combined dataset has 6851 total records. [2025-09-05T18:17:26.308690] [INFO ] [MAIN ] EOT: Found 1 missing trading days. [2025-09-05T18:17:26.315738] [INFO ] [MAIN ] EOT: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:26.321928] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-05T18:17:26.427949] [WARN ] [VALIDATOR ] EOS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:26.534900] [WARN ] [VALIDATOR ] EOG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:26.569506] [INFO ] [MAIN ] EOG: Combined data validation passed. [2025-09-05T18:17:26.620999] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-05T18:17:26.625037] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-05T18:17:26.800801] [INFO ] [MAIN ] EOG: Update completed successfully. [2025-09-05T18:17:26.804574] [INFO ] [MAIN ] Update Progress: 741/2363 symbols completed. EOG took 3.2s. Estimated remaining: 38m 3s. Rate: 42.6 symbols/min [2025-09-05T18:17:26.984465] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:26.987714] [WARN ] [VALIDATOR ] EOS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:26.987933] [INFO ] [MAIN ] EOS: Combined data validation passed. [2025-09-05T18:17:27.029129] [INFO ] [MAIN ] EPAC: Loaded 13084 existing records. [2025-09-05T18:17:27.145626] [INFO ] [MAIN ] EOS: Update completed successfully. [2025-09-05T18:17:27.162204] [INFO ] [MAIN ] Update Progress: 742/2363 symbols completed. EOS took 2.6s. Estimated remaining: 37m 59s. Rate: 42.7 symbols/min [2025-09-05T18:17:27.301753] [INFO ] [MAIN ] EPAC: Found 1 missing trading days. [2025-09-05T18:17:27.321181] [INFO ] [MAIN ] EPAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:27.324557] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-05T18:17:27.396919] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:27.416107] [INFO ] [MAIN ] EPAM: Loaded 17545 existing records. [2025-09-05T18:17:27.526367] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:17:27.578876] [INFO ] [MAIN ] EOT: Adding 125 new records, updating 0 existing records. [2025-09-05T18:17:27.640295] [INFO ] [MAIN ] EPAM: Found 1 missing trading days. [2025-09-05T18:17:27.640808] [INFO ] [MAIN ] EPAM: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:27.641095] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-05T18:17:27.642033] [INFO ] [MAIN ] EOT: Combined dataset has 5144 total records. [2025-09-05T18:17:27.741719] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:17:27.857975] [INFO ] [MAIN ] EPAC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:17:27.888358] [WARN ] [VALIDATOR ] EOT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:17:27.889408] [INFO ] [MAIN ] EPAC: Combined dataset has 13084 total records. [2025-09-05T18:17:27.922831] [FATAL] [VALIDATOR ] EPAC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:17:27.943915] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-05T18:17:27.956563] [FATAL] [MAIN ] EPAC: Combined data validation failed. [2025-09-05T18:17:27.991444] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:17:27.991382] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-05T18:17:28.005466] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-05T18:17:28.010013] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-09-05T18:17:28.011995] [INFO ] [MAIN ] Update Progress: 743/2363 symbols completed. EPAC took 1.2s. Estimated remaining: 37m 57s. Rate: 42.7 symbols/min [2025-09-05T18:17:28.273475] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:28.293991] [WARN ] [VALIDATOR ] EOT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:17:28.294283] [INFO ] [MAIN ] EOT: Combined data validation passed. [2025-09-05T18:17:28.330465] [INFO ] [MAIN ] EPC: Loaded 30039 existing records. [2025-09-05T18:17:28.446560] [INFO ] [MAIN ] EOT: Update completed successfully. [2025-09-05T18:17:28.458155] [INFO ] [MAIN ] Update Progress: 744/2363 symbols completed. EOT took 2.7s. Estimated remaining: 37m 53s. Rate: 42.7 symbols/min [2025-09-05T18:17:28.525590] [INFO ] [MAIN ] EPC: Found 1 missing trading days. [2025-09-05T18:17:28.561897] [INFO ] [MAIN ] EPC: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:28.606685] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-05T18:17:28.635537] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:17:28.758541] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:28.780103] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-05T18:17:28.819109] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-05T18:17:28.829992] [INFO ] [MAIN ] EPAM: Adding 330 new records, updating 0 existing records. [2025-09-05T18:17:28.833636] [INFO ] [MAIN ] EPAM: Combined dataset has 17875 total records. [2025-09-05T18:17:29.031035] [WARN ] [VALIDATOR ] EPAM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:29.032026] [INFO ] [MAIN ] EPD: Loaded 25621 existing records. [2025-09-05T18:17:29.406321] [INFO ] [MAIN ] EPD: Found 1 missing trading days. [2025-09-05T18:17:29.407925] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:17:29.408236] [INFO ] [MAIN ] EPD: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:29.441759] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-05T18:17:29.598478] [INFO ] [MAIN ] EPC: Adding 313 new records, updating 560 existing records. [2025-09-05T18:17:29.605029] [INFO ] [MAIN ] EPC: Combined dataset has 30352 total records. [2025-09-05T18:17:29.787466] [WARN ] [VALIDATOR ] EPC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:17:29.890355] [WARN ] [VALIDATOR ] EPAM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:29.890629] [INFO ] [MAIN ] EPAM: Combined data validation passed. [2025-09-05T18:17:30.111408] [INFO ] [MAIN ] EPAM: Update completed successfully. [2025-09-05T18:17:30.113809] [INFO ] [MAIN ] Update Progress: 745/2363 symbols completed. EPAM took 2.9s. Estimated remaining: 37m 52s. Rate: 42.7 symbols/min [2025-09-05T18:17:30.148289] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-05T18:17:30.186488] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-05T18:17:30.225934] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:17:30.399067] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:30.475284] [INFO ] [MAIN ] EPD: Adding 390 new records, updating 0 existing records. [2025-09-05T18:17:30.476293] [WARN ] [VALIDATOR ] EPC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:17:30.478044] [INFO ] [MAIN ] EPC: Combined data validation passed. [2025-09-05T18:17:30.486464] [INFO ] [MAIN ] EPD: Combined dataset has 26011 total records. [2025-09-05T18:17:30.655194] [INFO ] [MAIN ] EPR: Loaded 21560 existing records. [2025-09-05T18:17:31.000801] [INFO ] [MAIN ] EPR: Found 1 missing trading days. [2025-09-05T18:17:30.967371] [WARN ] [VALIDATOR ] EPD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:31.031348] [INFO ] [MAIN ] EPR: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:31.036793] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-05T18:17:31.192001] [INFO ] [MAIN ] EPC: Update completed successfully. [2025-09-05T18:17:31.195399] [INFO ] [MAIN ] Update Progress: 746/2363 symbols completed. EPC took 3.2s. Estimated remaining: 37m 50s. Rate: 42.7 symbols/min [2025-09-05T18:17:31.472539] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:31.489430] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-05T18:17:31.502931] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-05T18:17:31.503401] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:17:31.644180] [INFO ] [MAIN ] EPRT: Loaded 22928 existing records. [2025-09-05T18:17:31.653173] [INFO ] [MAIN ] EPR: Adding 339 new records, updating 0 existing records. [2025-09-05T18:17:31.786109] [INFO ] [MAIN ] EPR: Combined dataset has 21899 total records. [2025-09-05T18:17:31.858554] [INFO ] [MAIN ] EPRT: Found 1 missing trading days. [2025-09-05T18:17:31.880845] [INFO ] [MAIN ] EPRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:31.901863] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-05T18:17:32.021106] [WARN ] [VALIDATOR ] EPR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:32.214599] [WARN ] [VALIDATOR ] EPD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:32.215045] [INFO ] [MAIN ] EPD: Combined data validation passed. [2025-09-05T18:17:32.273078] [WARN ] [VALIDATOR ] EPR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:32.273303] [INFO ] [MAIN ] EPR: Combined data validation passed. [2025-09-05T18:17:32.512005] [INFO ] [MAIN ] EPR: Update completed successfully. [2025-09-05T18:17:32.527551] [INFO ] [MAIN ] Update Progress: 747/2363 symbols completed. EPR took 2.4s. Estimated remaining: 37m 49s. Rate: 42.7 symbols/min [2025-09-05T18:17:32.535306] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-05T18:17:32.580479] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-05T18:17:32.601433] [INFO ] [MAIN ] EPD: Update completed successfully. [2025-09-05T18:17:32.587499] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:17:32.635466] [INFO ] [MAIN ] Update Progress: 748/2363 symbols completed. EPD took 4.1s. Estimated remaining: 37m 44s. Rate: 42.8 symbols/min [2025-09-05T18:17:32.966291] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:32.986346] [INFO ] [MAIN ] EPRT: Adding 330 new records, updating 0 existing records. [2025-09-05T18:17:33.067716] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:33.072061] [INFO ] [MAIN ] EQBK: Loaded 8368 existing records. [2025-09-05T18:17:33.110395] [INFO ] [MAIN ] EPRT: Combined dataset has 23258 total records. [2025-09-05T18:17:33.369178] [INFO ] [MAIN ] EQBK: Found 1 missing trading days. [2025-09-05T18:17:33.377710] [INFO ] [MAIN ] EQBK: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:33.389049] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-05T18:17:33.383551] [INFO ] [MAIN ] EQH: Loaded 25125 existing records. [2025-09-05T18:17:33.543916] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:17:33.558100] [WARN ] [VALIDATOR ] EPRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:33.628252] [INFO ] [REMOTE ] EOD: Full fetch complete (15360 records). [2025-09-05T18:17:33.907229] [INFO ] [MAIN ] EQH: Found 1 missing trading days. [2025-09-05T18:17:33.950894] [INFO ] [MAIN ] EQH: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:33.953528] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-05T18:17:34.251722] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-05T18:17:34.314693] [WARN ] [VALIDATOR ] EPRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:34.320505] [INFO ] [MAIN ] EPRT: Combined data validation passed. [2025-09-05T18:17:34.332128] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-05T18:17:34.332689] [INFO ] [MAIN ] Update Progress: 749/2363 symbols completed. EOD took 11.9s. Estimated remaining: 37m 44s. Rate: 42.8 symbols/min [2025-09-05T18:17:34.527346] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:17:34.619936] [INFO ] [MAIN ] EQBK: Adding 99 new records, updating 0 existing records. [2025-09-05T18:17:34.660888] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:34.670601] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:17:34.676910] [INFO ] [MAIN ] EQBK: Combined dataset has 8467 total records. [2025-09-05T18:17:34.959132] [INFO ] [MAIN ] EQNR: Loaded 25341 existing records. [2025-09-05T18:17:34.957915] [INFO ] [MAIN ] EPRT: Update completed successfully. [2025-09-05T18:17:34.977703] [INFO ] [MAIN ] Update Progress: 750/2363 symbols completed. EPRT took 3.8s. Estimated remaining: 37m 41s. Rate: 42.8 symbols/min [2025-09-05T18:17:35.075193] [INFO ] [MAIN ] EQH: Adding 390 new records, updating 0 existing records. [2025-09-05T18:17:35.136153] [WARN ] [VALIDATOR ] EQBK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:17:35.432912] [INFO ] [MAIN ] EQH: Combined dataset has 25515 total records. [2025-09-05T18:17:35.432809] [INFO ] [MAIN ] EQNR: Found 1 missing trading days. [2025-09-05T18:17:35.442030] [INFO ] [MAIN ] EQNR: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:35.510736] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-05T18:17:35.730065] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:35.730469] [WARN ] [MAIN ] EQR: No existing data found, performing full refresh instead. [2025-09-05T18:17:35.747340] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-05T18:17:35.747684] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-05T18:17:35.758157] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-05T18:17:35.847891] [WARN ] [VALIDATOR ] EQH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:36.341064] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:17:36.436284] [INFO ] [REMOTE ] EQR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:17:36.440954] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-05T18:17:36.571920] [INFO ] [MAIN ] EQNR: Adding 379 new records, updating 0 existing records. [2025-09-05T18:17:36.579443] [WARN ] [VALIDATOR ] EQBK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:17:36.579775] [INFO ] [MAIN ] EQBK: Combined data validation passed. [2025-09-05T18:17:36.579850] [INFO ] [MAIN ] EQNR: Combined dataset has 25720 total records. [2025-09-05T18:17:36.579342] [WARN ] [VALIDATOR ] EQH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:36.623505] [INFO ] [MAIN ] EQH: Combined data validation passed. [2025-09-05T18:17:36.799555] [INFO ] [MAIN ] EQBK: Update completed successfully. [2025-09-05T18:17:36.801034] [INFO ] [MAIN ] Update Progress: 751/2363 symbols completed. EQBK took 4.3s. Estimated remaining: 37m 40s. Rate: 42.8 symbols/min [2025-09-05T18:17:36.968242] [WARN ] [VALIDATOR ] EQNR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:37.225819] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:37.357468] [INFO ] [MAIN ] EQS: Loaded 1349 existing records. [2025-09-05T18:17:37.570849] [INFO ] [MAIN ] EQS: Found 1 missing trading days. [2025-09-05T18:17:37.579893] [INFO ] [MAIN ] EQS: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:37.582209] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-05T18:17:37.593753] [INFO ] [MAIN ] EQH: Update completed successfully. [2025-09-05T18:17:37.596932] [INFO ] [MAIN ] Update Progress: 752/2363 symbols completed. EQH took 4.9s. Estimated remaining: 37m 37s. Rate: 42.8 symbols/min [2025-09-05T18:17:37.769819] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:37.770112] [WARN ] [MAIN ] EQT: No existing data found, performing full refresh instead. [2025-09-05T18:17:37.770549] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-05T18:17:37.770690] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-05T18:17:37.770889] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-05T18:17:38.124942] [INFO ] [REMOTE ] EQT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:17:38.125223] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-05T18:17:38.125980] [WARN ] [VALIDATOR ] EQNR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:38.126105] [INFO ] [MAIN ] EQNR: Combined data validation passed. [2025-09-05T18:17:38.335917] [INFO ] [MAIN ] EQNR: Update completed successfully. [2025-09-05T18:17:38.338473] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-05T18:17:38.349403] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-05T18:17:38.352932] [INFO ] [MAIN ] Update Progress: 753/2363 symbols completed. EQNR took 4.0s. Estimated remaining: 37m 35s. Rate: 42.8 symbols/min [2025-09-05T18:17:38.546243] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:38.549772] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:17:38.574852] [INFO ] [MAIN ] EQS: Adding 46 new records, updating 0 existing records. [2025-09-05T18:17:38.577660] [INFO ] [MAIN ] EQV: Loaded 1530 existing records. [2025-09-05T18:17:38.649953] [INFO ] [MAIN ] EQS: Combined dataset has 1395 total records. [2025-09-05T18:17:38.897369] [INFO ] [MAIN ] EQV: Found 1 missing trading days. [2025-09-05T18:17:38.907759] [INFO ] [MAIN ] EQV: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:38.941183] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-05T18:17:38.960889] [WARN ] [VALIDATOR ] EQS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:39.163673] [WARN ] [VALIDATOR ] EQS: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-07-24 [2025-09-05T18:17:39.163883] [INFO ] [MAIN ] EQS: Combined data validation passed. [2025-09-05T18:17:39.173079] [INFO ] [MAIN ] EQS: Update completed successfully. [2025-09-05T18:17:39.173415] [INFO ] [MAIN ] Update Progress: 754/2363 symbols completed. EQS took 2.4s. Estimated remaining: 37m 32s. Rate: 42.9 symbols/min [2025-09-05T18:17:39.344974] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:39.368493] [INFO ] [MAIN ] ERJ: Loaded 24455 existing records. [2025-09-05T18:17:39.551696] [INFO ] [MAIN ] ERJ: Found 1 missing trading days. [2025-09-05T18:17:39.551885] [INFO ] [MAIN ] ERJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:39.552122] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-05T18:17:39.780992] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:17:39.788130] [INFO ] [MAIN ] EQV: Adding 22 new records, updating 0 existing records. [2025-09-05T18:17:39.789386] [INFO ] [MAIN ] EQV: Combined dataset has 1552 total records. [2025-09-05T18:17:39.974377] [WARN ] [VALIDATOR ] EQV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:40.164601] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:17:40.320260] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-05T18:17:40.341031] [INFO ] [MAIN ] ERJ: Adding 387 new records, updating 0 existing records. [2025-09-05T18:17:40.343024] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-05T18:17:40.347957] [INFO ] [MAIN ] ERJ: Combined dataset has 24842 total records. [2025-09-05T18:17:40.539096] [WARN ] [VALIDATOR ] ERJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:40.735370] [WARN ] [VALIDATOR ] EQV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:40.735869] [INFO ] [MAIN ] EQV: Combined data validation passed. [2025-09-05T18:17:40.748607] [INFO ] [MAIN ] EQV: Update completed successfully. [2025-09-05T18:17:40.751219] [INFO ] [MAIN ] Update Progress: 755/2363 symbols completed. EQV took 2.4s. Estimated remaining: 37m 31s. Rate: 42.9 symbols/min [2025-09-05T18:17:40.751272] [WARN ] [VALIDATOR ] ERJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:40.756874] [INFO ] [MAIN ] ERJ: Combined data validation passed. [2025-09-05T18:17:41.035020] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:41.106412] [INFO ] [MAIN ] ERJ: Update completed successfully. [2025-09-05T18:17:41.106338] [INFO ] [MAIN ] ERO: Loaded 19511 existing records. [2025-09-05T18:17:41.114840] [INFO ] [MAIN ] Update Progress: 756/2363 symbols completed. ERJ took 1.9s. Estimated remaining: 37m 27s. Rate: 42.9 symbols/min [2025-09-05T18:17:41.467732] [INFO ] [MAIN ] ERO: Found 1 missing trading days. [2025-09-05T18:17:41.444870] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:41.467944] [INFO ] [MAIN ] ERO: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:41.468225] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-05T18:17:41.493312] [INFO ] [MAIN ] ES: Loaded 25060 existing records. [2025-09-05T18:17:41.704861] [INFO ] [MAIN ] ES: Found 1 missing trading days. [2025-09-05T18:17:41.705216] [INFO ] [MAIN ] ES: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:41.705451] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-05T18:17:41.708629] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (3.58 seconds). [2025-09-05T18:17:42.058302] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-05T18:17:42.081779] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:17:42.215794] [INFO ] [MAIN ] ERO: Adding 385 new records, updating 0 existing records. [2025-09-05T18:17:42.219262] [INFO ] [MAIN ] ERO: Combined dataset has 19896 total records. [2025-09-05T18:17:42.268682] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-05T18:17:42.412498] [WARN ] [VALIDATOR ] ERO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:42.615465] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:17:42.768855] [INFO ] [MAIN ] ES: Adding 372 new records, updating 0 existing records. [2025-09-05T18:17:42.773455] [INFO ] [MAIN ] ES: Combined dataset has 25432 total records. [2025-09-05T18:17:42.959340] [WARN ] [VALIDATOR ] ES: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:17:43.065269] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-05T18:17:43.160607] [WARN ] [VALIDATOR ] ERO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:43.161039] [INFO ] [MAIN ] ERO: Combined data validation passed. [2025-09-05T18:17:43.285060] [INFO ] [MAIN ] ERO: Update completed successfully. [2025-09-05T18:17:43.289382] [INFO ] [MAIN ] Update Progress: 757/2363 symbols completed. ERO took 2.5s. Estimated remaining: 37m 28s. Rate: 42.9 symbols/min [2025-09-05T18:17:43.287014] [WARN ] [VALIDATOR ] ES: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:17:43.289689] [INFO ] [MAIN ] ES: Combined data validation passed. [2025-09-05T18:17:43.453915] [INFO ] [MAIN ] ES: Update completed successfully. [2025-09-05T18:17:43.457028] [INFO ] [MAIN ] Update Progress: 758/2363 symbols completed. ES took 2.3s. Estimated remaining: 37m 24s. Rate: 42.9 symbols/min [2025-09-05T18:17:44.446301] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-05T18:17:44.458104] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-05T18:17:44.965683] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-05T18:17:44.976065] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-05T18:17:46.239526] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-05T18:17:46.250560] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-05T18:17:46.424543] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-05T18:17:46.436101] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-05T18:17:47.827579] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-05T18:17:47.838287] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-05T18:17:48.639578] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-05T18:17:48.651224] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-05T18:17:49.371238] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-05T18:17:49.382568] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-05T18:17:50.429940] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-05T18:17:50.441504] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-05T18:17:50.649271] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-05T18:17:50.661338] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-05T18:17:51.235292] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:17:51.239035] [INFO ] [REMOTE ] EQR: Full fetch complete (55616 records). [2025-09-05T18:17:51.627169] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-05T18:17:51.875501] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-05T18:17:51.875684] [INFO ] [MAIN ] Update Progress: 759/2363 symbols completed. EQR took 16.8s. Estimated remaining: 37m 37s. Rate: 42.6 symbols/min [2025-09-05T18:17:52.549074] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-05T18:17:52.561078] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-05T18:17:54.642479] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-05T18:17:54.654622] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-05T18:17:56.517525] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-05T18:17:56.529337] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-05T18:17:57.283438] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:17:57.286518] [INFO ] [REMOTE ] EQT: Full fetch complete (58361 records). [2025-09-05T18:17:57.660851] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-05T18:17:57.927139] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-05T18:17:57.927291] [INFO ] [MAIN ] Update Progress: 760/2363 symbols completed. EQT took 20.3s. Estimated remaining: 37m 46s. Rate: 42.5 symbols/min [2025-09-05T18:17:58.563585] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:58.651320] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:58.663430] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:58.690309] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:17:58.708180] [INFO ] [MAIN ] ESAB: Loaded 12106 existing records. [2025-09-05T18:17:58.716281] [INFO ] [MAIN ] ESE: Loaded 8161 existing records. [2025-09-05T18:17:58.907942] [INFO ] [MAIN ] ESNT: Loaded 18276 existing records. [2025-09-05T18:17:58.929821] [INFO ] [MAIN ] ESI: Loaded 24017 existing records. [2025-09-05T18:17:59.311532] [INFO ] [MAIN ] ESE: Found 1 missing trading days. [2025-09-05T18:17:59.351313] [INFO ] [MAIN ] ESAB: Found 1 missing trading days. [2025-09-05T18:17:59.340707] [INFO ] [MAIN ] ESE: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:59.352464] [INFO ] [MAIN ] ESAB: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:59.352407] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-05T18:17:59.352761] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-05T18:17:59.503898] [INFO ] [MAIN ] ESNT: Found 1 missing trading days. [2025-09-05T18:17:59.509800] [INFO ] [MAIN ] ESI: Found 1 missing trading days. [2025-09-05T18:17:59.509886] [INFO ] [MAIN ] ESNT: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:59.510143] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-05T18:17:59.510183] [INFO ] [MAIN ] ESI: Need to fetch 1 months: 2025-09 [2025-09-05T18:17:59.511218] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-05T18:17:59.981455] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:18:00.056685] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:18:00.056529] [INFO ] [MAIN ] ESNT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:18:00.093298] [INFO ] [MAIN ] ESNT: Combined dataset has 18276 total records. [2025-09-05T18:18:00.107487] [INFO ] [MAIN ] ESE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:18:00.108486] [FATAL] [VALIDATOR ] ESNT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:18:00.108575] [FATAL] [MAIN ] ESNT: Combined data validation failed. [2025-09-05T18:18:00.108613] [WARN ] [MAIN ] ESNT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:18:00.108683] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-05T18:18:00.109709] [INFO ] [LOCAL ] ESNT: Starting deletion of derivative data. [2025-09-05T18:18:00.109756] [INFO ] [MAIN ] ESE: Combined dataset has 8161 total records. [2025-09-05T18:18:00.111726] [INFO ] [MAIN ] Update Progress: 761/2363 symbols completed. ESNT took 2.2s. Estimated remaining: 37m 46s. Rate: 42.4 symbols/min [2025-09-05T18:18:00.110168] [FATAL] [VALIDATOR ] ESE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:18:00.111990] [FATAL] [MAIN ] ESE: Combined data validation failed. [2025-09-05T18:18:00.187599] [WARN ] [MAIN ] ESE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:18:00.214428] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-05T18:18:00.229849] [INFO ] [LOCAL ] ESE: Starting deletion of derivative data. [2025-09-05T18:18:00.266740] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:18:00.301212] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:00.311107] [INFO ] [MAIN ] Update Progress: 762/2363 symbols completed. ESE took 2.4s. Estimated remaining: 37m 42s. Rate: 42.5 symbols/min [2025-09-05T18:18:00.574249] [INFO ] [MAIN ] ESI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:18:00.599403] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:00.608582] [INFO ] [MAIN ] ESRT: Loaded 22477 existing records. [2025-09-05T18:18:00.640436] [INFO ] [MAIN ] ESI: Combined dataset has 24017 total records. [2025-09-05T18:18:00.686048] [FATAL] [VALIDATOR ] ESI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:18:00.700872] [FATAL] [MAIN ] ESI: Combined data validation failed. [2025-09-05T18:18:00.707375] [WARN ] [MAIN ] ESI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:18:00.719487] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-05T18:18:00.748244] [INFO ] [LOCAL ] ESI: Starting deletion of derivative data. [2025-09-05T18:18:00.769089] [INFO ] [MAIN ] ESS: Loaded 14733 existing records. [2025-09-05T18:18:00.842557] [INFO ] [MAIN ] ESRT: Found 1 missing trading days. [2025-09-05T18:18:00.837119] [INFO ] [MAIN ] Update Progress: 763/2363 symbols completed. ESI took 2.9s. Estimated remaining: 37m 38s. Rate: 42.5 symbols/min [2025-09-05T18:18:00.843193] [INFO ] [MAIN ] ESRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:00.927051] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-05T18:18:01.223630] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:01.231140] [INFO ] [MAIN ] ESS: Found 1 missing trading days. [2025-09-05T18:18:01.231987] [INFO ] [MAIN ] ESS: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:01.232524] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-05T18:18:01.263476] [INFO ] [MAIN ] ESTC: Loaded 23992 existing records. [2025-09-05T18:18:01.379922] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-05T18:18:01.549293] [INFO ] [MAIN ] ESAB: Adding 146 new records, updating 0 existing records. [2025-09-05T18:18:01.557965] [INFO ] [MAIN ] ESTC: Found 1 missing trading days. [2025-09-05T18:18:01.558369] [INFO ] [MAIN ] ESTC: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:01.558873] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-05T18:18:01.562076] [INFO ] [MAIN ] ESAB: Combined dataset has 12252 total records. [2025-09-05T18:18:01.739261] [WARN ] [VALIDATOR ] ESAB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:01.854502] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:18:02.091157] [INFO ] [MAIN ] ESRT: Adding 337 new records, updating 0 existing records. [2025-09-05T18:18:02.092536] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:18:02.198740] [INFO ] [MAIN ] ESS: Adding 214 new records, updating 0 existing records. [2025-09-05T18:18:02.198905] [INFO ] [MAIN ] ESRT: Combined dataset has 22814 total records. [2025-09-05T18:18:02.307975] [INFO ] [MAIN ] ESS: Combined dataset has 14947 total records. [2025-09-05T18:18:02.496988] [WARN ] [VALIDATOR ] ESRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:02.659618] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T18:18:02.715016] [WARN ] [VALIDATOR ] ESS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:03.085054] [WARN ] [VALIDATOR ] ESAB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:03.113500] [INFO ] [MAIN ] ESAB: Combined data validation passed. [2025-09-05T18:18:03.139992] [INFO ] [MAIN ] ESTC: Adding 383 new records, updating 0 existing records. [2025-09-05T18:18:03.275995] [INFO ] [MAIN ] ESTC: Combined dataset has 24375 total records. [2025-09-05T18:18:03.537546] [WARN ] [VALIDATOR ] ESTC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:03.679132] [INFO ] [MAIN ] ESAB: Update completed successfully. [2025-09-05T18:18:03.758747] [INFO ] [MAIN ] Update Progress: 764/2363 symbols completed. ESAB took 5.8s. Estimated remaining: 37m 40s. Rate: 42.4 symbols/min [2025-09-05T18:18:03.806145] [WARN ] [VALIDATOR ] ESS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:03.815149] [INFO ] [MAIN ] ESS: Combined data validation passed. [2025-09-05T18:18:03.814944] [WARN ] [VALIDATOR ] ESRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:03.829429] [INFO ] [MAIN ] ESRT: Combined data validation passed. [2025-09-05T18:18:04.090821] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:04.128933] [INFO ] [MAIN ] ESS: Update completed successfully. [2025-09-05T18:18:04.138146] [INFO ] [MAIN ] Update Progress: 765/2363 symbols completed. ESS took 3.8s. Estimated remaining: 37m 37s. Rate: 42.5 symbols/min [2025-09-05T18:18:04.277969] [INFO ] [MAIN ] ET: Loaded 25773 existing records. [2025-09-05T18:18:04.427125] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:04.497503] [INFO ] [MAIN ] ETB: Loaded 5180 existing records. [2025-09-05T18:18:04.648417] [INFO ] [MAIN ] ET: Found 1 missing trading days. [2025-09-05T18:18:04.660013] [INFO ] [MAIN ] ESRT: Update completed successfully. [2025-09-05T18:18:04.659869] [INFO ] [MAIN ] ET: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:04.661084] [WARN ] [VALIDATOR ] ESTC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:04.693328] [INFO ] [MAIN ] ESTC: Combined data validation passed. [2025-09-05T18:18:04.692677] [INFO ] [MAIN ] Update Progress: 766/2363 symbols completed. ESRT took 4.6s. Estimated remaining: 37m 33s. Rate: 42.5 symbols/min [2025-09-05T18:18:04.693149] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-05T18:18:04.855455] [INFO ] [MAIN ] ETB: Found 1 missing trading days. [2025-09-05T18:18:04.861228] [INFO ] [MAIN ] ETB: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:04.946136] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-05T18:18:05.050771] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:05.081078] [INFO ] [MAIN ] ETD: Loaded 20948 existing records. [2025-09-05T18:18:05.285585] [INFO ] [MAIN ] ETD: Found 1 missing trading days. [2025-09-05T18:18:05.291470] [INFO ] [MAIN ] ETD: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:05.294871] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-05T18:18:05.299801] [INFO ] [MAIN ] ESTC: Update completed successfully. [2025-09-05T18:18:05.302822] [INFO ] [MAIN ] Update Progress: 767/2363 symbols completed. ESTC took 4.5s. Estimated remaining: 37m 30s. Rate: 42.6 symbols/min [2025-09-05T18:18:05.473521] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:05.473764] [WARN ] [MAIN ] ETG: No existing data found, performing full refresh instead. [2025-09-05T18:18:05.473873] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-05T18:18:05.473912] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-05T18:18:05.473958] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-05T18:18:05.765471] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:18:05.873213] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:18:05.887988] [INFO ] [REMOTE ] ETG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:18:05.900357] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-05T18:18:05.934951] [INFO ] [MAIN ] ETB: Adding 46 new records, updating 0 existing records. [2025-09-05T18:18:06.001559] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:18:06.052459] [INFO ] [MAIN ] ET: Adding 390 new records, updating 0 existing records. [2025-09-05T18:18:06.036635] [INFO ] [MAIN ] ETB: Combined dataset has 5226 total records. [2025-09-05T18:18:06.284614] [INFO ] [MAIN ] ETD: Adding 204 new records, updating 0 existing records. [2025-09-05T18:18:06.301974] [INFO ] [MAIN ] ET: Combined dataset has 26163 total records. [2025-09-05T18:18:06.342135] [WARN ] [VALIDATOR ] ETB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:06.518848] [INFO ] [MAIN ] ETD: Combined dataset has 21152 total records. [2025-09-05T18:18:06.799981] [WARN ] [VALIDATOR ] ET: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:06.996035] [WARN ] [VALIDATOR ] ETD: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:18:07.301706] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-05T18:18:07.307031] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-05T18:18:07.329691] [WARN ] [VALIDATOR ] ETD: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:18:07.329795] [WARN ] [VALIDATOR ] ET: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:07.330853] [INFO ] [MAIN ] ET: Combined data validation passed. [2025-09-05T18:18:07.330770] [INFO ] [MAIN ] ETD: Combined data validation passed. [2025-09-05T18:18:07.332545] [WARN ] [VALIDATOR ] ETB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:07.332922] [INFO ] [MAIN ] ETB: Combined data validation passed. [2025-09-05T18:18:07.590136] [INFO ] [MAIN ] ETB: Update completed successfully. [2025-09-05T18:18:07.591516] [INFO ] [MAIN ] Update Progress: 768/2363 symbols completed. ETB took 3.4s. Estimated remaining: 37m 31s. Rate: 42.5 symbols/min [2025-09-05T18:18:07.590197] [INFO ] [MAIN ] ETD: Update completed successfully. [2025-09-05T18:18:07.595697] [INFO ] [MAIN ] Update Progress: 769/2363 symbols completed. ETD took 2.9s. Estimated remaining: 37m 26s. Rate: 42.6 symbols/min [2025-09-05T18:18:07.909177] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:07.949803] [WARN ] [MAIN ] ETJ: No existing data found, performing full refresh instead. [2025-09-05T18:18:08.029230] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-05T18:18:08.031402] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-05T18:18:08.030736] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:08.033264] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-05T18:18:08.034864] [WARN ] [MAIN ] ETN: No existing data found, performing full refresh instead. [2025-09-05T18:18:08.047277] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-05T18:18:08.057943] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-05T18:18:08.115568] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-05T18:18:08.248542] [INFO ] [MAIN ] ET: Update completed successfully. [2025-09-05T18:18:08.315609] [INFO ] [MAIN ] Update Progress: 770/2363 symbols completed. ET took 4.6s. Estimated remaining: 37m 24s. Rate: 42.6 symbols/min [2025-09-05T18:18:08.535723] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-05T18:18:08.628882] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-05T18:18:08.833753] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:18:08.862461] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-05T18:18:09.016387] [INFO ] [REMOTE ] ETN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:18:09.019658] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:09.020193] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-05T18:18:09.025805] [INFO ] [MAIN ] ETO: Loaded 3282 existing records. [2025-09-05T18:18:09.197895] [INFO ] [MAIN ] ETO: Found 1 missing trading days. [2025-09-05T18:18:09.198108] [INFO ] [MAIN ] ETO: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:09.198345] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-05T18:18:09.974121] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-05T18:18:09.978395] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-05T18:18:10.049096] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:18:10.066973] [INFO ] [MAIN ] ETO: Adding 32 new records, updating 0 existing records. [2025-09-05T18:18:10.069007] [INFO ] [MAIN ] ETO: Combined dataset has 3314 total records. [2025-09-05T18:18:10.080918] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-05T18:18:10.128482] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-05T18:18:10.263746] [WARN ] [VALIDATOR ] ETO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:10.449357] [WARN ] [VALIDATOR ] ETO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:10.449576] [INFO ] [MAIN ] ETO: Combined data validation passed. [2025-09-05T18:18:10.470752] [INFO ] [MAIN ] ETO: Update completed successfully. [2025-09-05T18:18:10.471282] [INFO ] [MAIN ] Update Progress: 771/2363 symbols completed. ETO took 2.1s. Estimated remaining: 37m 24s. Rate: 42.6 symbols/min [2025-09-05T18:18:10.641372] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:10.667363] [INFO ] [MAIN ] ETR: Loaded 25394 existing records. [2025-09-05T18:18:10.845218] [INFO ] [MAIN ] ETR: Found 1 missing trading days. [2025-09-05T18:18:10.845490] [INFO ] [MAIN ] ETR: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:10.845808] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-05T18:18:10.863158] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-05T18:18:10.869161] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-05T18:18:11.065407] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-05T18:18:11.076238] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-05T18:18:11.168831] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-05T18:18:11.173078] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-05T18:18:11.280517] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:18:11.442305] [INFO ] [MAIN ] ETR: Adding 385 new records, updating 0 existing records. [2025-09-05T18:18:11.446735] [INFO ] [MAIN ] ETR: Combined dataset has 25779 total records. [2025-09-05T18:18:11.632318] [WARN ] [VALIDATOR ] ETR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:11.846782] [WARN ] [VALIDATOR ] ETR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:11.847015] [INFO ] [MAIN ] ETR: Combined data validation passed. [2025-09-05T18:18:12.032674] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-05T18:18:12.052714] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-05T18:18:12.055928] [INFO ] [MAIN ] ETR: Update completed successfully. [2025-09-05T18:18:12.059040] [INFO ] [MAIN ] Update Progress: 772/2363 symbols completed. ETR took 1.6s. Estimated remaining: 37m 23s. Rate: 42.6 symbols/min [2025-09-05T18:18:12.235264] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:12.246136] [INFO ] [MAIN ] ETV: Loaded 9772 existing records. [2025-09-05T18:18:12.419533] [INFO ] [MAIN ] ETV: Found 1 missing trading days. [2025-09-05T18:18:12.419718] [INFO ] [MAIN ] ETV: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:12.419988] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-05T18:18:12.433846] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-05T18:18:12.663461] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-05T18:18:13.629621] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:18:13.696993] [INFO ] [MAIN ] ETV: Adding 128 new records, updating 0 existing records. [2025-09-05T18:18:13.736224] [INFO ] [MAIN ] ETV: Combined dataset has 9900 total records. [2025-09-05T18:18:13.738257] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-05T18:18:13.818875] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-05T18:18:13.940810] [WARN ] [VALIDATOR ] ETV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:13.977815] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-05T18:18:14.079164] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-05T18:18:14.174038] [WARN ] [VALIDATOR ] ETV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:14.174248] [INFO ] [MAIN ] ETV: Combined data validation passed. [2025-09-05T18:18:14.235567] [INFO ] [MAIN ] ETV: Update completed successfully. [2025-09-05T18:18:14.236905] [INFO ] [MAIN ] Update Progress: 773/2363 symbols completed. ETV took 2.2s. Estimated remaining: 37m 23s. Rate: 42.5 symbols/min [2025-09-05T18:18:14.268664] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-05T18:18:14.418960] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:14.419307] [WARN ] [MAIN ] ETW: No existing data found, performing full refresh instead. [2025-09-05T18:18:14.419461] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-05T18:18:14.419502] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-05T18:18:14.419547] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-05T18:18:14.773847] [INFO ] [REMOTE ] ETW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:18:15.063469] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-05T18:18:15.382122] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-05T18:18:15.863482] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-05T18:18:16.435063] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-05T18:18:16.663501] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-05T18:18:16.712998] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-05T18:18:16.834256] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-05T18:18:17.463470] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-05T18:18:18.263468] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-05T18:18:18.459608] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-05T18:18:19.006186] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-05T18:18:19.063430] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-05T18:18:19.242131] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-05T18:18:19.863534] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-05T18:18:20.663485] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-05T18:18:20.712204] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-05T18:18:20.929148] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-05T18:18:21.463475] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-05T18:18:21.502201] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:18:21.503749] [INFO ] [REMOTE ] ETG: Full fetch complete (18836 records). [2025-09-05T18:18:21.897830] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-05T18:18:21.987121] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-05T18:18:21.987282] [INFO ] [MAIN ] Update Progress: 774/2363 symbols completed. ETG took 16.7s. Estimated remaining: 37m 34s. Rate: 42.3 symbols/min [2025-09-05T18:18:22.162392] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:22.168028] [INFO ] [MAIN ] ETX: Loaded 3226 existing records. [2025-09-05T18:18:22.268697] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-05T18:18:22.341262] [INFO ] [MAIN ] ETX: Found 1 missing trading days. [2025-09-05T18:18:22.341389] [INFO ] [MAIN ] ETX: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:22.583666] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-05T18:18:23.063473] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-05T18:18:23.863471] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-05T18:18:24.174844] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-05T18:18:24.339525] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-05T18:18:24.663462] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-05T18:18:24.984580] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-05T18:18:25.463502] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-05T18:18:26.263470] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-05T18:18:26.666895] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-05T18:18:27.063469] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-05T18:18:27.100865] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:18:27.119914] [INFO ] [MAIN ] ETX: Adding 50 new records, updating 0 existing records. [2025-09-05T18:18:27.121770] [INFO ] [MAIN ] ETX: Combined dataset has 3276 total records. [2025-09-05T18:18:27.309014] [WARN ] [VALIDATOR ] ETX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:27.492959] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-05T18:18:27.595307] [WARN ] [VALIDATOR ] ETX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:27.595524] [INFO ] [MAIN ] ETX: Combined data validation passed. [2025-09-05T18:18:27.618169] [INFO ] [MAIN ] ETX: Update completed successfully. [2025-09-05T18:18:27.618779] [INFO ] [MAIN ] Update Progress: 775/2363 symbols completed. ETX took 5.6s. Estimated remaining: 37m 42s. Rate: 42.1 symbols/min [2025-09-05T18:18:27.825224] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:27.837195] [INFO ] [MAIN ] ETY: Loaded 10365 existing records. [2025-09-05T18:18:27.868623] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-05T18:18:28.014635] [INFO ] [MAIN ] ETY: Found 1 missing trading days. [2025-09-05T18:18:28.014854] [INFO ] [MAIN ] ETY: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:28.460517] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-05T18:18:28.663469] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-05T18:18:29.463462] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-05T18:18:29.963808] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-05T18:18:30.014804] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-05T18:18:30.263522] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-05T18:18:30.407615] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-05T18:18:31.063525] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-05T18:18:31.204882] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:18:31.262747] [INFO ] [MAIN ] ETY: Adding 123 new records, updating 0 existing records. [2025-09-05T18:18:31.264871] [INFO ] [MAIN ] ETY: Combined dataset has 10488 total records. [2025-09-05T18:18:31.442149] [WARN ] [VALIDATOR ] ETY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:31.629534] [WARN ] [VALIDATOR ] ETY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:31.629766] [INFO ] [MAIN ] ETY: Combined data validation passed. [2025-09-05T18:18:31.695409] [INFO ] [MAIN ] ETY: Update completed successfully. [2025-09-05T18:18:31.696598] [INFO ] [MAIN ] Update Progress: 776/2363 symbols completed. ETY took 4.1s. Estimated remaining: 37m 46s. Rate: 42.0 symbols/min [2025-09-05T18:18:31.864157] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-05T18:18:31.865990] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:31.876204] [INFO ] [MAIN ] EVC: Loaded 8865 existing records. [2025-09-05T18:18:32.054487] [INFO ] [MAIN ] EVC: Found 1 missing trading days. [2025-09-05T18:18:32.054632] [INFO ] [MAIN ] EVC: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:32.312855] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-05T18:18:32.535484] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:18:32.536880] [INFO ] [REMOTE ] ETJ: Full fetch complete (18793 records). [2025-09-05T18:18:32.678821] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-05T18:18:32.897916] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-05T18:18:32.969601] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-05T18:18:32.969766] [INFO ] [MAIN ] Update Progress: 777/2363 symbols completed. ETJ took 25.4s. Estimated remaining: 37m 44s. Rate: 42.0 symbols/min [2025-09-05T18:18:33.139595] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:33.147248] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:18:33.150360] [INFO ] [REMOTE ] ETN: Full fetch complete (57587 records). [2025-09-05T18:18:33.262327] [INFO ] [MAIN ] EVEX: Loaded 16330 existing records. [2025-09-05T18:18:33.470078] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-05T18:18:33.614419] [INFO ] [MAIN ] EVEX: Found 1 missing trading days. [2025-09-05T18:18:33.625466] [INFO ] [MAIN ] EVEX: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:33.703519] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-05T18:18:33.965679] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-05T18:18:33.965884] [INFO ] [MAIN ] Update Progress: 778/2363 symbols completed. ETN took 26.4s. Estimated remaining: 37m 42s. Rate: 42.0 symbols/min [2025-09-05T18:18:34.135624] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:34.141447] [INFO ] [MAIN ] EVF: Loaded 4726 existing records. [2025-09-05T18:18:34.268632] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-05T18:18:34.313344] [INFO ] [MAIN ] EVF: Found 1 missing trading days. [2025-09-05T18:18:34.313442] [INFO ] [MAIN ] EVF: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:34.809548] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T18:18:34.811067] [INFO ] [REMOTE ] ETW: Full fetch complete (27613 records). [2025-09-05T18:18:34.811918] [FATAL] [VALIDATOR ] ETW: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:18:34.811995] [FATAL] [MAIN ] ETW: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:18:34.812032] [WARN ] [MAIN ] ETW: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:18:34.812068] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-05T18:18:34.812128] [INFO ] [LOCAL ] ETW: Starting deletion of derivative data. [2025-09-05T18:18:34.812247] [INFO ] [MAIN ] Update Progress: 779/2363 symbols completed. ETW took 20.6s. Estimated remaining: 37m 39s. Rate: 42.1 symbols/min [2025-09-05T18:18:34.982096] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:34.986537] [INFO ] [MAIN ] EVG: Loaded 2854 existing records. [2025-09-05T18:18:35.068712] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-05T18:18:35.157796] [INFO ] [MAIN ] EVG: Found 1 missing trading days. [2025-09-05T18:18:35.157921] [INFO ] [MAIN ] EVG: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:35.446835] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:18:35.573189] [INFO ] [MAIN ] EVEX: Adding 360 new records, updating 0 existing records. [2025-09-05T18:18:35.576107] [INFO ] [MAIN ] EVEX: Combined dataset has 16690 total records. [2025-09-05T18:18:35.682329] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:18:35.774009] [INFO ] [MAIN ] EVC: Adding 118 new records, updating 0 existing records. [2025-09-05T18:18:35.803577] [WARN ] [VALIDATOR ] EVEX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:35.867237] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-05T18:18:35.888417] [INFO ] [MAIN ] EVC: Combined dataset has 8983 total records. [2025-09-05T18:18:36.173614] [WARN ] [VALIDATOR ] EVC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:36.369394] [WARN ] [VALIDATOR ] EVC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:36.369500] [WARN ] [VALIDATOR ] EVEX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:36.369829] [INFO ] [MAIN ] EVEX: Combined data validation passed. [2025-09-05T18:18:36.369743] [INFO ] [MAIN ] EVC: Combined data validation passed. [2025-09-05T18:18:36.504342] [INFO ] [MAIN ] EVC: Update completed successfully. [2025-09-05T18:18:36.509141] [INFO ] [MAIN ] Update Progress: 780/2363 symbols completed. EVC took 4.8s. Estimated remaining: 37m 38s. Rate: 42.1 symbols/min [2025-09-05T18:18:36.597836] [INFO ] [MAIN ] EVEX: Update completed successfully. [2025-09-05T18:18:36.618249] [INFO ] [MAIN ] Update Progress: 781/2363 symbols completed. EVEX took 3.6s. Estimated remaining: 37m 34s. Rate: 42.1 symbols/min [2025-09-05T18:18:36.681604] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-05T18:18:36.800961] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:18:36.802333] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:36.831442] [INFO ] [MAIN ] EVG: Adding 77 new records, updating 0 existing records. [2025-09-05T18:18:36.898514] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:36.899157] [INFO ] [MAIN ] EVG: Combined dataset has 2931 total records. [2025-09-05T18:18:37.017294] [INFO ] [MAIN ] EVN: Loaded 5257 existing records. [2025-09-05T18:18:37.183620] [INFO ] [MAIN ] EVH: Loaded 37165 existing records. [2025-09-05T18:18:37.186959] [WARN ] [VALIDATOR ] EVG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:37.506724] [INFO ] [MAIN ] EVN: Found 1 missing trading days. [2025-09-05T18:18:37.527664] [INFO ] [MAIN ] EVN: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:37.553583] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-05T18:18:37.617953] [INFO ] [MAIN ] EVH: Found 1 missing trading days. [2025-09-05T18:18:37.629926] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:18:37.637994] [INFO ] [MAIN ] EVH: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:37.681072] [INFO ] [MAIN ] EVF: Adding 39 new records, updating 0 existing records. [2025-09-05T18:18:37.685688] [INFO ] [MAIN ] EVF: Combined dataset has 4765 total records. [2025-09-05T18:18:37.867990] [WARN ] [VALIDATOR ] EVF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:38.058687] [WARN ] [VALIDATOR ] EVG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:38.059126] [INFO ] [MAIN ] EVG: Combined data validation passed. [2025-09-05T18:18:38.079148] [INFO ] [MAIN ] EVG: Update completed successfully. [2025-09-05T18:18:38.079899] [INFO ] [MAIN ] Update Progress: 782/2363 symbols completed. EVG took 3.3s. Estimated remaining: 37m 33s. Rate: 42.1 symbols/min [2025-09-05T18:18:38.162855] [WARN ] [VALIDATOR ] EVF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:38.184268] [INFO ] [MAIN ] EVF: Combined data validation passed. [2025-09-05T18:18:38.275208] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:38.273574] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-05T18:18:38.289717] [INFO ] [MAIN ] EVF: Update completed successfully. [2025-09-05T18:18:38.290334] [INFO ] [MAIN ] Update Progress: 783/2363 symbols completed. EVF took 4.3s. Estimated remaining: 37m 29s. Rate: 42.2 symbols/min [2025-09-05T18:18:38.365515] [INFO ] [MAIN ] EVR: Loaded 15497 existing records. [2025-09-05T18:18:38.573071] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:18:38.577841] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:38.697476] [INFO ] [MAIN ] EVR: Found 1 missing trading days. [2025-09-05T18:18:38.673168] [INFO ] [MAIN ] EVN: Adding 83 new records, updating 0 existing records. [2025-09-05T18:18:38.704609] [INFO ] [MAIN ] EVR: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:38.706522] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:18:38.711690] [INFO ] [MAIN ] EVT: Loaded 8180 existing records. [2025-09-05T18:18:38.773152] [INFO ] [MAIN ] EVN: Combined dataset has 5340 total records. [2025-09-05T18:18:39.083816] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-05T18:18:39.138812] [INFO ] [MAIN ] EVH: Adding 359 new records, updating 0 existing records. [2025-09-05T18:18:39.166403] [INFO ] [MAIN ] EVT: Found 1 missing trading days. [2025-09-05T18:18:39.175256] [INFO ] [MAIN ] EVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:39.252915] [WARN ] [VALIDATOR ] EVN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:39.322153] [INFO ] [MAIN ] EVH: Combined dataset has 37524 total records. [2025-09-05T18:18:39.619758] [WARN ] [VALIDATOR ] EVH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:18:39.749777] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:18:39.873619] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-05T18:18:39.915807] [INFO ] [MAIN ] EVR: Adding 232 new records, updating 0 existing records. [2025-09-05T18:18:39.920917] [INFO ] [MAIN ] EVR: Combined dataset has 15729 total records. [2025-09-05T18:18:40.108467] [WARN ] [VALIDATOR ] EVR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:40.295109] [WARN ] [VALIDATOR ] EVH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:18:40.295687] [INFO ] [MAIN ] EVH: Combined data validation passed. [2025-09-05T18:18:40.295246] [WARN ] [VALIDATOR ] EVN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:40.296669] [INFO ] [MAIN ] EVN: Combined data validation passed. [2025-09-05T18:18:40.536002] [INFO ] [MAIN ] EVN: Update completed successfully. [2025-09-05T18:18:40.538660] [INFO ] [MAIN ] Update Progress: 784/2363 symbols completed. EVN took 3.9s. Estimated remaining: 37m 29s. Rate: 42.1 symbols/min [2025-09-05T18:18:40.726693] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:40.741579] [INFO ] [MAIN ] EVH: Update completed successfully. [2025-09-05T18:18:40.745782] [INFO ] [MAIN ] Update Progress: 785/2363 symbols completed. EVH took 4.2s. Estimated remaining: 37m 25s. Rate: 42.2 symbols/min [2025-09-05T18:18:40.797694] [INFO ] [MAIN ] EVTC: Loaded 12427 existing records. [2025-09-05T18:18:41.088536] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:41.116250] [INFO ] [MAIN ] EVTC: Found 1 missing trading days. [2025-09-05T18:18:41.120964] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T18:18:41.121235] [INFO ] [MAIN ] EVTC: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:41.129192] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-05T18:18:41.181609] [INFO ] [MAIN ] EVT: Adding 131 new records, updating 0 existing records. [2025-09-05T18:18:41.184361] [WARN ] [VALIDATOR ] EVR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:41.184744] [INFO ] [MAIN ] EVR: Combined data validation passed. [2025-09-05T18:18:41.186386] [INFO ] [MAIN ] EVT: Combined dataset has 8311 total records. [2025-09-05T18:18:41.275463] [INFO ] [MAIN ] EVTL: Loaded 21497 existing records. [2025-09-05T18:18:41.557064] [WARN ] [VALIDATOR ] EVT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:41.753624] [INFO ] [MAIN ] EVTL: Found 1 missing trading days. [2025-09-05T18:18:41.762696] [INFO ] [MAIN ] EVTL: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:41.779151] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-05T18:18:41.780223] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:18:41.934843] [INFO ] [MAIN ] EVTC: Adding 209 new records, updating 0 existing records. [2025-09-05T18:18:41.947489] [INFO ] [MAIN ] EVTC: Combined dataset has 12636 total records. [2025-09-05T18:18:42.037671] [INFO ] [MAIN ] EVR: Update completed successfully. [2025-09-05T18:18:42.050675] [INFO ] [MAIN ] Update Progress: 786/2363 symbols completed. EVR took 4.0s. Estimated remaining: 37m 24s. Rate: 42.2 symbols/min [2025-09-05T18:18:42.218810] [WARN ] [VALIDATOR ] EVTC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:42.432490] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:42.529975] [INFO ] [MAIN ] EVTR: Loaded 11270 existing records. [2025-09-05T18:18:42.652605] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:18:42.760923] [INFO ] [MAIN ] EVTR: Found 1 missing trading days. [2025-09-05T18:18:42.771736] [INFO ] [MAIN ] EVTR: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:42.777226] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-05T18:18:42.784115] [WARN ] [VALIDATOR ] EVT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:42.810380] [INFO ] [MAIN ] EVT: Combined data validation passed. [2025-09-05T18:18:42.878123] [INFO ] [MAIN ] EVTL: Adding 325 new records, updating 0 existing records. [2025-09-05T18:18:42.907102] [INFO ] [MAIN ] EVT: Update completed successfully. [2025-09-05T18:18:42.908580] [INFO ] [MAIN ] Update Progress: 787/2363 symbols completed. EVT took 4.6s. Estimated remaining: 37m 21s. Rate: 42.2 symbols/min [2025-09-05T18:18:42.908872] [INFO ] [MAIN ] EVTL: Combined dataset has 21822 total records. [2025-09-05T18:18:43.205034] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:43.278958] [WARN ] [VALIDATOR ] EVTC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:43.277724] [WARN ] [VALIDATOR ] EVTL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:43.279217] [INFO ] [MAIN ] EVTC: Combined data validation passed. [2025-09-05T18:18:43.615688] [INFO ] [MAIN ] EW: Loaded 25480 existing records. [2025-09-05T18:18:43.744968] [INFO ] [MAIN ] EVTC: Update completed successfully. [2025-09-05T18:18:43.762420] [INFO ] [MAIN ] Update Progress: 788/2363 symbols completed. EVTC took 3.2s. Estimated remaining: 37m 18s. Rate: 42.2 symbols/min [2025-09-05T18:18:43.890204] [INFO ] [MAIN ] EW: Found 1 missing trading days. [2025-09-05T18:18:43.921140] [INFO ] [MAIN ] EW: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:43.929741] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-05T18:18:43.940910] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:18:44.027067] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:44.085743] [INFO ] [MAIN ] EVTR: Adding 210 new records, updating 0 existing records. [2025-09-05T18:18:44.093767] [INFO ] [MAIN ] EVTR: Combined dataset has 11480 total records. [2025-09-05T18:18:44.183555] [INFO ] [MAIN ] EXG: Loaded 16398 existing records. [2025-09-05T18:18:44.389282] [WARN ] [VALIDATOR ] EVTR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:44.593618] [INFO ] [MAIN ] EXG: Found 1 missing trading days. [2025-09-05T18:18:44.598794] [INFO ] [MAIN ] EXG: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:44.599179] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-05T18:18:44.692450] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:18:44.813590] [WARN ] [VALIDATOR ] EVTL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:44.829877] [INFO ] [MAIN ] EVTL: Combined data validation passed. [2025-09-05T18:18:44.864496] [INFO ] [MAIN ] EW: Adding 381 new records, updating 0 existing records. [2025-09-05T18:18:44.875871] [WARN ] [VALIDATOR ] EVTR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:44.876089] [INFO ] [MAIN ] EVTR: Combined data validation passed. [2025-09-05T18:18:44.934333] [INFO ] [MAIN ] EW: Combined dataset has 25861 total records. [2025-09-05T18:18:45.132802] [INFO ] [MAIN ] EVTR: Update completed successfully. [2025-09-05T18:18:45.147436] [INFO ] [MAIN ] Update Progress: 789/2363 symbols completed. EVTR took 3.1s. Estimated remaining: 37m 17s. Rate: 42.2 symbols/min [2025-09-05T18:18:45.319866] [WARN ] [VALIDATOR ] EW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:45.553252] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:45.648879] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:18:45.662627] [INFO ] [MAIN ] EVTL: Update completed successfully. [2025-09-05T18:18:45.682702] [INFO ] [MAIN ] Update Progress: 790/2363 symbols completed. EVTL took 4.9s. Estimated remaining: 37m 14s. Rate: 42.3 symbols/min [2025-09-05T18:18:45.906870] [INFO ] [MAIN ] EXG: Adding 283 new records, updating 0 existing records. [2025-09-05T18:18:45.891528] [INFO ] [MAIN ] EXK: Loaded 25383 existing records. [2025-09-05T18:18:46.028817] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:46.069952] [INFO ] [MAIN ] EXG: Combined dataset has 16681 total records. [2025-09-05T18:18:46.293260] [INFO ] [MAIN ] EXP: Loaded 14375 existing records. [2025-09-05T18:18:46.292795] [INFO ] [MAIN ] EXK: Found 1 missing trading days. [2025-09-05T18:18:46.348503] [INFO ] [MAIN ] EXK: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:46.412934] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-05T18:18:46.457863] [WARN ] [VALIDATOR ] EXG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:46.676019] [INFO ] [MAIN ] EXP: Found 1 missing trading days. [2025-09-05T18:18:46.692086] [INFO ] [MAIN ] EXP: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:46.716414] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-05T18:18:46.757473] [WARN ] [VALIDATOR ] EW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:46.758088] [INFO ] [MAIN ] EW: Combined data validation passed. [2025-09-05T18:18:46.764219] [WARN ] [VALIDATOR ] EXG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:46.764427] [INFO ] [MAIN ] EXG: Combined data validation passed. [2025-09-05T18:18:47.013252] [INFO ] [MAIN ] EXG: Update completed successfully. [2025-09-05T18:18:47.018952] [INFO ] [MAIN ] Update Progress: 791/2363 symbols completed. EXG took 3.3s. Estimated remaining: 37m 12s. Rate: 42.3 symbols/min [2025-09-05T18:18:47.219223] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:47.221833] [INFO ] [MAIN ] EW: Update completed successfully. [2025-09-05T18:18:47.225007] [INFO ] [MAIN ] Update Progress: 792/2363 symbols completed. EW took 4.3s. Estimated remaining: 37m 8s. Rate: 42.3 symbols/min [2025-09-05T18:18:47.359180] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:18:47.445310] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:47.470528] [INFO ] [MAIN ] EXPD: Loaded 22624 existing records. [2025-09-05T18:18:47.585536] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:18:47.727300] [INFO ] [MAIN ] EXK: Adding 390 new records, updating 0 existing records. [2025-09-05T18:18:47.726191] [INFO ] [MAIN ] EXR: Loaded 21924 existing records. [2025-09-05T18:18:47.921380] [INFO ] [MAIN ] EXP: Adding 266 new records, updating 0 existing records. [2025-09-05T18:18:47.910695] [INFO ] [MAIN ] EXPD: Found 1 missing trading days. [2025-09-05T18:18:47.936631] [INFO ] [MAIN ] EXPD: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:47.938546] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-05T18:18:47.944058] [INFO ] [MAIN ] EXK: Combined dataset has 25773 total records. [2025-09-05T18:18:48.085788] [INFO ] [MAIN ] EXP: Combined dataset has 14641 total records. [2025-09-05T18:18:48.268725] [INFO ] [MAIN ] EXR: Found 1 missing trading days. [2025-09-05T18:18:48.311628] [INFO ] [MAIN ] EXR: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:48.315308] [WARN ] [VALIDATOR ] EXK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:48.333667] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-05T18:18:48.664681] [WARN ] [VALIDATOR ] EXP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:48.711985] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:18:48.889611] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:18:49.078926] [INFO ] [MAIN ] EXPD: Adding 0 new records, updating 0 existing records. [2025-09-05T18:18:49.130245] [INFO ] [MAIN ] EXR: Adding 346 new records, updating 0 existing records. [2025-09-05T18:18:49.131451] [INFO ] [MAIN ] EXPD: Combined dataset has 22624 total records. [2025-09-05T18:18:49.132980] [FATAL] [VALIDATOR ] EXPD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:18:49.133149] [FATAL] [MAIN ] EXPD: Combined data validation failed. [2025-09-05T18:18:49.135729] [WARN ] [MAIN ] EXPD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:18:49.138269] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-05T18:18:49.140070] [INFO ] [LOCAL ] EXPD: Starting deletion of derivative data. [2025-09-05T18:18:49.144318] [INFO ] [MAIN ] Update Progress: 793/2363 symbols completed. EXPD took 2.1s. Estimated remaining: 37m 8s. Rate: 42.3 symbols/min [2025-09-05T18:18:49.194821] [INFO ] [MAIN ] EXR: Combined dataset has 22270 total records. [2025-09-05T18:18:49.544614] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:49.562148] [WARN ] [VALIDATOR ] EXK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:49.562427] [INFO ] [MAIN ] EXK: Combined data validation passed. [2025-09-05T18:18:49.556811] [WARN ] [VALIDATOR ] EXP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:49.573894] [INFO ] [MAIN ] EXP: Combined data validation passed. [2025-09-05T18:18:49.715102] [WARN ] [VALIDATOR ] EXR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:50.050139] [INFO ] [MAIN ] F: Loaded 25801 existing records. [2025-09-05T18:18:50.151084] [INFO ] [MAIN ] EXP: Update completed successfully. [2025-09-05T18:18:50.175512] [INFO ] [MAIN ] Update Progress: 794/2363 symbols completed. EXP took 4.5s. Estimated remaining: 37m 6s. Rate: 42.3 symbols/min [2025-09-05T18:18:50.214079] [INFO ] [MAIN ] EXK: Update completed successfully. [2025-09-05T18:18:50.249177] [INFO ] [MAIN ] Update Progress: 795/2363 symbols completed. EXK took 5.1s. Estimated remaining: 37m 2s. Rate: 42.3 symbols/min [2025-09-05T18:18:50.792096] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:50.793953] [INFO ] [MAIN ] F: Found 1 missing trading days. [2025-09-05T18:18:50.820698] [INFO ] [MAIN ] F: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:50.836534] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-05T18:18:50.871765] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:50.892579] [INFO ] [MAIN ] FAF: Loaded 20263 existing records. [2025-09-05T18:18:50.892673] [WARN ] [VALIDATOR ] EXR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:50.928510] [INFO ] [MAIN ] EXR: Combined data validation passed. [2025-09-05T18:18:51.076402] [INFO ] [MAIN ] FBIN: Loaded 24068 existing records. [2025-09-05T18:18:51.283154] [INFO ] [MAIN ] FAF: Found 1 missing trading days. [2025-09-05T18:18:51.308580] [INFO ] [MAIN ] FAF: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:51.322307] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-05T18:18:51.398058] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:18:51.415781] [INFO ] [MAIN ] EXR: Update completed successfully. [2025-09-05T18:18:51.424937] [INFO ] [MAIN ] FBIN: Found 1 missing trading days. [2025-09-05T18:18:51.427242] [INFO ] [MAIN ] FBIN: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:51.456318] [INFO ] [MAIN ] Update Progress: 796/2363 symbols completed. EXR took 4.2s. Estimated remaining: 36m 60s. Rate: 42.4 symbols/min [2025-09-05T18:18:51.459914] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-05T18:18:51.676831] [INFO ] [MAIN ] F: Adding 0 new records, updating 0 existing records. [2025-09-05T18:18:51.742883] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:51.749061] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:18:51.751527] [INFO ] [MAIN ] F: Combined dataset has 25801 total records. [2025-09-05T18:18:51.771870] [FATAL] [VALIDATOR ] F: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:18:51.777207] [FATAL] [MAIN ] F: Combined data validation failed. [2025-09-05T18:18:51.802111] [WARN ] [MAIN ] F: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:18:51.818991] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-05T18:18:51.870284] [INFO ] [MAIN ] FAF: Adding 278 new records, updating 0 existing records. [2025-09-05T18:18:51.865420] [INFO ] [LOCAL ] F: Starting deletion of derivative data. [2025-09-05T18:18:51.870720] [INFO ] [MAIN ] FBK: Loaded 13669 existing records. [2025-09-05T18:18:51.880312] [INFO ] [MAIN ] Update Progress: 797/2363 symbols completed. F took 2.7s. Estimated remaining: 36m 56s. Rate: 42.4 symbols/min [2025-09-05T18:18:51.989345] [INFO ] [MAIN ] FAF: Combined dataset has 20541 total records. [2025-09-05T18:18:52.128534] [INFO ] [MAIN ] FBK: Found 1 missing trading days. [2025-09-05T18:18:52.155141] [INFO ] [MAIN ] FBK: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:52.155434] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-05T18:18:52.233426] [WARN ] [VALIDATOR ] FAF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:52.425622] [WARN ] [VALIDATOR ] FAF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:52.425859] [INFO ] [MAIN ] FAF: Combined data validation passed. [2025-09-05T18:18:52.550381] [INFO ] [MAIN ] FAF: Update completed successfully. [2025-09-05T18:18:52.552778] [INFO ] [MAIN ] Update Progress: 798/2363 symbols completed. FAF took 2.3s. Estimated remaining: 36m 54s. Rate: 42.4 symbols/min [2025-09-05T18:18:52.822694] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:18:52.880175] [INFO ] [MAIN ] FBK: Adding 131 new records, updating 0 existing records. [2025-09-05T18:18:52.882438] [INFO ] [MAIN ] FBK: Combined dataset has 13800 total records. [2025-09-05T18:18:53.066436] [WARN ] [VALIDATOR ] FBK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:53.198879] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-05T18:18:53.428941] [INFO ] [MAIN ] FBIN: Adding 374 new records, updating 0 existing records. [2025-09-05T18:18:53.433713] [INFO ] [MAIN ] FBIN: Combined dataset has 24442 total records. [2025-09-05T18:18:53.626679] [WARN ] [VALIDATOR ] FBIN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:53.827851] [WARN ] [VALIDATOR ] FBK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:53.828309] [INFO ] [MAIN ] FBK: Combined data validation passed. [2025-09-05T18:18:53.869451] [WARN ] [VALIDATOR ] FBIN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:53.876053] [INFO ] [MAIN ] FBIN: Combined data validation passed. [2025-09-05T18:18:53.920672] [INFO ] [MAIN ] FBK: Update completed successfully. [2025-09-05T18:18:53.922200] [INFO ] [MAIN ] Update Progress: 799/2363 symbols completed. FBK took 2.5s. Estimated remaining: 36m 52s. Rate: 42.4 symbols/min [2025-09-05T18:18:54.072427] [INFO ] [MAIN ] FBIN: Update completed successfully. [2025-09-05T18:18:54.075403] [INFO ] [MAIN ] Update Progress: 800/2363 symbols completed. FBIN took 3.8s. Estimated remaining: 36m 48s. Rate: 42.5 symbols/min [2025-09-05T18:18:54.663870] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:54.741273] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:54.744218] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:54.805368] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:54.809958] [INFO ] [MAIN ] FC: Loaded 7474 existing records. [2025-09-05T18:18:54.900623] [INFO ] [MAIN ] FBRT: Loaded 16390 existing records. [2025-09-05T18:18:54.972247] [INFO ] [MAIN ] FBP: Loaded 21882 existing records. [2025-09-05T18:18:55.263748] [INFO ] [MAIN ] FC: Found 1 missing trading days. [2025-09-05T18:18:55.303975] [INFO ] [MAIN ] FCF: Loaded 29538 existing records. [2025-09-05T18:18:55.304556] [INFO ] [MAIN ] FC: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:55.405899] [INFO ] [MAIN ] FBRT: Found 1 missing trading days. [2025-09-05T18:18:55.453214] [INFO ] [MAIN ] FBRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:55.360311] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-05T18:18:55.487935] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-05T18:18:55.517610] [INFO ] [MAIN ] FBP: Found 1 missing trading days. [2025-09-05T18:18:55.517789] [INFO ] [MAIN ] FBP: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:55.525134] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-05T18:18:55.606964] [INFO ] [MAIN ] FCF: Found 1 missing trading days. [2025-09-05T18:18:55.607128] [INFO ] [MAIN ] FCF: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:55.607421] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-05T18:18:56.072065] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:18:56.105452] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:18:56.189418] [INFO ] [MAIN ] FBRT: Adding 184 new records, updating 0 existing records. [2025-09-05T18:18:56.198148] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:18:56.274921] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:18:56.308447] [INFO ] [MAIN ] FC: Adding 104 new records, updating 0 existing records. [2025-09-05T18:18:56.334244] [INFO ] [MAIN ] FCF: Adding 284 new records, updating 0 existing records. [2025-09-05T18:18:56.360405] [INFO ] [MAIN ] FBRT: Combined dataset has 16574 total records. [2025-09-05T18:18:56.410456] [INFO ] [MAIN ] FC: Combined dataset has 7578 total records. [2025-09-05T18:18:56.603384] [INFO ] [MAIN ] FBP: Adding 313 new records, updating 0 existing records. [2025-09-05T18:18:56.652605] [INFO ] [MAIN ] FCF: Combined dataset has 29822 total records. [2025-09-05T18:18:56.834391] [INFO ] [MAIN ] FBP: Combined dataset has 22195 total records. [2025-09-05T18:18:56.890823] [WARN ] [VALIDATOR ] FBRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:57.232336] [WARN ] [VALIDATOR ] FC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:57.471549] [WARN ] [VALIDATOR ] FCF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:18:57.480294] [WARN ] [VALIDATOR ] FBP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:18:58.103722] [WARN ] [VALIDATOR ] FBRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:58.104179] [WARN ] [VALIDATOR ] FBP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:58.104418] [INFO ] [MAIN ] FBRT: Combined data validation passed. [2025-09-05T18:18:58.104588] [INFO ] [MAIN ] FBP: Combined data validation passed. [2025-09-05T18:18:58.104267] [WARN ] [VALIDATOR ] FCF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:18:58.104670] [WARN ] [VALIDATOR ] FC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:18:58.106429] [INFO ] [MAIN ] FC: Combined data validation passed. [2025-09-05T18:18:58.106279] [INFO ] [MAIN ] FCF: Combined data validation passed. [2025-09-05T18:18:58.334167] [INFO ] [MAIN ] FC: Update completed successfully. [2025-09-05T18:18:58.394987] [INFO ] [MAIN ] Update Progress: 801/2363 symbols completed. FC took 4.3s. Estimated remaining: 36m 52s. Rate: 42.4 symbols/min [2025-09-05T18:18:58.402672] [INFO ] [MAIN ] FBRT: Update completed successfully. [2025-09-05T18:18:58.418161] [INFO ] [MAIN ] Update Progress: 802/2363 symbols completed. FBRT took 4.3s. Estimated remaining: 36m 48s. Rate: 42.4 symbols/min [2025-09-05T18:18:58.834212] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:58.838232] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:58.926933] [INFO ] [MAIN ] FBP: Update completed successfully. [2025-09-05T18:18:58.937410] [INFO ] [MAIN ] FCN: Loaded 11630 existing records. [2025-09-05T18:18:58.951940] [INFO ] [MAIN ] Update Progress: 803/2363 symbols completed. FBP took 4.9s. Estimated remaining: 36m 45s. Rate: 42.4 symbols/min [2025-09-05T18:18:58.979041] [INFO ] [MAIN ] FCPT: Loaded 16981 existing records. [2025-09-05T18:18:59.229870] [INFO ] [MAIN ] FCF: Update completed successfully. [2025-09-05T18:18:59.258242] [INFO ] [MAIN ] Update Progress: 804/2363 symbols completed. FCF took 5.2s. Estimated remaining: 36m 42s. Rate: 42.5 symbols/min [2025-09-05T18:18:59.475393] [INFO ] [MAIN ] FCN: Found 1 missing trading days. [2025-09-05T18:18:59.525937] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:59.526019] [INFO ] [MAIN ] FCN: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:59.556016] [INFO ] [MAIN ] FCPT: Found 1 missing trading days. [2025-09-05T18:18:59.556342] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-05T18:18:59.561610] [INFO ] [MAIN ] FCPT: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:59.579169] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-05T18:18:59.637026] [INFO ] [MAIN ] FCRX: Loaded 559 existing records. [2025-09-05T18:18:59.773149] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:18:59.837383] [INFO ] [MAIN ] FCT: Loaded 7157 existing records. [2025-09-05T18:18:59.861262] [INFO ] [MAIN ] FCRX: Found 1 missing trading days. [2025-09-05T18:18:59.912861] [INFO ] [MAIN ] FCRX: Need to fetch 1 months: 2025-09 [2025-09-05T18:18:59.927628] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-05T18:19:00.033614] [INFO ] [MAIN ] FCT: Found 1 missing trading days. [2025-09-05T18:19:00.033805] [INFO ] [MAIN ] FCT: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:00.034046] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-05T18:19:00.120456] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:19:00.171036] [INFO ] [MAIN ] FCN: Adding 170 new records, updating 0 existing records. [2025-09-05T18:19:00.173207] [INFO ] [MAIN ] FCN: Combined dataset has 11800 total records. [2025-09-05T18:19:00.286269] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:19:00.416901] [WARN ] [VALIDATOR ] FCN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:00.550190] [INFO ] [MAIN ] FCPT: Adding 295 new records, updating 0 existing records. [2025-09-05T18:19:00.570969] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:19:00.577407] [INFO ] [MAIN ] FCRX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:19:00.579688] [INFO ] [MAIN ] FCRX: Combined dataset has 559 total records. [2025-09-05T18:19:00.580257] [FATAL] [VALIDATOR ] FCRX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:19:00.601571] [FATAL] [MAIN ] FCRX: Combined data validation failed. [2025-09-05T18:19:00.630069] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:19:00.656707] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-05T18:19:00.663697] [INFO ] [MAIN ] FCPT: Combined dataset has 17276 total records. [2025-09-05T18:19:00.675424] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-05T18:19:00.734127] [INFO ] [MAIN ] Update Progress: 805/2363 symbols completed. FCRX took 1.8s. Estimated remaining: 36m 40s. Rate: 42.5 symbols/min [2025-09-05T18:19:00.932540] [WARN ] [VALIDATOR ] FCPT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:01.139783] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:01.250481] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T18:19:01.331032] [INFO ] [MAIN ] FCT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:19:01.350123] [INFO ] [MAIN ] FCX: Loaded 25684 existing records. [2025-09-05T18:19:01.346703] [INFO ] [MAIN ] FCT: Combined dataset has 7157 total records. [2025-09-05T18:19:01.448193] [WARN ] [VALIDATOR ] FCN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:01.458774] [FATAL] [VALIDATOR ] FCT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:19:01.462389] [INFO ] [MAIN ] FCN: Combined data validation passed. [2025-09-05T18:19:01.462304] [FATAL] [MAIN ] FCT: Combined data validation failed. [2025-09-05T18:19:01.462928] [WARN ] [MAIN ] FCT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:19:01.469037] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-05T18:19:01.474770] [INFO ] [LOCAL ] FCT: Starting deletion of derivative data. [2025-09-05T18:19:01.572473] [INFO ] [MAIN ] Update Progress: 806/2363 symbols completed. FCT took 2.3s. Estimated remaining: 36m 38s. Rate: 42.5 symbols/min [2025-09-05T18:19:01.582074] [INFO ] [MAIN ] FCX: Found 1 missing trading days. [2025-09-05T18:19:01.597893] [INFO ] [MAIN ] FCX: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:01.600094] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-05T18:19:01.797240] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:01.809762] [INFO ] [MAIN ] FCN: Update completed successfully. [2025-09-05T18:19:01.813009] [INFO ] [MAIN ] Update Progress: 807/2363 symbols completed. FCN took 3.4s. Estimated remaining: 36m 34s. Rate: 42.5 symbols/min [2025-09-05T18:19:01.815743] [WARN ] [VALIDATOR ] FCPT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:01.828323] [INFO ] [MAIN ] FCPT: Combined data validation passed. [2025-09-05T18:19:01.997410] [INFO ] [MAIN ] FDP: Loaded 14133 existing records. [2025-09-05T18:19:02.084905] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:02.259824] [INFO ] [MAIN ] FDS: Loaded 12107 existing records. [2025-09-05T18:19:02.348031] [INFO ] [MAIN ] FDP: Found 1 missing trading days. [2025-09-05T18:19:02.368444] [INFO ] [MAIN ] FDP: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:02.380558] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-05T18:19:02.440910] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:19:02.481057] [INFO ] [MAIN ] FCPT: Update completed successfully. [2025-09-05T18:19:02.527100] [INFO ] [MAIN ] Update Progress: 808/2363 symbols completed. FCPT took 4.1s. Estimated remaining: 36m 31s. Rate: 42.6 symbols/min [2025-09-05T18:19:02.610284] [INFO ] [MAIN ] FDS: Found 1 missing trading days. [2025-09-05T18:19:02.636549] [INFO ] [MAIN ] FDS: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:02.690556] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-05T18:19:02.836284] [INFO ] [MAIN ] FCX: Adding 390 new records, updating 0 existing records. [2025-09-05T18:19:02.915363] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:02.917172] [INFO ] [MAIN ] FCX: Combined dataset has 26074 total records. [2025-09-05T18:19:03.133524] [INFO ] [MAIN ] FDX: Loaded 24624 existing records. [2025-09-05T18:19:03.139929] [WARN ] [VALIDATOR ] FCX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:03.253802] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:19:03.608982] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:19:03.608188] [INFO ] [MAIN ] FDX: Found 1 missing trading days. [2025-09-05T18:19:03.632871] [INFO ] [MAIN ] FDX: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:03.613946] [INFO ] [MAIN ] FDP: Adding 207 new records, updating 0 existing records. [2025-09-05T18:19:03.634574] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-05T18:19:03.702980] [INFO ] [MAIN ] FDP: Combined dataset has 14340 total records. [2025-09-05T18:19:03.715704] [INFO ] [MAIN ] FDS: Adding 239 new records, updating 0 existing records. [2025-09-05T18:19:03.826385] [INFO ] [MAIN ] FDS: Combined dataset has 12346 total records. [2025-09-05T18:19:03.989813] [WARN ] [VALIDATOR ] FDP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:04.239203] [WARN ] [VALIDATOR ] FDS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:04.286455] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:19:04.654002] [INFO ] [MAIN ] FDX: Adding 378 new records, updating 0 existing records. [2025-09-05T18:19:04.661635] [INFO ] [MAIN ] FDX: Combined dataset has 25002 total records. [2025-09-05T18:19:04.820010] [WARN ] [VALIDATOR ] FDP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:04.857530] [INFO ] [MAIN ] FDP: Combined data validation passed. [2025-09-05T18:19:04.853071] [WARN ] [VALIDATOR ] FCX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:04.857429] [WARN ] [VALIDATOR ] FDX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:04.863736] [INFO ] [MAIN ] FCX: Combined data validation passed. [2025-09-05T18:19:04.863528] [WARN ] [VALIDATOR ] FDS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:04.875298] [INFO ] [MAIN ] FDS: Combined data validation passed. [2025-09-05T18:19:05.352436] [INFO ] [MAIN ] FDS: Update completed successfully. [2025-09-05T18:19:05.357047] [INFO ] [MAIN ] Update Progress: 809/2363 symbols completed. FDS took 3.5s. Estimated remaining: 36m 33s. Rate: 42.5 symbols/min [2025-09-05T18:19:05.532514] [WARN ] [VALIDATOR ] FDX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:05.539998] [INFO ] [MAIN ] FDX: Combined data validation passed. [2025-09-05T18:19:05.598392] [INFO ] [MAIN ] FCX: Update completed successfully. [2025-09-05T18:19:05.602095] [INFO ] [MAIN ] Update Progress: 810/2363 symbols completed. FCX took 4.9s. Estimated remaining: 36m 29s. Rate: 42.6 symbols/min [2025-09-05T18:19:05.597987] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:05.605292] [INFO ] [MAIN ] FDP: Update completed successfully. [2025-09-05T18:19:05.605097] [WARN ] [MAIN ] FE: No existing data found, performing full refresh instead. [2025-09-05T18:19:05.628836] [INFO ] [MAIN ] Update Progress: 811/2363 symbols completed. FDP took 4.0s. Estimated remaining: 36m 25s. Rate: 42.6 symbols/min [2025-09-05T18:19:05.728873] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-05T18:19:05.763739] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-05T18:19:05.810391] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-05T18:19:06.208884] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:06.205027] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:06.319033] [INFO ] [MAIN ] FENG: Loaded 593 existing records. [2025-09-05T18:19:06.559323] [INFO ] [MAIN ] FDX: Update completed successfully. [2025-09-05T18:19:06.598505] [INFO ] [MAIN ] FERG: Loaded 22585 existing records. [2025-09-05T18:19:06.597409] [INFO ] [MAIN ] Update Progress: 812/2363 symbols completed. FDX took 4.0s. Estimated remaining: 36m 23s. Rate: 42.6 symbols/min [2025-09-05T18:19:06.640165] [INFO ] [REMOTE ] FE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:06.679320] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-05T18:19:06.822132] [INFO ] [MAIN ] FENG: Found 1 missing trading days. [2025-09-05T18:19:06.858500] [INFO ] [MAIN ] FENG: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:06.903905] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-05T18:19:07.068852] [INFO ] [MAIN ] FERG: Found 1 missing trading days. [2025-09-05T18:19:07.068729] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:07.069040] [INFO ] [MAIN ] FERG: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:07.069515] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-05T18:19:07.077736] [INFO ] [MAIN ] FET: Loaded 6357 existing records. [2025-09-05T18:19:07.263182] [INFO ] [MAIN ] FET: Found 1 missing trading days. [2025-09-05T18:19:07.263366] [INFO ] [MAIN ] FET: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:07.263624] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-05T18:19:07.270167] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:19:07.280048] [INFO ] [MAIN ] FENG: Adding 17 new records, updating 0 existing records. [2025-09-05T18:19:07.281465] [INFO ] [MAIN ] FENG: Combined dataset has 610 total records. [2025-09-05T18:19:07.457485] [WARN ] [VALIDATOR ] FENG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:07.645635] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:19:07.783830] [INFO ] [MAIN ] FERG: Adding 373 new records, updating 0 existing records. [2025-09-05T18:19:07.788687] [INFO ] [MAIN ] FERG: Combined dataset has 22958 total records. [2025-09-05T18:19:07.940794] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:19:07.978028] [WARN ] [VALIDATOR ] FERG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:08.081427] [INFO ] [MAIN ] FET: Adding 132 new records, updating 0 existing records. [2025-09-05T18:19:08.128117] [INFO ] [MAIN ] FET: Combined dataset has 6489 total records. [2025-09-05T18:19:08.415331] [WARN ] [VALIDATOR ] FET: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:08.618471] [WARN ] [VALIDATOR ] FENG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:08.619000] [INFO ] [MAIN ] FENG: Combined data validation passed. [2025-09-05T18:19:08.624983] [INFO ] [MAIN ] FENG: Update completed successfully. [2025-09-05T18:19:08.625368] [INFO ] [MAIN ] Update Progress: 813/2363 symbols completed. FENG took 3.0s. Estimated remaining: 36m 23s. Rate: 42.6 symbols/min [2025-09-05T18:19:08.729764] [WARN ] [VALIDATOR ] FERG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:08.742886] [WARN ] [VALIDATOR ] FET: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:08.743161] [INFO ] [MAIN ] FET: Combined data validation passed. [2025-09-05T18:19:08.743762] [INFO ] [MAIN ] FERG: Combined data validation passed. [2025-09-05T18:19:08.836510] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:08.921362] [INFO ] [MAIN ] FET: Update completed successfully. [2025-09-05T18:19:08.932900] [INFO ] [MAIN ] Update Progress: 814/2363 symbols completed. FET took 2.3s. Estimated remaining: 36m 19s. Rate: 42.7 symbols/min [2025-09-05T18:19:09.050135] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-05T18:19:09.050940] [INFO ] [MAIN ] FF: Loaded 11370 existing records. [2025-09-05T18:19:09.086765] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-05T18:19:09.318384] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:09.393799] [INFO ] [MAIN ] FF: Found 1 missing trading days. [2025-09-05T18:19:09.395060] [INFO ] [MAIN ] FF: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:09.398673] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-05T18:19:09.397661] [INFO ] [MAIN ] FFA: Loaded 2220 existing records. [2025-09-05T18:19:09.500594] [INFO ] [MAIN ] FERG: Update completed successfully. [2025-09-05T18:19:09.524064] [INFO ] [MAIN ] Update Progress: 815/2363 symbols completed. FERG took 3.8s. Estimated remaining: 36m 16s. Rate: 42.7 symbols/min [2025-09-05T18:19:09.761941] [INFO ] [MAIN ] FFA: Found 1 missing trading days. [2025-09-05T18:19:09.790579] [INFO ] [MAIN ] FFA: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:09.795531] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-05T18:19:09.815714] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:09.825344] [INFO ] [MAIN ] FFC: Loaded 8121 existing records. [2025-09-05T18:19:10.004917] [INFO ] [MAIN ] FFC: Found 1 missing trading days. [2025-09-05T18:19:10.005223] [INFO ] [MAIN ] FFC: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:10.005494] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-05T18:19:10.011109] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:19:10.132769] [INFO ] [MAIN ] FF: Adding 104 new records, updating 457 existing records. [2025-09-05T18:19:10.136433] [INFO ] [MAIN ] FF: Combined dataset has 11474 total records. [2025-09-05T18:19:10.313839] [WARN ] [VALIDATOR ] FF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:10.540034] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:19:10.558304] [INFO ] [MAIN ] FFA: Adding 74 new records, updating 0 existing records. [2025-09-05T18:19:10.563097] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-05T18:19:10.563864] [WARN ] [VALIDATOR ] FF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:10.575413] [INFO ] [MAIN ] FF: Combined data validation passed. [2025-09-05T18:19:10.575218] [INFO ] [MAIN ] FFA: Combined dataset has 2294 total records. [2025-09-05T18:19:10.597876] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-05T18:19:10.813337] [INFO ] [MAIN ] FF: Update completed successfully. [2025-09-05T18:19:10.833074] [WARN ] [VALIDATOR ] FFA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:10.834977] [INFO ] [MAIN ] Update Progress: 816/2363 symbols completed. FF took 2.2s. Estimated remaining: 36m 15s. Rate: 42.7 symbols/min [2025-09-05T18:19:11.213282] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:11.213441] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:19:11.214251] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-09-05T18:19:11.255202] [INFO ] [MAIN ] FFC: Adding 104 new records, updating 0 existing records. [2025-09-05T18:19:11.251484] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-05T18:19:11.255623] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-05T18:19:11.255860] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-05T18:19:11.327755] [INFO ] [MAIN ] FFC: Combined dataset has 8225 total records. [2025-09-05T18:19:11.693453] [WARN ] [VALIDATOR ] FFC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:11.930469] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:11.933836] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-05T18:19:12.022558] [WARN ] [VALIDATOR ] FFA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:12.023023] [INFO ] [MAIN ] FFA: Combined data validation passed. [2025-09-05T18:19:12.038234] [INFO ] [MAIN ] FFA: Update completed successfully. [2025-09-05T18:19:12.038913] [INFO ] [MAIN ] Update Progress: 817/2363 symbols completed. FFA took 3.1s. Estimated remaining: 36m 13s. Rate: 42.7 symbols/min [2025-09-05T18:19:12.041943] [WARN ] [VALIDATOR ] FFC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:12.106384] [INFO ] [MAIN ] FFC: Combined data validation passed. [2025-09-05T18:19:12.263226] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:12.266429] [WARN ] [MAIN ] FG: No existing data found, performing full refresh instead. [2025-09-05T18:19:12.266573] [INFO ] [MAIN ] FFC: Update completed successfully. [2025-09-05T18:19:12.267821] [INFO ] [MAIN ] Update Progress: 818/2363 symbols completed. FFC took 2.7s. Estimated remaining: 36m 9s. Rate: 42.7 symbols/min [2025-09-05T18:19:12.267998] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-05T18:19:12.273302] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-05T18:19:12.279468] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-05T18:19:12.650575] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:12.694810] [WARN ] [MAIN ] FGN: No existing data found, performing full refresh instead. [2025-09-05T18:19:12.718491] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-05T18:19:12.721768] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-05T18:19:12.748730] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-05T18:19:12.874526] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-05T18:19:12.872253] [INFO ] [REMOTE ] FG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:12.918038] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-05T18:19:12.943300] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-05T18:19:13.208850] [INFO ] [REMOTE ] FGN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:13.209167] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-05T18:19:13.575480] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-05T18:19:13.583062] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-05T18:19:13.783612] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-05T18:19:13.786338] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-05T18:19:13.857748] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-05T18:19:13.859320] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-05T18:19:14.310218] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-05T18:19:14.313140] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-05T18:19:14.395754] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-05T18:19:14.397128] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-05T18:19:14.526840] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-05T18:19:14.794126] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-05T18:19:14.826333] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-05T18:19:15.063483] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-05T18:19:15.549381] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-05T18:19:15.863478] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-05T18:19:16.663480] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-05T18:19:17.086905] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-05T18:19:17.153093] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-05T18:19:17.463513] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-05T18:19:17.761808] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-05T18:19:18.263560] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-05T18:19:18.656867] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-05T18:19:19.015773] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-05T18:19:19.063538] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-05T18:19:19.863458] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-05T18:19:20.145065] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-05T18:19:20.406806] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-05T18:19:20.663486] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-05T18:19:21.463477] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-05T18:19:22.089907] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-05T18:19:22.212951] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-05T18:19:22.263451] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-05T18:19:23.063531] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-05T18:19:23.805159] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-05T18:19:23.863436] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-05T18:19:24.233306] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-05T18:19:24.663549] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-05T18:19:25.473811] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-05T18:19:25.477322] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-05T18:19:25.678841] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-05T18:19:26.263447] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-05T18:19:26.400930] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-05T18:19:26.998747] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:19:27.000093] [INFO ] [REMOTE ] FG: Full fetch complete (22802 records). [2025-09-05T18:19:27.068971] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-05T18:19:27.371483] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-05T18:19:27.479446] [INFO ] [MAIN ] FG: Full history saved. [2025-09-05T18:19:27.479622] [INFO ] [MAIN ] Update Progress: 819/2363 symbols completed. FG took 15.4s. Estimated remaining: 36m 34s. Rate: 42.2 symbols/min [2025-09-05T18:19:27.648869] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:27.653376] [INFO ] [MAIN ] FGSN: Loaded 2507 existing records. [2025-09-05T18:19:27.824042] [INFO ] [MAIN ] FGSN: Found 1 missing trading days. [2025-09-05T18:19:27.824314] [INFO ] [MAIN ] FGSN: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:27.863422] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-05T18:19:28.373848] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-05T18:19:28.452907] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:19:28.469208] [INFO ] [MAIN ] FGSN: Adding 25 new records, updating 0 existing records. [2025-09-05T18:19:28.470631] [INFO ] [MAIN ] FGSN: Combined dataset has 2532 total records. [2025-09-05T18:19:28.644913] [WARN ] [VALIDATOR ] FGSN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:28.673230] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-05T18:19:28.856192] [WARN ] [VALIDATOR ] FGSN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:28.856422] [INFO ] [MAIN ] FGSN: Combined data validation passed. [2025-09-05T18:19:28.872669] [INFO ] [MAIN ] FGSN: Update completed successfully. [2025-09-05T18:19:28.873175] [INFO ] [MAIN ] Update Progress: 820/2363 symbols completed. FGSN took 1.4s. Estimated remaining: 36m 32s. Rate: 42.2 symbols/min [2025-09-05T18:19:29.056862] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:29.057024] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-09-05T18:19:29.057181] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-05T18:19:29.057245] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-05T18:19:29.057312] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-05T18:19:29.436012] [INFO ] [REMOTE ] FHI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:29.463427] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-05T18:19:30.263469] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-05T18:19:30.926703] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-05T18:19:31.029422] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-05T18:19:31.063443] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-05T18:19:31.717186] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-05T18:19:31.863472] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-05T18:19:31.928969] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:19:31.932052] [INFO ] [REMOTE ] FE: Full fetch complete (58099 records). [2025-09-05T18:19:32.305490] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-05T18:19:32.565339] [INFO ] [MAIN ] FE: Full history saved. [2025-09-05T18:19:32.565514] [INFO ] [MAIN ] Update Progress: 821/2363 symbols completed. FE took 27.2s. Estimated remaining: 36m 35s. Rate: 42.1 symbols/min [2025-09-05T18:19:32.667962] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-05T18:19:32.738795] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:32.738944] [WARN ] [MAIN ] FHN: No existing data found, performing full refresh instead. [2025-09-05T18:19:32.739062] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-05T18:19:32.739101] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-05T18:19:32.739147] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-05T18:19:33.099924] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-05T18:19:33.104985] [INFO ] [REMOTE ] FHN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:33.150617] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-05T18:19:33.463495] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-05T18:19:34.168272] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-05T18:19:34.263480] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-05T18:19:34.929574] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:19:34.930339] [INFO ] [REMOTE ] FGN: Full fetch complete (4325 records). [2025-09-05T18:19:35.070486] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-05T18:19:35.284671] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-05T18:19:35.303864] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-05T18:19:35.303973] [INFO ] [MAIN ] Update Progress: 822/2363 symbols completed. FGN took 23.0s. Estimated remaining: 36m 36s. Rate: 42.1 symbols/min [2025-09-05T18:19:35.472362] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:35.472568] [WARN ] [MAIN ] FI: No existing data found, performing full refresh instead. [2025-09-05T18:19:35.472736] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-05T18:19:35.472776] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-05T18:19:35.472821] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-05T18:19:35.825189] [INFO ] [REMOTE ] FI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:35.863426] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-05T18:19:36.663479] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-05T18:19:36.853287] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-05T18:19:37.463439] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-05T18:19:37.522734] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-05T18:19:37.792943] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-05T18:19:37.988968] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:19:37.992520] [INFO ] [REMOTE ] FFWM: Full fetch complete (39840 records). [2025-09-05T18:19:38.268667] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-05T18:19:38.356129] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-05T18:19:38.519080] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-05T18:19:38.519235] [INFO ] [MAIN ] Update Progress: 823/2363 symbols completed. FFWM took 27.6s. Estimated remaining: 36m 38s. Rate: 42.0 symbols/min [2025-09-05T18:19:38.697610] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:38.710968] [INFO ] [MAIN ] FICO: Loaded 11239 existing records. [2025-09-05T18:19:38.910014] [INFO ] [MAIN ] FICO: Found 1 missing trading days. [2025-09-05T18:19:38.910165] [INFO ] [MAIN ] FICO: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:39.063456] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-05T18:19:39.624220] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:19:39.694343] [INFO ] [MAIN ] FICO: Adding 119 new records, updating 0 existing records. [2025-09-05T18:19:39.696774] [INFO ] [MAIN ] FICO: Combined dataset has 11358 total records. [2025-09-05T18:19:39.864442] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-05T18:19:39.893207] [WARN ] [VALIDATOR ] FICO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:40.106223] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-05T18:19:40.126014] [WARN ] [VALIDATOR ] FICO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:40.126238] [INFO ] [MAIN ] FICO: Combined data validation passed. [2025-09-05T18:19:40.204844] [INFO ] [MAIN ] FICO: Update completed successfully. [2025-09-05T18:19:40.206247] [INFO ] [MAIN ] Update Progress: 824/2363 symbols completed. FICO took 1.7s. Estimated remaining: 36m 37s. Rate: 42.0 symbols/min [2025-09-05T18:19:40.398393] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:40.409625] [INFO ] [MAIN ] FIG: Loaded 9485 existing records. [2025-09-05T18:19:40.601633] [INFO ] [MAIN ] FIG: Found 1 missing trading days. [2025-09-05T18:19:40.601816] [INFO ] [MAIN ] FIG: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:40.663429] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-05T18:19:41.463435] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-05T18:19:41.852599] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-05T18:19:42.263500] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-05T18:19:43.063518] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-05T18:19:43.368953] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-05T18:19:43.397486] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-05T18:19:43.558494] [INFO ] [MAIN ] FIG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:19:43.561577] [INFO ] [MAIN ] FIG: Combined dataset has 9875 total records. [2025-09-05T18:19:43.745027] [WARN ] [VALIDATOR ] FIG: Not fatal, but first date in data (2025-07-31) does not match expected start date (2025-01-31) [2025-09-05T18:19:43.868596] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-05T18:19:43.941338] [WARN ] [VALIDATOR ] FIG: Missing days changed. Total missing: 124 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30 [2025-09-05T18:19:43.941550] [INFO ] [MAIN ] FIG: Combined data validation passed. [2025-09-05T18:19:44.004468] [INFO ] [MAIN ] FIG: Update completed successfully. [2025-09-05T18:19:44.005722] [INFO ] [MAIN ] Update Progress: 825/2363 symbols completed. FIG took 3.8s. Estimated remaining: 36m 40s. Rate: 41.9 symbols/min [2025-09-05T18:19:44.176773] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:44.199937] [INFO ] [MAIN ] FIGS: Loaded 23502 existing records. [2025-09-05T18:19:44.429808] [INFO ] [MAIN ] FIGS: Found 1 missing trading days. [2025-09-05T18:19:44.430037] [INFO ] [MAIN ] FIGS: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:44.461881] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-05T18:19:44.663474] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-05T18:19:44.741061] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-05T18:19:45.441401] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:19:45.470220] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-05T18:19:45.594331] [INFO ] [MAIN ] FIGS: Adding 384 new records, updating 0 existing records. [2025-09-05T18:19:45.598103] [INFO ] [MAIN ] FIGS: Combined dataset has 23886 total records. [2025-09-05T18:19:45.777556] [WARN ] [VALIDATOR ] FIGS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:19:45.969844] [WARN ] [VALIDATOR ] FIGS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:19:45.970054] [INFO ] [MAIN ] FIGS: Combined data validation passed. [2025-09-05T18:19:46.113509] [INFO ] [MAIN ] FIGS: Update completed successfully. [2025-09-05T18:19:46.116580] [INFO ] [MAIN ] Update Progress: 826/2363 symbols completed. FIGS took 2.1s. Estimated remaining: 36m 40s. Rate: 41.9 symbols/min [2025-09-05T18:19:46.256336] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-05T18:19:46.269616] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-05T18:19:46.342056] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:46.342292] [WARN ] [MAIN ] FIHL: No existing data found, performing full refresh instead. [2025-09-05T18:19:46.342451] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-05T18:19:46.342492] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-05T18:19:46.342538] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-05T18:19:46.704556] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:19:47.063461] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-05T18:19:47.108367] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-05T18:19:47.653303] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-05T18:19:47.863491] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-05T18:19:48.663485] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-05T18:19:49.188790] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-05T18:19:49.463453] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-05T18:19:50.017742] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-05T18:19:50.263536] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-05T18:19:50.499896] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-05T18:19:51.063503] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-05T18:19:51.369697] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-05T18:19:51.679532] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-05T18:19:51.863500] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-05T18:19:52.527982] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-05T18:19:52.663473] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-05T18:19:53.463498] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-05T18:19:54.003478] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-05T18:19:54.074391] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-05T18:19:54.263522] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-05T18:19:55.063484] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-05T18:19:55.243003] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-05T18:19:55.863669] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-05T18:19:56.044006] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-05T18:19:56.465943] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-05T18:19:56.663532] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-05T18:19:57.463529] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-05T18:19:57.475171] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:19:57.478095] [INFO ] [REMOTE ] FI: Full fetch complete (58117 records). [2025-09-05T18:19:57.878557] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-05T18:19:57.893791] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-05T18:19:58.179944] [INFO ] [MAIN ] FI: Full history saved. [2025-09-05T18:19:58.180169] [INFO ] [MAIN ] Update Progress: 827/2363 symbols completed. FI took 22.9s. Estimated remaining: 36m 58s. Rate: 41.5 symbols/min [2025-09-05T18:19:58.268835] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-05T18:19:58.358929] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:19:58.365161] [INFO ] [MAIN ] FINS: Loaded 3887 existing records. [2025-09-05T18:19:58.541082] [INFO ] [MAIN ] FINS: Found 1 missing trading days. [2025-09-05T18:19:58.541254] [INFO ] [MAIN ] FINS: Need to fetch 1 months: 2025-09 [2025-09-05T18:19:59.063532] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-05T18:19:59.158708] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-05T18:19:59.863570] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-05T18:19:59.980412] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-05T18:20:00.002252] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:20:00.026936] [INFO ] [MAIN ] FINS: Adding 45 new records, updating 0 existing records. [2025-09-05T18:20:00.028965] [INFO ] [MAIN ] FINS: Combined dataset has 3932 total records. [2025-09-05T18:20:00.207287] [WARN ] [VALIDATOR ] FINS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:00.407526] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:20:00.416179] [INFO ] [REMOTE ] FHN: Full fetch complete (58001 records). [2025-09-05T18:20:00.669487] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-05T18:20:00.809331] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-05T18:20:00.939871] [WARN ] [VALIDATOR ] FINS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:00.941743] [INFO ] [MAIN ] FINS: Combined data validation passed. [2025-09-05T18:20:00.970280] [INFO ] [MAIN ] FINS: Update completed successfully. [2025-09-05T18:20:00.971674] [INFO ] [MAIN ] Update Progress: 828/2363 symbols completed. FINS took 2.8s. Estimated remaining: 36m 59s. Rate: 41.5 symbols/min [2025-09-05T18:20:01.153407] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:01.272315] [INFO ] [MAIN ] FINV: Loaded 22376 existing records. [2025-09-05T18:20:01.464550] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-05T18:20:01.473671] [INFO ] [MAIN ] FINV: Found 1 missing trading days. [2025-09-05T18:20:01.475866] [INFO ] [MAIN ] FINV: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:01.515784] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-05T18:20:01.515997] [INFO ] [MAIN ] Update Progress: 829/2363 symbols completed. FHN took 29.0s. Estimated remaining: 36m 56s. Rate: 41.5 symbols/min [2025-09-05T18:20:01.716988] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:01.746303] [INFO ] [MAIN ] FIS: Loaded 25406 existing records. [2025-09-05T18:20:01.948399] [INFO ] [MAIN ] FIS: Found 1 missing trading days. [2025-09-05T18:20:01.948585] [INFO ] [MAIN ] FIS: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:02.263524] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-05T18:20:02.406246] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-05T18:20:02.795600] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:20:02.926629] [INFO ] [MAIN ] FINV: Adding 358 new records, updating 0 existing records. [2025-09-05T18:20:02.929826] [INFO ] [MAIN ] FINV: Combined dataset has 22734 total records. [2025-09-05T18:20:03.075522] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-05T18:20:03.115903] [WARN ] [VALIDATOR ] FINV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:03.325779] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-05T18:20:03.342654] [WARN ] [VALIDATOR ] FINV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:03.342878] [INFO ] [MAIN ] FINV: Combined data validation passed. [2025-09-05T18:20:03.476584] [INFO ] [MAIN ] FINV: Update completed successfully. [2025-09-05T18:20:03.479371] [INFO ] [MAIN ] Update Progress: 830/2363 symbols completed. FINV took 2.5s. Estimated remaining: 36m 56s. Rate: 41.5 symbols/min [2025-09-05T18:20:03.650113] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:03.665289] [INFO ] [MAIN ] FIX: Loaded 12922 existing records. [2025-09-05T18:20:03.849390] [INFO ] [MAIN ] FIX: Found 1 missing trading days. [2025-09-05T18:20:03.849605] [INFO ] [MAIN ] FIX: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:03.863428] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-05T18:20:04.663503] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-05T18:20:04.903343] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-05T18:20:04.924107] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:20:04.982693] [INFO ] [MAIN ] FIX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:20:04.984350] [INFO ] [MAIN ] FIX: Combined dataset has 12922 total records. [2025-09-05T18:20:04.984877] [FATAL] [VALIDATOR ] FIX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:20:04.984980] [FATAL] [MAIN ] FIX: Combined data validation failed. [2025-09-05T18:20:04.985017] [WARN ] [MAIN ] FIX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:20:04.985055] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-05T18:20:04.985544] [INFO ] [LOCAL ] FIX: Starting deletion of derivative data. [2025-09-05T18:20:04.987587] [INFO ] [MAIN ] Update Progress: 831/2363 symbols completed. FIX took 1.5s. Estimated remaining: 36m 54s. Rate: 41.5 symbols/min [2025-09-05T18:20:05.128889] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:20:05.221699] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:05.242309] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-05T18:20:05.257909] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-05T18:20:05.268158] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-05T18:20:05.273338] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-05T18:20:05.393920] [INFO ] [MAIN ] FIS: Adding 0 new records, updating 0 existing records. [2025-09-05T18:20:05.469389] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-05T18:20:05.469486] [INFO ] [MAIN ] FIS: Combined dataset has 25406 total records. [2025-09-05T18:20:05.479134] [FATAL] [VALIDATOR ] FIS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:20:05.505301] [FATAL] [MAIN ] FIS: Combined data validation failed. [2025-09-05T18:20:05.522450] [WARN ] [MAIN ] FIS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:20:05.559268] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-05T18:20:05.601071] [INFO ] [LOCAL ] FIS: Starting deletion of derivative data. [2025-09-05T18:20:05.615365] [INFO ] [MAIN ] Update Progress: 832/2363 symbols completed. FIS took 4.1s. Estimated remaining: 36m 51s. Rate: 41.5 symbols/min [2025-09-05T18:20:05.796591] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:20:05.865572] [INFO ] [MAIN ] FL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:05.889868] [INFO ] [MAIN ] FL: Loaded 24425 existing records. [2025-09-05T18:20:06.072690] [INFO ] [MAIN ] FL: Found 1 missing trading days. [2025-09-05T18:20:06.072863] [INFO ] [MAIN ] FL: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:06.263500] [INFO ] [REMOTE ] FL: Fetching primary data for 2025-09. [2025-09-05T18:20:06.898313] [INFO ] [REMOTE ] FL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:20:07.040702] [INFO ] [MAIN ] FL: Adding 315 new records, updating 0 existing records. [2025-09-05T18:20:07.044953] [INFO ] [MAIN ] FL: Combined dataset has 24740 total records. [2025-09-05T18:20:07.068764] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-05T18:20:07.237416] [WARN ] [VALIDATOR ] FL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:07.470154] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-05T18:20:07.483849] [WARN ] [VALIDATOR ] FL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:07.484087] [INFO ] [MAIN ] FL: Combined data validation passed. [2025-09-05T18:20:07.646262] [INFO ] [MAIN ] FL: Update completed successfully. [2025-09-05T18:20:07.649995] [INFO ] [MAIN ] Update Progress: 833/2363 symbols completed. FL took 2.0s. Estimated remaining: 36m 51s. Rate: 41.5 symbols/min [2025-09-05T18:20:07.851379] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:07.860034] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:20:07.863608] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-05T18:20:07.863918] [INFO ] [REMOTE ] FHI: Full fetch complete (44307 records). [2025-09-05T18:20:07.903994] [INFO ] [MAIN ] FLC: Loaded 2722 existing records. [2025-09-05T18:20:08.166837] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-05T18:20:08.214457] [INFO ] [MAIN ] FLC: Found 1 missing trading days. [2025-09-05T18:20:08.241495] [INFO ] [MAIN ] FLC: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:08.468689] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-05T18:20:08.675160] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-05T18:20:08.697734] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-05T18:20:08.698214] [INFO ] [MAIN ] Update Progress: 834/2363 symbols completed. FHI took 39.8s. Estimated remaining: 36m 49s. Rate: 41.5 symbols/min [2025-09-05T18:20:08.882531] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:08.910925] [INFO ] [MAIN ] FLG: Loaded 25453 existing records. [2025-09-05T18:20:09.089069] [INFO ] [MAIN ] FLG: Found 1 missing trading days. [2025-09-05T18:20:09.089223] [INFO ] [MAIN ] FLG: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:09.463507] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-05T18:20:10.035961] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-05T18:20:10.242831] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:20:10.264522] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-05T18:20:10.264430] [INFO ] [MAIN ] FLC: Adding 66 new records, updating 0 existing records. [2025-09-05T18:20:10.268432] [INFO ] [MAIN ] FLC: Combined dataset has 2788 total records. [2025-09-05T18:20:10.480570] [WARN ] [VALIDATOR ] FLC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:10.661780] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-05T18:20:10.682024] [WARN ] [VALIDATOR ] FLC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:10.682236] [INFO ] [MAIN ] FLC: Combined data validation passed. [2025-09-05T18:20:10.701812] [INFO ] [MAIN ] FLC: Update completed successfully. [2025-09-05T18:20:10.702320] [INFO ] [MAIN ] Update Progress: 835/2363 symbols completed. FLC took 3.1s. Estimated remaining: 36m 49s. Rate: 41.5 symbols/min [2025-09-05T18:20:10.875206] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:10.875399] [WARN ] [MAIN ] FLNG: No existing data found, performing full refresh instead. [2025-09-05T18:20:10.875529] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-05T18:20:10.875569] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-05T18:20:10.875614] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-05T18:20:11.070930] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-05T18:20:11.238831] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:20:11.351204] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-05T18:20:11.863473] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-05T18:20:12.663533] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-05T18:20:13.211060] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:20:13.359218] [INFO ] [MAIN ] FLG: Adding 386 new records, updating 0 existing records. [2025-09-05T18:20:13.362727] [INFO ] [MAIN ] FLG: Combined dataset has 25839 total records. [2025-09-05T18:20:13.465070] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-05T18:20:13.545794] [WARN ] [VALIDATOR ] FLG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:13.751752] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-05T18:20:13.768877] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-05T18:20:13.786120] [WARN ] [VALIDATOR ] FLG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:13.786345] [INFO ] [MAIN ] FLG: Combined data validation passed. [2025-09-05T18:20:13.946269] [INFO ] [MAIN ] FLG: Update completed successfully. [2025-09-05T18:20:13.948924] [INFO ] [MAIN ] Update Progress: 836/2363 symbols completed. FLG took 5.3s. Estimated remaining: 36m 50s. Rate: 41.5 symbols/min [2025-09-05T18:20:14.169893] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:14.193868] [INFO ] [MAIN ] FLO: Loaded 24865 existing records. [2025-09-05T18:20:14.268692] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-05T18:20:14.372772] [INFO ] [MAIN ] FLO: Found 1 missing trading days. [2025-09-05T18:20:14.372918] [INFO ] [MAIN ] FLO: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:15.063530] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-05T18:20:15.863534] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-05T18:20:16.025764] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-05T18:20:16.131299] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:20:16.279602] [INFO ] [MAIN ] FLO: Adding 385 new records, updating 0 existing records. [2025-09-05T18:20:16.282884] [INFO ] [MAIN ] FLO: Combined dataset has 25250 total records. [2025-09-05T18:20:16.468106] [WARN ] [VALIDATOR ] FLO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:16.663779] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-05T18:20:16.670941] [WARN ] [VALIDATOR ] FLO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:16.671156] [INFO ] [MAIN ] FLO: Combined data validation passed. [2025-09-05T18:20:16.823184] [INFO ] [MAIN ] FLO: Update completed successfully. [2025-09-05T18:20:16.826305] [INFO ] [MAIN ] Update Progress: 837/2363 symbols completed. FLO took 2.9s. Estimated remaining: 36m 52s. Rate: 41.4 symbols/min [2025-09-05T18:20:17.242330] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-05T18:20:17.463496] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-05T18:20:18.228617] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-05T18:20:18.263427] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-05T18:20:18.901389] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-05T18:20:18.904598] [INFO ] [REMOTE ] FIHL: Full fetch complete (43293 records). [2025-09-05T18:20:19.077408] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-05T18:20:19.279463] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-05T18:20:19.386797] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-05T18:20:19.479805] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-05T18:20:19.479993] [INFO ] [MAIN ] Update Progress: 838/2363 symbols completed. FIHL took 33.3s. Estimated remaining: 36m 52s. Rate: 41.4 symbols/min [2025-09-05T18:20:19.627858] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-05T18:20:19.863480] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-05T18:20:20.663499] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-05T18:20:21.033991] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-05T18:20:21.375203] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-05T18:20:21.463482] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-05T18:20:22.031007] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-05T18:20:22.263485] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-05T18:20:23.063494] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-05T18:20:23.518739] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-05T18:20:23.528740] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-05T18:20:23.863475] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-05T18:20:24.481754] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:20:24.482499] [INFO ] [REMOTE ] FIXT: Full fetch complete (1533 records). [2025-09-05T18:20:24.659309] [WARN ] [VALIDATOR ] FIXT: Not fatal, but first date in data (2025-06-16) does not match expected start date (2025-01-31) [2025-09-05T18:20:24.691570] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-05T18:20:24.867574] [WARN ] [VALIDATOR ] FIXT: Missing days changed. Total missing: 93 No longer missing: 2025-01-29, 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13 [2025-09-05T18:20:24.867848] [INFO ] [MAIN ] FIXT: Fetched primary data is valid. [2025-09-05T18:20:24.878931] [INFO ] [MAIN ] FIXT: Full history saved. [2025-09-05T18:20:24.879023] [INFO ] [MAIN ] Update Progress: 839/2363 symbols completed. FIXT took 19.9s. Estimated remaining: 36m 58s. Rate: 41.2 symbols/min [2025-09-05T18:20:26.506862] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-05T18:20:26.514961] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-05T18:20:28.115428] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-05T18:20:28.123441] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-05T18:20:28.920798] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:20:28.923197] [INFO ] [REMOTE ] FLNG: Full fetch complete (37684 records). [2025-09-05T18:20:29.327749] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-05T18:20:29.488559] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-05T18:20:29.488760] [INFO ] [MAIN ] Update Progress: 840/2363 symbols completed. FLNG took 18.8s. Estimated remaining: 37m 2s. Rate: 41.1 symbols/min [2025-09-05T18:20:30.089008] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:30.205260] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:30.226998] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:30.203167] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:30.237727] [INFO ] [MAIN ] FLOC: Loaded 13387 existing records. [2025-09-05T18:20:30.470386] [INFO ] [MAIN ] FLUT: Loaded 24343 existing records. [2025-09-05T18:20:30.474355] [INFO ] [MAIN ] FLR: Loaded 25471 existing records. [2025-09-05T18:20:30.479115] [INFO ] [MAIN ] FLOC: Found 1 missing trading days. [2025-09-05T18:20:30.490857] [INFO ] [MAIN ] FLOC: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:30.640211] [INFO ] [MAIN ] FLS: Loaded 37584 existing records. [2025-09-05T18:20:30.625696] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-05T18:20:30.923184] [INFO ] [MAIN ] FLUT: Found 1 missing trading days. [2025-09-05T18:20:30.988001] [INFO ] [MAIN ] FLR: Found 1 missing trading days. [2025-09-05T18:20:30.988057] [INFO ] [MAIN ] FLUT: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:30.998409] [INFO ] [MAIN ] FLR: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:31.019951] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-05T18:20:31.013700] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-05T18:20:31.057272] [INFO ] [MAIN ] FLS: Found 1 missing trading days. [2025-09-05T18:20:31.057469] [INFO ] [MAIN ] FLS: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:31.057916] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-05T18:20:31.770065] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:20:31.911466] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:20:31.924484] [INFO ] [MAIN ] FLR: Adding 383 new records, updating 0 existing records. [2025-09-05T18:20:31.969263] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:20:32.017774] [INFO ] [MAIN ] FLOC: Adding 183 new records, updating 0 existing records. [2025-09-05T18:20:32.069976] [INFO ] [MAIN ] FLR: Combined dataset has 25854 total records. [2025-09-05T18:20:32.222282] [INFO ] [MAIN ] FLOC: Combined dataset has 13570 total records. [2025-09-05T18:20:32.286376] [INFO ] [MAIN ] FLS: Adding 383 new records, updating 0 existing records. [2025-09-05T18:20:32.464107] [WARN ] [VALIDATOR ] FLR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:32.573133] [INFO ] [MAIN ] FLS: Combined dataset has 37967 total records. [2025-09-05T18:20:32.647675] [WARN ] [VALIDATOR ] FLOC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:33.090502] [WARN ] [VALIDATOR ] FLS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:20:33.215999] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-05T18:20:33.476297] [INFO ] [MAIN ] FLUT: Adding 365 new records, updating 0 existing records. [2025-09-05T18:20:33.484453] [INFO ] [MAIN ] FLUT: Combined dataset has 24708 total records. [2025-09-05T18:20:33.597606] [WARN ] [VALIDATOR ] FLOC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:33.597521] [WARN ] [VALIDATOR ] FLR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:33.618615] [INFO ] [MAIN ] FLOC: Combined data validation passed. [2025-09-05T18:20:33.633783] [INFO ] [MAIN ] FLR: Combined data validation passed. [2025-09-05T18:20:33.671508] [WARN ] [VALIDATOR ] FLUT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:34.006221] [INFO ] [MAIN ] FLOC: Update completed successfully. [2025-09-05T18:20:34.009311] [INFO ] [MAIN ] Update Progress: 841/2363 symbols completed. FLOC took 4.5s. Estimated remaining: 37m 6s. Rate: 41.0 symbols/min [2025-09-05T18:20:34.067826] [WARN ] [VALIDATOR ] FLS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:20:34.088854] [INFO ] [MAIN ] FLS: Combined data validation passed. [2025-09-05T18:20:34.356977] [INFO ] [MAIN ] FLR: Update completed successfully. [2025-09-05T18:20:34.391733] [INFO ] [MAIN ] Update Progress: 842/2363 symbols completed. FLR took 4.8s. Estimated remaining: 37m 3s. Rate: 41.1 symbols/min [2025-09-05T18:20:34.395937] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:34.537950] [INFO ] [MAIN ] FLXR: Loaded 10046 existing records. [2025-09-05T18:20:34.696327] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:34.857670] [INFO ] [MAIN ] FLS: Update completed successfully. [2025-09-05T18:20:34.872749] [INFO ] [MAIN ] Update Progress: 843/2363 symbols completed. FLS took 5.4s. Estimated remaining: 36m 60s. Rate: 41.1 symbols/min [2025-09-05T18:20:34.947831] [INFO ] [MAIN ] FLXR: Found 1 missing trading days. [2025-09-05T18:20:34.979109] [INFO ] [MAIN ] FLXR: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:35.001746] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-05T18:20:35.070823] [INFO ] [MAIN ] FMC: Loaded 24582 existing records. [2025-09-05T18:20:35.136439] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:35.255132] [INFO ] [MAIN ] FMN: Loaded 4038 existing records. [2025-09-05T18:20:35.365767] [INFO ] [MAIN ] FMC: Found 1 missing trading days. [2025-09-05T18:20:35.379604] [INFO ] [MAIN ] FMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:35.391604] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-05T18:20:35.469312] [WARN ] [VALIDATOR ] FLUT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:35.487483] [INFO ] [MAIN ] FMN: Found 1 missing trading days. [2025-09-05T18:20:35.487698] [INFO ] [MAIN ] FLUT: Combined data validation passed. [2025-09-05T18:20:35.487748] [INFO ] [MAIN ] FMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:35.488133] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-05T18:20:35.650745] [INFO ] [MAIN ] FLUT: Update completed successfully. [2025-09-05T18:20:35.654075] [INFO ] [MAIN ] Update Progress: 844/2363 symbols completed. FLUT took 6.2s. Estimated remaining: 36m 57s. Rate: 41.1 symbols/min [2025-09-05T18:20:35.848566] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:35.848798] [WARN ] [MAIN ] FMS: No existing data found, performing full refresh instead. [2025-09-05T18:20:35.848929] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-05T18:20:35.848970] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-05T18:20:35.849016] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-05T18:20:36.218333] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:20:36.368054] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T18:20:36.402110] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:20:36.458990] [INFO ] [REMOTE ] FMS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:20:36.481291] [INFO ] [MAIN ] FMN: Adding 13 new records, updating 0 existing records. [2025-09-05T18:20:36.475342] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-05T18:20:36.614147] [INFO ] [MAIN ] FLXR: Adding 190 new records, updating 0 existing records. [2025-09-05T18:20:36.637383] [INFO ] [MAIN ] FMN: Combined dataset has 4051 total records. [2025-09-05T18:20:36.690339] [INFO ] [MAIN ] FMC: Adding 389 new records, updating 0 existing records. [2025-09-05T18:20:36.732153] [INFO ] [MAIN ] FLXR: Combined dataset has 10236 total records. [2025-09-05T18:20:36.899831] [INFO ] [MAIN ] FMC: Combined dataset has 24971 total records. [2025-09-05T18:20:37.222441] [WARN ] [VALIDATOR ] FMN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:20:37.382489] [WARN ] [VALIDATOR ] FLXR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:37.630505] [WARN ] [VALIDATOR ] FMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:38.023005] [WARN ] [VALIDATOR ] FLXR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:38.023412] [INFO ] [MAIN ] FLXR: Combined data validation passed. [2025-09-05T18:20:38.023075] [WARN ] [VALIDATOR ] FMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:38.023627] [INFO ] [MAIN ] FMC: Combined data validation passed. [2025-09-05T18:20:38.023124] [WARN ] [VALIDATOR ] FMN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:20:38.024375] [INFO ] [MAIN ] FMN: Combined data validation passed. [2025-09-05T18:20:38.202974] [INFO ] [MAIN ] FMN: Update completed successfully. [2025-09-05T18:20:38.205612] [INFO ] [MAIN ] Update Progress: 845/2363 symbols completed. FMN took 3.3s. Estimated remaining: 36m 58s. Rate: 41.1 symbols/min [2025-09-05T18:20:38.308262] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-05T18:20:38.332722] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-05T18:20:38.438567] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:38.439459] [INFO ] [MAIN ] FLXR: Update completed successfully. [2025-09-05T18:20:38.442029] [INFO ] [MAIN ] Update Progress: 846/2363 symbols completed. FLXR took 4.4s. Estimated remaining: 36m 54s. Rate: 41.1 symbols/min [2025-09-05T18:20:38.642703] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:38.666816] [INFO ] [MAIN ] FMX: Loaded 19453 existing records. [2025-09-05T18:20:38.717820] [INFO ] [MAIN ] FMY: Loaded 1076 existing records. [2025-09-05T18:20:38.862462] [INFO ] [MAIN ] FMC: Update completed successfully. [2025-09-05T18:20:38.892367] [INFO ] [MAIN ] Update Progress: 847/2363 symbols completed. FMC took 4.5s. Estimated remaining: 36m 51s. Rate: 41.1 symbols/min [2025-09-05T18:20:39.065414] [INFO ] [MAIN ] FMX: Found 1 missing trading days. [2025-09-05T18:20:39.126056] [INFO ] [MAIN ] FMX: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:39.136808] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-05T18:20:39.136529] [INFO ] [MAIN ] FMY: Found 1 missing trading days. [2025-09-05T18:20:39.142792] [INFO ] [MAIN ] FMY: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:39.160716] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-05T18:20:39.264851] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:39.283827] [INFO ] [MAIN ] FN: Loaded 18057 existing records. [2025-09-05T18:20:39.463369] [INFO ] [MAIN ] FN: Found 1 missing trading days. [2025-09-05T18:20:39.463556] [INFO ] [MAIN ] FN: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:39.463829] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-05T18:20:39.594545] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-05T18:20:39.600110] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-05T18:20:39.714843] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:20:39.787950] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:20:39.813507] [INFO ] [MAIN ] FMY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:20:39.819790] [INFO ] [MAIN ] FMY: Combined dataset has 1076 total records. [2025-09-05T18:20:39.830503] [FATAL] [VALIDATOR ] FMY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:20:39.843488] [INFO ] [MAIN ] FMX: Adding 294 new records, updating 0 existing records. [2025-09-05T18:20:39.844172] [FATAL] [MAIN ] FMY: Combined data validation failed. [2025-09-05T18:20:39.845431] [WARN ] [MAIN ] FMY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:20:39.845727] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-05T18:20:39.846056] [INFO ] [LOCAL ] FMY: Starting deletion of derivative data. [2025-09-05T18:20:39.846708] [INFO ] [MAIN ] Update Progress: 848/2363 symbols completed. FMY took 1.4s. Estimated remaining: 36m 48s. Rate: 41.2 symbols/min [2025-09-05T18:20:39.846995] [INFO ] [MAIN ] FMX: Combined dataset has 19747 total records. [2025-09-05T18:20:40.209189] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:40.270190] [WARN ] [VALIDATOR ] FMX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:40.342257] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:20:40.602884] [INFO ] [MAIN ] FN: Adding 317 new records, updating 0 existing records. [2025-09-05T18:20:40.603840] [INFO ] [MAIN ] FNB: Loaded 25067 existing records. [2025-09-05T18:20:40.718282] [INFO ] [MAIN ] FN: Combined dataset has 18374 total records. [2025-09-05T18:20:40.876540] [INFO ] [MAIN ] FNB: Found 1 missing trading days. [2025-09-05T18:20:40.895338] [INFO ] [MAIN ] FNB: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:40.899140] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-05T18:20:40.981121] [WARN ] [VALIDATOR ] FN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:41.195819] [WARN ] [VALIDATOR ] FMX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:41.195952] [WARN ] [VALIDATOR ] FN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:41.196264] [INFO ] [MAIN ] FMX: Combined data validation passed. [2025-09-05T18:20:41.196617] [INFO ] [MAIN ] FN: Combined data validation passed. [2025-09-05T18:20:41.358805] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-05T18:20:41.393241] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-05T18:20:41.456548] [INFO ] [MAIN ] FMX: Update completed successfully. [2025-09-05T18:20:41.461222] [INFO ] [MAIN ] FN: Update completed successfully. [2025-09-05T18:20:41.461115] [INFO ] [MAIN ] Update Progress: 849/2363 symbols completed. FMX took 3.3s. Estimated remaining: 36m 47s. Rate: 41.2 symbols/min [2025-09-05T18:20:41.475387] [INFO ] [MAIN ] Update Progress: 850/2363 symbols completed. FN took 2.6s. Estimated remaining: 36m 43s. Rate: 41.2 symbols/min [2025-09-05T18:20:41.688769] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:20:41.845980] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:41.896490] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:41.993490] [INFO ] [MAIN ] FNB: Adding 387 new records, updating 0 existing records. [2025-09-05T18:20:42.012935] [INFO ] [MAIN ] FNB: Combined dataset has 25454 total records. [2025-09-05T18:20:42.013726] [INFO ] [MAIN ] FND: Loaded 24755 existing records. [2025-09-05T18:20:42.186547] [INFO ] [MAIN ] FNF: Loaded 23411 existing records. [2025-09-05T18:20:42.523466] [WARN ] [VALIDATOR ] FNB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:42.552126] [INFO ] [MAIN ] FND: Found 1 missing trading days. [2025-09-05T18:20:42.585159] [INFO ] [MAIN ] FND: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:42.585053] [INFO ] [MAIN ] FNF: Found 1 missing trading days. [2025-09-05T18:20:42.638909] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-05T18:20:42.629760] [INFO ] [MAIN ] FNF: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:42.688952] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-05T18:20:42.784942] [WARN ] [VALIDATOR ] FNB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:42.785167] [INFO ] [MAIN ] FNB: Combined data validation passed. [2025-09-05T18:20:42.903621] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-05T18:20:42.917627] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-05T18:20:42.972198] [INFO ] [MAIN ] FNB: Update completed successfully. [2025-09-05T18:20:42.975409] [INFO ] [MAIN ] Update Progress: 851/2363 symbols completed. FNB took 3.1s. Estimated remaining: 36m 42s. Rate: 41.2 symbols/min [2025-09-05T18:20:43.159994] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:43.182547] [INFO ] [MAIN ] FNV: Loaded 21433 existing records. [2025-09-05T18:20:43.366943] [INFO ] [MAIN ] FNV: Found 1 missing trading days. [2025-09-05T18:20:43.367199] [INFO ] [MAIN ] FNV: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:43.367520] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-05T18:20:43.376612] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:20:43.421441] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:20:43.607796] [INFO ] [MAIN ] FNF: Adding 357 new records, updating 0 existing records. [2025-09-05T18:20:43.675179] [INFO ] [MAIN ] FND: Adding 389 new records, updating 0 existing records. [2025-09-05T18:20:43.679281] [INFO ] [MAIN ] FNF: Combined dataset has 23768 total records. [2025-09-05T18:20:43.765458] [INFO ] [MAIN ] FND: Combined dataset has 25144 total records. [2025-09-05T18:20:43.984264] [WARN ] [VALIDATOR ] FNF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:44.148900] [WARN ] [VALIDATOR ] FND: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:44.195311] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:20:44.598218] [INFO ] [MAIN ] FNV: Adding 311 new records, updating 0 existing records. [2025-09-05T18:20:44.605981] [INFO ] [MAIN ] FNV: Combined dataset has 21744 total records. [2025-09-05T18:20:44.768782] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-05T18:20:44.834247] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-05T18:20:44.831846] [WARN ] [VALIDATOR ] FNV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:45.035776] [WARN ] [VALIDATOR ] FNF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:45.035841] [WARN ] [VALIDATOR ] FND: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:45.036001] [INFO ] [MAIN ] FNF: Combined data validation passed. [2025-09-05T18:20:45.036250] [INFO ] [MAIN ] FND: Combined data validation passed. [2025-09-05T18:20:45.337562] [INFO ] [MAIN ] FND: Update completed successfully. [2025-09-05T18:20:45.341229] [INFO ] [MAIN ] Update Progress: 852/2363 symbols completed. FND took 3.9s. Estimated remaining: 36m 42s. Rate: 41.2 symbols/min [2025-09-05T18:20:45.341408] [INFO ] [MAIN ] FNF: Update completed successfully. [2025-09-05T18:20:45.357567] [INFO ] [MAIN ] Update Progress: 853/2363 symbols completed. FNF took 3.9s. Estimated remaining: 36m 38s. Rate: 41.2 symbols/min [2025-09-05T18:20:45.629239] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:45.665493] [WARN ] [VALIDATOR ] FNV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:45.696551] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:45.696686] [INFO ] [MAIN ] FNV: Combined data validation passed. [2025-09-05T18:20:45.702585] [INFO ] [MAIN ] FOA: Loaded 5679 existing records. [2025-09-05T18:20:45.832680] [INFO ] [MAIN ] FOF: Loaded 3739 existing records. [2025-09-05T18:20:46.127479] [INFO ] [MAIN ] FOA: Found 1 missing trading days. [2025-09-05T18:20:46.133441] [INFO ] [MAIN ] FOA: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:46.148536] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-05T18:20:46.185731] [INFO ] [MAIN ] FOF: Found 1 missing trading days. [2025-09-05T18:20:46.187496] [INFO ] [MAIN ] FOF: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:46.188299] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-05T18:20:46.230580] [INFO ] [MAIN ] FNV: Update completed successfully. [2025-09-05T18:20:46.235149] [INFO ] [MAIN ] Update Progress: 854/2363 symbols completed. FNV took 3.3s. Estimated remaining: 36m 35s. Rate: 41.2 symbols/min [2025-09-05T18:20:46.409028] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:46.428809] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-05T18:20:46.437585] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-05T18:20:46.442290] [INFO ] [MAIN ] FOR: Loaded 8938 existing records. [2025-09-05T18:20:46.617507] [INFO ] [MAIN ] FOR: Found 1 missing trading days. [2025-09-05T18:20:46.617664] [INFO ] [MAIN ] FOR: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:46.617869] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-05T18:20:46.773059] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:20:46.815482] [INFO ] [MAIN ] FOA: Adding 147 new records, updating 0 existing records. [2025-09-05T18:20:46.817604] [INFO ] [MAIN ] FOA: Combined dataset has 5826 total records. [2025-09-05T18:20:46.922803] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:20:46.954544] [INFO ] [MAIN ] FOF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:20:47.003989] [INFO ] [MAIN ] FOF: Combined dataset has 3739 total records. [2025-09-05T18:20:47.020566] [FATAL] [VALIDATOR ] FOF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:20:47.028878] [WARN ] [VALIDATOR ] FOA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:47.029016] [FATAL] [MAIN ] FOF: Combined data validation failed. [2025-09-05T18:20:47.034313] [WARN ] [MAIN ] FOF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:20:47.098416] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-05T18:20:47.135528] [INFO ] [LOCAL ] FOF: Starting deletion of derivative data. [2025-09-05T18:20:47.136368] [INFO ] [MAIN ] Update Progress: 855/2363 symbols completed. FOF took 1.7s. Estimated remaining: 36m 33s. Rate: 41.3 symbols/min [2025-09-05T18:20:47.326046] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:20:47.439303] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:47.453118] [INFO ] [MAIN ] FOR: Adding 129 new records, updating 0 existing records. [2025-09-05T18:20:47.458408] [INFO ] [MAIN ] FOR: Combined dataset has 9067 total records. [2025-09-05T18:20:47.645302] [INFO ] [MAIN ] FOUR: Loaded 23425 existing records. [2025-09-05T18:20:47.682348] [WARN ] [VALIDATOR ] FOR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:48.067470] [INFO ] [MAIN ] FOUR: Found 1 missing trading days. [2025-09-05T18:20:48.067767] [INFO ] [MAIN ] FOUR: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:48.068525] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-05T18:20:48.090918] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-05T18:20:48.099032] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-05T18:20:48.117436] [WARN ] [VALIDATOR ] FOA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:48.117496] [WARN ] [VALIDATOR ] FOR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:48.117769] [INFO ] [MAIN ] FOA: Combined data validation passed. [2025-09-05T18:20:48.117869] [INFO ] [MAIN ] FOR: Combined data validation passed. [2025-09-05T18:20:48.205090] [INFO ] [MAIN ] FOA: Update completed successfully. [2025-09-05T18:20:48.213702] [INFO ] [MAIN ] Update Progress: 856/2363 symbols completed. FOA took 2.9s. Estimated remaining: 36m 31s. Rate: 41.3 symbols/min [2025-09-05T18:20:48.262171] [INFO ] [MAIN ] FOR: Update completed successfully. [2025-09-05T18:20:48.296838] [INFO ] [MAIN ] Update Progress: 857/2363 symbols completed. FOR took 2.1s. Estimated remaining: 36m 27s. Rate: 41.3 symbols/min [2025-09-05T18:20:48.529222] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:48.571116] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:20:48.589222] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:48.689162] [INFO ] [MAIN ] FPF: Loaded 8862 existing records. [2025-09-05T18:20:48.743046] [INFO ] [MAIN ] FPH: Loaded 9229 existing records. [2025-09-05T18:20:48.887065] [INFO ] [MAIN ] FOUR: Adding 359 new records, updating 0 existing records. [2025-09-05T18:20:49.063333] [INFO ] [MAIN ] FPF: Found 1 missing trading days. [2025-09-05T18:20:49.093007] [INFO ] [MAIN ] FPF: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:49.100989] [INFO ] [MAIN ] FOUR: Combined dataset has 23784 total records. [2025-09-05T18:20:49.121840] [INFO ] [MAIN ] FPH: Found 1 missing trading days. [2025-09-05T18:20:49.122391] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-05T18:20:49.122150] [INFO ] [MAIN ] FPH: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:49.123504] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-05T18:20:49.302155] [WARN ] [VALIDATOR ] FOUR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:49.496357] [WARN ] [VALIDATOR ] FOUR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:49.496573] [INFO ] [MAIN ] FOUR: Combined data validation passed. [2025-09-05T18:20:49.638598] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-05T18:20:49.648816] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-05T18:20:49.688137] [INFO ] [MAIN ] FOUR: Update completed successfully. [2025-09-05T18:20:49.690832] [INFO ] [MAIN ] Update Progress: 858/2363 symbols completed. FOUR took 2.5s. Estimated remaining: 36m 25s. Rate: 41.3 symbols/min [2025-09-05T18:20:49.860423] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:49.864454] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:20:49.922775] [INFO ] [MAIN ] FPH: Adding 137 new records, updating 0 existing records. [2025-09-05T18:20:49.932180] [INFO ] [MAIN ] FPI: Loaded 14862 existing records. [2025-09-05T18:20:49.932410] [INFO ] [MAIN ] FPH: Combined dataset has 9366 total records. [2025-09-05T18:20:50.336784] [INFO ] [MAIN ] FPI: Found 1 missing trading days. [2025-09-05T18:20:50.337507] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T18:20:50.302019] [WARN ] [VALIDATOR ] FPH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:50.345315] [INFO ] [MAIN ] FPI: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:50.410687] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-05T18:20:50.472057] [INFO ] [MAIN ] FPF: Adding 73 new records, updating 0 existing records. [2025-09-05T18:20:50.522971] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:20:50.555415] [INFO ] [MAIN ] FPF: Combined dataset has 8935 total records. [2025-09-05T18:20:50.586507] [INFO ] [REMOTE ] FMS: Full fetch complete (32369 records). [2025-09-05T18:20:50.923832] [WARN ] [VALIDATOR ] FPF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:51.143634] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:20:51.396380] [INFO ] [MAIN ] FPI: Adding 244 new records, updating 0 existing records. [2025-09-05T18:20:51.408629] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-05T18:20:51.413899] [INFO ] [MAIN ] FPI: Combined dataset has 15106 total records. [2025-09-05T18:20:51.803739] [WARN ] [VALIDATOR ] FPI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:51.828848] [WARN ] [VALIDATOR ] FPH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:51.847309] [INFO ] [MAIN ] FPH: Combined data validation passed. [2025-09-05T18:20:51.859633] [WARN ] [VALIDATOR ] FPF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:51.932155] [INFO ] [MAIN ] FPF: Combined data validation passed. [2025-09-05T18:20:51.977087] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-05T18:20:51.971720] [INFO ] [MAIN ] FPH: Update completed successfully. [2025-09-05T18:20:51.977488] [INFO ] [MAIN ] Update Progress: 859/2363 symbols completed. FMS took 16.3s. Estimated remaining: 36m 25s. Rate: 41.3 symbols/min [2025-09-05T18:20:51.979571] [INFO ] [MAIN ] Update Progress: 860/2363 symbols completed. FPH took 3.7s. Estimated remaining: 36m 21s. Rate: 41.3 symbols/min [2025-09-05T18:20:52.496835] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:52.494941] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:52.511867] [INFO ] [MAIN ] FPF: Update completed successfully. [2025-09-05T18:20:52.513355] [INFO ] [MAIN ] Update Progress: 861/2363 symbols completed. FPF took 4.3s. Estimated remaining: 36m 18s. Rate: 41.4 symbols/min [2025-09-05T18:20:52.580744] [INFO ] [MAIN ] FRA: Loaded 6794 existing records. [2025-09-05T18:20:52.743760] [INFO ] [MAIN ] FR: Loaded 22039 existing records. [2025-09-05T18:20:52.826944] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:53.067162] [INFO ] [MAIN ] FRGE: Loaded 6906 existing records. [2025-09-05T18:20:53.044459] [INFO ] [MAIN ] FRA: Found 1 missing trading days. [2025-09-05T18:20:53.105300] [INFO ] [MAIN ] FRA: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:53.115285] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-05T18:20:53.147011] [INFO ] [MAIN ] FR: Found 1 missing trading days. [2025-09-05T18:20:53.172847] [INFO ] [MAIN ] FR: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:53.178907] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-05T18:20:53.294905] [INFO ] [MAIN ] FRGE: Found 1 missing trading days. [2025-09-05T18:20:53.295179] [INFO ] [MAIN ] FRGE: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:53.295400] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-05T18:20:53.297801] [WARN ] [VALIDATOR ] FPI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:53.298071] [INFO ] [MAIN ] FPI: Combined data validation passed. [2025-09-05T18:20:53.401728] [INFO ] [MAIN ] FPI: Update completed successfully. [2025-09-05T18:20:53.403511] [INFO ] [MAIN ] Update Progress: 862/2363 symbols completed. FPI took 3.7s. Estimated remaining: 36m 16s. Rate: 41.4 symbols/min [2025-09-05T18:20:53.578053] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:53.603774] [INFO ] [MAIN ] FRO: Loaded 24665 existing records. [2025-09-05T18:20:53.786249] [INFO ] [MAIN ] FRO: Found 1 missing trading days. [2025-09-05T18:20:53.786407] [INFO ] [MAIN ] FRO: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:53.786942] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-05T18:20:53.814291] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:20:53.946877] [INFO ] [MAIN ] FR: Adding 350 new records, updating 0 existing records. [2025-09-05T18:20:53.950138] [INFO ] [MAIN ] FR: Combined dataset has 22389 total records. [2025-09-05T18:20:54.136712] [WARN ] [VALIDATOR ] FR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:54.238848] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T18:20:54.296307] [INFO ] [MAIN ] FRA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:20:54.361050] [INFO ] [MAIN ] FRA: Combined dataset has 6794 total records. [2025-09-05T18:20:54.370261] [FATAL] [VALIDATOR ] FRA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:20:54.370341] [FATAL] [MAIN ] FRA: Combined data validation failed. [2025-09-05T18:20:54.370381] [WARN ] [MAIN ] FRA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:20:54.370418] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-05T18:20:54.370736] [INFO ] [LOCAL ] FRA: Starting deletion of derivative data. [2025-09-05T18:20:54.372179] [INFO ] [MAIN ] Update Progress: 863/2363 symbols completed. FRA took 2.4s. Estimated remaining: 36m 14s. Rate: 41.4 symbols/min [2025-09-05T18:20:54.470568] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:20:54.525370] [INFO ] [MAIN ] FRGE: Adding 89 new records, updating 0 existing records. [2025-09-05T18:20:54.595795] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:54.596622] [INFO ] [MAIN ] FRGE: Combined dataset has 6995 total records. [2025-09-05T18:20:54.737250] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:20:54.824079] [WARN ] [VALIDATOR ] FRGE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:54.943451] [INFO ] [MAIN ] FRT: Loaded 31824 existing records. [2025-09-05T18:20:55.205377] [INFO ] [MAIN ] FRO: Adding 388 new records, updating 0 existing records. [2025-09-05T18:20:55.346911] [INFO ] [MAIN ] FRO: Combined dataset has 25053 total records. [2025-09-05T18:20:55.345785] [INFO ] [MAIN ] FRT: Found 1 missing trading days. [2025-09-05T18:20:55.347247] [INFO ] [MAIN ] FRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:55.347775] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-05T18:20:55.456361] [WARN ] [VALIDATOR ] FR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:55.457071] [INFO ] [MAIN ] FR: Combined data validation passed. [2025-09-05T18:20:55.536883] [WARN ] [VALIDATOR ] FRO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:55.886736] [INFO ] [MAIN ] FR: Update completed successfully. [2025-09-05T18:20:55.891319] [INFO ] [MAIN ] Update Progress: 864/2363 symbols completed. FR took 3.9s. Estimated remaining: 36m 12s. Rate: 41.4 symbols/min [2025-09-05T18:20:56.087777] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:56.097213] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:20:56.241385] [WARN ] [VALIDATOR ] FRGE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:56.261002] [INFO ] [MAIN ] FRT: Adding 312 new records, updating 0 existing records. [2025-09-05T18:20:56.262590] [INFO ] [MAIN ] FRGE: Combined data validation passed. [2025-09-05T18:20:56.283248] [INFO ] [MAIN ] FSCO: Loaded 27780 existing records. [2025-09-05T18:20:56.372795] [WARN ] [VALIDATOR ] FRO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:20:56.395003] [INFO ] [MAIN ] FRT: Combined dataset has 32136 total records. [2025-09-05T18:20:56.405472] [INFO ] [MAIN ] FRO: Combined data validation passed. [2025-09-05T18:20:56.750338] [INFO ] [MAIN ] FSCO: Found 1 missing trading days. [2025-09-05T18:20:56.759194] [INFO ] [MAIN ] FSCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:56.803347] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-05T18:20:56.796912] [INFO ] [MAIN ] FRGE: Update completed successfully. [2025-09-05T18:20:56.852732] [INFO ] [MAIN ] Update Progress: 865/2363 symbols completed. FRGE took 4.3s. Estimated remaining: 36m 10s. Rate: 41.4 symbols/min [2025-09-05T18:20:56.895266] [WARN ] [VALIDATOR ] FRT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:20:57.270760] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:57.370757] [INFO ] [MAIN ] FSK: Loaded 23098 existing records. [2025-09-05T18:20:57.382951] [INFO ] [MAIN ] FRO: Update completed successfully. [2025-09-05T18:20:57.408680] [INFO ] [MAIN ] Update Progress: 866/2363 symbols completed. FRO took 4.0s. Estimated remaining: 36m 7s. Rate: 41.4 symbols/min [2025-09-05T18:20:57.698630] [INFO ] [MAIN ] FSK: Found 1 missing trading days. [2025-09-05T18:20:57.726241] [INFO ] [MAIN ] FSK: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:57.748148] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-05T18:20:57.747581] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:57.751139] [WARN ] [VALIDATOR ] FRT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:20:57.751404] [INFO ] [MAIN ] FRT: Combined data validation passed. [2025-09-05T18:20:57.897211] [INFO ] [MAIN ] FSLY: Loaded 24450 existing records. [2025-09-05T18:20:58.180993] [INFO ] [MAIN ] FSLY: Found 1 missing trading days. [2025-09-05T18:20:58.182226] [INFO ] [MAIN ] FSLY: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:58.184284] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-05T18:20:58.195875] [INFO ] [MAIN ] FRT: Update completed successfully. [2025-09-05T18:20:58.200026] [INFO ] [MAIN ] Update Progress: 867/2363 symbols completed. FRT took 3.8s. Estimated remaining: 36m 4s. Rate: 41.5 symbols/min [2025-09-05T18:20:58.341281] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:20:58.428159] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:58.490622] [INFO ] [MAIN ] FSCO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:20:58.499032] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:20:58.530950] [INFO ] [MAIN ] FSCO: Combined dataset has 27780 total records. [2025-09-05T18:20:58.577952] [FATAL] [VALIDATOR ] FSCO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:20:58.612077] [FATAL] [MAIN ] FSCO: Combined data validation failed. [2025-09-05T18:20:58.629439] [WARN ] [MAIN ] FSCO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:20:58.651875] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-05T18:20:58.646570] [INFO ] [MAIN ] FSM: Loaded 25433 existing records. [2025-09-05T18:20:58.708257] [INFO ] [MAIN ] FSK: Adding 354 new records, updating 0 existing records. [2025-09-05T18:20:58.708330] [INFO ] [LOCAL ] FSCO: Starting deletion of derivative data. [2025-09-05T18:20:58.772490] [INFO ] [MAIN ] Update Progress: 868/2363 symbols completed. FSCO took 2.9s. Estimated remaining: 36m 1s. Rate: 41.5 symbols/min [2025-09-05T18:20:58.948848] [INFO ] [MAIN ] FSK: Combined dataset has 23452 total records. [2025-09-05T18:20:58.998906] [INFO ] [MAIN ] FSM: Found 1 missing trading days. [2025-09-05T18:20:59.006378] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:20:59.006572] [INFO ] [MAIN ] FSM: Need to fetch 1 months: 2025-09 [2025-09-05T18:20:59.022196] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-05T18:20:59.213017] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:20:59.249546] [WARN ] [MAIN ] FSS: No existing data found, performing full refresh instead. [2025-09-05T18:20:59.268770] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-05T18:20:59.268879] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-05T18:20:59.274133] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-05T18:20:59.472950] [WARN ] [VALIDATOR ] FSK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:20:59.522410] [INFO ] [MAIN ] FSLY: Adding 382 new records, updating 0 existing records. [2025-09-05T18:20:59.753858] [INFO ] [MAIN ] FSLY: Combined dataset has 24832 total records. [2025-09-05T18:20:59.929396] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:21:00.138448] [INFO ] [REMOTE ] FSS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:00.180091] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-05T18:21:00.292559] [WARN ] [VALIDATOR ] FSLY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:00.332159] [INFO ] [MAIN ] FSM: Adding 390 new records, updating 0 existing records. [2025-09-05T18:21:00.465336] [INFO ] [MAIN ] FSM: Combined dataset has 25823 total records. [2025-09-05T18:21:00.702994] [WARN ] [VALIDATOR ] FSM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:00.905076] [WARN ] [VALIDATOR ] FSK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:00.905724] [INFO ] [MAIN ] FSK: Combined data validation passed. [2025-09-05T18:21:00.968792] [WARN ] [VALIDATOR ] FSM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:00.968919] [WARN ] [VALIDATOR ] FSLY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:00.978284] [INFO ] [MAIN ] FSLY: Combined data validation passed. [2025-09-05T18:21:00.978183] [INFO ] [MAIN ] FSM: Combined data validation passed. [2025-09-05T18:21:01.261411] [INFO ] [MAIN ] FSLY: Update completed successfully. [2025-09-05T18:21:01.267937] [INFO ] [MAIN ] Update Progress: 869/2363 symbols completed. FSLY took 3.8s. Estimated remaining: 36m 2s. Rate: 41.5 symbols/min [2025-09-05T18:21:01.494510] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:01.499709] [INFO ] [MAIN ] FSM: Update completed successfully. [2025-09-05T18:21:01.503796] [INFO ] [MAIN ] Update Progress: 870/2363 symbols completed. FSM took 3.3s. Estimated remaining: 35m 58s. Rate: 41.5 symbols/min [2025-09-05T18:21:01.567270] [INFO ] [MAIN ] FT: Loaded 3066 existing records. [2025-09-05T18:21:01.839733] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:01.850497] [INFO ] [MAIN ] FSK: Update completed successfully. [2025-09-05T18:21:01.912065] [INFO ] [MAIN ] Update Progress: 871/2363 symbols completed. FSK took 5.0s. Estimated remaining: 35m 55s. Rate: 41.5 symbols/min [2025-09-05T18:21:01.909429] [INFO ] [MAIN ] FT: Found 1 missing trading days. [2025-09-05T18:21:01.912399] [INFO ] [MAIN ] FT: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:01.972970] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-05T18:21:02.030594] [INFO ] [MAIN ] FTHY: Loaded 5485 existing records. [2025-09-05T18:21:02.208760] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:02.251734] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-05T18:21:02.290776] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-05T18:21:02.309567] [INFO ] [MAIN ] FTHY: Found 1 missing trading days. [2025-09-05T18:21:02.310775] [INFO ] [MAIN ] FTHY: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:02.311013] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-05T18:21:02.332538] [INFO ] [MAIN ] FTI: Loaded 25418 existing records. [2025-09-05T18:21:02.508887] [INFO ] [MAIN ] FTI: Found 1 missing trading days. [2025-09-05T18:21:02.509032] [INFO ] [MAIN ] FTI: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:02.509246] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-05T18:21:02.809438] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:21:02.838672] [INFO ] [MAIN ] FT: Adding 59 new records, updating 0 existing records. [2025-09-05T18:21:02.840627] [INFO ] [MAIN ] FT: Combined dataset has 3125 total records. [2025-09-05T18:21:03.035051] [WARN ] [VALIDATOR ] FT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:03.237735] [WARN ] [VALIDATOR ] FT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:03.237962] [INFO ] [MAIN ] FT: Combined data validation passed. [2025-09-05T18:21:03.259673] [INFO ] [MAIN ] FT: Update completed successfully. [2025-09-05T18:21:03.260446] [INFO ] [MAIN ] Update Progress: 872/2363 symbols completed. FT took 2.0s. Estimated remaining: 35m 53s. Rate: 41.5 symbols/min [2025-09-05T18:21:03.344182] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:21:03.515466] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:03.550664] [WARN ] [MAIN ] FTK: No existing data found, performing full refresh instead. [2025-09-05T18:21:03.550529] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T18:21:03.637168] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-05T18:21:03.637081] [INFO ] [MAIN ] FTHY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:21:03.647581] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-05T18:21:03.652272] [INFO ] [MAIN ] FTI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:21:03.648125] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-05T18:21:03.653719] [INFO ] [MAIN ] FTHY: Combined dataset has 5485 total records. [2025-09-05T18:21:03.665636] [FATAL] [VALIDATOR ] FTHY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:21:03.686940] [FATAL] [MAIN ] FTHY: Combined data validation failed. [2025-09-05T18:21:03.698274] [WARN ] [MAIN ] FTHY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:21:03.716507] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-05T18:21:03.752508] [INFO ] [LOCAL ] FTHY: Starting deletion of derivative data. [2025-09-05T18:21:03.773552] [INFO ] [MAIN ] Update Progress: 873/2363 symbols completed. FTHY took 2.3s. Estimated remaining: 35m 50s. Rate: 41.6 symbols/min [2025-09-05T18:21:03.774088] [INFO ] [MAIN ] FTI: Combined dataset has 25808 total records. [2025-09-05T18:21:04.118015] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-05T18:21:04.178316] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-05T18:21:04.402633] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:04.406324] [WARN ] [VALIDATOR ] FTI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:04.552676] [INFO ] [REMOTE ] FTK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:04.593991] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-05T18:21:04.632385] [INFO ] [MAIN ] FTS: Loaded 20501 existing records. [2025-09-05T18:21:04.872822] [INFO ] [MAIN ] FTS: Found 1 missing trading days. [2025-09-05T18:21:04.873138] [INFO ] [MAIN ] FTS: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:04.873363] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-05T18:21:04.883060] [WARN ] [VALIDATOR ] FTI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:04.883279] [INFO ] [MAIN ] FTI: Combined data validation passed. [2025-09-05T18:21:05.053866] [INFO ] [MAIN ] FTI: Update completed successfully. [2025-09-05T18:21:05.057369] [INFO ] [MAIN ] Update Progress: 874/2363 symbols completed. FTI took 3.1s. Estimated remaining: 35m 49s. Rate: 41.6 symbols/min [2025-09-05T18:21:05.230031] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:05.230197] [WARN ] [MAIN ] FTV: No existing data found, performing full refresh instead. [2025-09-05T18:21:05.236747] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-05T18:21:05.237309] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-05T18:21:05.237543] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-05T18:21:05.237658] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-05T18:21:05.510431] [INFO ] [MAIN ] FTS: Adding 301 new records, updating 0 existing records. [2025-09-05T18:21:05.659547] [INFO ] [MAIN ] FTS: Combined dataset has 20802 total records. [2025-09-05T18:21:05.729341] [INFO ] [REMOTE ] FTV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:05.763399] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-05T18:21:05.933371] [WARN ] [VALIDATOR ] FTS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:06.072756] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-05T18:21:06.142876] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-05T18:21:06.181265] [WARN ] [VALIDATOR ] FTS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:06.181494] [INFO ] [MAIN ] FTS: Combined data validation passed. [2025-09-05T18:21:06.321123] [INFO ] [MAIN ] FTS: Update completed successfully. [2025-09-05T18:21:06.324359] [INFO ] [MAIN ] Update Progress: 875/2363 symbols completed. FTS took 2.5s. Estimated remaining: 35m 47s. Rate: 41.6 symbols/min [2025-09-05T18:21:06.507747] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:06.526746] [INFO ] [MAIN ] FTWO: Loaded 1053 existing records. [2025-09-05T18:21:06.527259] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-05T18:21:06.532836] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-05T18:21:06.751763] [INFO ] [MAIN ] FTWO: Found 1 missing trading days. [2025-09-05T18:21:06.752036] [INFO ] [MAIN ] FTWO: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:07.063539] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-05T18:21:07.603853] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-05T18:21:07.640788] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-05T18:21:07.678682] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-05T18:21:07.863494] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-05T18:21:07.894989] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:21:07.899183] [INFO ] [MAIN ] FTWO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:21:07.900256] [INFO ] [MAIN ] FTWO: Combined dataset has 1053 total records. [2025-09-05T18:21:07.900617] [FATAL] [VALIDATOR ] FTWO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:21:07.900720] [FATAL] [MAIN ] FTWO: Combined data validation failed. [2025-09-05T18:21:07.900758] [WARN ] [MAIN ] FTWO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:21:07.900796] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-05T18:21:07.900977] [INFO ] [LOCAL ] FTWO: Starting deletion of derivative data. [2025-09-05T18:21:07.901283] [INFO ] [MAIN ] Update Progress: 876/2363 symbols completed. FTWO took 1.6s. Estimated remaining: 35m 46s. Rate: 41.6 symbols/min [2025-09-05T18:21:08.075821] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:08.100874] [INFO ] [MAIN ] FUBO: Loaded 25723 existing records. [2025-09-05T18:21:08.291863] [INFO ] [MAIN ] FUBO: Found 1 missing trading days. [2025-09-05T18:21:08.292030] [INFO ] [MAIN ] FUBO: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:08.663524] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-05T18:21:08.972530] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-05T18:21:09.463475] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-05T18:21:09.576209] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-05T18:21:10.263493] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-05T18:21:11.015004] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-05T18:21:11.063478] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-05T18:21:11.863486] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-05T18:21:12.002178] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-05T18:21:12.524586] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:21:12.654199] [INFO ] [MAIN ] FUBO: Adding 0 new records, updating 0 existing records. [2025-09-05T18:21:12.656334] [INFO ] [MAIN ] FUBO: Combined dataset has 25723 total records. [2025-09-05T18:21:12.656918] [FATAL] [VALIDATOR ] FUBO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:21:12.657022] [FATAL] [MAIN ] FUBO: Combined data validation failed. [2025-09-05T18:21:12.657073] [WARN ] [MAIN ] FUBO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:21:12.657127] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-05T18:21:12.657672] [INFO ] [LOCAL ] FUBO: Starting deletion of derivative data. [2025-09-05T18:21:12.661100] [INFO ] [MAIN ] Update Progress: 877/2363 symbols completed. FUBO took 4.8s. Estimated remaining: 35m 50s. Rate: 41.5 symbols/min [2025-09-05T18:21:12.663421] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-05T18:21:13.018489] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-05T18:21:13.463524] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-05T18:21:14.206240] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-05T18:21:14.263518] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-05T18:21:15.063537] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-05T18:21:15.252825] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-05T18:21:15.863483] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-05T18:21:16.236088] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:21:16.237851] [INFO ] [REMOTE ] FSS: Full fetch complete (38187 records). [2025-09-05T18:21:16.670017] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-05T18:21:16.672048] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-05T18:21:16.680347] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-05T18:21:16.850350] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-05T18:21:16.850498] [INFO ] [MAIN ] Update Progress: 878/2363 symbols completed. FSS took 18.0s. Estimated remaining: 35m 53s. Rate: 41.4 symbols/min [2025-09-05T18:21:16.949298] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-05T18:21:17.463527] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-05T18:21:18.211979] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-05T18:21:18.263432] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-05T18:21:19.286782] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-05T18:21:19.295261] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-05T18:21:19.745942] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-05T18:21:19.863509] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-05T18:21:21.077381] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-05T18:21:21.084743] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-05T18:21:21.750697] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:21:21.752981] [INFO ] [REMOTE ] FTK: Full fetch complete (32992 records). [2025-09-05T18:21:22.170611] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-05T18:21:22.312067] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-05T18:21:22.327835] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-05T18:21:22.387858] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-05T18:21:22.388066] [INFO ] [MAIN ] Update Progress: 879/2363 symbols completed. FTK took 19.1s. Estimated remaining: 35m 59s. Rate: 41.2 symbols/min [2025-09-05T18:21:24.155422] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-05T18:21:24.166232] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-05T18:21:26.111604] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-05T18:21:26.123382] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-05T18:21:27.749568] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-05T18:21:27.762389] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-05T18:21:28.483122] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:21:28.486201] [INFO ] [REMOTE ] FTV: Full fetch complete (57459 records). [2025-09-05T18:21:28.860917] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-05T18:21:29.117966] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-05T18:21:29.118167] [INFO ] [MAIN ] Update Progress: 880/2363 symbols completed. FTV took 24.1s. Estimated remaining: 36m 6s. Rate: 41.1 symbols/min [2025-09-05T18:21:29.745257] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:29.811163] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:29.808230] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:29.834186] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:29.834540] [WARN ] [MAIN ] FUN: No existing data found, performing full refresh instead. [2025-09-05T18:21:29.834828] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-05T18:21:29.834876] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-05T18:21:29.834924] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-05T18:21:29.967111] [INFO ] [MAIN ] FVR: Loaded 10949 existing records. [2025-09-05T18:21:30.044699] [INFO ] [MAIN ] FUL: Loaded 14933 existing records. [2025-09-05T18:21:30.129245] [INFO ] [MAIN ] FVRR: Loaded 19545 existing records. [2025-09-05T18:21:30.489616] [INFO ] [MAIN ] FVR: Found 1 missing trading days. [2025-09-05T18:21:30.568029] [INFO ] [MAIN ] FVR: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:30.637865] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-05T18:21:30.739687] [INFO ] [MAIN ] FUL: Found 1 missing trading days. [2025-09-05T18:21:30.768237] [INFO ] [REMOTE ] FUN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:30.775913] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-05T18:21:30.775671] [INFO ] [MAIN ] FUL: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:30.776225] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-05T18:21:30.806399] [INFO ] [MAIN ] FVRR: Found 1 missing trading days. [2025-09-05T18:21:30.806546] [INFO ] [MAIN ] FVRR: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:30.806802] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-05T18:21:31.235539] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:21:31.314060] [INFO ] [MAIN ] FUL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:21:31.315989] [INFO ] [MAIN ] FUL: Combined dataset has 14933 total records. [2025-09-05T18:21:31.316431] [FATAL] [VALIDATOR ] FUL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:21:31.316515] [FATAL] [MAIN ] FUL: Combined data validation failed. [2025-09-05T18:21:31.316554] [WARN ] [MAIN ] FUL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:21:31.316595] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-05T18:21:31.317216] [INFO ] [LOCAL ] FUL: Starting deletion of derivative data. [2025-09-05T18:21:31.318815] [INFO ] [MAIN ] Update Progress: 881/2363 symbols completed. FUL took 2.2s. Estimated remaining: 36m 6s. Rate: 41.1 symbols/min [2025-09-05T18:21:31.500952] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:31.503391] [INFO ] [MAIN ] FXED: Loaded 689 existing records. [2025-09-05T18:21:31.629851] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:21:31.720361] [INFO ] [MAIN ] FXED: Found 1 missing trading days. [2025-09-05T18:21:31.730779] [INFO ] [MAIN ] FXED: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:31.731016] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-05T18:21:31.782893] [INFO ] [MAIN ] FVRR: Adding 235 new records, updating 0 existing records. [2025-09-05T18:21:31.786569] [INFO ] [MAIN ] FVRR: Combined dataset has 19780 total records. [2025-09-05T18:21:31.968723] [WARN ] [VALIDATOR ] FVRR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:32.077499] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-05T18:21:32.210493] [INFO ] [MAIN ] FVR: Adding 201 new records, updating 0 existing records. [2025-09-05T18:21:32.214202] [INFO ] [MAIN ] FVR: Combined dataset has 11150 total records. [2025-09-05T18:21:32.319390] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:21:32.323038] [INFO ] [MAIN ] FXED: Adding 0 new records, updating 0 existing records. [2025-09-05T18:21:32.324258] [INFO ] [MAIN ] FXED: Combined dataset has 689 total records. [2025-09-05T18:21:32.335215] [FATAL] [VALIDATOR ] FXED: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:21:32.345613] [FATAL] [MAIN ] FXED: Combined data validation failed. [2025-09-05T18:21:32.365242] [WARN ] [MAIN ] FXED: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:21:32.374747] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-05T18:21:32.402514] [INFO ] [LOCAL ] FXED: Starting deletion of derivative data. [2025-09-05T18:21:32.402338] [WARN ] [VALIDATOR ] FVR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:32.423565] [INFO ] [MAIN ] Update Progress: 882/2363 symbols completed. FXED took 1.1s. Estimated remaining: 36m 4s. Rate: 41.1 symbols/min [2025-09-05T18:21:32.777107] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:32.777722] [WARN ] [MAIN ] G: No existing data found, performing full refresh instead. [2025-09-05T18:21:32.779286] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-05T18:21:32.780221] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-05T18:21:32.781023] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-05T18:21:33.013194] [WARN ] [VALIDATOR ] FVRR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:33.029625] [INFO ] [MAIN ] FVRR: Combined data validation passed. [2025-09-05T18:21:33.101464] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-05T18:21:33.135264] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-05T18:21:33.275606] [WARN ] [VALIDATOR ] FVR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:33.334740] [INFO ] [MAIN ] FVR: Combined data validation passed. [2025-09-05T18:21:33.339262] [INFO ] [REMOTE ] G: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:33.341268] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-05T18:21:33.413573] [INFO ] [MAIN ] FVRR: Update completed successfully. [2025-09-05T18:21:33.417053] [INFO ] [MAIN ] Update Progress: 883/2363 symbols completed. FVRR took 4.3s. Estimated remaining: 36m 1s. Rate: 41.1 symbols/min [2025-09-05T18:21:33.598131] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:33.607451] [INFO ] [MAIN ] FVR: Update completed successfully. [2025-09-05T18:21:33.611409] [INFO ] [MAIN ] Update Progress: 884/2363 symbols completed. FVR took 4.5s. Estimated remaining: 35m 58s. Rate: 41.1 symbols/min [2025-09-05T18:21:33.712815] [INFO ] [MAIN ] GAB: Loaded 12358 existing records. [2025-09-05T18:21:33.906314] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:33.973792] [INFO ] [MAIN ] GAB: Found 1 missing trading days. [2025-09-05T18:21:33.974001] [INFO ] [MAIN ] GAB: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:33.974279] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-05T18:21:33.977428] [INFO ] [MAIN ] GAM: Loaded 3014 existing records. [2025-09-05T18:21:34.152579] [INFO ] [MAIN ] GAM: Found 1 missing trading days. [2025-09-05T18:21:34.152736] [INFO ] [MAIN ] GAM: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:34.152953] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-05T18:21:34.790840] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-05T18:21:34.799949] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-05T18:21:34.948554] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:21:34.959052] [INFO ] [MAIN ] GAM: Adding 18 new records, updating 0 existing records. [2025-09-05T18:21:34.960409] [INFO ] [MAIN ] GAM: Combined dataset has 3032 total records. [2025-09-05T18:21:35.066026] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:21:35.222523] [WARN ] [VALIDATOR ] GAM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:21:35.250044] [INFO ] [MAIN ] GAB: Adding 168 new records, updating 0 existing records. [2025-09-05T18:21:35.414752] [INFO ] [MAIN ] GAB: Combined dataset has 12526 total records. [2025-09-05T18:21:35.551739] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-05T18:21:35.603276] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-05T18:21:35.642105] [WARN ] [VALIDATOR ] GAB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:35.846110] [WARN ] [VALIDATOR ] GAM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:21:35.846204] [WARN ] [VALIDATOR ] GAB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:35.846668] [INFO ] [MAIN ] GAM: Combined data validation passed. [2025-09-05T18:21:35.846808] [INFO ] [MAIN ] GAB: Combined data validation passed. [2025-09-05T18:21:35.901183] [INFO ] [MAIN ] GAM: Update completed successfully. [2025-09-05T18:21:35.902114] [INFO ] [MAIN ] Update Progress: 885/2363 symbols completed. GAM took 2.3s. Estimated remaining: 35m 58s. Rate: 41.1 symbols/min [2025-09-05T18:21:36.035024] [INFO ] [MAIN ] GAB: Update completed successfully. [2025-09-05T18:21:36.047715] [INFO ] [MAIN ] Update Progress: 886/2363 symbols completed. GAB took 2.6s. Estimated remaining: 35m 54s. Rate: 41.1 symbols/min [2025-09-05T18:21:36.283732] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:36.355739] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:36.356065] [WARN ] [MAIN ] GATX: No existing data found, performing full refresh instead. [2025-09-05T18:21:36.356452] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-05T18:21:36.356589] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-05T18:21:36.356708] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-05T18:21:36.591333] [INFO ] [MAIN ] GAP: Loaded 25640 existing records. [2025-09-05T18:21:36.813145] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-05T18:21:36.911919] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-05T18:21:36.917315] [INFO ] [REMOTE ] GATX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:36.950958] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-05T18:21:36.992130] [INFO ] [MAIN ] GAP: Found 1 missing trading days. [2025-09-05T18:21:36.992724] [INFO ] [MAIN ] GAP: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:36.993110] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-05T18:21:37.287271] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-05T18:21:37.297193] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-05T18:21:37.699619] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:21:37.853966] [INFO ] [MAIN ] GAP: Adding 390 new records, updating 0 existing records. [2025-09-05T18:21:37.857444] [INFO ] [MAIN ] GAP: Combined dataset has 26030 total records. [2025-09-05T18:21:38.041842] [WARN ] [VALIDATOR ] GAP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:38.243247] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-05T18:21:38.248188] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-05T18:21:38.258458] [WARN ] [VALIDATOR ] GAP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:38.258697] [INFO ] [MAIN ] GAP: Combined data validation passed. [2025-09-05T18:21:38.429057] [INFO ] [MAIN ] GAP: Update completed successfully. [2025-09-05T18:21:38.457599] [INFO ] [MAIN ] Update Progress: 887/2363 symbols completed. GAP took 2.6s. Estimated remaining: 35m 54s. Rate: 41.1 symbols/min [2025-09-05T18:21:38.544113] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-05T18:21:38.593878] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-05T18:21:38.658060] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:38.667573] [INFO ] [MAIN ] GBAB: Loaded 6797 existing records. [2025-09-05T18:21:38.864419] [INFO ] [MAIN ] GBAB: Found 1 missing trading days. [2025-09-05T18:21:38.864764] [INFO ] [MAIN ] GBAB: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:38.865025] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-05T18:21:38.958494] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-05T18:21:39.063497] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-05T18:21:39.135484] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-05T18:21:39.863532] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-05T18:21:39.877253] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:21:39.907079] [INFO ] [MAIN ] GBAB: Adding 0 new records, updating 0 existing records. [2025-09-05T18:21:39.908205] [INFO ] [MAIN ] GBAB: Combined dataset has 6797 total records. [2025-09-05T18:21:39.908558] [FATAL] [VALIDATOR ] GBAB: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:21:39.908635] [FATAL] [MAIN ] GBAB: Combined data validation failed. [2025-09-05T18:21:39.908692] [WARN ] [MAIN ] GBAB: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:21:39.908734] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-05T18:21:39.909129] [INFO ] [LOCAL ] GBAB: Starting deletion of derivative data. [2025-09-05T18:21:39.910021] [INFO ] [MAIN ] Update Progress: 888/2363 symbols completed. GBAB took 1.4s. Estimated remaining: 35m 53s. Rate: 41.1 symbols/min [2025-09-05T18:21:40.081902] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:40.101987] [INFO ] [MAIN ] GBCI: Loaded 19655 existing records. [2025-09-05T18:21:40.281435] [INFO ] [MAIN ] GBCI: Found 1 missing trading days. [2025-09-05T18:21:40.281624] [INFO ] [MAIN ] GBCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:40.618575] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-05T18:21:40.663428] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-05T18:21:41.127257] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-05T18:21:41.178547] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-05T18:21:41.463541] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-05T18:21:42.263528] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-05T18:21:42.410267] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-05T18:21:42.942932] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:21:43.057508] [INFO ] [MAIN ] GBCI: Adding 311 new records, updating 0 existing records. [2025-09-05T18:21:43.060867] [INFO ] [MAIN ] GBCI: Combined dataset has 19966 total records. [2025-09-05T18:21:43.072743] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-05T18:21:43.244802] [WARN ] [VALIDATOR ] GBCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:43.441563] [WARN ] [VALIDATOR ] GBCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:43.441796] [INFO ] [MAIN ] GBCI: Combined data validation passed. [2025-09-05T18:21:43.578381] [INFO ] [MAIN ] GBCI: Update completed successfully. [2025-09-05T18:21:43.580607] [INFO ] [MAIN ] Update Progress: 889/2363 symbols completed. GBCI took 3.7s. Estimated remaining: 35m 55s. Rate: 41.0 symbols/min [2025-09-05T18:21:43.729586] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-05T18:21:43.796219] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:43.796690] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-05T18:21:43.796820] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-05T18:21:43.796859] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-05T18:21:43.796904] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-05T18:21:43.871128] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-05T18:21:44.153622] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:44.668545] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-05T18:21:44.678386] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-05T18:21:45.392214] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-05T18:21:45.463477] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-05T18:21:45.685422] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-05T18:21:46.263432] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-05T18:21:46.610356] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-05T18:21:47.063483] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-05T18:21:47.335735] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-05T18:21:47.863462] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-05T18:21:48.065228] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-05T18:21:48.180072] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-05T18:21:48.663482] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-05T18:21:49.463468] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-05T18:21:50.263519] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-05T18:21:50.878069] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-05T18:21:51.063993] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-05T18:21:51.368843] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-05T18:21:51.488777] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-05T18:21:51.863526] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-05T18:21:52.663533] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-05T18:21:53.037875] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-05T18:21:53.219559] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-05T18:21:53.280586] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-05T18:21:53.463540] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-05T18:21:53.806714] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-05T18:21:54.263531] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-05T18:21:55.063530] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-05T18:21:55.480891] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-05T18:21:55.643159] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:21:55.645528] [INFO ] [REMOTE ] G: Full fetch complete (53852 records). [2025-09-05T18:21:55.646385] [FATAL] [VALIDATOR ] G: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:21:55.646483] [FATAL] [MAIN ] G: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:21:55.646536] [WARN ] [MAIN ] G: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:21:55.646602] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-05T18:21:55.646720] [INFO ] [LOCAL ] G: Starting deletion of derivative data. [2025-09-05T18:21:55.646814] [INFO ] [MAIN ] Update Progress: 890/2363 symbols completed. G took 23.2s. Estimated remaining: 36m 11s. Rate: 40.7 symbols/min [2025-09-05T18:21:55.822461] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:55.841535] [INFO ] [MAIN ] GBTG: Loaded 18932 existing records. [2025-09-05T18:21:55.871162] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-05T18:21:56.018255] [INFO ] [MAIN ] GBTG: Found 1 missing trading days. [2025-09-05T18:21:56.018406] [INFO ] [MAIN ] GBTG: Need to fetch 1 months: 2025-09 [2025-09-05T18:21:56.350385] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-05T18:21:56.663519] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-05T18:21:57.463520] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-05T18:21:57.793336] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-05T18:21:58.263518] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-05T18:21:58.272828] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-05T18:21:58.384405] [INFO ] [MAIN ] GBTG: Adding 251 new records, updating 0 existing records. [2025-09-05T18:21:58.387431] [INFO ] [MAIN ] GBTG: Combined dataset has 19183 total records. [2025-09-05T18:21:58.565389] [WARN ] [VALIDATOR ] GBTG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:21:58.756388] [WARN ] [VALIDATOR ] GBTG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:21:58.756608] [INFO ] [MAIN ] GBTG: Combined data validation passed. [2025-09-05T18:21:58.878884] [INFO ] [MAIN ] GBTG: Update completed successfully. [2025-09-05T18:21:58.881277] [INFO ] [MAIN ] Update Progress: 891/2363 symbols completed. GBTG took 3.2s. Estimated remaining: 36m 13s. Rate: 40.7 symbols/min [2025-09-05T18:21:59.054782] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:21:59.055059] [WARN ] [MAIN ] GBX: No existing data found, performing full refresh instead. [2025-09-05T18:21:59.055215] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-05T18:21:59.055257] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-05T18:21:59.055304] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-05T18:21:59.068557] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-05T18:21:59.227631] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:21:59.293019] [INFO ] [REMOTE ] FUN: Full fetch complete (55241 records). [2025-09-05T18:21:59.620753] [INFO ] [REMOTE ] GBX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:21:59.660557] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-05T18:21:59.834082] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-05T18:21:59.891891] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-05T18:22:00.081329] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-05T18:22:00.081504] [INFO ] [MAIN ] Update Progress: 892/2363 symbols completed. FUN took 31.0s. Estimated remaining: 36m 11s. Rate: 40.7 symbols/min [2025-09-05T18:22:00.256801] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:00.277944] [INFO ] [MAIN ] GCI: Loaded 21053 existing records. [2025-09-05T18:22:00.457138] [INFO ] [MAIN ] GCI: Found 1 missing trading days. [2025-09-05T18:22:00.457415] [INFO ] [MAIN ] GCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:00.663516] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-05T18:22:01.309958] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:22:01.312101] [INFO ] [REMOTE ] GATX: Full fetch complete (18692 records). [2025-09-05T18:22:01.471318] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-05T18:22:01.733721] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-05T18:22:01.825696] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-05T18:22:01.865718] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-05T18:22:01.865910] [INFO ] [MAIN ] Update Progress: 893/2363 symbols completed. GATX took 25.8s. Estimated remaining: 36m 10s. Rate: 40.7 symbols/min [2025-09-05T18:22:02.044179] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:22:02.063419] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:02.193970] [INFO ] [MAIN ] GCO: Loaded 10816 existing records. [2025-09-05T18:22:02.212301] [INFO ] [MAIN ] GCI: Adding 345 new records, updating 0 existing records. [2025-09-05T18:22:02.268706] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-05T18:22:02.348351] [INFO ] [MAIN ] GCI: Combined dataset has 21398 total records. [2025-09-05T18:22:02.477415] [INFO ] [MAIN ] GCO: Found 1 missing trading days. [2025-09-05T18:22:02.529281] [INFO ] [MAIN ] GCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:02.611286] [WARN ] [VALIDATOR ] GCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:02.813912] [WARN ] [VALIDATOR ] GCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:02.814179] [INFO ] [MAIN ] GCI: Combined data validation passed. [2025-09-05T18:22:02.945439] [INFO ] [MAIN ] GCI: Update completed successfully. [2025-09-05T18:22:02.948445] [INFO ] [MAIN ] Update Progress: 894/2363 symbols completed. GCI took 2.9s. Estimated remaining: 36m 8s. Rate: 40.7 symbols/min [2025-09-05T18:22:03.043129] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:22:03.054122] [INFO ] [REMOTE ] GBLI: Full fetch complete (1036 records). [2025-09-05T18:22:03.068675] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-05T18:22:03.231006] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:03.246919] [WARN ] [MAIN ] GCTS: No existing data found, performing full refresh instead. [2025-09-05T18:22:03.250840] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-05T18:22:03.251293] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-05T18:22:03.262099] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-05T18:22:03.875320] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-05T18:22:03.977744] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:22:03.988189] [WARN ] [VALIDATOR ] GBLI: Missing days changed. Total missing: 23 New missing: 2025-06-04, 2025-06-05, 2025-06-12, 2025-06-18, 2025-06-23, 2025-06-24, 2025-07-02, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-18, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05 No longer missing: 2025-01-29, 2025-01-30, 2025-01-31, 2025-02-03, 2025-02-07, 2025-02-10, 2025-02-12, 2025-02-13, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-11, 2025-02-14, 2025-02-21, 2025-03-04, 2025-06-04, 2025-06-05, 2025-06-12, 2025-06-18, 2025-06-23, 2025-06-24, 2025-07-02, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-18, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05 [2025-09-05T18:22:03.988691] [INFO ] [MAIN ] GBLI: Fetched primary data is valid. [2025-09-05T18:22:03.996543] [INFO ] [MAIN ] GBLI: Full history saved. [2025-09-05T18:22:03.996788] [INFO ] [MAIN ] Update Progress: 895/2363 symbols completed. GBLI took 20.4s. Estimated remaining: 36m 5s. Rate: 40.7 symbols/min [2025-09-05T18:22:04.205534] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:04.205741] [WARN ] [MAIN ] GCV: No existing data found, performing full refresh instead. [2025-09-05T18:22:04.205876] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-05T18:22:04.205917] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-05T18:22:04.205963] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-05T18:22:04.630614] [INFO ] [REMOTE ] GCV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:22:04.656839] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-05T18:22:04.669200] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:22:04.669315] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-05T18:22:04.746596] [INFO ] [MAIN ] GCO: Adding 240 new records, updating 0 existing records. [2025-09-05T18:22:04.749328] [INFO ] [MAIN ] GCO: Combined dataset has 11056 total records. [2025-09-05T18:22:04.946754] [WARN ] [VALIDATOR ] GCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:05.150750] [WARN ] [VALIDATOR ] GCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:05.151002] [INFO ] [MAIN ] GCO: Combined data validation passed. [2025-09-05T18:22:05.219424] [INFO ] [MAIN ] GCO: Update completed successfully. [2025-09-05T18:22:05.220958] [INFO ] [MAIN ] Update Progress: 896/2363 symbols completed. GCO took 3.4s. Estimated remaining: 36m 3s. Rate: 40.7 symbols/min [2025-09-05T18:22:05.398207] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:05.420089] [INFO ] [MAIN ] GD: Loaded 22084 existing records. [2025-09-05T18:22:05.468757] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-05T18:22:05.612576] [INFO ] [MAIN ] GD: Found 1 missing trading days. [2025-09-05T18:22:05.612789] [INFO ] [MAIN ] GD: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:05.904348] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-05T18:22:06.263543] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-05T18:22:07.009755] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:22:07.064794] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-05T18:22:07.151271] [INFO ] [MAIN ] GD: Adding 347 new records, updating 0 existing records. [2025-09-05T18:22:07.176636] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-05T18:22:07.176783] [INFO ] [MAIN ] GD: Combined dataset has 22431 total records. [2025-09-05T18:22:07.420922] [WARN ] [VALIDATOR ] GD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:07.621531] [WARN ] [VALIDATOR ] GD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:07.621811] [INFO ] [MAIN ] GD: Combined data validation passed. [2025-09-05T18:22:07.773402] [INFO ] [MAIN ] GD: Update completed successfully. [2025-09-05T18:22:07.776465] [INFO ] [MAIN ] Update Progress: 897/2363 symbols completed. GD took 2.6s. Estimated remaining: 36m 4s. Rate: 40.7 symbols/min [2025-09-05T18:22:07.870239] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-05T18:22:07.958166] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:07.984895] [INFO ] [MAIN ] GDDY: Loaded 23984 existing records. [2025-09-05T18:22:08.169755] [INFO ] [MAIN ] GDDY: Found 1 missing trading days. [2025-09-05T18:22:08.169980] [INFO ] [MAIN ] GDDY: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:08.292224] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-05T18:22:08.663491] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-05T18:22:09.463460] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-05T18:22:09.713867] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-05T18:22:09.873588] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-05T18:22:09.945528] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:22:10.105097] [INFO ] [MAIN ] GDDY: Adding 368 new records, updating 0 existing records. [2025-09-05T18:22:10.109069] [INFO ] [MAIN ] GDDY: Combined dataset has 24352 total records. [2025-09-05T18:22:10.268601] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-05T18:22:10.301969] [WARN ] [VALIDATOR ] GDDY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:10.516436] [WARN ] [VALIDATOR ] GDDY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:10.516675] [INFO ] [MAIN ] GDDY: Combined data validation passed. [2025-09-05T18:22:10.681597] [INFO ] [MAIN ] GDDY: Update completed successfully. [2025-09-05T18:22:10.685877] [INFO ] [MAIN ] Update Progress: 898/2363 symbols completed. GDDY took 2.9s. Estimated remaining: 36m 5s. Rate: 40.6 symbols/min [2025-09-05T18:22:10.870480] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:10.874084] [INFO ] [MAIN ] GDIV: Loaded 1489 existing records. [2025-09-05T18:22:11.052140] [INFO ] [MAIN ] GDIV: Found 1 missing trading days. [2025-09-05T18:22:11.052308] [INFO ] [MAIN ] GDIV: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:11.063492] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-05T18:22:11.635114] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-05T18:22:11.824458] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:22:11.831357] [INFO ] [MAIN ] GDIV: Adding 16 new records, updating 0 existing records. [2025-09-05T18:22:11.832913] [INFO ] [MAIN ] GDIV: Combined dataset has 1505 total records. [2025-09-05T18:22:11.868632] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-05T18:22:12.016479] [WARN ] [VALIDATOR ] GDIV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:12.213451] [WARN ] [VALIDATOR ] GDIV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:12.213713] [INFO ] [MAIN ] GDIV: Combined data validation passed. [2025-09-05T18:22:12.224895] [INFO ] [MAIN ] GDIV: Update completed successfully. [2025-09-05T18:22:12.225236] [INFO ] [MAIN ] Update Progress: 899/2363 symbols completed. GDIV took 1.5s. Estimated remaining: 36m 3s. Rate: 40.6 symbols/min [2025-09-05T18:22:12.411744] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:12.415238] [INFO ] [MAIN ] GDL: Loaded 1832 existing records. [2025-09-05T18:22:12.597572] [INFO ] [MAIN ] GDL: Found 1 missing trading days. [2025-09-05T18:22:12.597923] [INFO ] [MAIN ] GDL: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:12.663465] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-05T18:22:12.953066] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-05T18:22:13.463515] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-05T18:22:14.118224] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-05T18:22:14.263520] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-05T18:22:14.862398] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-05T18:22:14.926987] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-05T18:22:15.063472] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-05T18:22:15.863454] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-05T18:22:15.892283] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-05T18:22:16.663475] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-05T18:22:17.268730] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-05T18:22:17.300022] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-05T18:22:17.463522] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-05T18:22:18.263486] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-05T18:22:19.063493] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-05T18:22:19.101752] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-05T18:22:19.112398] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:22:19.122933] [INFO ] [MAIN ] GDL: Adding 37 new records, updating 0 existing records. [2025-09-05T18:22:19.124444] [INFO ] [MAIN ] GDL: Combined dataset has 1869 total records. [2025-09-05T18:22:19.312315] [WARN ] [VALIDATOR ] GDL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:22:19.503529] [WARN ] [VALIDATOR ] GDL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:22:19.503780] [INFO ] [MAIN ] GDL: Combined data validation passed. [2025-09-05T18:22:19.516141] [INFO ] [MAIN ] GDL: Update completed successfully. [2025-09-05T18:22:19.516583] [INFO ] [MAIN ] Update Progress: 900/2363 symbols completed. GDL took 7.3s. Estimated remaining: 36m 11s. Rate: 40.4 symbols/min [2025-09-05T18:22:19.693791] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:19.700985] [INFO ] [MAIN ] GDO: Loaded 2949 existing records. [2025-09-05T18:22:19.889868] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-05T18:22:19.894441] [INFO ] [MAIN ] GDO: Found 1 missing trading days. [2025-09-05T18:22:19.896040] [INFO ] [MAIN ] GDO: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:20.329000] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-05T18:22:20.663467] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-05T18:22:21.463600] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-05T18:22:21.596616] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-05T18:22:21.901378] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-05T18:22:22.226539] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:22:22.245821] [INFO ] [MAIN ] GDO: Adding 36 new records, updating 0 existing records. [2025-09-05T18:22:22.248068] [INFO ] [MAIN ] GDO: Combined dataset has 2985 total records. [2025-09-05T18:22:22.270405] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-05T18:22:22.437481] [WARN ] [VALIDATOR ] GDO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:22.638355] [WARN ] [VALIDATOR ] GDO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:22.638556] [INFO ] [MAIN ] GDO: Combined data validation passed. [2025-09-05T18:22:22.659486] [INFO ] [MAIN ] GDO: Update completed successfully. [2025-09-05T18:22:22.660026] [INFO ] [MAIN ] Update Progress: 901/2363 symbols completed. GDO took 3.1s. Estimated remaining: 36m 12s. Rate: 40.4 symbols/min [2025-09-05T18:22:22.833780] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:22.854567] [INFO ] [MAIN ] GDOT: Loaded 18104 existing records. [2025-09-05T18:22:23.032699] [INFO ] [MAIN ] GDOT: Found 1 missing trading days. [2025-09-05T18:22:23.032909] [INFO ] [MAIN ] GDOT: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:23.063450] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-05T18:22:23.201435] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-05T18:22:23.863477] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-05T18:22:24.212505] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:22:24.213892] [INFO ] [REMOTE ] GCTS: Full fetch complete (20441 records). [2025-09-05T18:22:24.214981] [FATAL] [VALIDATOR ] GCTS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:24.215061] [FATAL] [MAIN ] GCTS: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:22:24.215108] [WARN ] [MAIN ] GCTS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:24.215155] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-05T18:22:24.215242] [INFO ] [LOCAL ] GCTS: Starting deletion of derivative data. [2025-09-05T18:22:24.215365] [INFO ] [MAIN ] Update Progress: 902/2363 symbols completed. GCTS took 21.3s. Estimated remaining: 36m 11s. Rate: 40.4 symbols/min [2025-09-05T18:22:24.330557] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:22:24.398150] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:24.394880] [INFO ] [REMOTE ] GBX: Full fetch complete (32895 records). [2025-09-05T18:22:24.601539] [INFO ] [MAIN ] GDV: Loaded 15122 existing records. [2025-09-05T18:22:24.671623] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-05T18:22:24.981870] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-05T18:22:24.981745] [INFO ] [MAIN ] GDV: Found 1 missing trading days. [2025-09-05T18:22:24.981992] [INFO ] [MAIN ] GDV: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:25.129865] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-05T18:22:25.130017] [INFO ] [MAIN ] Update Progress: 903/2363 symbols completed. GBX took 26.2s. Estimated remaining: 36m 9s. Rate: 40.4 symbols/min [2025-09-05T18:22:25.304422] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:25.331164] [INFO ] [MAIN ] GE: Loaded 25709 existing records. [2025-09-05T18:22:25.471481] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-05T18:22:25.490396] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:22:25.540759] [INFO ] [MAIN ] GE: Found 1 missing trading days. [2025-09-05T18:22:25.544226] [INFO ] [MAIN ] GE: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:25.641622] [INFO ] [MAIN ] GDOT: Adding 278 new records, updating 0 existing records. [2025-09-05T18:22:25.644686] [INFO ] [MAIN ] GDOT: Combined dataset has 18382 total records. [2025-09-05T18:22:25.826446] [WARN ] [VALIDATOR ] GDOT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:26.020369] [WARN ] [VALIDATOR ] GDOT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:26.020608] [INFO ] [MAIN ] GDOT: Combined data validation passed. [2025-09-05T18:22:26.141567] [INFO ] [MAIN ] GDOT: Update completed successfully. [2025-09-05T18:22:26.143517] [INFO ] [MAIN ] Update Progress: 904/2363 symbols completed. GDOT took 3.5s. Estimated remaining: 36m 6s. Rate: 40.4 symbols/min [2025-09-05T18:22:26.268562] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-05T18:22:26.325550] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:26.337567] [INFO ] [MAIN ] GEF: Loaded 11203 existing records. [2025-09-05T18:22:26.517117] [INFO ] [MAIN ] GEF: Found 1 missing trading days. [2025-09-05T18:22:26.517309] [INFO ] [MAIN ] GEF: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:26.527794] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-05T18:22:27.063486] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-05T18:22:27.352558] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:22:27.405812] [INFO ] [MAIN ] GDV: Adding 187 new records, updating 0 existing records. [2025-09-05T18:22:27.408709] [INFO ] [MAIN ] GDV: Combined dataset has 15309 total records. [2025-09-05T18:22:27.592142] [WARN ] [VALIDATOR ] GDV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:22:27.788357] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-05T18:22:27.799811] [WARN ] [VALIDATOR ] GDV: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:22:27.800024] [INFO ] [MAIN ] GDV: Combined data validation passed. [2025-09-05T18:22:27.875229] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-05T18:22:27.904292] [INFO ] [MAIN ] GDV: Update completed successfully. [2025-09-05T18:22:27.906140] [INFO ] [MAIN ] Update Progress: 905/2363 symbols completed. GDV took 3.7s. Estimated remaining: 36m 5s. Rate: 40.4 symbols/min [2025-09-05T18:22:28.074958] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:28.092534] [INFO ] [MAIN ] GEL: Loaded 17124 existing records. [2025-09-05T18:22:28.269561] [INFO ] [MAIN ] GEL: Found 1 missing trading days. [2025-09-05T18:22:28.269796] [INFO ] [MAIN ] GEL: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:28.471034] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:22:28.639587] [INFO ] [MAIN ] GE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:22:28.643409] [INFO ] [MAIN ] GE: Combined dataset has 26099 total records. [2025-09-05T18:22:28.668604] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-05T18:22:28.830951] [WARN ] [VALIDATOR ] GE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:29.026587] [WARN ] [VALIDATOR ] GE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:29.026835] [INFO ] [MAIN ] GE: Combined data validation passed. [2025-09-05T18:22:29.205886] [INFO ] [MAIN ] GE: Update completed successfully. [2025-09-05T18:22:29.209183] [INFO ] [MAIN ] Update Progress: 906/2363 symbols completed. GE took 4.1s. Estimated remaining: 36m 4s. Rate: 40.4 symbols/min [2025-09-05T18:22:29.381360] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:29.406274] [INFO ] [MAIN ] GENI: Loaded 25219 existing records. [2025-09-05T18:22:29.472076] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-05T18:22:29.524683] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-05T18:22:29.603356] [INFO ] [MAIN ] GENI: Found 1 missing trading days. [2025-09-05T18:22:29.603637] [INFO ] [MAIN ] GENI: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:29.830300] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-05T18:22:29.915072] [INFO ] [MAIN ] GEL: Adding 213 new records, updating 0 existing records. [2025-09-05T18:22:29.917796] [INFO ] [MAIN ] GEL: Combined dataset has 17337 total records. [2025-09-05T18:22:30.106733] [WARN ] [VALIDATOR ] GEL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:30.265331] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-05T18:22:30.301859] [WARN ] [VALIDATOR ] GEL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:30.302115] [INFO ] [MAIN ] GEL: Combined data validation passed. [2025-09-05T18:22:30.410426] [INFO ] [MAIN ] GEL: Update completed successfully. [2025-09-05T18:22:30.412410] [INFO ] [MAIN ] Update Progress: 907/2363 symbols completed. GEL took 2.5s. Estimated remaining: 36m 2s. Rate: 40.4 symbols/min [2025-09-05T18:22:30.606470] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:30.633184] [INFO ] [MAIN ] GEO: Loaded 24877 existing records. [2025-09-05T18:22:30.818415] [INFO ] [MAIN ] GEO: Found 1 missing trading days. [2025-09-05T18:22:30.818680] [INFO ] [MAIN ] GEO: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:30.825859] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:22:30.901727] [INFO ] [MAIN ] GEF: Adding 190 new records, updating 0 existing records. [2025-09-05T18:22:30.904211] [INFO ] [MAIN ] GEF: Combined dataset has 11393 total records. [2025-09-05T18:22:31.075748] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-05T18:22:31.080383] [WARN ] [VALIDATOR ] GEF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:31.312737] [WARN ] [VALIDATOR ] GEF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:31.312976] [INFO ] [MAIN ] GEF: Combined data validation passed. [2025-09-05T18:22:31.386421] [INFO ] [MAIN ] GEF: Update completed successfully. [2025-09-05T18:22:31.387948] [INFO ] [MAIN ] Update Progress: 908/2363 symbols completed. GEF took 5.2s. Estimated remaining: 35m 59s. Rate: 40.4 symbols/min [2025-09-05T18:22:31.560508] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:31.579322] [INFO ] [MAIN ] GES: Loaded 18113 existing records. [2025-09-05T18:22:31.756292] [INFO ] [MAIN ] GES: Found 1 missing trading days. [2025-09-05T18:22:31.756434] [INFO ] [MAIN ] GES: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:31.863696] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:22:31.863760] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-05T18:22:32.021053] [INFO ] [MAIN ] GEO: Adding 381 new records, updating 0 existing records. [2025-09-05T18:22:32.024633] [INFO ] [MAIN ] GEO: Combined dataset has 25258 total records. [2025-09-05T18:22:32.214162] [WARN ] [VALIDATOR ] GEO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:32.410351] [WARN ] [VALIDATOR ] GEO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:32.410579] [INFO ] [MAIN ] GEO: Combined data validation passed. [2025-09-05T18:22:32.515044] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:22:32.686185] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-05T18:22:32.727858] [INFO ] [MAIN ] GEO: Update completed successfully. [2025-09-05T18:22:32.751244] [INFO ] [MAIN ] Update Progress: 909/2363 symbols completed. GEO took 2.3s. Estimated remaining: 35m 58s. Rate: 40.4 symbols/min [2025-09-05T18:22:32.753110] [INFO ] [MAIN ] GES: Adding 208 new records, updating 0 existing records. [2025-09-05T18:22:32.889724] [INFO ] [MAIN ] GES: Combined dataset has 18321 total records. [2025-09-05T18:22:33.022347] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:33.136298] [WARN ] [VALIDATOR ] GES: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:33.219609] [INFO ] [MAIN ] GETY: Loaded 16846 existing records. [2025-09-05T18:22:33.479831] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-05T18:22:33.518330] [INFO ] [MAIN ] GETY: Found 1 missing trading days. [2025-09-05T18:22:33.519137] [INFO ] [MAIN ] GETY: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:33.529858] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-05T18:22:33.542141] [WARN ] [VALIDATOR ] GES: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:33.542393] [INFO ] [MAIN ] GES: Combined data validation passed. [2025-09-05T18:22:33.654845] [INFO ] [MAIN ] GES: Update completed successfully. [2025-09-05T18:22:33.656492] [INFO ] [MAIN ] Update Progress: 910/2363 symbols completed. GES took 2.3s. Estimated remaining: 35m 55s. Rate: 40.4 symbols/min [2025-09-05T18:22:33.832364] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:33.859867] [INFO ] [MAIN ] GEV: Loaded 25325 existing records. [2025-09-05T18:22:34.039987] [INFO ] [MAIN ] GEV: Found 1 missing trading days. [2025-09-05T18:22:34.040207] [INFO ] [MAIN ] GEV: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:34.116914] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:22:34.240412] [INFO ] [MAIN ] GENI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:34.242223] [INFO ] [MAIN ] GENI: Combined dataset has 25219 total records. [2025-09-05T18:22:34.242670] [FATAL] [VALIDATOR ] GENI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:34.242744] [FATAL] [MAIN ] GENI: Combined data validation failed. [2025-09-05T18:22:34.242781] [WARN ] [MAIN ] GENI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:34.242857] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-05T18:22:34.243518] [INFO ] [LOCAL ] GENI: Starting deletion of derivative data. [2025-09-05T18:22:34.246267] [INFO ] [MAIN ] Update Progress: 911/2363 symbols completed. GENI took 5.0s. Estimated remaining: 35m 52s. Rate: 40.5 symbols/min [2025-09-05T18:22:34.268769] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-05T18:22:34.421099] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:34.423941] [INFO ] [MAIN ] GF: Loaded 1197 existing records. [2025-09-05T18:22:34.602350] [INFO ] [MAIN ] GF: Found 1 missing trading days. [2025-09-05T18:22:34.603100] [INFO ] [MAIN ] GF: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:35.056361] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:22:35.075471] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-05T18:22:35.204711] [INFO ] [MAIN ] GEV: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:35.206610] [INFO ] [MAIN ] GEV: Combined dataset has 25325 total records. [2025-09-05T18:22:35.207120] [FATAL] [VALIDATOR ] GEV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:35.207245] [FATAL] [MAIN ] GEV: Combined data validation failed. [2025-09-05T18:22:35.207301] [WARN ] [MAIN ] GEV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:35.207379] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-05T18:22:35.208224] [INFO ] [LOCAL ] GEV: Starting deletion of derivative data. [2025-09-05T18:22:35.211702] [INFO ] [MAIN ] Update Progress: 912/2363 symbols completed. GEV took 1.6s. Estimated remaining: 35m 50s. Rate: 40.5 symbols/min [2025-09-05T18:22:35.390690] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:35.414100] [INFO ] [MAIN ] GFF: Loaded 23391 existing records. [2025-09-05T18:22:35.603695] [INFO ] [MAIN ] GFF: Found 1 missing trading days. [2025-09-05T18:22:35.603842] [INFO ] [MAIN ] GFF: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:35.863517] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-05T18:22:36.431703] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:22:36.531539] [INFO ] [MAIN ] GFF: Adding 223 new records, updating 0 existing records. [2025-09-05T18:22:36.534943] [INFO ] [MAIN ] GFF: Combined dataset has 23614 total records. [2025-09-05T18:22:36.666807] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-05T18:22:36.661580] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T18:22:36.749224] [WARN ] [VALIDATOR ] GFF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:22:36.934981] [INFO ] [MAIN ] GETY: Adding 283 new records, updating 0 existing records. [2025-09-05T18:22:37.019940] [INFO ] [MAIN ] GETY: Combined dataset has 17129 total records. [2025-09-05T18:22:37.207514] [WARN ] [VALIDATOR ] GETY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:37.417132] [WARN ] [VALIDATOR ] GETY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:37.417223] [WARN ] [VALIDATOR ] GFF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:22:37.417443] [INFO ] [MAIN ] GFF: Combined data validation passed. [2025-09-05T18:22:37.417526] [INFO ] [MAIN ] GETY: Combined data validation passed. [2025-09-05T18:22:37.522689] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-05T18:22:37.597371] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:22:37.605385] [INFO ] [MAIN ] GF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:37.607084] [INFO ] [MAIN ] GF: Combined dataset has 1197 total records. [2025-09-05T18:22:37.608331] [FATAL] [VALIDATOR ] GF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:37.609509] [FATAL] [MAIN ] GF: Combined data validation failed. [2025-09-05T18:22:37.610571] [WARN ] [MAIN ] GF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:37.610931] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-05T18:22:37.613448] [INFO ] [LOCAL ] GF: Starting deletion of derivative data. [2025-09-05T18:22:37.615324] [INFO ] [MAIN ] Update Progress: 913/2363 symbols completed. GF took 3.4s. Estimated remaining: 35m 50s. Rate: 40.5 symbols/min [2025-09-05T18:22:37.820099] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:37.862198] [INFO ] [MAIN ] GFI: Loaded 25259 existing records. [2025-09-05T18:22:37.963420] [INFO ] [MAIN ] GETY: Update completed successfully. [2025-09-05T18:22:37.981957] [INFO ] [MAIN ] Update Progress: 914/2363 symbols completed. GETY took 5.2s. Estimated remaining: 35m 47s. Rate: 40.5 symbols/min [2025-09-05T18:22:38.001106] [INFO ] [MAIN ] GFF: Update completed successfully. [2025-09-05T18:22:38.017162] [INFO ] [MAIN ] Update Progress: 915/2363 symbols completed. GFF took 2.8s. Estimated remaining: 35m 43s. Rate: 40.5 symbols/min [2025-09-05T18:22:38.239715] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:22:38.221958] [INFO ] [MAIN ] GFI: Found 1 missing trading days. [2025-09-05T18:22:38.295757] [INFO ] [MAIN ] GFI: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:38.300122] [INFO ] [REMOTE ] GCV: Full fetch complete (7083 records). [2025-09-05T18:22:38.327296] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-05T18:22:38.321853] [FATAL] [VALIDATOR ] GCV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:38.339396] [FATAL] [MAIN ] GCV: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:22:38.420929] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:38.389854] [WARN ] [MAIN ] GCV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:38.452520] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-05T18:22:38.452434] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:38.452804] [WARN ] [MAIN ] GFR: No existing data found, performing full refresh instead. [2025-09-05T18:22:38.453488] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-05T18:22:38.453189] [INFO ] [LOCAL ] GCV: Starting deletion of derivative data. [2025-09-05T18:22:38.453595] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-05T18:22:38.453680] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-05T18:22:38.465262] [INFO ] [MAIN ] Update Progress: 916/2363 symbols completed. GCV took 34.5s. Estimated remaining: 35m 40s. Rate: 40.6 symbols/min [2025-09-05T18:22:38.871905] [INFO ] [MAIN ] GFL: Loaded 21717 existing records. [2025-09-05T18:22:38.929471] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:39.116506] [INFO ] [REMOTE ] GFR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:22:39.122121] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-05T18:22:39.141148] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:22:39.277616] [INFO ] [MAIN ] GFL: Found 1 missing trading days. [2025-09-05T18:22:39.298413] [INFO ] [MAIN ] GFL: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:39.368269] [INFO ] [MAIN ] GGB: Loaded 38672 existing records. [2025-09-05T18:22:39.411240] [INFO ] [MAIN ] GFI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:39.504221] [INFO ] [MAIN ] GFI: Combined dataset has 25259 total records. [2025-09-05T18:22:39.529568] [FATAL] [VALIDATOR ] GFI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:39.535867] [FATAL] [MAIN ] GFI: Combined data validation failed. [2025-09-05T18:22:39.553912] [WARN ] [MAIN ] GFI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:39.563759] [INFO ] [MAIN ] GGB: Found 1 missing trading days. [2025-09-05T18:22:39.563848] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-05T18:22:39.564018] [INFO ] [MAIN ] GGB: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:39.564906] [INFO ] [LOCAL ] GFI: Starting deletion of derivative data. [2025-09-05T18:22:39.568226] [INFO ] [MAIN ] Update Progress: 917/2363 symbols completed. GFI took 2.0s. Estimated remaining: 35m 38s. Rate: 40.6 symbols/min [2025-09-05T18:22:39.863467] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-05T18:22:40.104924] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-05T18:22:40.376137] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:22:40.536435] [INFO ] [MAIN ] GGB: Adding 380 new records, updating 0 existing records. [2025-09-05T18:22:40.541027] [INFO ] [MAIN ] GGB: Combined dataset has 39052 total records. [2025-09-05T18:22:40.668532] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-05T18:22:40.737700] [WARN ] [VALIDATOR ] GGB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:22:40.937878] [WARN ] [VALIDATOR ] GGB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:22:40.938181] [INFO ] [MAIN ] GGB: Combined data validation passed. [2025-09-05T18:22:41.189764] [INFO ] [MAIN ] GGB: Update completed successfully. [2025-09-05T18:22:41.194721] [INFO ] [MAIN ] Update Progress: 918/2363 symbols completed. GGB took 2.7s. Estimated remaining: 35m 37s. Rate: 40.6 symbols/min [2025-09-05T18:22:41.233608] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:22:41.335372] [INFO ] [MAIN ] GFL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:41.337277] [INFO ] [MAIN ] GFL: Combined dataset has 21717 total records. [2025-09-05T18:22:41.337770] [FATAL] [VALIDATOR ] GFL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:41.337870] [FATAL] [MAIN ] GFL: Combined data validation failed. [2025-09-05T18:22:41.337928] [WARN ] [MAIN ] GFL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:41.337993] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-05T18:22:41.338518] [INFO ] [LOCAL ] GFL: Starting deletion of derivative data. [2025-09-05T18:22:41.341542] [INFO ] [MAIN ] Update Progress: 919/2363 symbols completed. GFL took 3.3s. Estimated remaining: 35m 33s. Rate: 40.6 symbols/min [2025-09-05T18:22:41.463485] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-05T18:22:42.208934] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-05T18:22:42.263492] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-05T18:22:43.160300] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-05T18:22:43.163407] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-05T18:22:44.033048] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-05T18:22:44.036591] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-05T18:22:44.623985] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-05T18:22:44.663459] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-05T18:22:45.450158] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-05T18:22:45.463424] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-05T18:22:46.122626] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-05T18:22:46.263524] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-05T18:22:46.925208] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-05T18:22:47.063481] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-05T18:22:47.670112] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:22:47.670992] [INFO ] [REMOTE ] GFR: Full fetch complete (9406 records). [2025-09-05T18:22:48.052423] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-05T18:22:48.085803] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-05T18:22:48.085962] [INFO ] [MAIN ] Update Progress: 920/2363 symbols completed. GFR took 10.0s. Estimated remaining: 35m 40s. Rate: 40.5 symbols/min [2025-09-05T18:22:48.754343] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:48.794197] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:48.796529] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:48.798190] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:48.798415] [WARN ] [MAIN ] GHC: No existing data found, performing full refresh instead. [2025-09-05T18:22:48.799958] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-05T18:22:48.800036] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-05T18:22:48.800107] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-05T18:22:48.846877] [INFO ] [MAIN ] GGZ: Loaded 1084 existing records. [2025-09-05T18:22:49.005502] [INFO ] [MAIN ] GGT: Loaded 6824 existing records. [2025-09-05T18:22:49.117087] [INFO ] [MAIN ] GGG: Loaded 18803 existing records. [2025-09-05T18:22:49.472989] [INFO ] [MAIN ] GGZ: Found 1 missing trading days. [2025-09-05T18:22:49.547702] [INFO ] [MAIN ] GGZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:49.564328] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-05T18:22:49.648180] [INFO ] [MAIN ] GGT: Found 1 missing trading days. [2025-09-05T18:22:49.721685] [INFO ] [MAIN ] GGT: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:49.734857] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-05T18:22:49.757515] [INFO ] [REMOTE ] GHC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:22:49.765918] [INFO ] [MAIN ] GGG: Found 1 missing trading days. [2025-09-05T18:22:49.766691] [INFO ] [MAIN ] GGG: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:49.766282] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-05T18:22:50.142329] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:22:50.150354] [INFO ] [MAIN ] GGZ: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:50.151383] [INFO ] [MAIN ] GGZ: Combined dataset has 1084 total records. [2025-09-05T18:22:50.151755] [FATAL] [VALIDATOR ] GGZ: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:50.151850] [FATAL] [MAIN ] GGZ: Combined data validation failed. [2025-09-05T18:22:50.151922] [WARN ] [MAIN ] GGZ: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:50.151990] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-05T18:22:50.152215] [INFO ] [LOCAL ] GGZ: Starting deletion of derivative data. [2025-09-05T18:22:50.152566] [INFO ] [MAIN ] Update Progress: 921/2363 symbols completed. GGZ took 2.1s. Estimated remaining: 35m 39s. Rate: 40.4 symbols/min [2025-09-05T18:22:50.269970] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-05T18:22:50.351933] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:50.354441] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-05T18:22:50.357997] [INFO ] [MAIN ] GHG: Loaded 1285 existing records. [2025-09-05T18:22:50.543106] [INFO ] [MAIN ] GHG: Found 1 missing trading days. [2025-09-05T18:22:50.543268] [INFO ] [MAIN ] GHG: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:50.892092] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:22:50.943981] [INFO ] [MAIN ] GGT: Adding 113 new records, updating 0 existing records. [2025-09-05T18:22:50.947868] [INFO ] [MAIN ] GGT: Combined dataset has 6937 total records. [2025-09-05T18:22:51.063526] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-05T18:22:51.057974] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:22:51.196031] [WARN ] [VALIDATOR ] GGT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:51.349978] [INFO ] [MAIN ] GGG: Adding 278 new records, updating 0 existing records. [2025-09-05T18:22:51.410314] [INFO ] [MAIN ] GGG: Combined dataset has 19081 total records. [2025-09-05T18:22:51.613227] [WARN ] [VALIDATOR ] GGG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:51.820939] [WARN ] [VALIDATOR ] GGT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:51.821015] [WARN ] [VALIDATOR ] GGG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:51.821373] [INFO ] [MAIN ] GGG: Combined data validation passed. [2025-09-05T18:22:51.821243] [INFO ] [MAIN ] GGT: Combined data validation passed. [2025-09-05T18:22:51.892153] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-05T18:22:51.984414] [INFO ] [MAIN ] GGT: Update completed successfully. [2025-09-05T18:22:51.987771] [INFO ] [MAIN ] GGG: Update completed successfully. [2025-09-05T18:22:51.987689] [INFO ] [MAIN ] Update Progress: 922/2363 symbols completed. GGT took 3.9s. Estimated remaining: 35m 38s. Rate: 40.4 symbols/min [2025-09-05T18:22:51.989960] [INFO ] [MAIN ] Update Progress: 923/2363 symbols completed. GGG took 3.9s. Estimated remaining: 35m 35s. Rate: 40.5 symbols/min [2025-09-05T18:22:52.113440] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-05T18:22:52.308014] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:52.366780] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:52.373612] [INFO ] [MAIN ] GHI: Loaded 3574 existing records. [2025-09-05T18:22:52.418825] [INFO ] [MAIN ] GHLD: Loaded 2754 existing records. [2025-09-05T18:22:52.676569] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-05T18:22:52.699387] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:22:52.726796] [INFO ] [MAIN ] GHI: Found 1 missing trading days. [2025-09-05T18:22:52.738173] [INFO ] [MAIN ] GHI: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:52.738064] [INFO ] [MAIN ] GHG: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:52.741299] [INFO ] [MAIN ] GHG: Combined dataset has 1285 total records. [2025-09-05T18:22:52.739919] [INFO ] [MAIN ] GHLD: Found 1 missing trading days. [2025-09-05T18:22:52.741873] [INFO ] [MAIN ] GHLD: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:52.741816] [FATAL] [VALIDATOR ] GHG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:52.742196] [FATAL] [MAIN ] GHG: Combined data validation failed. [2025-09-05T18:22:52.742254] [WARN ] [MAIN ] GHG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:52.742320] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-05T18:22:52.742550] [INFO ] [LOCAL ] GHG: Starting deletion of derivative data. [2025-09-05T18:22:52.743026] [INFO ] [MAIN ] Update Progress: 924/2363 symbols completed. GHG took 2.6s. Estimated remaining: 35m 32s. Rate: 40.5 symbols/min [2025-09-05T18:22:52.921926] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:52.934409] [INFO ] [MAIN ] GHM: Loaded 10471 existing records. [2025-09-05T18:22:53.125743] [INFO ] [MAIN ] GHM: Found 1 missing trading days. [2025-09-05T18:22:53.125882] [INFO ] [MAIN ] GHM: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:53.261767] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-05T18:22:53.463471] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-05T18:22:53.712376] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-05T18:22:53.753005] [INFO ] [MAIN ] GHM: Adding 101 new records, updating 0 existing records. [2025-09-05T18:22:53.756234] [INFO ] [MAIN ] GHM: Combined dataset has 10572 total records. [2025-09-05T18:22:53.995874] [WARN ] [VALIDATOR ] GHM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:22:54.187280] [WARN ] [VALIDATOR ] GHM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:22:54.187481] [INFO ] [MAIN ] GHM: Combined data validation passed. [2025-09-05T18:22:54.260068] [INFO ] [MAIN ] GHM: Update completed successfully. [2025-09-05T18:22:54.261374] [INFO ] [MAIN ] Update Progress: 925/2363 symbols completed. GHM took 1.5s. Estimated remaining: 35m 30s. Rate: 40.5 symbols/min [2025-09-05T18:22:54.272835] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-05T18:22:54.436617] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:54.455051] [INFO ] [MAIN ] GHY: Loaded 15681 existing records. [2025-09-05T18:22:54.632112] [INFO ] [MAIN ] GHY: Found 1 missing trading days. [2025-09-05T18:22:54.632289] [INFO ] [MAIN ] GHY: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:55.063493] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-05T18:22:55.091477] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:22:55.104975] [INFO ] [MAIN ] GHLD: Adding 0 new records, updating 0 existing records. [2025-09-05T18:22:55.107134] [INFO ] [MAIN ] GHLD: Combined dataset has 2754 total records. [2025-09-05T18:22:55.107599] [FATAL] [VALIDATOR ] GHLD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:22:55.107697] [FATAL] [MAIN ] GHLD: Combined data validation failed. [2025-09-05T18:22:55.107736] [WARN ] [MAIN ] GHLD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:22:55.107782] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-05T18:22:55.108074] [INFO ] [LOCAL ] GHLD: Starting deletion of derivative data. [2025-09-05T18:22:55.108786] [INFO ] [MAIN ] Update Progress: 926/2363 symbols completed. GHLD took 3.1s. Estimated remaining: 35m 28s. Rate: 40.5 symbols/min [2025-09-05T18:22:55.297958] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:55.316662] [INFO ] [MAIN ] GIB: Loaded 15242 existing records. [2025-09-05T18:22:55.499132] [INFO ] [MAIN ] GIB: Found 1 missing trading days. [2025-09-05T18:22:55.499330] [INFO ] [MAIN ] GIB: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:55.755835] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:22:55.775952] [INFO ] [MAIN ] GHI: Adding 47 new records, updating 0 existing records. [2025-09-05T18:22:55.777694] [INFO ] [MAIN ] GHI: Combined dataset has 3621 total records. [2025-09-05T18:22:55.868666] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-05T18:22:55.958158] [WARN ] [VALIDATOR ] GHI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:56.144947] [WARN ] [VALIDATOR ] GHI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:56.145146] [INFO ] [MAIN ] GHI: Combined data validation passed. [2025-09-05T18:22:56.168592] [INFO ] [MAIN ] GHI: Update completed successfully. [2025-09-05T18:22:56.169173] [INFO ] [MAIN ] Update Progress: 927/2363 symbols completed. GHI took 4.2s. Estimated remaining: 35m 26s. Rate: 40.5 symbols/min [2025-09-05T18:22:56.340535] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:56.340754] [WARN ] [MAIN ] GIC: No existing data found, performing full refresh instead. [2025-09-05T18:22:56.340876] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-05T18:22:56.340916] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-05T18:22:56.340961] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-05T18:22:56.593568] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-05T18:22:56.668563] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-05T18:22:56.705429] [INFO ] [REMOTE ] GIC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:22:57.183043] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:22:57.270313] [INFO ] [MAIN ] GIB: Adding 187 new records, updating 0 existing records. [2025-09-05T18:22:57.272999] [INFO ] [MAIN ] GIB: Combined dataset has 15429 total records. [2025-09-05T18:22:57.450862] [WARN ] [VALIDATOR ] GIB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:22:57.471155] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-05T18:22:57.649938] [WARN ] [VALIDATOR ] GIB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:22:57.650160] [INFO ] [MAIN ] GIB: Combined data validation passed. [2025-09-05T18:22:57.757782] [INFO ] [MAIN ] GIB: Update completed successfully. [2025-09-05T18:22:57.759712] [INFO ] [MAIN ] Update Progress: 928/2363 symbols completed. GIB took 2.7s. Estimated remaining: 35m 25s. Rate: 40.5 symbols/min [2025-09-05T18:22:57.935471] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:22:57.955270] [INFO ] [MAIN ] GIL: Loaded 20329 existing records. [2025-09-05T18:22:58.129205] [INFO ] [MAIN ] GIL: Found 1 missing trading days. [2025-09-05T18:22:58.129391] [INFO ] [MAIN ] GIL: Need to fetch 1 months: 2025-09 [2025-09-05T18:22:58.263478] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-05T18:22:59.063483] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-05T18:22:59.658622] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:22:59.798779] [INFO ] [MAIN ] GIL: Adding 347 new records, updating 0 existing records. [2025-09-05T18:22:59.801757] [INFO ] [MAIN ] GIL: Combined dataset has 20676 total records. [2025-09-05T18:22:59.871830] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-05T18:22:59.984498] [WARN ] [VALIDATOR ] GIL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:00.193658] [WARN ] [VALIDATOR ] GIL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:00.193880] [INFO ] [MAIN ] GIL: Combined data validation passed. [2025-09-05T18:23:00.326437] [INFO ] [MAIN ] GIL: Update completed successfully. [2025-09-05T18:23:00.329059] [INFO ] [MAIN ] Update Progress: 929/2363 symbols completed. GIL took 2.6s. Estimated remaining: 35m 25s. Rate: 40.5 symbols/min [2025-09-05T18:23:00.501278] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:00.528030] [INFO ] [MAIN ] GIS: Loaded 25675 existing records. [2025-09-05T18:23:00.709759] [INFO ] [MAIN ] GIS: Found 1 missing trading days. [2025-09-05T18:23:00.709935] [INFO ] [MAIN ] GIS: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:00.710160] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-05T18:23:00.839987] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:23:00.892356] [INFO ] [MAIN ] GHY: Adding 125 new records, updating 0 existing records. [2025-09-05T18:23:00.894859] [INFO ] [MAIN ] GHY: Combined dataset has 15806 total records. [2025-09-05T18:23:01.077298] [WARN ] [VALIDATOR ] GHY: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:23:01.271369] [WARN ] [VALIDATOR ] GHY: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:23:01.271598] [INFO ] [MAIN ] GHY: Combined data validation passed. [2025-09-05T18:23:01.374832] [INFO ] [MAIN ] GHY: Update completed successfully. [2025-09-05T18:23:01.376717] [INFO ] [MAIN ] Update Progress: 930/2363 symbols completed. GHY took 7.1s. Estimated remaining: 35m 23s. Rate: 40.5 symbols/min [2025-09-05T18:23:01.598296] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:01.608216] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:23:01.779099] [INFO ] [MAIN ] GKOS: Loaded 20139 existing records. [2025-09-05T18:23:01.786952] [INFO ] [MAIN ] GIS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:23:01.929373] [INFO ] [MAIN ] GIS: Combined dataset has 26065 total records. [2025-09-05T18:23:02.025717] [INFO ] [MAIN ] GKOS: Found 1 missing trading days. [2025-09-05T18:23:02.063329] [INFO ] [MAIN ] GKOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:02.082787] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-05T18:23:02.162784] [WARN ] [VALIDATOR ] GIS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:02.355117] [WARN ] [VALIDATOR ] GIS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:02.355331] [INFO ] [MAIN ] GIS: Combined data validation passed. [2025-09-05T18:23:02.514915] [INFO ] [MAIN ] GIS: Update completed successfully. [2025-09-05T18:23:02.517797] [INFO ] [MAIN ] Update Progress: 931/2363 symbols completed. GIS took 2.2s. Estimated remaining: 35m 21s. Rate: 40.5 symbols/min [2025-09-05T18:23:02.691774] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:02.723184] [INFO ] [MAIN ] GL: Loaded 28786 existing records. [2025-09-05T18:23:02.915813] [INFO ] [MAIN ] GL: Found 1 missing trading days. [2025-09-05T18:23:02.916348] [INFO ] [MAIN ] GL: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:02.916581] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-05T18:23:03.064348] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (5.59 seconds). [2025-09-05T18:23:03.065571] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-05T18:23:03.604382] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (5.34 seconds). [2025-09-05T18:23:03.772875] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-05T18:23:03.863464] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-05T18:23:04.138942] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T18:23:04.245164] [INFO ] [MAIN ] GL: Adding 208 new records, updating 0 existing records. [2025-09-05T18:23:04.251602] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-05T18:23:04.312291] [INFO ] [MAIN ] GL: Combined dataset has 28994 total records. [2025-09-05T18:23:04.478210] [INFO ] [MAIN ] GKOS: Adding 300 new records, updating 0 existing records. [2025-09-05T18:23:04.559169] [WARN ] [VALIDATOR ] GL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:23:04.559532] [INFO ] [MAIN ] GKOS: Combined dataset has 20439 total records. [2025-09-05T18:23:04.668628] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-05T18:23:04.739462] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-05T18:23:04.963586] [WARN ] [VALIDATOR ] GKOS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:05.173929] [WARN ] [VALIDATOR ] GKOS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:05.173856] [WARN ] [VALIDATOR ] GL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:23:05.174350] [INFO ] [MAIN ] GKOS: Combined data validation passed. [2025-09-05T18:23:05.174266] [INFO ] [MAIN ] GL: Combined data validation passed. [2025-09-05T18:23:05.463809] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-05T18:23:05.480580] [INFO ] [MAIN ] GKOS: Update completed successfully. [2025-09-05T18:23:05.484106] [INFO ] [MAIN ] Update Progress: 932/2363 symbols completed. GKOS took 4.1s. Estimated remaining: 35m 21s. Rate: 40.5 symbols/min [2025-09-05T18:23:05.532330] [INFO ] [MAIN ] GL: Update completed successfully. [2025-09-05T18:23:05.563731] [INFO ] [MAIN ] Update Progress: 933/2363 symbols completed. GL took 3.0s. Estimated remaining: 35m 18s. Rate: 40.5 symbols/min [2025-09-05T18:23:05.803430] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:05.850959] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:05.851303] [WARN ] [MAIN ] GLP: No existing data found, performing full refresh instead. [2025-09-05T18:23:05.851513] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-05T18:23:05.851604] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-05T18:23:05.851686] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-05T18:23:06.023188] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-05T18:23:06.136036] [INFO ] [MAIN ] GLOB: Loaded 35687 existing records. [2025-09-05T18:23:06.170717] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-05T18:23:06.269626] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-05T18:23:06.441365] [INFO ] [REMOTE ] GLP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:23:06.518757] [INFO ] [MAIN ] GLOB: Found 1 missing trading days. [2025-09-05T18:23:06.518949] [INFO ] [MAIN ] GLOB: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:07.063503] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-05T18:23:07.276184] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-05T18:23:07.863507] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-05T18:23:07.988738] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-05T18:23:08.663463] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-05T18:23:08.930304] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-05T18:23:09.213995] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:23:09.214764] [INFO ] [REMOTE ] GHC: Full fetch complete (2641 records). [2025-09-05T18:23:09.468608] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-05T18:23:09.565780] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-05T18:23:09.580897] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-05T18:23:09.581000] [INFO ] [MAIN ] Update Progress: 934/2363 symbols completed. GHC took 21.5s. Estimated remaining: 35m 20s. Rate: 40.4 symbols/min [2025-09-05T18:23:09.749303] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:09.779492] [INFO ] [MAIN ] GLW: Loaded 25633 existing records. [2025-09-05T18:23:09.952792] [INFO ] [MAIN ] GLW: Found 1 missing trading days. [2025-09-05T18:23:09.952951] [INFO ] [MAIN ] GLW: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:10.263474] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-05T18:23:10.372983] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-05T18:23:10.668987] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-05T18:23:10.819678] [INFO ] [MAIN ] GLW: Adding 389 new records, updating 0 existing records. [2025-09-05T18:23:10.825419] [INFO ] [MAIN ] GLW: Combined dataset has 26022 total records. [2025-09-05T18:23:11.020877] [WARN ] [VALIDATOR ] GLW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:11.068709] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-05T18:23:11.242268] [WARN ] [VALIDATOR ] GLW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:11.242475] [INFO ] [MAIN ] GLW: Combined data validation passed. [2025-09-05T18:23:11.408313] [INFO ] [MAIN ] GLW: Update completed successfully. [2025-09-05T18:23:11.411656] [INFO ] [MAIN ] Update Progress: 935/2363 symbols completed. GLW took 1.8s. Estimated remaining: 35m 19s. Rate: 40.4 symbols/min [2025-09-05T18:23:11.582714] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:11.608078] [INFO ] [MAIN ] GM: Loaded 25710 existing records. [2025-09-05T18:23:11.787491] [INFO ] [MAIN ] GM: Found 1 missing trading days. [2025-09-05T18:23:11.787670] [INFO ] [MAIN ] GM: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:11.863455] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-05T18:23:12.165829] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-05T18:23:12.663472] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-05T18:23:12.693083] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-05T18:23:12.982238] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:23:13.128396] [INFO ] [MAIN ] GM: Adding 390 new records, updating 0 existing records. [2025-09-05T18:23:13.131682] [INFO ] [MAIN ] GM: Combined dataset has 26100 total records. [2025-09-05T18:23:13.311239] [WARN ] [VALIDATOR ] GM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:13.468801] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-05T18:23:13.513250] [WARN ] [VALIDATOR ] GM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:13.513577] [INFO ] [MAIN ] GM: Combined data validation passed. [2025-09-05T18:23:13.672292] [INFO ] [MAIN ] GM: Update completed successfully. [2025-09-05T18:23:13.675954] [INFO ] [MAIN ] Update Progress: 936/2363 symbols completed. GM took 2.3s. Estimated remaining: 35m 19s. Rate: 40.4 symbols/min [2025-09-05T18:23:13.848760] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:13.887731] [INFO ] [MAIN ] GME: Loaded 40527 existing records. [2025-09-05T18:23:14.067416] [INFO ] [MAIN ] GME: Found 1 missing trading days. [2025-09-05T18:23:14.067554] [INFO ] [MAIN ] GME: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:14.117743] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:23:14.269222] [INFO ] [MAIN ] GLOB: Adding 371 new records, updating 0 existing records. [2025-09-05T18:23:14.268581] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-05T18:23:14.275007] [INFO ] [MAIN ] GLOB: Combined dataset has 36058 total records. [2025-09-05T18:23:14.494338] [WARN ] [VALIDATOR ] GLOB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:23:14.688981] [WARN ] [VALIDATOR ] GLOB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:23:14.689190] [INFO ] [MAIN ] GLOB: Combined data validation passed. [2025-09-05T18:23:14.907698] [INFO ] [MAIN ] GLOB: Update completed successfully. [2025-09-05T18:23:14.911494] [INFO ] [MAIN ] Update Progress: 937/2363 symbols completed. GLOB took 9.4s. Estimated remaining: 35m 17s. Rate: 40.4 symbols/min [2025-09-05T18:23:15.080139] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-05T18:23:15.082585] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:15.106202] [INFO ] [MAIN ] GMED: Loaded 22916 existing records. [2025-09-05T18:23:15.292064] [INFO ] [MAIN ] GMED: Found 1 missing trading days. [2025-09-05T18:23:15.292525] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-05T18:23:15.292787] [INFO ] [MAIN ] GMED: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:15.422911] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-05T18:23:15.569002] [INFO ] [MAIN ] GME: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:15.571337] [INFO ] [MAIN ] GME: Combined dataset has 40527 total records. [2025-09-05T18:23:15.571923] [FATAL] [VALIDATOR ] GME: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:15.572008] [FATAL] [MAIN ] GME: Combined data validation failed. [2025-09-05T18:23:15.572045] [WARN ] [MAIN ] GME: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:15.572084] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-05T18:23:15.572950] [INFO ] [LOCAL ] GME: Starting deletion of derivative data. [2025-09-05T18:23:15.577875] [INFO ] [MAIN ] Update Progress: 938/2363 symbols completed. GME took 1.9s. Estimated remaining: 35m 14s. Rate: 40.4 symbols/min [2025-09-05T18:23:15.749431] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:15.767528] [INFO ] [MAIN ] GMRE: Loaded 18569 existing records. [2025-09-05T18:23:15.868855] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-05T18:23:15.956773] [INFO ] [MAIN ] GMRE: Found 1 missing trading days. [2025-09-05T18:23:15.956909] [INFO ] [MAIN ] GMRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:16.663481] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-05T18:23:16.808250] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-05T18:23:16.955914] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-05T18:23:17.061490] [INFO ] [MAIN ] GMRE: Adding 255 new records, updating 0 existing records. [2025-09-05T18:23:17.064413] [INFO ] [MAIN ] GMRE: Combined dataset has 18824 total records. [2025-09-05T18:23:17.242502] [WARN ] [VALIDATOR ] GMRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:17.435504] [WARN ] [VALIDATOR ] GMRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:17.435754] [INFO ] [MAIN ] GMRE: Combined data validation passed. [2025-09-05T18:23:17.481398] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-05T18:23:17.547670] [INFO ] [MAIN ] GMRE: Update completed successfully. [2025-09-05T18:23:17.549815] [INFO ] [MAIN ] Update Progress: 939/2363 symbols completed. GMRE took 2.0s. Estimated remaining: 35m 14s. Rate: 40.4 symbols/min [2025-09-05T18:23:17.727138] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:17.742616] [INFO ] [MAIN ] GNE: Loaded 14410 existing records. [2025-09-05T18:23:17.932968] [INFO ] [MAIN ] GNE: Found 1 missing trading days. [2025-09-05T18:23:17.933124] [INFO ] [MAIN ] GNE: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:17.940215] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:23:18.077516] [INFO ] [MAIN ] GMED: Adding 344 new records, updating 0 existing records. [2025-09-05T18:23:18.080764] [INFO ] [MAIN ] GMED: Combined dataset has 23260 total records. [2025-09-05T18:23:18.256200] [WARN ] [VALIDATOR ] GMED: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:18.268610] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-05T18:23:18.457725] [WARN ] [VALIDATOR ] GMED: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:18.457943] [INFO ] [MAIN ] GMED: Combined data validation passed. [2025-09-05T18:23:18.600659] [INFO ] [MAIN ] GMED: Update completed successfully. [2025-09-05T18:23:18.603907] [INFO ] [MAIN ] Update Progress: 940/2363 symbols completed. GMED took 3.7s. Estimated remaining: 35m 11s. Rate: 40.4 symbols/min [2025-09-05T18:23:18.786949] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:18.817487] [INFO ] [MAIN ] GNK: Loaded 30505 existing records. [2025-09-05T18:23:18.993679] [INFO ] [MAIN ] GNK: Found 1 missing trading days. [2025-09-05T18:23:18.993835] [INFO ] [MAIN ] GNK: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:19.063422] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-05T18:23:19.436282] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-05T18:23:19.829001] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:23:19.868604] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-05T18:23:19.945301] [INFO ] [MAIN ] GNK: Adding 259 new records, updating 0 existing records. [2025-09-05T18:23:19.948710] [INFO ] [MAIN ] GNK: Combined dataset has 30764 total records. [2025-09-05T18:23:20.131129] [WARN ] [VALIDATOR ] GNK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:23:20.340260] [WARN ] [VALIDATOR ] GNK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:23:20.340476] [INFO ] [MAIN ] GNK: Combined data validation passed. [2025-09-05T18:23:20.436052] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:23:20.444842] [INFO ] [REMOTE ] GIC: Full fetch complete (15159 records). [2025-09-05T18:23:20.670702] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-05T18:23:20.912747] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-05T18:23:20.922458] [INFO ] [MAIN ] GNK: Update completed successfully. [2025-09-05T18:23:20.926672] [INFO ] [MAIN ] Update Progress: 941/2363 symbols completed. GNK took 2.3s. Estimated remaining: 35m 11s. Rate: 40.4 symbols/min [2025-09-05T18:23:21.155132] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:21.168417] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-05T18:23:21.168711] [INFO ] [MAIN ] Update Progress: 942/2363 symbols completed. GIC took 25.0s. Estimated remaining: 35m 8s. Rate: 40.4 symbols/min [2025-09-05T18:23:21.301804] [INFO ] [MAIN ] GNL: Loaded 22390 existing records. [2025-09-05T18:23:21.375621] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:23:21.404287] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:21.469733] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-05T18:23:21.513505] [INFO ] [MAIN ] GNE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:21.585800] [INFO ] [MAIN ] GNE: Combined dataset has 14410 total records. [2025-09-05T18:23:21.609366] [INFO ] [MAIN ] GNL: Found 1 missing trading days. [2025-09-05T18:23:21.610206] [INFO ] [MAIN ] GNL: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:21.610122] [FATAL] [VALIDATOR ] GNE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:21.610559] [FATAL] [MAIN ] GNE: Combined data validation failed. [2025-09-05T18:23:21.610623] [WARN ] [MAIN ] GNE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:21.610689] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-05T18:23:21.611075] [INFO ] [LOCAL ] GNE: Starting deletion of derivative data. [2025-09-05T18:23:21.613766] [INFO ] [MAIN ] Update Progress: 943/2363 symbols completed. GNE took 4.1s. Estimated remaining: 35m 5s. Rate: 40.5 symbols/min [2025-09-05T18:23:21.701862] [INFO ] [MAIN ] GNRC: Loaded 21745 existing records. [2025-09-05T18:23:21.988100] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:22.011291] [INFO ] [MAIN ] GNRC: Found 1 missing trading days. [2025-09-05T18:23:22.011377] [INFO ] [MAIN ] GNRC: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:22.017260] [INFO ] [MAIN ] GNT: Loaded 3804 existing records. [2025-09-05T18:23:22.186239] [INFO ] [MAIN ] GNT: Found 1 missing trading days. [2025-09-05T18:23:22.186377] [INFO ] [MAIN ] GNT: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:22.263440] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-05T18:23:22.365384] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-05T18:23:22.921030] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:23:22.957834] [INFO ] [MAIN ] GNT: Adding 109 new records, updating 0 existing records. [2025-09-05T18:23:22.959607] [INFO ] [MAIN ] GNT: Combined dataset has 3913 total records. [2025-09-05T18:23:23.068552] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-05T18:23:23.142691] [WARN ] [VALIDATOR ] GNT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:23.339984] [WARN ] [VALIDATOR ] GNT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:23.340267] [INFO ] [MAIN ] GNT: Combined data validation passed. [2025-09-05T18:23:23.364242] [INFO ] [MAIN ] GNT: Update completed successfully. [2025-09-05T18:23:23.364913] [INFO ] [MAIN ] Update Progress: 944/2363 symbols completed. GNT took 1.8s. Estimated remaining: 35m 4s. Rate: 40.5 symbols/min [2025-09-05T18:23:23.545019] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:23.551299] [INFO ] [MAIN ] GNTY: Loaded 4466 existing records. [2025-09-05T18:23:23.736507] [INFO ] [MAIN ] GNTY: Found 1 missing trading days. [2025-09-05T18:23:23.736748] [INFO ] [MAIN ] GNTY: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:23.741893] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:23:23.851853] [INFO ] [MAIN ] GNL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:23.853703] [INFO ] [MAIN ] GNL: Combined dataset has 22390 total records. [2025-09-05T18:23:23.854406] [FATAL] [VALIDATOR ] GNL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:23.854492] [FATAL] [MAIN ] GNL: Combined data validation failed. [2025-09-05T18:23:23.854531] [WARN ] [MAIN ] GNL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:23.854576] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-05T18:23:23.855122] [INFO ] [LOCAL ] GNL: Starting deletion of derivative data. [2025-09-05T18:23:23.858209] [INFO ] [MAIN ] Update Progress: 945/2363 symbols completed. GNL took 2.9s. Estimated remaining: 35m 1s. Rate: 40.5 symbols/min [2025-09-05T18:23:23.863674] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-05T18:23:24.041622] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:24.066010] [INFO ] [MAIN ] GNW: Loaded 24563 existing records. [2025-09-05T18:23:24.252122] [INFO ] [MAIN ] GNW: Found 1 missing trading days. [2025-09-05T18:23:24.252300] [INFO ] [MAIN ] GNW: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:24.663511] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-05T18:23:24.825138] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:23:24.848169] [INFO ] [MAIN ] GNTY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:24.849716] [INFO ] [MAIN ] GNTY: Combined dataset has 4466 total records. [2025-09-05T18:23:24.850127] [FATAL] [VALIDATOR ] GNTY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:24.850213] [FATAL] [MAIN ] GNTY: Combined data validation failed. [2025-09-05T18:23:24.850253] [WARN ] [MAIN ] GNTY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:24.850294] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-05T18:23:24.850564] [INFO ] [LOCAL ] GNTY: Starting deletion of derivative data. [2025-09-05T18:23:24.851587] [INFO ] [MAIN ] Update Progress: 946/2363 symbols completed. GNTY took 1.5s. Estimated remaining: 34m 59s. Rate: 40.5 symbols/min [2025-09-05T18:23:25.035221] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:25.059303] [INFO ] [MAIN ] GOF: Loaded 20066 existing records. [2025-09-05T18:23:25.252751] [INFO ] [MAIN ] GOF: Found 1 missing trading days. [2025-09-05T18:23:25.252912] [INFO ] [MAIN ] GOF: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:25.261728] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-05T18:23:25.463493] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-05T18:23:26.263527] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-05T18:23:27.040176] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-05T18:23:27.064900] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-05T18:23:27.141461] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-05T18:23:27.171346] [INFO ] [MAIN ] GOF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:27.173797] [INFO ] [MAIN ] GOF: Combined dataset has 20066 total records. [2025-09-05T18:23:27.174378] [FATAL] [VALIDATOR ] GOF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:27.174480] [FATAL] [MAIN ] GOF: Combined data validation failed. [2025-09-05T18:23:27.174518] [WARN ] [MAIN ] GOF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:27.174562] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-05T18:23:27.175173] [INFO ] [LOCAL ] GOF: Starting deletion of derivative data. [2025-09-05T18:23:27.178161] [INFO ] [MAIN ] Update Progress: 947/2363 symbols completed. GOF took 2.3s. Estimated remaining: 34m 58s. Rate: 40.5 symbols/min [2025-09-05T18:23:27.362442] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:27.362661] [WARN ] [MAIN ] GOLF: No existing data found, performing full refresh instead. [2025-09-05T18:23:27.362802] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-05T18:23:27.362843] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-05T18:23:27.362888] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-05T18:23:27.721198] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:23:27.867719] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-05T18:23:27.869301] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:23:27.989009] [INFO ] [MAIN ] GNW: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:27.991123] [INFO ] [MAIN ] GNW: Combined dataset has 24563 total records. [2025-09-05T18:23:27.991749] [FATAL] [VALIDATOR ] GNW: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:27.991830] [FATAL] [MAIN ] GNW: Combined data validation failed. [2025-09-05T18:23:27.991866] [WARN ] [MAIN ] GNW: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:27.991915] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-05T18:23:27.992752] [INFO ] [LOCAL ] GNW: Starting deletion of derivative data. [2025-09-05T18:23:27.996212] [INFO ] [MAIN ] Update Progress: 948/2363 symbols completed. GNW took 4.1s. Estimated remaining: 34m 56s. Rate: 40.5 symbols/min [2025-09-05T18:23:28.167614] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:28.190096] [INFO ] [MAIN ] GOOS: Loaded 22248 existing records. [2025-09-05T18:23:28.370991] [INFO ] [MAIN ] GOOS: Found 1 missing trading days. [2025-09-05T18:23:28.371143] [INFO ] [MAIN ] GOOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:28.663472] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-05T18:23:29.321516] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-05T18:23:29.463465] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-05T18:23:29.566379] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-05T18:23:30.263706] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-05T18:23:30.979365] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-05T18:23:31.063132] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-05T18:23:31.065563] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-05T18:23:31.863479] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-05T18:23:32.611791] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-05T18:23:32.626104] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:23:32.668626] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-05T18:23:32.742084] [INFO ] [MAIN ] GNRC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:32.744770] [INFO ] [MAIN ] GNRC: Combined dataset has 21745 total records. [2025-09-05T18:23:32.745328] [FATAL] [VALIDATOR ] GNRC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:32.745415] [FATAL] [MAIN ] GNRC: Combined data validation failed. [2025-09-05T18:23:32.745454] [WARN ] [MAIN ] GNRC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:32.745509] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-05T18:23:32.746054] [INFO ] [LOCAL ] GNRC: Starting deletion of derivative data. [2025-09-05T18:23:32.749104] [INFO ] [MAIN ] Update Progress: 949/2363 symbols completed. GNRC took 11.6s. Estimated remaining: 34m 59s. Rate: 40.4 symbols/min [2025-09-05T18:23:32.937097] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:32.937298] [WARN ] [MAIN ] GOTU: No existing data found, performing full refresh instead. [2025-09-05T18:23:32.937425] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-05T18:23:32.937464] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-05T18:23:32.937722] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-05T18:23:33.316486] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:23:33.463467] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-05T18:23:34.263487] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-05T18:23:34.329404] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-05T18:23:34.793162] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:23:34.794377] [INFO ] [REMOTE ] GLP: Full fetch complete (10334 records). [2025-09-05T18:23:34.794879] [FATAL] [VALIDATOR ] GLP: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:34.794958] [FATAL] [MAIN ] GLP: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:23:34.794996] [WARN ] [MAIN ] GLP: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:34.795033] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-05T18:23:34.795096] [INFO ] [LOCAL ] GLP: Starting deletion of derivative data. [2025-09-05T18:23:34.795201] [INFO ] [MAIN ] Update Progress: 950/2363 symbols completed. GLP took 29.2s. Estimated remaining: 34m 59s. Rate: 40.4 symbols/min [2025-09-05T18:23:34.984172] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:35.010154] [INFO ] [MAIN ] GPC: Loaded 21474 existing records. [2025-09-05T18:23:35.068598] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-05T18:23:35.217450] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-05T18:23:35.258024] [INFO ] [MAIN ] GPC: Found 1 missing trading days. [2025-09-05T18:23:35.258175] [INFO ] [MAIN ] GPC: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:35.748633] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:23:35.857815] [INFO ] [MAIN ] GOOS: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:35.860435] [INFO ] [MAIN ] GOOS: Combined dataset has 22248 total records. [2025-09-05T18:23:35.860931] [FATAL] [VALIDATOR ] GOOS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:35.861015] [FATAL] [MAIN ] GOOS: Combined data validation failed. [2025-09-05T18:23:35.861054] [WARN ] [MAIN ] GOOS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:35.861108] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-05T18:23:35.861618] [INFO ] [LOCAL ] GOOS: Starting deletion of derivative data. [2025-09-05T18:23:35.864814] [INFO ] [MAIN ] Update Progress: 951/2363 symbols completed. GOOS took 7.9s. Estimated remaining: 34m 57s. Rate: 40.4 symbols/min [2025-09-05T18:23:35.864948] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-05T18:23:36.049416] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:36.049629] [WARN ] [MAIN ] GPI: No existing data found, performing full refresh instead. [2025-09-05T18:23:36.049773] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-05T18:23:36.049819] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-05T18:23:36.049864] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-05T18:23:36.478436] [INFO ] [REMOTE ] GPI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:23:36.611193] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:23:36.668735] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-05T18:23:36.744616] [INFO ] [MAIN ] GPC: Adding 355 new records, updating 0 existing records. [2025-09-05T18:23:36.749869] [INFO ] [MAIN ] GPC: Combined dataset has 21829 total records. [2025-09-05T18:23:36.940763] [WARN ] [VALIDATOR ] GPC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:37.136839] [WARN ] [VALIDATOR ] GPC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:37.137045] [INFO ] [MAIN ] GPC: Combined data validation passed. [2025-09-05T18:23:37.290660] [INFO ] [MAIN ] GPC: Update completed successfully. [2025-09-05T18:23:37.293812] [INFO ] [MAIN ] Update Progress: 952/2363 symbols completed. GPC took 2.5s. Estimated remaining: 34m 55s. Rate: 40.4 symbols/min [2025-09-05T18:23:37.468750] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-05T18:23:37.470538] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:37.475932] [INFO ] [MAIN ] GPJA: Loaded 2369 existing records. [2025-09-05T18:23:37.648395] [INFO ] [MAIN ] GPJA: Found 1 missing trading days. [2025-09-05T18:23:37.648541] [INFO ] [MAIN ] GPJA: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:37.971330] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-05T18:23:38.263479] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-05T18:23:38.881046] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:23:38.899180] [INFO ] [MAIN ] GPJA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:23:38.900433] [INFO ] [MAIN ] GPJA: Combined dataset has 2369 total records. [2025-09-05T18:23:38.900846] [FATAL] [VALIDATOR ] GPJA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:23:38.900942] [FATAL] [MAIN ] GPJA: Combined data validation failed. [2025-09-05T18:23:38.900983] [WARN ] [MAIN ] GPJA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:23:38.901040] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-05T18:23:38.901414] [INFO ] [LOCAL ] GPJA: Starting deletion of derivative data. [2025-09-05T18:23:38.902093] [INFO ] [MAIN ] Update Progress: 953/2363 symbols completed. GPJA took 1.6s. Estimated remaining: 34m 54s. Rate: 40.4 symbols/min [2025-09-05T18:23:39.068696] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-05T18:23:39.109978] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:39.139483] [INFO ] [MAIN ] GPK: Loaded 25261 existing records. [2025-09-05T18:23:39.379320] [INFO ] [MAIN ] GPK: Found 1 missing trading days. [2025-09-05T18:23:39.380172] [INFO ] [MAIN ] GPK: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:39.383214] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-05T18:23:39.863588] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-05T18:23:40.663482] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-05T18:23:41.045750] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-05T18:23:41.220231] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-05T18:23:41.255030] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:23:41.415846] [INFO ] [MAIN ] GPK: Adding 390 new records, updating 0 existing records. [2025-09-05T18:23:41.419267] [INFO ] [MAIN ] GPK: Combined dataset has 25651 total records. [2025-09-05T18:23:41.468682] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-05T18:23:41.620321] [WARN ] [VALIDATOR ] GPK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:41.857351] [WARN ] [VALIDATOR ] GPK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:41.857595] [INFO ] [MAIN ] GPK: Combined data validation passed. [2025-09-05T18:23:42.034202] [INFO ] [MAIN ] GPK: Update completed successfully. [2025-09-05T18:23:42.037407] [INFO ] [MAIN ] Update Progress: 954/2363 symbols completed. GPK took 3.1s. Estimated remaining: 34m 55s. Rate: 40.4 symbols/min [2025-09-05T18:23:42.246463] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:42.260348] [INFO ] [MAIN ] GPMT: Loaded 12725 existing records. [2025-09-05T18:23:42.271754] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-05T18:23:42.457799] [INFO ] [MAIN ] GPMT: Found 1 missing trading days. [2025-09-05T18:23:42.458021] [INFO ] [MAIN ] GPMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:42.887209] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-05T18:23:43.063486] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-05T18:23:43.863478] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-05T18:23:43.939690] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-05T18:23:44.587994] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-05T18:23:44.663476] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-05T18:23:44.817856] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-05T18:23:45.463470] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-05T18:23:46.263479] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-05T18:23:46.471194] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-05T18:23:46.609510] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-05T18:23:46.656275] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:23:46.711253] [INFO ] [MAIN ] GPMT: Adding 99 new records, updating 0 existing records. [2025-09-05T18:23:46.713774] [INFO ] [MAIN ] GPMT: Combined dataset has 12824 total records. [2025-09-05T18:23:46.897419] [WARN ] [VALIDATOR ] GPMT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:47.063454] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-05T18:23:47.090779] [WARN ] [VALIDATOR ] GPMT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:47.090976] [INFO ] [MAIN ] GPMT: Combined data validation passed. [2025-09-05T18:23:47.167023] [INFO ] [MAIN ] GPMT: Update completed successfully. [2025-09-05T18:23:47.168697] [INFO ] [MAIN ] Update Progress: 955/2363 symbols completed. GPMT took 5.1s. Estimated remaining: 34m 59s. Rate: 40.3 symbols/min [2025-09-05T18:23:47.338049] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:47.363436] [INFO ] [MAIN ] GPN: Loaded 24697 existing records. [2025-09-05T18:23:47.544046] [INFO ] [MAIN ] GPN: Found 1 missing trading days. [2025-09-05T18:23:47.544245] [INFO ] [MAIN ] GPN: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:47.863426] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-05T18:23:48.263952] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-05T18:23:48.613031] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:23:48.668577] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-05T18:23:48.769353] [INFO ] [MAIN ] GPN: Adding 371 new records, updating 0 existing records. [2025-09-05T18:23:48.772869] [INFO ] [MAIN ] GPN: Combined dataset has 25068 total records. [2025-09-05T18:23:48.951424] [WARN ] [VALIDATOR ] GPN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:49.163515] [WARN ] [VALIDATOR ] GPN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:49.164028] [INFO ] [MAIN ] GPN: Combined data validation passed. [2025-09-05T18:23:49.320177] [INFO ] [MAIN ] GPN: Update completed successfully. [2025-09-05T18:23:49.323553] [INFO ] [MAIN ] Update Progress: 956/2363 symbols completed. GPN took 2.2s. Estimated remaining: 34m 58s. Rate: 40.2 symbols/min [2025-09-05T18:23:49.469782] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-05T18:23:49.502990] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:49.515194] [INFO ] [MAIN ] GPOR: Loaded 10889 existing records. [2025-09-05T18:23:49.694622] [INFO ] [MAIN ] GPOR: Found 1 missing trading days. [2025-09-05T18:23:49.694819] [INFO ] [MAIN ] GPOR: Need to fetch 1 months: 2025-09 [2025-09-05T18:23:50.263509] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-05T18:23:50.314731] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-05T18:23:50.599930] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-05T18:23:50.907382] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-05T18:23:51.063502] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-05T18:23:51.863487] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-05T18:23:52.065990] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-05T18:23:52.663532] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-05T18:23:53.137704] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:23:53.140208] [INFO ] [REMOTE ] GOLF: Full fetch complete (35848 records). [2025-09-05T18:23:53.468212] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-05T18:23:53.530534] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-05T18:23:53.553942] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-05T18:23:53.713702] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-05T18:23:53.713847] [INFO ] [MAIN ] Update Progress: 957/2363 symbols completed. GOLF took 26.5s. Estimated remaining: 35m 1s. Rate: 40.2 symbols/min [2025-09-05T18:23:54.130949] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:23:54.198591] [INFO ] [MAIN ] GPOR: Adding 199 new records, updating 0 existing records. [2025-09-05T18:23:54.200962] [INFO ] [MAIN ] GPOR: Combined dataset has 11088 total records. [2025-09-05T18:23:54.268602] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-05T18:23:54.388748] [WARN ] [VALIDATOR ] GPOR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:23:54.579750] [WARN ] [VALIDATOR ] GPOR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:23:54.579967] [INFO ] [MAIN ] GPOR: Combined data validation passed. [2025-09-05T18:23:54.653005] [INFO ] [MAIN ] GPOR: Update completed successfully. [2025-09-05T18:23:54.654306] [INFO ] [MAIN ] Update Progress: 958/2363 symbols completed. GPOR took 5.3s. Estimated remaining: 34m 58s. Rate: 40.2 symbols/min [2025-09-05T18:23:55.063558] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-05T18:23:55.782900] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-05T18:23:55.863487] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-05T18:23:56.121928] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-05T18:23:56.484076] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:23:56.487252] [INFO ] [REMOTE ] GOTU: Full fetch complete (44288 records). [2025-09-05T18:23:56.671132] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-05T18:23:56.878664] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-05T18:23:57.066490] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-05T18:23:57.066670] [INFO ] [MAIN ] Update Progress: 959/2363 symbols completed. GOTU took 24.3s. Estimated remaining: 34m 58s. Rate: 40.1 symbols/min [2025-09-05T18:23:57.702486] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-05T18:23:57.705880] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-05T18:23:58.144310] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:23:58.145475] [INFO ] [REMOTE ] GPI: Full fetch complete (16181 records). [2025-09-05T18:23:58.514792] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-05T18:23:58.592622] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-05T18:23:58.592824] [INFO ] [MAIN ] Update Progress: 960/2363 symbols completed. GPI took 22.7s. Estimated remaining: 34m 57s. Rate: 40.1 symbols/min [2025-09-05T18:23:59.213575] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:59.232695] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:59.241119] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:59.246434] [WARN ] [MAIN ] GRBK: No existing data found, performing full refresh instead. [2025-09-05T18:23:59.285363] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-05T18:23:59.311097] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:23:59.308279] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-05T18:23:59.311351] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-05T18:23:59.364182] [INFO ] [MAIN ] GRC: Loaded 4019 existing records. [2025-09-05T18:23:59.509978] [INFO ] [MAIN ] GPRK: Loaded 17887 existing records. [2025-09-05T18:23:59.515552] [INFO ] [MAIN ] GRDN: Loaded 9837 existing records. [2025-09-05T18:23:59.974659] [INFO ] [MAIN ] GRC: Found 1 missing trading days. [2025-09-05T18:24:00.067172] [INFO ] [MAIN ] GRC: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:00.105745] [INFO ] [MAIN ] GPRK: Found 1 missing trading days. [2025-09-05T18:24:00.150139] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-05T18:24:00.155006] [INFO ] [MAIN ] GRDN: Found 1 missing trading days. [2025-09-05T18:24:00.155992] [INFO ] [MAIN ] GPRK: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:00.167017] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-05T18:24:00.166601] [INFO ] [MAIN ] GRDN: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:00.209337] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-05T18:24:00.239981] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:24:00.611181] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:24:00.630966] [INFO ] [MAIN ] GRC: Adding 60 new records, updating 0 existing records. [2025-09-05T18:24:00.632749] [INFO ] [MAIN ] GRC: Combined dataset has 4079 total records. [2025-09-05T18:24:00.665693] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-05T18:24:00.818193] [WARN ] [VALIDATOR ] GRC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:01.009483] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:24:01.115160] [INFO ] [MAIN ] GPRK: Adding 241 new records, updating 0 existing records. [2025-09-05T18:24:01.120883] [INFO ] [MAIN ] GPRK: Combined dataset has 18128 total records. [2025-09-05T18:24:01.326154] [WARN ] [VALIDATOR ] GPRK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:01.497531] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:24:01.608830] [INFO ] [MAIN ] GRDN: Adding 249 new records, updating 0 existing records. [2025-09-05T18:24:01.615982] [INFO ] [MAIN ] GRDN: Combined dataset has 10086 total records. [2025-09-05T18:24:01.616763] [WARN ] [VALIDATOR ] GRC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:01.617610] [INFO ] [MAIN ] GRC: Combined data validation passed. [2025-09-05T18:24:01.772048] [INFO ] [MAIN ] GRC: Update completed successfully. [2025-09-05T18:24:01.788544] [INFO ] [MAIN ] Update Progress: 961/2363 symbols completed. GRC took 3.2s. Estimated remaining: 34m 58s. Rate: 40.1 symbols/min [2025-09-05T18:24:01.855465] [WARN ] [VALIDATOR ] GRDN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:02.286885] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:02.303839] [WARN ] [VALIDATOR ] GPRK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:02.304628] [INFO ] [MAIN ] GPRK: Combined data validation passed. [2025-09-05T18:24:02.316049] [INFO ] [MAIN ] GRMN: Loaded 19355 existing records. [2025-09-05T18:24:02.381163] [WARN ] [VALIDATOR ] GRDN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:02.437106] [INFO ] [MAIN ] GRDN: Combined data validation passed. [2025-09-05T18:24:02.526134] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-05T18:24:02.596635] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-05T18:24:02.721227] [INFO ] [MAIN ] GRMN: Found 1 missing trading days. [2025-09-05T18:24:02.730095] [INFO ] [MAIN ] GRMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:02.736686] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-05T18:24:02.736214] [INFO ] [MAIN ] GRDN: Update completed successfully. [2025-09-05T18:24:02.738615] [INFO ] [MAIN ] Update Progress: 962/2363 symbols completed. GRDN took 4.1s. Estimated remaining: 34m 56s. Rate: 40.1 symbols/min [2025-09-05T18:24:02.935739] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:02.945488] [INFO ] [MAIN ] GPRK: Update completed successfully. [2025-09-05T18:24:02.947611] [INFO ] [MAIN ] Update Progress: 963/2363 symbols completed. GPRK took 4.4s. Estimated remaining: 34m 52s. Rate: 40.1 symbols/min [2025-09-05T18:24:03.155064] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:03.168506] [INFO ] [MAIN ] GRND: Loaded 37727 existing records. [2025-09-05T18:24:03.333669] [INFO ] [MAIN ] GRNT: Loaded 16664 existing records. [2025-09-05T18:24:03.368860] [INFO ] [MAIN ] GRND: Found 1 missing trading days. [2025-09-05T18:24:03.380965] [INFO ] [MAIN ] GRND: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:03.398408] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-05T18:24:03.487728] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:24:03.642217] [INFO ] [MAIN ] GRNT: Found 1 missing trading days. [2025-09-05T18:24:03.657693] [INFO ] [MAIN ] GRNT: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:03.709771] [INFO ] [MAIN ] GRMN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:24:03.711520] [INFO ] [MAIN ] GRMN: Combined dataset has 19355 total records. [2025-09-05T18:24:03.712009] [FATAL] [VALIDATOR ] GRMN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:24:03.712095] [FATAL] [MAIN ] GRMN: Combined data validation failed. [2025-09-05T18:24:03.712133] [WARN ] [MAIN ] GRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:24:03.712175] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-05T18:24:03.712861] [INFO ] [LOCAL ] GRMN: Starting deletion of derivative data. [2025-09-05T18:24:03.715090] [INFO ] [MAIN ] Update Progress: 964/2363 symbols completed. GRMN took 1.9s. Estimated remaining: 34m 50s. Rate: 40.2 symbols/min [2025-09-05T18:24:03.871593] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-05T18:24:03.891412] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:03.899048] [INFO ] [MAIN ] GROV: Loaded 4979 existing records. [2025-09-05T18:24:04.080138] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-05T18:24:04.100680] [INFO ] [MAIN ] GROV: Found 1 missing trading days. [2025-09-05T18:24:04.108194] [INFO ] [MAIN ] GROV: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:04.115078] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:24:04.267123] [INFO ] [MAIN ] GRND: Adding 347 new records, updating 0 existing records. [2025-09-05T18:24:04.271734] [INFO ] [MAIN ] GRND: Combined dataset has 38074 total records. [2025-09-05T18:24:04.454075] [WARN ] [VALIDATOR ] GRND: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:24:04.649489] [WARN ] [VALIDATOR ] GRND: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:24:04.649722] [INFO ] [MAIN ] GRND: Combined data validation passed. [2025-09-05T18:24:04.706253] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-05T18:24:04.881059] [INFO ] [MAIN ] GRND: Update completed successfully. [2025-09-05T18:24:04.885470] [INFO ] [MAIN ] Update Progress: 965/2363 symbols completed. GRND took 2.1s. Estimated remaining: 34m 48s. Rate: 40.2 symbols/min [2025-09-05T18:24:05.055318] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:05.055477] [WARN ] [MAIN ] GRX: No existing data found, performing full refresh instead. [2025-09-05T18:24:05.055600] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-05T18:24:05.055639] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-05T18:24:05.055706] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-05T18:24:05.405438] [INFO ] [REMOTE ] GRX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:24:05.412232] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:24:05.468521] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-05T18:24:05.517805] [INFO ] [MAIN ] GRNT: Adding 289 new records, updating 0 existing records. [2025-09-05T18:24:05.520738] [INFO ] [MAIN ] GRNT: Combined dataset has 16953 total records. [2025-09-05T18:24:05.700092] [WARN ] [VALIDATOR ] GRNT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:05.903038] [WARN ] [VALIDATOR ] GRNT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:05.903250] [INFO ] [MAIN ] GRNT: Combined data validation passed. [2025-09-05T18:24:06.014688] [INFO ] [MAIN ] GRNT: Update completed successfully. [2025-09-05T18:24:06.024938] [INFO ] [MAIN ] Update Progress: 966/2363 symbols completed. GRNT took 3.1s. Estimated remaining: 34m 46s. Rate: 40.2 symbols/min [2025-09-05T18:24:06.072362] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-05T18:24:06.208004] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:06.231751] [INFO ] [MAIN ] GS: Loaded 24542 existing records. [2025-09-05T18:24:06.268684] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-05T18:24:06.417201] [INFO ] [MAIN ] GS: Found 1 missing trading days. [2025-09-05T18:24:06.419164] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:24:06.419211] [INFO ] [MAIN ] GS: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:06.434608] [INFO ] [MAIN ] GROV: Adding 19 new records, updating 0 existing records. [2025-09-05T18:24:06.436031] [INFO ] [MAIN ] GROV: Combined dataset has 4998 total records. [2025-09-05T18:24:06.613891] [WARN ] [VALIDATOR ] GROV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:06.804387] [WARN ] [VALIDATOR ] GROV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:06.804637] [INFO ] [MAIN ] GROV: Combined data validation passed. [2025-09-05T18:24:06.837954] [INFO ] [MAIN ] GROV: Update completed successfully. [2025-09-05T18:24:06.838821] [INFO ] [MAIN ] Update Progress: 967/2363 symbols completed. GROV took 3.1s. Estimated remaining: 34m 43s. Rate: 40.2 symbols/min [2025-09-05T18:24:07.010329] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:07.010525] [WARN ] [MAIN ] GSBD: No existing data found, performing full refresh instead. [2025-09-05T18:24:07.010668] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-05T18:24:07.010713] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-05T18:24:07.010760] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-05T18:24:07.076211] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-05T18:24:07.400111] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:24:07.705621] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:24:07.780355] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-05T18:24:07.868565] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-05T18:24:07.889089] [INFO ] [MAIN ] GS: Adding 371 new records, updating 0 existing records. [2025-09-05T18:24:07.893387] [INFO ] [MAIN ] GS: Combined dataset has 24913 total records. [2025-09-05T18:24:08.069515] [WARN ] [VALIDATOR ] GS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:08.262279] [WARN ] [VALIDATOR ] GS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:08.262494] [INFO ] [MAIN ] GS: Combined data validation passed. [2025-09-05T18:24:08.434680] [INFO ] [MAIN ] GS: Update completed successfully. [2025-09-05T18:24:08.438239] [INFO ] [MAIN ] Update Progress: 968/2363 symbols completed. GS took 2.4s. Estimated remaining: 34m 42s. Rate: 40.2 symbols/min [2025-09-05T18:24:08.613708] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:08.640886] [INFO ] [MAIN ] GSK: Loaded 25537 existing records. [2025-09-05T18:24:08.672433] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-05T18:24:08.821665] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-05T18:24:08.831927] [INFO ] [MAIN ] GSK: Found 1 missing trading days. [2025-09-05T18:24:08.834548] [INFO ] [MAIN ] GSK: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:09.463545] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-05T18:24:10.263565] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-05T18:24:10.525405] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-05T18:24:10.719906] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-05T18:24:10.883377] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-05T18:24:11.063508] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-05T18:24:11.863503] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-05T18:24:12.453068] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-05T18:24:12.579614] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-05T18:24:12.663487] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-05T18:24:13.113457] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:24:13.259595] [INFO ] [MAIN ] GSK: Adding 389 new records, updating 0 existing records. [2025-09-05T18:24:13.263332] [INFO ] [MAIN ] GSK: Combined dataset has 25926 total records. [2025-09-05T18:24:13.448251] [WARN ] [VALIDATOR ] GSK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:13.468737] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-05T18:24:13.645712] [WARN ] [VALIDATOR ] GSK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:13.645967] [INFO ] [MAIN ] GSK: Combined data validation passed. [2025-09-05T18:24:13.810747] [INFO ] [MAIN ] GSK: Update completed successfully. [2025-09-05T18:24:13.814150] [INFO ] [MAIN ] Update Progress: 969/2363 symbols completed. GSK took 5.4s. Estimated remaining: 34m 46s. Rate: 40.1 symbols/min [2025-09-05T18:24:13.992557] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:14.009372] [INFO ] [MAIN ] GSL: Loaded 15864 existing records. [2025-09-05T18:24:14.193220] [INFO ] [MAIN ] GSL: Found 1 missing trading days. [2025-09-05T18:24:14.194935] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-05T18:24:14.195083] [INFO ] [MAIN ] GSL: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:14.263465] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-05T18:24:14.697178] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-05T18:24:15.063505] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-05T18:24:15.863525] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-05T18:24:16.563002] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-05T18:24:16.663515] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-05T18:24:17.230717] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-05T18:24:17.463472] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-05T18:24:17.997105] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-05T18:24:18.087245] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-05T18:24:18.263469] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-05T18:24:18.977561] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-05T18:24:19.063490] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-05T18:24:19.325154] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-05T18:24:19.417274] [INFO ] [MAIN ] GSL: Adding 248 new records, updating 0 existing records. [2025-09-05T18:24:19.419967] [INFO ] [MAIN ] GSL: Combined dataset has 16112 total records. [2025-09-05T18:24:19.601789] [WARN ] [VALIDATOR ] GSL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:19.805076] [WARN ] [VALIDATOR ] GSL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:19.805317] [INFO ] [MAIN ] GSL: Combined data validation passed. [2025-09-05T18:24:19.881004] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-05T18:24:19.912459] [INFO ] [MAIN ] GSL: Update completed successfully. [2025-09-05T18:24:19.914774] [INFO ] [MAIN ] Update Progress: 970/2363 symbols completed. GSL took 6.1s. Estimated remaining: 34m 51s. Rate: 40.0 symbols/min [2025-09-05T18:24:20.091423] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:20.114591] [INFO ] [MAIN ] GTES: Loaded 23766 existing records. [2025-09-05T18:24:20.292632] [INFO ] [MAIN ] GTES: Found 1 missing trading days. [2025-09-05T18:24:20.292807] [INFO ] [MAIN ] GTES: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:20.663494] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-05T18:24:20.679314] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-05T18:24:21.235038] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:24:21.385283] [INFO ] [MAIN ] GTES: Adding 382 new records, updating 0 existing records. [2025-09-05T18:24:21.388795] [INFO ] [MAIN ] GTES: Combined dataset has 24148 total records. [2025-09-05T18:24:21.468635] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-05T18:24:21.570046] [WARN ] [VALIDATOR ] GTES: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:21.767835] [WARN ] [VALIDATOR ] GTES: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:21.768049] [INFO ] [MAIN ] GTES: Combined data validation passed. [2025-09-05T18:24:21.919354] [INFO ] [MAIN ] GTES: Update completed successfully. [2025-09-05T18:24:21.922681] [INFO ] [MAIN ] Update Progress: 971/2363 symbols completed. GTES took 2.0s. Estimated remaining: 34m 50s. Rate: 40.0 symbols/min [2025-09-05T18:24:22.124871] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:22.149360] [INFO ] [MAIN ] GTLS: Loaded 22036 existing records. [2025-09-05T18:24:22.268741] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-05T18:24:22.329562] [INFO ] [MAIN ] GTLS: Found 1 missing trading days. [2025-09-05T18:24:22.329735] [INFO ] [MAIN ] GTLS: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:23.063495] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-05T18:24:23.284881] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-05T18:24:23.516816] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-05T18:24:23.828264] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:24:23.863489] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-05T18:24:23.982066] [INFO ] [MAIN ] GTLS: Adding 361 new records, updating 0 existing records. [2025-09-05T18:24:23.985462] [INFO ] [MAIN ] GTLS: Combined dataset has 22397 total records. [2025-09-05T18:24:24.175807] [WARN ] [VALIDATOR ] GTLS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:24.373731] [WARN ] [VALIDATOR ] GTLS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:24.373968] [INFO ] [MAIN ] GTLS: Combined data validation passed. [2025-09-05T18:24:24.471515] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:24:24.511714] [INFO ] [REMOTE ] GRBK: Full fetch complete (30342 records). [2025-09-05T18:24:24.640396] [INFO ] [MAIN ] GTLS: Update completed successfully. [2025-09-05T18:24:24.653931] [INFO ] [MAIN ] Update Progress: 972/2363 symbols completed. GTLS took 2.7s. Estimated remaining: 34m 51s. Rate: 39.9 symbols/min [2025-09-05T18:24:24.664394] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-05T18:24:25.105338] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:25.134493] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-05T18:24:25.259704] [INFO ] [MAIN ] GTN: Loaded 21635 existing records. [2025-09-05T18:24:25.367033] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:24:25.393198] [INFO ] [REMOTE ] GRX: Full fetch complete (4236 records). [2025-09-05T18:24:25.468303] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-05T18:24:25.589449] [INFO ] [MAIN ] GTN: Found 1 missing trading days. [2025-09-05T18:24:25.590464] [INFO ] [MAIN ] GTN: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:25.870696] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-05T18:24:25.897101] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-05T18:24:25.898544] [INFO ] [MAIN ] Update Progress: 973/2363 symbols completed. GRBK took 27.3s. Estimated remaining: 34m 49s. Rate: 39.9 symbols/min [2025-09-05T18:24:25.948387] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-05T18:24:25.974828] [INFO ] [MAIN ] Update Progress: 974/2363 symbols completed. GRX took 21.1s. Estimated remaining: 34m 45s. Rate: 40.0 symbols/min [2025-09-05T18:24:26.239758] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:26.267764] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-05T18:24:26.271536] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:26.291105] [INFO ] [MAIN ] GTY: Loaded 14028 existing records. [2025-09-05T18:24:26.363711] [INFO ] [MAIN ] GUG: Loaded 9390 existing records. [2025-09-05T18:24:26.593719] [INFO ] [MAIN ] GTY: Found 1 missing trading days. [2025-09-05T18:24:26.619505] [INFO ] [MAIN ] GTY: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:26.668343] [INFO ] [MAIN ] GUG: Found 1 missing trading days. [2025-09-05T18:24:26.668526] [INFO ] [MAIN ] GUG: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:26.825572] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:24:27.009974] [INFO ] [MAIN ] GTN: Adding 294 new records, updating 0 existing records. [2025-09-05T18:24:27.014288] [INFO ] [MAIN ] GTN: Combined dataset has 21929 total records. [2025-09-05T18:24:27.070794] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-05T18:24:27.203464] [WARN ] [VALIDATOR ] GTN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:27.350178] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-05T18:24:27.444381] [WARN ] [VALIDATOR ] GTN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:27.444597] [INFO ] [MAIN ] GTN: Combined data validation passed. [2025-09-05T18:24:27.581416] [INFO ] [MAIN ] GTN: Update completed successfully. [2025-09-05T18:24:27.583781] [INFO ] [MAIN ] Update Progress: 975/2363 symbols completed. GTN took 2.9s. Estimated remaining: 34m 44s. Rate: 40.0 symbols/min [2025-09-05T18:24:27.703696] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:24:27.844931] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:27.854968] [INFO ] [MAIN ] GTY: Adding 181 new records, updating 0 existing records. [2025-09-05T18:24:27.858398] [INFO ] [MAIN ] GTY: Combined dataset has 14209 total records. [2025-09-05T18:24:27.869708] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-05T18:24:27.973366] [INFO ] [MAIN ] GUT: Loaded 7999 existing records. [2025-09-05T18:24:28.164243] [WARN ] [VALIDATOR ] GTY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:28.332231] [INFO ] [MAIN ] GUT: Found 1 missing trading days. [2025-09-05T18:24:28.343572] [INFO ] [MAIN ] GUT: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:28.431791] [WARN ] [VALIDATOR ] GTY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:28.432016] [INFO ] [MAIN ] GTY: Combined data validation passed. [2025-09-05T18:24:28.531518] [INFO ] [MAIN ] GTY: Update completed successfully. [2025-09-05T18:24:28.533305] [INFO ] [MAIN ] Update Progress: 976/2363 symbols completed. GTY took 2.6s. Estimated remaining: 34m 42s. Rate: 40.0 symbols/min [2025-09-05T18:24:28.677390] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-05T18:24:28.713595] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:28.713768] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:24:28.754759] [INFO ] [MAIN ] GUG: Adding 68 new records, updating 0 existing records. [2025-09-05T18:24:28.757862] [INFO ] [MAIN ] GUG: Combined dataset has 9458 total records. [2025-09-05T18:24:28.945174] [INFO ] [MAIN ] GVA: Loaded 15329 existing records. [2025-09-05T18:24:28.952118] [WARN ] [VALIDATOR ] GUG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:24:29.319327] [INFO ] [MAIN ] GVA: Found 1 missing trading days. [2025-09-05T18:24:29.319565] [INFO ] [MAIN ] GVA: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:29.329543] [WARN ] [VALIDATOR ] GUG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:24:29.329766] [INFO ] [MAIN ] GUG: Combined data validation passed. [2025-09-05T18:24:29.396166] [INFO ] [MAIN ] GUG: Update completed successfully. [2025-09-05T18:24:29.397473] [INFO ] [MAIN ] Update Progress: 977/2363 symbols completed. GUG took 3.4s. Estimated remaining: 34m 39s. Rate: 40.0 symbols/min [2025-09-05T18:24:29.472538] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-05T18:24:29.574717] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:29.574899] [WARN ] [MAIN ] GWH: No existing data found, performing full refresh instead. [2025-09-05T18:24:29.575224] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-05T18:24:29.575301] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-05T18:24:29.575348] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-05T18:24:29.937118] [INFO ] [REMOTE ] GWH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:24:30.244803] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-05T18:24:30.263419] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-05T18:24:30.642830] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T18:24:30.686155] [INFO ] [MAIN ] GUT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:24:30.687292] [INFO ] [MAIN ] GUT: Combined dataset has 7999 total records. [2025-09-05T18:24:30.687666] [FATAL] [VALIDATOR ] GUT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:24:30.687744] [FATAL] [MAIN ] GUT: Combined data validation failed. [2025-09-05T18:24:30.687810] [WARN ] [MAIN ] GUT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:24:30.687859] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-05T18:24:30.688160] [INFO ] [LOCAL ] GUT: Starting deletion of derivative data. [2025-09-05T18:24:30.689143] [INFO ] [MAIN ] Update Progress: 978/2363 symbols completed. GUT took 3.1s. Estimated remaining: 34m 37s. Rate: 40.0 symbols/min [2025-09-05T18:24:30.797803] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:24:30.925732] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:30.948583] [INFO ] [MAIN ] GVA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:24:30.946609] [WARN ] [MAIN ] GWRE: No existing data found, performing full refresh instead. [2025-09-05T18:24:30.949506] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-05T18:24:30.949581] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-05T18:24:30.950232] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-05T18:24:31.014878] [INFO ] [MAIN ] GVA: Combined dataset has 15329 total records. [2025-09-05T18:24:31.051028] [FATAL] [VALIDATOR ] GVA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:24:31.053492] [FATAL] [MAIN ] GVA: Combined data validation failed. [2025-09-05T18:24:31.053665] [WARN ] [MAIN ] GVA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:24:31.059336] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-05T18:24:31.064547] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-05T18:24:31.065689] [INFO ] [LOCAL ] GVA: Starting deletion of derivative data. [2025-09-05T18:24:31.077839] [INFO ] [MAIN ] Update Progress: 979/2363 symbols completed. GVA took 2.5s. Estimated remaining: 34m 34s. Rate: 40.0 symbols/min [2025-09-05T18:24:31.505047] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:24:31.508374] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:31.519692] [INFO ] [MAIN ] GWW: Loaded 9421 existing records. [2025-09-05T18:24:31.697528] [INFO ] [MAIN ] GWW: Found 1 missing trading days. [2025-09-05T18:24:31.697726] [INFO ] [MAIN ] GWW: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:31.721599] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-05T18:24:31.863474] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-05T18:24:32.403938] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:24:32.502282] [INFO ] [MAIN ] GWW: Adding 198 new records, updating 0 existing records. [2025-09-05T18:24:32.505793] [INFO ] [MAIN ] GWW: Combined dataset has 9619 total records. [2025-09-05T18:24:32.668829] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-05T18:24:32.774295] [WARN ] [VALIDATOR ] GWW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:33.034595] [WARN ] [VALIDATOR ] GWW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:33.036006] [INFO ] [MAIN ] GWW: Combined data validation passed. [2025-09-05T18:24:33.137530] [INFO ] [MAIN ] GWW: Update completed successfully. [2025-09-05T18:24:33.141211] [INFO ] [MAIN ] Update Progress: 980/2363 symbols completed. GWW took 2.0s. Estimated remaining: 34m 34s. Rate: 40.0 symbols/min [2025-09-05T18:24:33.402424] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:33.428618] [INFO ] [MAIN ] GXO: Loaded 21724 existing records. [2025-09-05T18:24:33.468730] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-05T18:24:33.654483] [INFO ] [MAIN ] GXO: Found 1 missing trading days. [2025-09-05T18:24:33.654662] [INFO ] [MAIN ] GXO: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:34.263506] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-05T18:24:34.549921] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-05T18:24:35.063494] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-05T18:24:35.155800] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-05T18:24:35.384140] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-05T18:24:35.716213] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:24:35.831219] [INFO ] [MAIN ] GXO: Adding 328 new records, updating 0 existing records. [2025-09-05T18:24:35.834352] [INFO ] [MAIN ] GXO: Combined dataset has 22052 total records. [2025-09-05T18:24:35.868605] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-05T18:24:36.020067] [WARN ] [VALIDATOR ] GXO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:36.222374] [WARN ] [VALIDATOR ] GXO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:36.222677] [INFO ] [MAIN ] GXO: Combined data validation passed. [2025-09-05T18:24:36.357923] [INFO ] [MAIN ] GXO: Update completed successfully. [2025-09-05T18:24:36.360534] [INFO ] [MAIN ] Update Progress: 981/2363 symbols completed. GXO took 3.2s. Estimated remaining: 34m 34s. Rate: 40.0 symbols/min [2025-09-05T18:24:36.529136] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:36.531864] [INFO ] [MAIN ] GYLD: Loaded 836 existing records. [2025-09-05T18:24:36.672209] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-05T18:24:36.702295] [INFO ] [MAIN ] GYLD: Found 1 missing trading days. [2025-09-05T18:24:36.702506] [INFO ] [MAIN ] GYLD: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:37.430535] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-05T18:24:37.463472] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-05T18:24:37.636028] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-05T18:24:37.710713] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-05T18:24:37.716049] [INFO ] [MAIN ] GYLD: Adding 13 new records, updating 0 existing records. [2025-09-05T18:24:37.717521] [INFO ] [MAIN ] GYLD: Combined dataset has 849 total records. [2025-09-05T18:24:37.899580] [WARN ] [VALIDATOR ] GYLD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:38.137252] [WARN ] [VALIDATOR ] GYLD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:38.137472] [INFO ] [MAIN ] GYLD: Combined data validation passed. [2025-09-05T18:24:38.146875] [INFO ] [MAIN ] GYLD: Update completed successfully. [2025-09-05T18:24:38.147197] [INFO ] [MAIN ] Update Progress: 982/2363 symbols completed. GYLD took 1.8s. Estimated remaining: 34m 33s. Rate: 40.0 symbols/min [2025-09-05T18:24:38.268608] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-05T18:24:38.328972] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:38.351110] [INFO ] [MAIN ] H: Loaded 21255 existing records. [2025-09-05T18:24:38.535802] [INFO ] [MAIN ] H: Found 1 missing trading days. [2025-09-05T18:24:38.536328] [INFO ] [MAIN ] H: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:39.063495] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-05T18:24:39.607143] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:24:39.733455] [INFO ] [MAIN ] H: Adding 306 new records, updating 0 existing records. [2025-09-05T18:24:39.736851] [INFO ] [MAIN ] H: Combined dataset has 21561 total records. [2025-09-05T18:24:39.865205] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-05T18:24:39.921692] [WARN ] [VALIDATOR ] H: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:40.057469] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-05T18:24:40.169126] [WARN ] [VALIDATOR ] H: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:40.169386] [INFO ] [MAIN ] H: Combined data validation passed. [2025-09-05T18:24:40.314073] [INFO ] [MAIN ] H: Update completed successfully. [2025-09-05T18:24:40.316693] [INFO ] [MAIN ] Update Progress: 983/2363 symbols completed. H took 2.2s. Estimated remaining: 34m 33s. Rate: 39.9 symbols/min [2025-09-05T18:24:40.488262] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:40.515311] [INFO ] [MAIN ] HAE: Loaded 28427 existing records. [2025-09-05T18:24:40.666219] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-05T18:24:40.693912] [INFO ] [MAIN ] HAE: Found 1 missing trading days. [2025-09-05T18:24:40.694140] [INFO ] [MAIN ] HAE: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:41.003706] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-05T18:24:41.441707] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-05T18:24:41.463472] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-05T18:24:42.263474] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-05T18:24:42.730692] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-05T18:24:42.912122] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:24:42.915936] [INFO ] [REMOTE ] GSBD: Full fetch complete (42857 records). [2025-09-05T18:24:43.071934] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-05T18:24:43.317566] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-05T18:24:43.514021] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-05T18:24:43.514180] [INFO ] [MAIN ] Update Progress: 984/2363 symbols completed. GSBD took 36.7s. Estimated remaining: 34m 34s. Rate: 39.9 symbols/min [2025-09-05T18:24:43.696023] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:43.716773] [INFO ] [MAIN ] HAFN: Loaded 19905 existing records. [2025-09-05T18:24:43.872595] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-05T18:24:43.904488] [INFO ] [MAIN ] HAFN: Found 1 missing trading days. [2025-09-05T18:24:43.904809] [INFO ] [MAIN ] HAFN: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:44.366117] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-05T18:24:44.663524] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-05T18:24:45.253968] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:24:45.377931] [INFO ] [MAIN ] HAE: Adding 291 new records, updating 0 existing records. [2025-09-05T18:24:45.381371] [INFO ] [MAIN ] HAE: Combined dataset has 28718 total records. [2025-09-05T18:24:45.468714] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-05T18:24:45.573673] [WARN ] [VALIDATOR ] HAE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:24:45.806433] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-05T18:24:45.821369] [WARN ] [VALIDATOR ] HAE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:24:45.821739] [INFO ] [MAIN ] HAE: Combined data validation passed. [2025-09-05T18:24:46.004286] [INFO ] [MAIN ] HAE: Update completed successfully. [2025-09-05T18:24:46.007555] [INFO ] [MAIN ] Update Progress: 985/2363 symbols completed. HAE took 5.7s. Estimated remaining: 34m 34s. Rate: 39.9 symbols/min [2025-09-05T18:24:46.179285] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:46.219629] [INFO ] [MAIN ] HAL: Loaded 40458 existing records. [2025-09-05T18:24:46.268737] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-05T18:24:46.410488] [INFO ] [MAIN ] HAL: Found 1 missing trading days. [2025-09-05T18:24:46.411127] [INFO ] [MAIN ] HAL: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:46.939869] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-05T18:24:47.063492] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-05T18:24:47.453538] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:24:47.595231] [INFO ] [MAIN ] HAL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:24:47.597794] [INFO ] [MAIN ] HAL: Combined dataset has 40458 total records. [2025-09-05T18:24:47.598539] [FATAL] [VALIDATOR ] HAL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:24:47.598629] [FATAL] [MAIN ] HAL: Combined data validation failed. [2025-09-05T18:24:47.598686] [WARN ] [MAIN ] HAL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:24:47.598725] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-05T18:24:47.599607] [INFO ] [LOCAL ] HAL: Starting deletion of derivative data. [2025-09-05T18:24:47.607345] [INFO ] [MAIN ] Update Progress: 986/2363 symbols completed. HAL took 1.6s. Estimated remaining: 34m 32s. Rate: 39.9 symbols/min [2025-09-05T18:24:47.820283] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-05T18:24:47.822281] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:47.866286] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-05T18:24:47.868464] [INFO ] [MAIN ] HASI: Loaded 22899 existing records. [2025-09-05T18:24:48.046213] [INFO ] [MAIN ] HASI: Found 1 missing trading days. [2025-09-05T18:24:48.046372] [INFO ] [MAIN ] HASI: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:48.544797] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-05T18:24:48.663489] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-05T18:24:48.948966] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-05T18:24:49.124402] [INFO ] [MAIN ] HASI: Adding 362 new records, updating 0 existing records. [2025-09-05T18:24:49.127560] [INFO ] [MAIN ] HASI: Combined dataset has 23261 total records. [2025-09-05T18:24:49.304540] [WARN ] [VALIDATOR ] HASI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:49.475813] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-05T18:24:49.498965] [WARN ] [VALIDATOR ] HASI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:49.499173] [INFO ] [MAIN ] HASI: Combined data validation passed. [2025-09-05T18:24:49.648211] [INFO ] [MAIN ] HASI: Update completed successfully. [2025-09-05T18:24:49.651170] [INFO ] [MAIN ] Update Progress: 987/2363 symbols completed. HASI took 2.0s. Estimated remaining: 34m 31s. Rate: 39.9 symbols/min [2025-09-05T18:24:49.821535] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:49.844272] [INFO ] [MAIN ] HAYW: Loaded 23274 existing records. [2025-09-05T18:24:50.030519] [INFO ] [MAIN ] HAYW: Found 1 missing trading days. [2025-09-05T18:24:50.030750] [INFO ] [MAIN ] HAYW: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:50.263531] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-05T18:24:50.922419] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:24:51.066508] [INFO ] [MAIN ] HAYW: Adding 382 new records, updating 0 existing records. [2025-09-05T18:24:51.066578] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-05T18:24:51.070895] [INFO ] [MAIN ] HAYW: Combined dataset has 23656 total records. [2025-09-05T18:24:51.285929] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-05T18:24:51.285625] [WARN ] [VALIDATOR ] HAYW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:51.706820] [INFO ] [MAIN ] HAFN: Adding 278 new records, updating 617 existing records. [2025-09-05T18:24:51.715415] [INFO ] [MAIN ] HAFN: Combined dataset has 20183 total records. [2025-09-05T18:24:51.871738] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-05T18:24:51.914714] [WARN ] [VALIDATOR ] HAFN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:52.128886] [WARN ] [VALIDATOR ] HAYW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:52.128999] [WARN ] [VALIDATOR ] HAFN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:52.129323] [INFO ] [MAIN ] HAFN: Combined data validation passed. [2025-09-05T18:24:52.129446] [INFO ] [MAIN ] HAYW: Combined data validation passed. [2025-09-05T18:24:52.365633] [INFO ] [MAIN ] HAYW: Update completed successfully. [2025-09-05T18:24:52.369568] [INFO ] [MAIN ] Update Progress: 988/2363 symbols completed. HAYW took 2.7s. Estimated remaining: 34m 32s. Rate: 39.8 symbols/min [2025-09-05T18:24:52.554811] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:52.560531] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:24:52.563655] [INFO ] [REMOTE ] GWH: Full fetch complete (16056 records). [2025-09-05T18:24:52.603071] [INFO ] [MAIN ] HBB: Loaded 2770 existing records. [2025-09-05T18:24:52.980377] [INFO ] [MAIN ] HBB: Found 1 missing trading days. [2025-09-05T18:24:53.017994] [INFO ] [MAIN ] HAFN: Update completed successfully. [2025-09-05T18:24:53.017904] [INFO ] [MAIN ] HBB: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:53.020262] [INFO ] [MAIN ] Update Progress: 989/2363 symbols completed. HAFN took 9.5s. Estimated remaining: 34m 29s. Rate: 39.8 symbols/min [2025-09-05T18:24:53.025822] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-05T18:24:53.241059] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-05T18:24:53.313497] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:53.405977] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-05T18:24:53.437119] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-05T18:24:53.448559] [INFO ] [MAIN ] Update Progress: 990/2363 symbols completed. GWH took 24.1s. Estimated remaining: 34m 26s. Rate: 39.9 symbols/min [2025-09-05T18:24:53.469021] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-05T18:24:53.480541] [INFO ] [MAIN ] HBI: Loaded 39862 existing records. [2025-09-05T18:24:53.785773] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:53.804103] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:24:53.816371] [INFO ] [MAIN ] HBI: Found 1 missing trading days. [2025-09-05T18:24:53.820357] [INFO ] [MAIN ] HBI: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:53.826938] [INFO ] [MAIN ] HBB: Adding 0 new records, updating 0 existing records. [2025-09-05T18:24:53.804180] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-09-05T18:24:53.828517] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-05T18:24:53.828475] [INFO ] [MAIN ] HBB: Combined dataset has 2770 total records. [2025-09-05T18:24:53.828965] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-05T18:24:53.828931] [FATAL] [VALIDATOR ] HBB: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:24:53.829064] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-05T18:24:53.829154] [FATAL] [MAIN ] HBB: Combined data validation failed. [2025-09-05T18:24:53.860016] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:24:53.904054] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-05T18:24:53.927728] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-09-05T18:24:53.930841] [INFO ] [MAIN ] Update Progress: 991/2363 symbols completed. HBB took 1.6s. Estimated remaining: 34m 23s. Rate: 39.9 symbols/min [2025-09-05T18:24:54.273563] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-05T18:24:54.311559] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:54.386781] [INFO ] [REMOTE ] HBM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:24:54.424521] [INFO ] [MAIN ] HCA: Loaded 35739 existing records. [2025-09-05T18:24:54.611528] [INFO ] [MAIN ] HCA: Found 1 missing trading days. [2025-09-05T18:24:54.611715] [INFO ] [MAIN ] HCA: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:55.051910] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-05T18:24:55.063411] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-05T18:24:55.103508] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:24:55.273698] [INFO ] [MAIN ] HBI: Adding 388 new records, updating 0 existing records. [2025-09-05T18:24:55.278096] [INFO ] [MAIN ] HBI: Combined dataset has 40250 total records. [2025-09-05T18:24:55.465919] [WARN ] [VALIDATOR ] HBI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:24:55.678846] [WARN ] [VALIDATOR ] HBI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:24:55.679108] [INFO ] [MAIN ] HBI: Combined data validation passed. [2025-09-05T18:24:55.884355] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-05T18:24:55.923737] [INFO ] [MAIN ] HBI: Update completed successfully. [2025-09-05T18:24:55.931603] [INFO ] [MAIN ] Update Progress: 992/2363 symbols completed. HBI took 2.9s. Estimated remaining: 34m 22s. Rate: 39.9 symbols/min [2025-09-05T18:24:56.108180] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:56.133373] [INFO ] [MAIN ] HCC: Loaded 21732 existing records. [2025-09-05T18:24:56.328650] [INFO ] [MAIN ] HCC: Found 1 missing trading days. [2025-09-05T18:24:56.328843] [INFO ] [MAIN ] HCC: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:56.653338] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:24:56.670925] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-05T18:24:56.801204] [INFO ] [MAIN ] HCA: Adding 331 new records, updating 0 existing records. [2025-09-05T18:24:56.805615] [INFO ] [MAIN ] HCA: Combined dataset has 36070 total records. [2025-09-05T18:24:56.999857] [WARN ] [VALIDATOR ] HCA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:24:57.155688] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-05T18:24:57.274496] [WARN ] [VALIDATOR ] HCA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:24:57.274767] [INFO ] [MAIN ] HCA: Combined data validation passed. [2025-09-05T18:24:57.482794] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-05T18:24:57.517202] [INFO ] [MAIN ] HCA: Update completed successfully. [2025-09-05T18:24:57.522230] [INFO ] [MAIN ] Update Progress: 993/2363 symbols completed. HCA took 3.6s. Estimated remaining: 34m 21s. Rate: 39.9 symbols/min [2025-09-05T18:24:57.708918] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:57.718693] [INFO ] [MAIN ] HCI: Loaded 7090 existing records. [2025-09-05T18:24:57.914907] [INFO ] [MAIN ] HCI: Found 1 missing trading days. [2025-09-05T18:24:57.915182] [INFO ] [MAIN ] HCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:58.088683] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:24:58.094732] [INFO ] [REMOTE ] GWRE: Full fetch complete (45564 records). [2025-09-05T18:24:58.268729] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-05T18:24:58.527384] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-05T18:24:58.671802] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-05T18:24:58.778095] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-05T18:24:58.778308] [INFO ] [MAIN ] Update Progress: 994/2363 symbols completed. GWRE took 28.1s. Estimated remaining: 34m 19s. Rate: 39.9 symbols/min [2025-09-05T18:24:58.947599] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:24:58.949730] [INFO ] [MAIN ] HCXY: Loaded 230 existing records. [2025-09-05T18:24:59.066036] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-05T18:24:59.084468] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:24:59.139600] [INFO ] [MAIN ] HCXY: Found 1 missing trading days. [2025-09-05T18:24:59.156132] [INFO ] [MAIN ] HCXY: Need to fetch 1 months: 2025-09 [2025-09-05T18:24:59.260843] [INFO ] [MAIN ] HCC: Adding 362 new records, updating 0 existing records. [2025-09-05T18:24:59.266630] [INFO ] [MAIN ] HCC: Combined dataset has 22094 total records. [2025-09-05T18:24:59.449953] [WARN ] [VALIDATOR ] HCC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:24:59.669490] [WARN ] [VALIDATOR ] HCC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:24:59.669754] [INFO ] [MAIN ] HCC: Combined data validation passed. [2025-09-05T18:24:59.818228] [INFO ] [MAIN ] HCC: Update completed successfully. [2025-09-05T18:24:59.820976] [INFO ] [MAIN ] Update Progress: 995/2363 symbols completed. HCC took 3.9s. Estimated remaining: 34m 17s. Rate: 39.9 symbols/min [2025-09-05T18:24:59.868555] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-05T18:25:00.004041] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:00.032176] [INFO ] [MAIN ] HD: Loaded 25619 existing records. [2025-09-05T18:25:00.217143] [INFO ] [MAIN ] HD: Found 1 missing trading days. [2025-09-05T18:25:00.217315] [INFO ] [MAIN ] HD: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:00.368046] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:25:00.401390] [INFO ] [MAIN ] HCI: Adding 129 new records, updating 0 existing records. [2025-09-05T18:25:00.404304] [INFO ] [MAIN ] HCI: Combined dataset has 7219 total records. [2025-09-05T18:25:00.586085] [WARN ] [VALIDATOR ] HCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:00.668574] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-05T18:25:00.806770] [WARN ] [VALIDATOR ] HCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:00.807009] [INFO ] [MAIN ] HCI: Combined data validation passed. [2025-09-05T18:25:00.861699] [INFO ] [MAIN ] HCI: Update completed successfully. [2025-09-05T18:25:00.862907] [INFO ] [MAIN ] Update Progress: 996/2363 symbols completed. HCI took 3.3s. Estimated remaining: 34m 15s. Rate: 39.9 symbols/min [2025-09-05T18:25:01.050985] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:01.087589] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-05T18:25:01.126099] [INFO ] [MAIN ] HDB: Loaded 24283 existing records. [2025-09-05T18:25:01.348956] [INFO ] [MAIN ] HDB: Found 1 missing trading days. [2025-09-05T18:25:01.349324] [INFO ] [MAIN ] HDB: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:01.357049] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:25:01.468575] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-05T18:25:01.629387] [INFO ] [MAIN ] HD: Adding 0 new records, updating 774 existing records. [2025-09-05T18:25:01.634784] [INFO ] [MAIN ] HD: Combined dataset has 25619 total records. [2025-09-05T18:25:01.635380] [FATAL] [VALIDATOR ] HD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:25:01.635479] [FATAL] [MAIN ] HD: Combined data validation failed. [2025-09-05T18:25:01.635546] [WARN ] [MAIN ] HD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:25:01.635605] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-05T18:25:01.636478] [INFO ] [LOCAL ] HD: Starting deletion of derivative data. [2025-09-05T18:25:01.639943] [INFO ] [MAIN ] Update Progress: 997/2363 symbols completed. HD took 1.8s. Estimated remaining: 34m 12s. Rate: 39.9 symbols/min [2025-09-05T18:25:02.069751] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:25:02.071472] [INFO ] [MAIN ] HCXY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:25:02.072352] [INFO ] [MAIN ] HCXY: Combined dataset has 230 total records. [2025-09-05T18:25:02.072705] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:25:02.072788] [FATAL] [MAIN ] HCXY: Combined data validation failed. [2025-09-05T18:25:02.072825] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:25:02.072861] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-05T18:25:02.073127] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-05T18:25:02.073404] [INFO ] [MAIN ] Update Progress: 998/2363 symbols completed. HCXY took 3.3s. Estimated remaining: 34m 9s. Rate: 40.0 symbols/min [2025-09-05T18:25:02.263582] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-05T18:25:02.876762] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:25:03.034512] [INFO ] [MAIN ] HDB: Adding 378 new records, updating 0 existing records. [2025-09-05T18:25:03.039737] [INFO ] [MAIN ] HDB: Combined dataset has 24661 total records. [2025-09-05T18:25:03.076593] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-05T18:25:03.246950] [WARN ] [VALIDATOR ] HDB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:03.455056] [WARN ] [VALIDATOR ] HDB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:03.455280] [INFO ] [MAIN ] HDB: Combined data validation passed. [2025-09-05T18:25:03.625416] [INFO ] [MAIN ] HDB: Update completed successfully. [2025-09-05T18:25:03.629524] [INFO ] [MAIN ] Update Progress: 999/2363 symbols completed. HDB took 2.8s. Estimated remaining: 34m 8s. Rate: 40.0 symbols/min [2025-09-05T18:25:04.965730] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-05T18:25:04.976941] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-05T18:25:06.389042] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-05T18:25:06.401568] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-05T18:25:08.195770] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-05T18:25:08.206715] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-05T18:25:10.223749] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-05T18:25:10.234919] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-05T18:25:12.122978] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-05T18:25:12.134968] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-05T18:25:14.076591] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-05T18:25:14.088166] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-05T18:25:14.669854] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:25:14.673978] [INFO ] [REMOTE ] HBM: Full fetch complete (57530 records). [2025-09-05T18:25:15.081950] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-05T18:25:15.346681] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-05T18:25:15.346876] [INFO ] [MAIN ] Update Progress: 1000/2363 symbols completed. HBM took 21.9s. Estimated remaining: 34m 20s. Rate: 39.7 symbols/min [2025-09-05T18:25:16.091117] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:16.188104] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:16.194668] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:16.221248] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:16.221348] [WARN ] [MAIN ] HESM: No existing data found, performing full refresh instead. [2025-09-05T18:25:16.223921] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-05T18:25:16.224127] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-05T18:25:16.225276] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-05T18:25:16.300284] [INFO ] [MAIN ] HEQ: Loaded 2658 existing records. [2025-09-05T18:25:16.402523] [INFO ] [MAIN ] HEI: Loaded 14780 existing records. [2025-09-05T18:25:16.458871] [INFO ] [MAIN ] HE: Loaded 23241 existing records. [2025-09-05T18:25:16.882876] [INFO ] [MAIN ] HEQ: Found 1 missing trading days. [2025-09-05T18:25:16.903911] [INFO ] [MAIN ] HEQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:16.969173] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-05T18:25:17.024023] [INFO ] [MAIN ] HEI: Found 1 missing trading days. [2025-09-05T18:25:17.127906] [INFO ] [MAIN ] HEI: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:17.133968] [INFO ] [MAIN ] HE: Found 1 missing trading days. [2025-09-05T18:25:17.138955] [INFO ] [MAIN ] HE: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:17.138768] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-05T18:25:17.139313] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-05T18:25:17.227468] [INFO ] [REMOTE ] HESM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:25:17.228414] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-05T18:25:17.438003] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-05T18:25:17.522098] [INFO ] [MAIN ] HEI: Adding 240 new records, updating 0 existing records. [2025-09-05T18:25:17.524479] [INFO ] [MAIN ] HEI: Combined dataset has 15020 total records. [2025-09-05T18:25:17.705983] [WARN ] [VALIDATOR ] HEI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:17.817177] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:25:17.836184] [INFO ] [MAIN ] HEQ: Adding 0 new records, updating 0 existing records. [2025-09-05T18:25:17.910341] [INFO ] [MAIN ] HEQ: Combined dataset has 2658 total records. [2025-09-05T18:25:17.925862] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:25:17.925403] [FATAL] [VALIDATOR ] HEQ: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:25:17.939542] [FATAL] [MAIN ] HEQ: Combined data validation failed. [2025-09-05T18:25:17.952656] [WARN ] [MAIN ] HEQ: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:25:17.952844] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-05T18:25:17.960514] [INFO ] [LOCAL ] HEQ: Starting deletion of derivative data. [2025-09-05T18:25:17.971668] [INFO ] [MAIN ] Update Progress: 1001/2363 symbols completed. HEQ took 2.6s. Estimated remaining: 34m 20s. Rate: 39.7 symbols/min [2025-09-05T18:25:18.198344] [INFO ] [MAIN ] HE: Adding 367 new records, updating 0 existing records. [2025-09-05T18:25:18.264289] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:18.269829] [INFO ] [MAIN ] HFND: Loaded 629 existing records. [2025-09-05T18:25:18.275242] [INFO ] [MAIN ] HE: Combined dataset has 23608 total records. [2025-09-05T18:25:18.629327] [INFO ] [MAIN ] HFND: Found 1 missing trading days. [2025-09-05T18:25:18.650560] [WARN ] [VALIDATOR ] HE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:18.672080] [INFO ] [MAIN ] HFND: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:18.696194] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-05T18:25:18.854703] [WARN ] [VALIDATOR ] HEI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:18.855492] [INFO ] [MAIN ] HEI: Combined data validation passed. [2025-09-05T18:25:19.012124] [INFO ] [MAIN ] HEI: Update completed successfully. [2025-09-05T18:25:19.013215] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-05T18:25:19.023675] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-05T18:25:19.026824] [INFO ] [MAIN ] Update Progress: 1002/2363 symbols completed. HEI took 3.7s. Estimated remaining: 34m 18s. Rate: 39.7 symbols/min [2025-09-05T18:25:19.122038] [WARN ] [VALIDATOR ] HE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:19.145843] [INFO ] [MAIN ] HE: Combined data validation passed. [2025-09-05T18:25:19.323598] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:19.341851] [INFO ] [MAIN ] HFRO: Loaded 8324 existing records. [2025-09-05T18:25:19.432222] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:25:19.452413] [INFO ] [MAIN ] HFND: Adding 11 new records, updating 0 existing records. [2025-09-05T18:25:19.466879] [INFO ] [MAIN ] HFND: Combined dataset has 640 total records. [2025-09-05T18:25:19.627610] [INFO ] [MAIN ] HFRO: Found 1 missing trading days. [2025-09-05T18:25:19.641199] [INFO ] [MAIN ] HFRO: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:19.653572] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-05T18:25:19.773658] [WARN ] [VALIDATOR ] HFND: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:20.001145] [INFO ] [MAIN ] HE: Update completed successfully. [2025-09-05T18:25:20.004219] [INFO ] [MAIN ] Update Progress: 1003/2363 symbols completed. HE took 4.7s. Estimated remaining: 34m 16s. Rate: 39.7 symbols/min [2025-09-05T18:25:20.183492] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:20.184017] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-09-05T18:25:20.184387] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-05T18:25:20.184503] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-05T18:25:20.184565] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-05T18:25:20.552479] [INFO ] [REMOTE ] HGER: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:25:20.553087] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-05T18:25:20.558477] [WARN ] [VALIDATOR ] HFND: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:20.558717] [INFO ] [MAIN ] HFND: Combined data validation passed. [2025-09-05T18:25:20.564510] [INFO ] [MAIN ] HFND: Update completed successfully. [2025-09-05T18:25:20.564853] [INFO ] [MAIN ] Update Progress: 1004/2363 symbols completed. HFND took 2.6s. Estimated remaining: 34m 13s. Rate: 39.7 symbols/min [2025-09-05T18:25:20.745808] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:20.763783] [INFO ] [MAIN ] HGLB: Loaded 6861 existing records. [2025-09-05T18:25:20.855252] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:25:20.869902] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-05T18:25:20.951921] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-05T18:25:20.953159] [INFO ] [MAIN ] HFRO: Adding 105 new records, updating 0 existing records. [2025-09-05T18:25:21.016628] [INFO ] [MAIN ] HGLB: Found 1 missing trading days. [2025-09-05T18:25:21.016951] [INFO ] [MAIN ] HGLB: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:21.017323] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-05T18:25:21.018246] [INFO ] [MAIN ] HFRO: Combined dataset has 8429 total records. [2025-09-05T18:25:21.197391] [WARN ] [VALIDATOR ] HFRO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:21.387299] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-05T18:25:21.389693] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-05T18:25:21.400037] [WARN ] [VALIDATOR ] HFRO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:21.400253] [INFO ] [MAIN ] HFRO: Combined data validation passed. [2025-09-05T18:25:21.451820] [INFO ] [MAIN ] HFRO: Update completed successfully. [2025-09-05T18:25:21.452953] [INFO ] [MAIN ] Update Progress: 1005/2363 symbols completed. HFRO took 2.4s. Estimated remaining: 34m 11s. Rate: 39.7 symbols/min [2025-09-05T18:25:21.632612] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:21.641373] [INFO ] [MAIN ] HGTY: Loaded 6549 existing records. [2025-09-05T18:25:21.817611] [INFO ] [MAIN ] HGTY: Found 1 missing trading days. [2025-09-05T18:25:21.817812] [INFO ] [MAIN ] HGTY: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:21.818106] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-05T18:25:21.823208] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-05T18:25:21.825107] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-05T18:25:21.921569] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:25:21.957443] [INFO ] [MAIN ] HGLB: Adding 179 new records, updating 0 existing records. [2025-09-05T18:25:21.959665] [INFO ] [MAIN ] HGLB: Combined dataset has 7040 total records. [2025-09-05T18:25:22.150567] [WARN ] [VALIDATOR ] HGLB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:25:22.276134] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:25:22.397484] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-05T18:25:22.409594] [INFO ] [MAIN ] HGTY: Adding 147 new records, updating 0 existing records. [2025-09-05T18:25:22.412457] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-05T18:25:22.417351] [INFO ] [MAIN ] HGTY: Combined dataset has 6696 total records. [2025-09-05T18:25:22.611368] [WARN ] [VALIDATOR ] HGTY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:22.862527] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-05T18:25:22.874330] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-05T18:25:22.879444] [WARN ] [VALIDATOR ] HGLB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:25:22.879757] [INFO ] [MAIN ] HGLB: Combined data validation passed. [2025-09-05T18:25:22.927772] [INFO ] [MAIN ] HGLB: Update completed successfully. [2025-09-05T18:25:22.932534] [INFO ] [MAIN ] Update Progress: 1006/2363 symbols completed. HGLB took 2.4s. Estimated remaining: 34m 9s. Rate: 39.7 symbols/min [2025-09-05T18:25:22.931395] [WARN ] [VALIDATOR ] HGTY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:22.944950] [INFO ] [MAIN ] HGTY: Combined data validation passed. [2025-09-05T18:25:23.160052] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:23.177385] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-05T18:25:23.183405] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-05T18:25:23.197347] [INFO ] [MAIN ] HGTY: Update completed successfully. [2025-09-05T18:25:23.198432] [INFO ] [MAIN ] Update Progress: 1007/2363 symbols completed. HGTY took 1.7s. Estimated remaining: 34m 6s. Rate: 39.8 symbols/min [2025-09-05T18:25:23.317845] [INFO ] [MAIN ] HGV: Loaded 22929 existing records. [2025-09-05T18:25:23.505190] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:23.583575] [INFO ] [MAIN ] HGV: Found 1 missing trading days. [2025-09-05T18:25:23.583769] [INFO ] [MAIN ] HGV: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:23.584107] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-05T18:25:23.597599] [INFO ] [MAIN ] HHH: Loaded 16320 existing records. [2025-09-05T18:25:23.775079] [INFO ] [MAIN ] HHH: Found 1 missing trading days. [2025-09-05T18:25:23.775222] [INFO ] [MAIN ] HHH: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:23.775457] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-05T18:25:24.090100] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-05T18:25:24.093162] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-05T18:25:24.327267] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:25:24.447848] [INFO ] [MAIN ] HGV: Adding 0 new records, updating 0 existing records. [2025-09-05T18:25:24.450380] [INFO ] [MAIN ] HGV: Combined dataset has 22929 total records. [2025-09-05T18:25:24.451002] [FATAL] [VALIDATOR ] HGV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:25:24.451089] [FATAL] [MAIN ] HGV: Combined data validation failed. [2025-09-05T18:25:24.451130] [WARN ] [MAIN ] HGV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:25:24.451175] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-05T18:25:24.451960] [INFO ] [LOCAL ] HGV: Starting deletion of derivative data. [2025-09-05T18:25:24.456424] [INFO ] [MAIN ] Update Progress: 1008/2363 symbols completed. HGV took 1.5s. Estimated remaining: 34m 4s. Rate: 39.8 symbols/min [2025-09-05T18:25:24.674939] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:24.675440] [WARN ] [MAIN ] HI: No existing data found, performing full refresh instead. [2025-09-05T18:25:24.675885] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-05T18:25:24.675945] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-05T18:25:24.688917] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-05T18:25:24.793275] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-05T18:25:24.841932] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-05T18:25:25.042718] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T18:25:25.090195] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-05T18:25:25.151267] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-05T18:25:25.214549] [INFO ] [MAIN ] HHH: Adding 261 new records, updating 0 existing records. [2025-09-05T18:25:25.240271] [INFO ] [REMOTE ] HI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:25:25.243719] [INFO ] [MAIN ] HHH: Combined dataset has 16581 total records. [2025-09-05T18:25:25.435058] [WARN ] [VALIDATOR ] HHH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:25.468619] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-05T18:25:25.634977] [WARN ] [VALIDATOR ] HHH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:25.635416] [INFO ] [MAIN ] HHH: Combined data validation passed. [2025-09-05T18:25:25.739023] [INFO ] [MAIN ] HHH: Update completed successfully. [2025-09-05T18:25:25.741208] [INFO ] [MAIN ] Update Progress: 1009/2363 symbols completed. HHH took 2.5s. Estimated remaining: 34m 2s. Rate: 39.8 symbols/min [2025-09-05T18:25:25.915432] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:25.941868] [INFO ] [MAIN ] HIG: Loaded 24497 existing records. [2025-09-05T18:25:26.134230] [INFO ] [MAIN ] HIG: Found 1 missing trading days. [2025-09-05T18:25:26.147612] [INFO ] [MAIN ] HIG: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:26.149731] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-05T18:25:26.263448] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-05T18:25:26.628991] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-05T18:25:26.857698] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:25:27.010303] [INFO ] [MAIN ] HIG: Adding 381 new records, updating 0 existing records. [2025-09-05T18:25:27.014808] [INFO ] [MAIN ] HIG: Combined dataset has 24878 total records. [2025-09-05T18:25:27.065384] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-05T18:25:27.153152] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-05T18:25:27.233071] [WARN ] [VALIDATOR ] HIG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:27.440239] [WARN ] [VALIDATOR ] HIG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:27.440464] [INFO ] [MAIN ] HIG: Combined data validation passed. [2025-09-05T18:25:27.599685] [INFO ] [MAIN ] HIG: Update completed successfully. [2025-09-05T18:25:27.603003] [INFO ] [MAIN ] Update Progress: 1010/2363 symbols completed. HIG took 1.9s. Estimated remaining: 34m 1s. Rate: 39.8 symbols/min [2025-09-05T18:25:27.781068] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:27.798031] [INFO ] [MAIN ] HII: Loaded 15147 existing records. [2025-09-05T18:25:27.868579] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-05T18:25:27.985766] [INFO ] [MAIN ] HII: Found 1 missing trading days. [2025-09-05T18:25:27.985977] [INFO ] [MAIN ] HII: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:28.663522] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-05T18:25:28.861633] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-05T18:25:29.002476] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-05T18:25:29.323201] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:25:29.422513] [INFO ] [MAIN ] HII: Adding 226 new records, updating 0 existing records. [2025-09-05T18:25:29.425759] [INFO ] [MAIN ] HII: Combined dataset has 15373 total records. [2025-09-05T18:25:29.468720] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-05T18:25:29.618971] [WARN ] [VALIDATOR ] HII: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:29.858845] [WARN ] [VALIDATOR ] HII: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:29.859059] [INFO ] [MAIN ] HII: Combined data validation passed. [2025-09-05T18:25:29.960755] [INFO ] [MAIN ] HII: Update completed successfully. [2025-09-05T18:25:29.962695] [INFO ] [MAIN ] Update Progress: 1011/2363 symbols completed. HII took 2.4s. Estimated remaining: 34m 1s. Rate: 39.7 symbols/min [2025-09-05T18:25:30.158701] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:30.188169] [INFO ] [MAIN ] HIMS: Loaded 25798 existing records. [2025-09-05T18:25:30.268596] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-05T18:25:30.376145] [INFO ] [MAIN ] HIMS: Found 1 missing trading days. [2025-09-05T18:25:30.376289] [INFO ] [MAIN ] HIMS: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:30.492594] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:25:30.494132] [INFO ] [REMOTE ] HGER: Full fetch complete (12378 records). [2025-09-05T18:25:30.868778] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-05T18:25:30.932074] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-05T18:25:30.932252] [INFO ] [MAIN ] Update Progress: 1012/2363 symbols completed. HGER took 10.9s. Estimated remaining: 33m 59s. Rate: 39.8 symbols/min [2025-09-05T18:25:31.068511] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-05T18:25:31.113800] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:31.125956] [INFO ] [MAIN ] HIO: Loaded 10654 existing records. [2025-09-05T18:25:31.300928] [INFO ] [MAIN ] HIO: Found 1 missing trading days. [2025-09-05T18:25:31.301084] [INFO ] [MAIN ] HIO: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:31.863546] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-05T18:25:32.108702] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-05T18:25:32.432890] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-05T18:25:32.609032] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:25:32.668550] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-05T18:25:32.765208] [INFO ] [MAIN ] HIMS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:25:32.768655] [INFO ] [MAIN ] HIMS: Combined dataset has 26188 total records. [2025-09-05T18:25:32.961007] [WARN ] [VALIDATOR ] HIMS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:33.164321] [WARN ] [VALIDATOR ] HIMS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:33.164599] [INFO ] [MAIN ] HIMS: Combined data validation passed. [2025-09-05T18:25:33.349267] [INFO ] [MAIN ] HIMS: Update completed successfully. [2025-09-05T18:25:33.352536] [INFO ] [MAIN ] Update Progress: 1013/2363 symbols completed. HIMS took 3.4s. Estimated remaining: 33m 58s. Rate: 39.7 symbols/min [2025-09-05T18:25:33.468706] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-05T18:25:33.554063] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:33.569959] [INFO ] [MAIN ] HIPO: Loaded 10801 existing records. [2025-09-05T18:25:33.765883] [INFO ] [MAIN ] HIPO: Found 1 missing trading days. [2025-09-05T18:25:33.766046] [INFO ] [MAIN ] HIPO: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:34.263528] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-05T18:25:34.768688] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-05T18:25:34.782005] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-05T18:25:34.906240] [INFO ] [MAIN ] HIO: Adding 270 new records, updating 0 existing records. [2025-09-05T18:25:34.910117] [INFO ] [MAIN ] HIO: Combined dataset has 10924 total records. [2025-09-05T18:25:35.068742] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-05T18:25:35.098245] [WARN ] [VALIDATOR ] HIO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:35.301329] [WARN ] [VALIDATOR ] HIO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:35.301591] [INFO ] [MAIN ] HIO: Combined data validation passed. [2025-09-05T18:25:35.377806] [INFO ] [MAIN ] HIO: Update completed successfully. [2025-09-05T18:25:35.379291] [INFO ] [MAIN ] Update Progress: 1014/2363 symbols completed. HIO took 4.4s. Estimated remaining: 33m 58s. Rate: 39.7 symbols/min [2025-09-05T18:25:35.564483] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:35.586751] [INFO ] [MAIN ] HIW: Loaded 20931 existing records. [2025-09-05T18:25:35.775351] [INFO ] [MAIN ] HIW: Found 1 missing trading days. [2025-09-05T18:25:35.775887] [INFO ] [MAIN ] HIW: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:35.790808] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:25:35.798095] [INFO ] [REMOTE ] HESM: Full fetch complete (52333 records). [2025-09-05T18:25:35.865767] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-05T18:25:36.028945] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-05T18:25:36.257545] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-05T18:25:36.515593] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-05T18:25:36.515927] [INFO ] [MAIN ] Update Progress: 1015/2363 symbols completed. HESM took 21.2s. Estimated remaining: 33m 56s. Rate: 39.7 symbols/min [2025-09-05T18:25:36.627190] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:25:36.672560] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-05T18:25:36.750144] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:36.758022] [INFO ] [MAIN ] HIPO: Adding 141 new records, updating 0 existing records. [2025-09-05T18:25:36.762784] [INFO ] [MAIN ] HIPO: Combined dataset has 10942 total records. [2025-09-05T18:25:36.882197] [INFO ] [MAIN ] HIX: Loaded 9630 existing records. [2025-09-05T18:25:37.072864] [WARN ] [VALIDATOR ] HIPO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:37.281331] [INFO ] [MAIN ] HIX: Found 1 missing trading days. [2025-09-05T18:25:37.284035] [INFO ] [MAIN ] HIX: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:37.389634] [WARN ] [VALIDATOR ] HIPO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:37.389871] [INFO ] [MAIN ] HIPO: Combined data validation passed. [2025-09-05T18:25:37.463503] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-05T18:25:37.464031] [INFO ] [MAIN ] HIPO: Update completed successfully. [2025-09-05T18:25:37.465626] [INFO ] [MAIN ] Update Progress: 1016/2363 symbols completed. HIPO took 4.1s. Estimated remaining: 33m 53s. Rate: 39.7 symbols/min [2025-09-05T18:25:37.653069] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:37.664204] [INFO ] [MAIN ] HKD: Loaded 9356 existing records. [2025-09-05T18:25:37.847379] [INFO ] [MAIN ] HKD: Found 1 missing trading days. [2025-09-05T18:25:37.847692] [INFO ] [MAIN ] HKD: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:38.248636] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-05T18:25:38.263415] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-05T18:25:38.781945] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T18:25:38.827323] [INFO ] [MAIN ] HIX: Adding 125 new records, updating 0 existing records. [2025-09-05T18:25:38.830168] [INFO ] [MAIN ] HIX: Combined dataset has 9755 total records. [2025-09-05T18:25:39.011945] [WARN ] [VALIDATOR ] HIX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:39.076362] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-05T18:25:39.212085] [WARN ] [VALIDATOR ] HIX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:39.212326] [INFO ] [MAIN ] HIX: Combined data validation passed. [2025-09-05T18:25:39.278249] [INFO ] [MAIN ] HIX: Update completed successfully. [2025-09-05T18:25:39.280030] [INFO ] [MAIN ] Update Progress: 1017/2363 symbols completed. HIX took 2.8s. Estimated remaining: 33m 52s. Rate: 39.7 symbols/min [2025-09-05T18:25:39.459159] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:39.459381] [WARN ] [MAIN ] HL: No existing data found, performing full refresh instead. [2025-09-05T18:25:39.459530] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-05T18:25:39.459593] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-05T18:25:39.459680] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-05T18:25:39.834064] [INFO ] [REMOTE ] HL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:25:39.866109] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-05T18:25:39.873379] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-05T18:25:40.118751] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T18:25:40.164423] [INFO ] [MAIN ] HKD: Adding 84 new records, updating 0 existing records. [2025-09-05T18:25:40.166578] [INFO ] [MAIN ] HKD: Combined dataset has 9440 total records. [2025-09-05T18:25:40.351950] [WARN ] [VALIDATOR ] HKD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:40.549966] [WARN ] [VALIDATOR ] HKD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:40.550192] [INFO ] [MAIN ] HKD: Combined data validation passed. [2025-09-05T18:25:40.609174] [INFO ] [MAIN ] HKD: Update completed successfully. [2025-09-05T18:25:40.610508] [INFO ] [MAIN ] Update Progress: 1018/2363 symbols completed. HKD took 3.1s. Estimated remaining: 33m 50s. Rate: 39.7 symbols/min [2025-09-05T18:25:40.671518] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-05T18:25:40.753936] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:25:40.830968] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:40.948685] [INFO ] [MAIN ] HIW: Adding 350 new records, updating 0 existing records. [2025-09-05T18:25:40.957471] [INFO ] [MAIN ] HLF: Loaded 23186 existing records. [2025-09-05T18:25:41.081916] [INFO ] [MAIN ] HIW: Combined dataset has 21281 total records. [2025-09-05T18:25:41.245830] [INFO ] [MAIN ] HLF: Found 1 missing trading days. [2025-09-05T18:25:41.275311] [INFO ] [MAIN ] HLF: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:41.359344] [WARN ] [VALIDATOR ] HIW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:41.466942] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-05T18:25:41.561567] [WARN ] [VALIDATOR ] HIW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:41.561797] [INFO ] [MAIN ] HIW: Combined data validation passed. [2025-09-05T18:25:41.711054] [INFO ] [MAIN ] HIW: Update completed successfully. [2025-09-05T18:25:41.713793] [INFO ] [MAIN ] Update Progress: 1019/2363 symbols completed. HIW took 6.3s. Estimated remaining: 33m 48s. Rate: 39.8 symbols/min [2025-09-05T18:25:41.893306] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:41.909470] [INFO ] [MAIN ] HLI: Loaded 14604 existing records. [2025-09-05T18:25:42.097773] [INFO ] [MAIN ] HLI: Found 1 missing trading days. [2025-09-05T18:25:42.097950] [INFO ] [MAIN ] HLI: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:42.221401] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-05T18:25:42.263507] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-05T18:25:42.749655] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:25:42.834827] [INFO ] [MAIN ] HLI: Adding 235 new records, updating 0 existing records. [2025-09-05T18:25:42.837447] [INFO ] [MAIN ] HLI: Combined dataset has 14839 total records. [2025-09-05T18:25:43.043280] [WARN ] [VALIDATOR ] HLI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:43.068519] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-05T18:25:43.257535] [WARN ] [VALIDATOR ] HLI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:43.257763] [INFO ] [MAIN ] HLI: Combined data validation passed. [2025-09-05T18:25:43.351238] [INFO ] [MAIN ] HLI: Update completed successfully. [2025-09-05T18:25:43.353067] [INFO ] [MAIN ] Update Progress: 1020/2363 symbols completed. HLI took 1.6s. Estimated remaining: 33m 47s. Rate: 39.8 symbols/min [2025-09-05T18:25:43.543206] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:43.582492] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-05T18:25:43.598850] [INFO ] [MAIN ] HLIO: Loaded 14664 existing records. [2025-09-05T18:25:43.790231] [INFO ] [MAIN ] HLIO: Found 1 missing trading days. [2025-09-05T18:25:43.790426] [INFO ] [MAIN ] HLIO: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:43.863481] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-05T18:25:44.256989] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-05T18:25:44.663517] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-05T18:25:44.908702] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-05T18:25:44.977438] [INFO ] [MAIN ] HLIO: Adding 182 new records, updating 0 existing records. [2025-09-05T18:25:44.979941] [INFO ] [MAIN ] HLIO: Combined dataset has 14846 total records. [2025-09-05T18:25:45.164600] [WARN ] [VALIDATOR ] HLIO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:45.361951] [WARN ] [VALIDATOR ] HLIO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:45.362191] [INFO ] [MAIN ] HLIO: Combined data validation passed. [2025-09-05T18:25:45.460911] [INFO ] [MAIN ] HLIO: Update completed successfully. [2025-09-05T18:25:45.462926] [INFO ] [MAIN ] Update Progress: 1021/2363 symbols completed. HLIO took 2.1s. Estimated remaining: 33m 46s. Rate: 39.7 symbols/min [2025-09-05T18:25:45.468632] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-05T18:25:45.655419] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:45.675803] [INFO ] [MAIN ] HLLY: Loaded 15466 existing records. [2025-09-05T18:25:45.859108] [INFO ] [MAIN ] HLLY: Found 1 missing trading days. [2025-09-05T18:25:45.859628] [INFO ] [MAIN ] HLLY: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:45.882311] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-05T18:25:45.923440] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-05T18:25:46.031842] [INFO ] [MAIN ] HLF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:25:46.033597] [INFO ] [MAIN ] HLF: Combined dataset has 23186 total records. [2025-09-05T18:25:46.034146] [FATAL] [VALIDATOR ] HLF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:25:46.034232] [FATAL] [MAIN ] HLF: Combined data validation failed. [2025-09-05T18:25:46.034270] [WARN ] [MAIN ] HLF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:25:46.034310] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-05T18:25:46.034885] [INFO ] [LOCAL ] HLF: Starting deletion of derivative data. [2025-09-05T18:25:46.037656] [INFO ] [MAIN ] Update Progress: 1022/2363 symbols completed. HLF took 5.4s. Estimated remaining: 33m 44s. Rate: 39.8 symbols/min [2025-09-05T18:25:46.213906] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:46.240992] [INFO ] [MAIN ] HLN: Loaded 25388 existing records. [2025-09-05T18:25:46.271130] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-05T18:25:46.424931] [INFO ] [MAIN ] HLN: Found 1 missing trading days. [2025-09-05T18:25:46.425662] [INFO ] [MAIN ] HLN: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:46.776825] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:25:46.876872] [INFO ] [MAIN ] HLLY: Adding 235 new records, updating 0 existing records. [2025-09-05T18:25:46.879798] [INFO ] [MAIN ] HLLY: Combined dataset has 15701 total records. [2025-09-05T18:25:47.060819] [WARN ] [VALIDATOR ] HLLY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:47.071732] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-05T18:25:47.255119] [WARN ] [VALIDATOR ] HLLY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:47.255731] [INFO ] [MAIN ] HLLY: Combined data validation passed. [2025-09-05T18:25:47.351791] [INFO ] [MAIN ] HLLY: Update completed successfully. [2025-09-05T18:25:47.354175] [INFO ] [MAIN ] Update Progress: 1023/2363 symbols completed. HLLY took 1.9s. Estimated remaining: 33m 42s. Rate: 39.8 symbols/min [2025-09-05T18:25:47.542858] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:47.573249] [INFO ] [MAIN ] HLT: Loaded 23912 existing records. [2025-09-05T18:25:47.817124] [INFO ] [MAIN ] HLT: Found 1 missing trading days. [2025-09-05T18:25:47.817483] [INFO ] [MAIN ] HLT: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:47.863511] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-05T18:25:48.174382] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:25:48.389748] [INFO ] [MAIN ] HLT: Adding 371 new records, updating 0 existing records. [2025-09-05T18:25:48.394363] [INFO ] [MAIN ] HLT: Combined dataset has 24283 total records. [2025-09-05T18:25:48.664670] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-05T18:25:48.698345] [WARN ] [VALIDATOR ] HLT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:49.001680] [WARN ] [VALIDATOR ] HLT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:49.001955] [INFO ] [MAIN ] HLT: Combined data validation passed. [2025-09-05T18:25:49.202726] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-05T18:25:49.240043] [INFO ] [MAIN ] HLT: Update completed successfully. [2025-09-05T18:25:49.243427] [INFO ] [MAIN ] Update Progress: 1024/2363 symbols completed. HLT took 1.9s. Estimated remaining: 33m 41s. Rate: 39.8 symbols/min [2025-09-05T18:25:49.402492] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:25:49.475742] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-05T18:25:49.504557] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:49.648082] [INFO ] [MAIN ] HLN: Adding 383 new records, updating 0 existing records. [2025-09-05T18:25:49.657101] [INFO ] [MAIN ] HLX: Loaded 22802 existing records. [2025-09-05T18:25:49.772307] [INFO ] [MAIN ] HLN: Combined dataset has 25771 total records. [2025-09-05T18:25:49.920756] [INFO ] [MAIN ] HLX: Found 1 missing trading days. [2025-09-05T18:25:49.948579] [INFO ] [MAIN ] HLX: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:50.026364] [WARN ] [VALIDATOR ] HLN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:50.232120] [WARN ] [VALIDATOR ] HLN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:50.232359] [INFO ] [MAIN ] HLN: Combined data validation passed. [2025-09-05T18:25:50.294879] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-05T18:25:50.404698] [INFO ] [MAIN ] HLN: Update completed successfully. [2025-09-05T18:25:50.407992] [INFO ] [MAIN ] Update Progress: 1025/2363 symbols completed. HLN took 4.4s. Estimated remaining: 33m 39s. Rate: 39.8 symbols/min [2025-09-05T18:25:50.581509] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:50.603925] [INFO ] [MAIN ] HMC: Loaded 22277 existing records. [2025-09-05T18:25:50.790297] [INFO ] [MAIN ] HMC: Found 1 missing trading days. [2025-09-05T18:25:50.790543] [INFO ] [MAIN ] HMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:50.851772] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-05T18:25:50.946425] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:25:51.068547] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-05T18:25:51.084590] [INFO ] [MAIN ] HLX: Adding 353 new records, updating 0 existing records. [2025-09-05T18:25:51.089234] [INFO ] [MAIN ] HLX: Combined dataset has 23155 total records. [2025-09-05T18:25:51.298020] [WARN ] [VALIDATOR ] HLX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:51.523585] [WARN ] [VALIDATOR ] HLX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:51.523864] [INFO ] [MAIN ] HLX: Combined data validation passed. [2025-09-05T18:25:51.661233] [INFO ] [MAIN ] HLX: Update completed successfully. [2025-09-05T18:25:51.664316] [INFO ] [MAIN ] Update Progress: 1026/2363 symbols completed. HLX took 2.4s. Estimated remaining: 33m 37s. Rate: 39.8 symbols/min [2025-09-05T18:25:51.811163] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:25:51.866990] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:51.867051] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-05T18:25:51.989203] [INFO ] [MAIN ] HMN: Loaded 11089 existing records. [2025-09-05T18:25:52.037897] [INFO ] [MAIN ] HMC: Adding 325 new records, updating 0 existing records. [2025-09-05T18:25:52.189961] [INFO ] [MAIN ] HMC: Combined dataset has 22602 total records. [2025-09-05T18:25:52.195286] [INFO ] [MAIN ] HMN: Found 1 missing trading days. [2025-09-05T18:25:52.195521] [INFO ] [MAIN ] HMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:52.381100] [WARN ] [VALIDATOR ] HMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:52.581208] [WARN ] [VALIDATOR ] HMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:52.581414] [INFO ] [MAIN ] HMC: Combined data validation passed. [2025-09-05T18:25:52.669127] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-05T18:25:52.722250] [INFO ] [MAIN ] HMC: Update completed successfully. [2025-09-05T18:25:52.725186] [INFO ] [MAIN ] Update Progress: 1027/2363 symbols completed. HMC took 2.3s. Estimated remaining: 33m 35s. Rate: 39.8 symbols/min [2025-09-05T18:25:52.899184] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:52.899345] [WARN ] [MAIN ] HMY: No existing data found, performing full refresh instead. [2025-09-05T18:25:52.899475] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-05T18:25:52.899516] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-05T18:25:52.899563] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-05T18:25:53.273310] [INFO ] [REMOTE ] HMY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:25:53.423329] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:25:53.425963] [INFO ] [REMOTE ] HI: Full fetch complete (38398 records). [2025-09-05T18:25:53.470192] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-05T18:25:53.822196] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-05T18:25:54.012842] [INFO ] [MAIN ] HI: Full history saved. [2025-09-05T18:25:54.013005] [INFO ] [MAIN ] Update Progress: 1028/2363 symbols completed. HI took 29.6s. Estimated remaining: 33m 33s. Rate: 39.8 symbols/min [2025-09-05T18:25:54.137924] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:25:54.219383] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:54.272151] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-05T18:25:54.289100] [INFO ] [MAIN ] HMN: Adding 142 new records, updating 0 existing records. [2025-09-05T18:25:54.334552] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-05T18:25:54.340954] [INFO ] [MAIN ] HMN: Combined dataset has 11231 total records. [2025-09-05T18:25:54.473438] [INFO ] [MAIN ] HNGE: Loaded 19701 existing records. [2025-09-05T18:25:54.672039] [WARN ] [VALIDATOR ] HMN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:54.856141] [INFO ] [MAIN ] HNGE: Found 1 missing trading days. [2025-09-05T18:25:54.872476] [INFO ] [MAIN ] HNGE: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:54.950061] [WARN ] [VALIDATOR ] HMN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:54.950282] [INFO ] [MAIN ] HMN: Combined data validation passed. [2025-09-05T18:25:55.020474] [INFO ] [MAIN ] HMN: Update completed successfully. [2025-09-05T18:25:55.021772] [INFO ] [MAIN ] Update Progress: 1029/2363 symbols completed. HMN took 3.4s. Estimated remaining: 33m 31s. Rate: 39.8 symbols/min [2025-09-05T18:25:55.068545] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-05T18:25:55.206610] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:55.224080] [INFO ] [MAIN ] HNI: Loaded 14302 existing records. [2025-09-05T18:25:55.407803] [INFO ] [MAIN ] HNI: Found 1 missing trading days. [2025-09-05T18:25:55.407945] [INFO ] [MAIN ] HNI: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:55.863504] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-05T18:25:56.255314] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-05T18:25:56.663482] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-05T18:25:57.111673] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:25:57.199838] [INFO ] [MAIN ] HNI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:25:57.201986] [INFO ] [MAIN ] HNI: Combined dataset has 14302 total records. [2025-09-05T18:25:57.202423] [FATAL] [VALIDATOR ] HNI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:25:57.202544] [FATAL] [MAIN ] HNI: Combined data validation failed. [2025-09-05T18:25:57.202591] [WARN ] [MAIN ] HNI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:25:57.202635] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-05T18:25:57.203104] [INFO ] [LOCAL ] HNI: Starting deletion of derivative data. [2025-09-05T18:25:57.205030] [INFO ] [MAIN ] Update Progress: 1030/2363 symbols completed. HNI took 2.2s. Estimated remaining: 33m 30s. Rate: 39.8 symbols/min [2025-09-05T18:25:57.380399] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:57.403427] [INFO ] [MAIN ] HOG: Loaded 24108 existing records. [2025-09-05T18:25:57.468077] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-05T18:25:57.543489] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-05T18:25:57.629511] [INFO ] [MAIN ] HOG: Found 1 missing trading days. [2025-09-05T18:25:57.639911] [INFO ] [MAIN ] HOG: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:57.702717] [INFO ] [MAIN ] HNGE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:25:57.704706] [INFO ] [MAIN ] HNGE: Combined dataset has 19701 total records. [2025-09-05T18:25:57.705292] [FATAL] [VALIDATOR ] HNGE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:25:57.738076] [FATAL] [MAIN ] HNGE: Combined data validation failed. [2025-09-05T18:25:57.738426] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:25:57.738764] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-05T18:25:57.740130] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-05T18:25:57.750759] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-05T18:25:57.753608] [INFO ] [MAIN ] Update Progress: 1031/2363 symbols completed. HNGE took 3.7s. Estimated remaining: 33m 28s. Rate: 39.8 symbols/min [2025-09-05T18:25:57.937184] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:25:57.959040] [INFO ] [MAIN ] HOMB: Loaded 20686 existing records. [2025-09-05T18:25:58.162020] [INFO ] [MAIN ] HOMB: Found 1 missing trading days. [2025-09-05T18:25:58.162189] [INFO ] [MAIN ] HOMB: Need to fetch 1 months: 2025-09 [2025-09-05T18:25:58.263502] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-05T18:25:59.063474] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-05T18:25:59.144719] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:25:59.263458] [INFO ] [MAIN ] HOMB: Adding 342 new records, updating 0 existing records. [2025-09-05T18:25:59.266954] [INFO ] [MAIN ] HOMB: Combined dataset has 21028 total records. [2025-09-05T18:25:59.463300] [WARN ] [VALIDATOR ] HOMB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:25:59.692375] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-05T18:25:59.712488] [WARN ] [VALIDATOR ] HOMB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:25:59.712770] [INFO ] [MAIN ] HOMB: Combined data validation passed. [2025-09-05T18:25:59.846020] [INFO ] [MAIN ] HOMB: Update completed successfully. [2025-09-05T18:25:59.849060] [INFO ] [MAIN ] Update Progress: 1032/2363 symbols completed. HOMB took 2.1s. Estimated remaining: 33m 27s. Rate: 39.8 symbols/min [2025-09-05T18:25:59.870109] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-05T18:26:00.024714] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:00.045569] [INFO ] [MAIN ] HOUS: Loaded 21090 existing records. [2025-09-05T18:26:00.223599] [INFO ] [MAIN ] HOUS: Found 1 missing trading days. [2025-09-05T18:26:00.223781] [INFO ] [MAIN ] HOUS: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:00.663467] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-05T18:26:01.085755] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-05T18:26:01.305532] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:26:01.462790] [INFO ] [MAIN ] HOG: Adding 383 new records, updating 0 existing records. [2025-09-05T18:26:01.463700] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-05T18:26:01.468020] [INFO ] [MAIN ] HOG: Combined dataset has 24491 total records. [2025-09-05T18:26:01.681621] [WARN ] [VALIDATOR ] HOG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:01.891467] [WARN ] [VALIDATOR ] HOG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:01.891760] [INFO ] [MAIN ] HOG: Combined data validation passed. [2025-09-05T18:26:02.048636] [INFO ] [MAIN ] HOG: Update completed successfully. [2025-09-05T18:26:02.070473] [INFO ] [MAIN ] Update Progress: 1033/2363 symbols completed. HOG took 4.9s. Estimated remaining: 33m 26s. Rate: 39.8 symbols/min [2025-09-05T18:26:02.186827] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-05T18:26:02.279247] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-05T18:26:02.282554] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:02.293678] [INFO ] [MAIN ] HOV: Loaded 7885 existing records. [2025-09-05T18:26:02.466879] [INFO ] [MAIN ] HOV: Found 1 missing trading days. [2025-09-05T18:26:02.467079] [INFO ] [MAIN ] HOV: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:02.913123] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:26:03.054968] [INFO ] [MAIN ] HOUS: Adding 363 new records, updating 0 existing records. [2025-09-05T18:26:03.058727] [INFO ] [MAIN ] HOUS: Combined dataset has 21453 total records. [2025-09-05T18:26:03.070853] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-05T18:26:03.241831] [WARN ] [VALIDATOR ] HOUS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:03.432030] [WARN ] [VALIDATOR ] HOUS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:03.432240] [INFO ] [MAIN ] HOUS: Combined data validation passed. [2025-09-05T18:26:03.555500] [INFO ] [MAIN ] HOUS: Update completed successfully. [2025-09-05T18:26:03.558496] [INFO ] [MAIN ] Update Progress: 1034/2363 symbols completed. HOUS took 3.7s. Estimated remaining: 33m 25s. Rate: 39.8 symbols/min [2025-09-05T18:26:03.728950] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:03.771263] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-05T18:26:03.807535] [INFO ] [MAIN ] HP: Loaded 24805 existing records. [2025-09-05T18:26:03.863488] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-05T18:26:03.985819] [INFO ] [MAIN ] HP: Found 1 missing trading days. [2025-09-05T18:26:03.985985] [INFO ] [MAIN ] HP: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:04.663532] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-05T18:26:05.253553] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:26:05.399804] [INFO ] [MAIN ] HP: Adding 367 new records, updating 0 existing records. [2025-09-05T18:26:05.403477] [INFO ] [MAIN ] HP: Combined dataset has 25172 total records. [2025-09-05T18:26:05.468131] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-05T18:26:05.586161] [WARN ] [VALIDATOR ] HP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:05.841445] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-05T18:26:05.866779] [WARN ] [VALIDATOR ] HP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:05.867113] [INFO ] [MAIN ] HP: Combined data validation passed. [2025-09-05T18:26:05.946564] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:26:06.020738] [INFO ] [MAIN ] HOV: Adding 111 new records, updating 0 existing records. [2025-09-05T18:26:06.050695] [INFO ] [MAIN ] HOV: Combined dataset has 7996 total records. [2025-09-05T18:26:06.279343] [INFO ] [MAIN ] HP: Update completed successfully. [2025-09-05T18:26:06.279194] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-05T18:26:06.308071] [INFO ] [MAIN ] Update Progress: 1035/2363 symbols completed. HP took 2.7s. Estimated remaining: 33m 25s. Rate: 39.7 symbols/min [2025-09-05T18:26:06.350180] [WARN ] [VALIDATOR ] HOV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:06.649103] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:06.763716] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-05T18:26:06.796093] [INFO ] [MAIN ] HPE: Loaded 25680 existing records. [2025-09-05T18:26:06.980633] [INFO ] [MAIN ] HPE: Found 1 missing trading days. [2025-09-05T18:26:06.980977] [INFO ] [MAIN ] HPE: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:06.984610] [WARN ] [VALIDATOR ] HOV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:06.984769] [INFO ] [MAIN ] HOV: Combined data validation passed. [2025-09-05T18:26:07.039703] [INFO ] [MAIN ] HOV: Update completed successfully. [2025-09-05T18:26:07.040718] [INFO ] [MAIN ] Update Progress: 1036/2363 symbols completed. HOV took 5.0s. Estimated remaining: 33m 22s. Rate: 39.8 symbols/min [2025-09-05T18:26:07.072179] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-05T18:26:07.226203] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:07.226393] [WARN ] [MAIN ] HPF: No existing data found, performing full refresh instead. [2025-09-05T18:26:07.226523] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-05T18:26:07.226568] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-05T18:26:07.226618] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-05T18:26:07.625823] [INFO ] [REMOTE ] HPF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:26:07.733000] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:26:07.736039] [INFO ] [REMOTE ] HL: Full fetch complete (58345 records). [2025-09-05T18:26:07.877470] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-05T18:26:08.108740] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-05T18:26:08.368799] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-05T18:26:08.409126] [INFO ] [MAIN ] HL: Full history saved. [2025-09-05T18:26:08.409292] [INFO ] [MAIN ] Update Progress: 1037/2363 symbols completed. HL took 29.1s. Estimated remaining: 33m 21s. Rate: 39.8 symbols/min [2025-09-05T18:26:08.443114] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:26:08.570494] [INFO ] [MAIN ] HPE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:26:08.572291] [INFO ] [MAIN ] HPE: Combined dataset has 25680 total records. [2025-09-05T18:26:08.572803] [FATAL] [VALIDATOR ] HPE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:08.572886] [FATAL] [MAIN ] HPE: Combined data validation failed. [2025-09-05T18:26:08.572922] [WARN ] [MAIN ] HPE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:08.572965] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-05T18:26:08.573580] [INFO ] [LOCAL ] HPE: Starting deletion of derivative data. [2025-09-05T18:26:08.576253] [INFO ] [MAIN ] Update Progress: 1038/2363 symbols completed. HPE took 2.2s. Estimated remaining: 33m 17s. Rate: 39.8 symbols/min [2025-09-05T18:26:08.663436] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-05T18:26:09.463512] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-05T18:26:09.663325] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-05T18:26:10.263515] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-05T18:26:10.953617] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-05T18:26:11.063526] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-05T18:26:11.447524] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-05T18:26:11.644635] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-05T18:26:11.863495] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-05T18:26:12.663470] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-05T18:26:13.405887] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-05T18:26:13.463450] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-05T18:26:13.915974] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-05T18:26:14.263514] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-05T18:26:14.311543] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-05T18:26:15.063516] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-05T18:26:16.060781] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-05T18:26:16.063482] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-05T18:26:16.291807] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-05T18:26:16.663542] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-05T18:26:16.840373] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-05T18:26:17.301497] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:26:17.304826] [INFO ] [REMOTE ] HMY: Full fetch complete (57765 records). [2025-09-05T18:26:17.472237] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-05T18:26:17.709845] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-05T18:26:17.969471] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-05T18:26:17.969692] [INFO ] [MAIN ] Update Progress: 1039/2363 symbols completed. HMY took 25.2s. Estimated remaining: 33m 26s. Rate: 39.6 symbols/min [2025-09-05T18:26:18.343492] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-05T18:26:18.345783] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-05T18:26:19.006185] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:26:19.007130] [INFO ] [REMOTE ] HPF: Full fetch complete (7627 records). [2025-09-05T18:26:19.007595] [FATAL] [VALIDATOR ] HPF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:19.007705] [FATAL] [MAIN ] HPF: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:26:19.007758] [WARN ] [MAIN ] HPF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:19.007806] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-05T18:26:19.007972] [INFO ] [LOCAL ] HPF: Starting deletion of derivative data. [2025-09-05T18:26:19.008087] [INFO ] [MAIN ] Update Progress: 1040/2363 symbols completed. HPF took 12.0s. Estimated remaining: 33m 24s. Rate: 39.6 symbols/min [2025-09-05T18:26:19.543358] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:19.664908] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:19.728043] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:19.761157] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:19.764932] [INFO ] [MAIN ] HPS: Loaded 5630 existing records. [2025-09-05T18:26:19.912718] [INFO ] [MAIN ] HPI: Loaded 7281 existing records. [2025-09-05T18:26:19.988435] [INFO ] [MAIN ] HPQ: Loaded 25657 existing records. [2025-09-05T18:26:20.028901] [INFO ] [MAIN ] HPP: Loaded 24874 existing records. [2025-09-05T18:26:20.036973] [INFO ] [MAIN ] HPS: Found 1 missing trading days. [2025-09-05T18:26:20.140883] [INFO ] [MAIN ] HPS: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:20.279208] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-05T18:26:20.481107] [INFO ] [MAIN ] HPI: Found 1 missing trading days. [2025-09-05T18:26:20.573868] [INFO ] [MAIN ] HPQ: Found 1 missing trading days. [2025-09-05T18:26:20.527380] [INFO ] [MAIN ] HPI: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:20.586033] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-05T18:26:20.585493] [INFO ] [MAIN ] HPP: Found 1 missing trading days. [2025-09-05T18:26:20.587246] [INFO ] [MAIN ] HPP: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:20.586121] [INFO ] [MAIN ] HPQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:20.663779] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-05T18:26:21.241488] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:26:21.327969] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:26:21.351819] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:26:21.464957] [INFO ] [MAIN ] HPI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:26:21.470228] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-05T18:26:21.455817] [INFO ] [MAIN ] HPS: Adding 73 new records, updating 0 existing records. [2025-09-05T18:26:21.486389] [INFO ] [MAIN ] HPP: Adding 379 new records, updating 0 existing records. [2025-09-05T18:26:21.489615] [INFO ] [MAIN ] HPI: Combined dataset has 7281 total records. [2025-09-05T18:26:21.490611] [FATAL] [VALIDATOR ] HPI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:21.492352] [INFO ] [MAIN ] HPS: Combined dataset has 5703 total records. [2025-09-05T18:26:21.490805] [FATAL] [MAIN ] HPI: Combined data validation failed. [2025-09-05T18:26:21.492601] [WARN ] [MAIN ] HPI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:21.523412] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-05T18:26:21.564257] [INFO ] [LOCAL ] HPI: Starting deletion of derivative data. [2025-09-05T18:26:21.588457] [INFO ] [MAIN ] Update Progress: 1041/2363 symbols completed. HPI took 2.6s. Estimated remaining: 33m 24s. Rate: 39.6 symbols/min [2025-09-05T18:26:21.600609] [INFO ] [MAIN ] HPP: Combined dataset has 25253 total records. [2025-09-05T18:26:21.865233] [WARN ] [VALIDATOR ] HPS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:22.141376] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:22.146310] [WARN ] [VALIDATOR ] HPP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:22.361579] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:26:22.481552] [INFO ] [MAIN ] HQH: Loaded 19344 existing records. [2025-09-05T18:26:22.737955] [INFO ] [MAIN ] HPQ: Adding 389 new records, updating 0 existing records. [2025-09-05T18:26:22.824190] [INFO ] [MAIN ] HQH: Found 1 missing trading days. [2025-09-05T18:26:22.829070] [INFO ] [MAIN ] HPQ: Combined dataset has 26046 total records. [2025-09-05T18:26:22.828577] [INFO ] [MAIN ] HQH: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:22.866099] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-05T18:26:23.031937] [WARN ] [VALIDATOR ] HPQ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:23.044733] [WARN ] [VALIDATOR ] HPP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:23.044866] [WARN ] [VALIDATOR ] HPS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:23.045169] [INFO ] [MAIN ] HPP: Combined data validation passed. [2025-09-05T18:26:23.045445] [INFO ] [MAIN ] HPS: Combined data validation passed. [2025-09-05T18:26:23.440072] [INFO ] [MAIN ] HPP: Update completed successfully. [2025-09-05T18:26:23.443173] [INFO ] [MAIN ] Update Progress: 1042/2363 symbols completed. HPP took 4.4s. Estimated remaining: 33m 23s. Rate: 39.6 symbols/min [2025-09-05T18:26:23.443346] [INFO ] [MAIN ] HPS: Update completed successfully. [2025-09-05T18:26:23.449680] [INFO ] [MAIN ] Update Progress: 1043/2363 symbols completed. HPS took 4.4s. Estimated remaining: 33m 19s. Rate: 39.6 symbols/min [2025-09-05T18:26:23.785502] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:23.798201] [WARN ] [MAIN ] HQL: No existing data found, performing full refresh instead. [2025-09-05T18:26:23.798397] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-05T18:26:23.792086] [WARN ] [VALIDATOR ] HPQ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:23.798727] [INFO ] [MAIN ] HPQ: Combined data validation passed. [2025-09-05T18:26:23.798501] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-05T18:26:23.818533] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:23.818826] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-05T18:26:24.193749] [INFO ] [MAIN ] HR: Loaded 24927 existing records. [2025-09-05T18:26:24.362455] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-05T18:26:24.456573] [INFO ] [REMOTE ] HQL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:26:24.492879] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-05T18:26:24.576828] [INFO ] [MAIN ] HQH: Adding 181 new records, updating 0 existing records. [2025-09-05T18:26:24.609653] [INFO ] [MAIN ] HR: Found 1 missing trading days. [2025-09-05T18:26:24.610390] [INFO ] [MAIN ] HR: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:24.611634] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-05T18:26:24.620164] [INFO ] [MAIN ] HQH: Combined dataset has 19525 total records. [2025-09-05T18:26:24.846116] [WARN ] [VALIDATOR ] HQH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:26:24.972085] [INFO ] [MAIN ] HPQ: Update completed successfully. [2025-09-05T18:26:24.990248] [INFO ] [MAIN ] Update Progress: 1044/2363 symbols completed. HPQ took 6.0s. Estimated remaining: 33m 18s. Rate: 39.6 symbols/min [2025-09-05T18:26:25.256842] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:25.266080] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:26:25.419493] [INFO ] [MAIN ] HRB: Loaded 23017 existing records. [2025-09-05T18:26:25.468211] [INFO ] [MAIN ] HR: Adding 389 new records, updating 0 existing records. [2025-09-05T18:26:25.572539] [INFO ] [MAIN ] HR: Combined dataset has 25316 total records. [2025-09-05T18:26:25.752854] [INFO ] [MAIN ] HRB: Found 1 missing trading days. [2025-09-05T18:26:25.770054] [INFO ] [MAIN ] HRB: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:25.770669] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-05T18:26:25.783034] [WARN ] [VALIDATOR ] HQH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:26:25.826949] [INFO ] [MAIN ] HQH: Combined data validation passed. [2025-09-05T18:26:25.848975] [WARN ] [VALIDATOR ] HR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:26.142919] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-05T18:26:26.149170] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-05T18:26:26.186813] [INFO ] [MAIN ] HQH: Update completed successfully. [2025-09-05T18:26:26.188957] [INFO ] [MAIN ] Update Progress: 1045/2363 symbols completed. HQH took 4.6s. Estimated remaining: 33m 16s. Rate: 39.6 symbols/min [2025-09-05T18:26:26.365702] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:26.370931] [WARN ] [VALIDATOR ] HR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:26.375374] [INFO ] [MAIN ] HR: Combined data validation passed. [2025-09-05T18:26:26.437885] [INFO ] [MAIN ] HRI: Loaded 15069 existing records. [2025-09-05T18:26:26.600373] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:26:26.688558] [INFO ] [MAIN ] HRI: Found 1 missing trading days. [2025-09-05T18:26:26.708774] [INFO ] [MAIN ] HRI: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:26.721581] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-05T18:26:26.934093] [INFO ] [MAIN ] HRB: Adding 377 new records, updating 729 existing records. [2025-09-05T18:26:26.971677] [INFO ] [MAIN ] HR: Update completed successfully. [2025-09-05T18:26:26.974463] [INFO ] [MAIN ] Update Progress: 1046/2363 symbols completed. HR took 3.5s. Estimated remaining: 33m 13s. Rate: 39.6 symbols/min [2025-09-05T18:26:27.040514] [INFO ] [MAIN ] HRB: Combined dataset has 23394 total records. [2025-09-05T18:26:27.271926] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:27.329168] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:26:27.381329] [WARN ] [VALIDATOR ] HRB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:27.465577] [INFO ] [MAIN ] HRI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:26:27.564398] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-05T18:26:27.562906] [INFO ] [MAIN ] HRI: Combined dataset has 15069 total records. [2025-09-05T18:26:27.615536] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-05T18:26:27.615026] [INFO ] [MAIN ] HRL: Loaded 39961 existing records. [2025-09-05T18:26:27.608087] [FATAL] [VALIDATOR ] HRI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:27.640373] [FATAL] [MAIN ] HRI: Combined data validation failed. [2025-09-05T18:26:27.717807] [WARN ] [MAIN ] HRI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:27.745529] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-05T18:26:27.788735] [INFO ] [LOCAL ] HRI: Starting deletion of derivative data. [2025-09-05T18:26:27.795830] [INFO ] [MAIN ] Update Progress: 1047/2363 symbols completed. HRI took 1.6s. Estimated remaining: 33m 11s. Rate: 39.7 symbols/min [2025-09-05T18:26:27.933262] [INFO ] [MAIN ] HRL: Found 1 missing trading days. [2025-09-05T18:26:27.956728] [INFO ] [MAIN ] HRL: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:27.967382] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-05T18:26:28.060890] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:28.076862] [WARN ] [VALIDATOR ] HRB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:28.077072] [INFO ] [MAIN ] HRB: Combined data validation passed. [2025-09-05T18:26:28.148316] [INFO ] [MAIN ] HRTG: Loaded 25749 existing records. [2025-09-05T18:26:28.365349] [INFO ] [MAIN ] HRTG: Found 1 missing trading days. [2025-09-05T18:26:28.369452] [INFO ] [MAIN ] HRTG: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:28.408554] [INFO ] [MAIN ] HRB: Update completed successfully. [2025-09-05T18:26:28.411209] [INFO ] [MAIN ] Update Progress: 1048/2363 symbols completed. HRB took 3.4s. Estimated remaining: 33m 8s. Rate: 39.7 symbols/min [2025-09-05T18:26:28.607164] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:28.607535] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-09-05T18:26:28.607768] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-05T18:26:28.607832] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-05T18:26:28.607890] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-05T18:26:28.668520] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-05T18:26:28.920405] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:26:29.047982] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:26:29.067863] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-05T18:26:29.193039] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:26:29.241047] [INFO ] [MAIN ] HRL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:26:29.303471] [INFO ] [MAIN ] HRTG: Adding 0 new records, updating 0 existing records. [2025-09-05T18:26:29.305612] [INFO ] [MAIN ] HRTG: Combined dataset has 25749 total records. [2025-09-05T18:26:29.306166] [FATAL] [VALIDATOR ] HRTG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:29.306409] [INFO ] [MAIN ] HRL: Combined dataset has 40351 total records. [2025-09-05T18:26:29.306344] [FATAL] [MAIN ] HRTG: Combined data validation failed. [2025-09-05T18:26:29.306611] [WARN ] [MAIN ] HRTG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:29.306726] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-05T18:26:29.353626] [INFO ] [LOCAL ] HRTG: Starting deletion of derivative data. [2025-09-05T18:26:29.406678] [INFO ] [MAIN ] Update Progress: 1049/2363 symbols completed. HRTG took 1.6s. Estimated remaining: 33m 6s. Rate: 39.7 symbols/min [2025-09-05T18:26:29.478209] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-05T18:26:29.599945] [WARN ] [VALIDATOR ] HRL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:26:29.781784] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:29.815831] [WARN ] [MAIN ] HSHP: No existing data found, performing full refresh instead. [2025-09-05T18:26:29.855545] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-05T18:26:29.875836] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-05T18:26:29.876122] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-05T18:26:30.253752] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:26:30.263442] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-05T18:26:30.264592] [WARN ] [VALIDATOR ] HRL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:26:30.264919] [INFO ] [MAIN ] HRL: Combined data validation passed. [2025-09-05T18:26:30.515572] [INFO ] [MAIN ] HRL: Update completed successfully. [2025-09-05T18:26:30.519594] [INFO ] [MAIN ] Update Progress: 1050/2363 symbols completed. HRL took 3.5s. Estimated remaining: 33m 4s. Rate: 39.7 symbols/min [2025-09-05T18:26:30.690995] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:30.729954] [INFO ] [MAIN ] HSY: Loaded 38131 existing records. [2025-09-05T18:26:30.940279] [INFO ] [MAIN ] HSY: Found 1 missing trading days. [2025-09-05T18:26:30.941442] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-05T18:26:30.941512] [INFO ] [MAIN ] HSY: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:31.063443] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-05T18:26:31.610494] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-05T18:26:31.863493] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-05T18:26:32.300168] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-05T18:26:32.663455] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-05T18:26:33.091748] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-05T18:26:33.463504] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-05T18:26:33.604358] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-05T18:26:34.263467] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-05T18:26:34.801068] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-05T18:26:34.841056] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:26:35.001014] [INFO ] [MAIN ] HSY: Adding 363 new records, updating 0 existing records. [2025-09-05T18:26:35.005597] [INFO ] [MAIN ] HSY: Combined dataset has 38494 total records. [2025-09-05T18:26:35.069280] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-05T18:26:35.209334] [WARN ] [VALIDATOR ] HSY: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:26:35.408688] [WARN ] [VALIDATOR ] HSY: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:26:35.408914] [INFO ] [MAIN ] HSY: Combined data validation passed. [2025-09-05T18:26:35.665519] [INFO ] [MAIN ] HSY: Update completed successfully. [2025-09-05T18:26:35.671459] [INFO ] [MAIN ] Update Progress: 1051/2363 symbols completed. HSY took 5.2s. Estimated remaining: 33m 7s. Rate: 39.6 symbols/min [2025-09-05T18:26:35.850230] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:35.860850] [INFO ] [MAIN ] HTB: Loaded 5171 existing records. [2025-09-05T18:26:35.872049] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-05T18:26:36.037511] [INFO ] [MAIN ] HTB: Found 1 missing trading days. [2025-09-05T18:26:36.037671] [INFO ] [MAIN ] HTB: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:36.663465] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-05T18:26:37.162906] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-05T18:26:37.187478] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-05T18:26:37.463485] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-05T18:26:37.928053] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-05T18:26:38.263474] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-05T18:26:38.332948] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-05T18:26:39.063464] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-05T18:26:39.200498] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-05T18:26:39.863457] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-05T18:26:40.143153] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-05T18:26:40.663461] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-05T18:26:40.944093] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:26:40.945609] [INFO ] [REMOTE ] HQL: Full fetch complete (18244 records). [2025-09-05T18:26:41.467696] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-05T18:26:41.487355] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-05T18:26:41.612361] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-05T18:26:41.612567] [INFO ] [MAIN ] Update Progress: 1052/2363 symbols completed. HQL took 18.2s. Estimated remaining: 33m 11s. Rate: 39.5 symbols/min [2025-09-05T18:26:41.899402] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:41.899831] [WARN ] [MAIN ] HTD: No existing data found, performing full refresh instead. [2025-09-05T18:26:41.900248] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-05T18:26:41.900467] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-05T18:26:41.900582] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-05T18:26:41.941755] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-05T18:26:42.268622] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-05T18:26:42.371265] [INFO ] [REMOTE ] HTD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:26:42.890941] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:26:42.917154] [INFO ] [MAIN ] HTB: Adding 81 new records, updating 0 existing records. [2025-09-05T18:26:42.918904] [INFO ] [MAIN ] HTB: Combined dataset has 5252 total records. [2025-09-05T18:26:43.069327] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-05T18:26:43.097535] [WARN ] [VALIDATOR ] HTB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:26:43.288286] [WARN ] [VALIDATOR ] HTB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:26:43.288512] [INFO ] [MAIN ] HTB: Combined data validation passed. [2025-09-05T18:26:43.322154] [INFO ] [MAIN ] HTB: Update completed successfully. [2025-09-05T18:26:43.322926] [INFO ] [MAIN ] Update Progress: 1053/2363 symbols completed. HTB took 7.7s. Estimated remaining: 33m 10s. Rate: 39.5 symbols/min [2025-09-05T18:26:43.495945] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:43.498020] [INFO ] [MAIN ] HTFC: Loaded 239 existing records. [2025-09-05T18:26:43.673447] [INFO ] [MAIN ] HTFC: Found 2 missing trading days. [2025-09-05T18:26:43.673665] [INFO ] [MAIN ] HTFC: Need to fetch 2 months: 2025-08, 2025-09 [2025-09-05T18:26:43.708119] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-05T18:26:43.863474] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-05T18:26:44.011883] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-05T18:26:44.663516] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-05T18:26:44.995858] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-05T18:26:45.463469] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-05T18:26:45.801926] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-05T18:26:45.804508] [INFO ] [MAIN ] HTFC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:26:45.805407] [INFO ] [MAIN ] HTFC: Combined dataset has 239 total records. [2025-09-05T18:26:45.805744] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:45.805834] [FATAL] [MAIN ] HTFC: Combined data validation failed. [2025-09-05T18:26:45.805891] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:45.805959] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-05T18:26:45.806207] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-05T18:26:45.806494] [INFO ] [MAIN ] Update Progress: 1054/2363 symbols completed. HTFC took 2.5s. Estimated remaining: 33m 10s. Rate: 39.5 symbols/min [2025-09-05T18:26:45.976778] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:45.999544] [INFO ] [MAIN ] HTGC: Loaded 22086 existing records. [2025-09-05T18:26:46.176265] [INFO ] [MAIN ] HTGC: Found 1 missing trading days. [2025-09-05T18:26:46.176438] [INFO ] [MAIN ] HTGC: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:46.207606] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-05T18:26:46.263474] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-05T18:26:47.063483] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-05T18:26:47.674870] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:26:47.786093] [INFO ] [MAIN ] HTGC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:26:47.788138] [INFO ] [MAIN ] HTGC: Combined dataset has 22086 total records. [2025-09-05T18:26:47.788683] [FATAL] [VALIDATOR ] HTGC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:47.788765] [FATAL] [MAIN ] HTGC: Combined data validation failed. [2025-09-05T18:26:47.788803] [WARN ] [MAIN ] HTGC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:47.788848] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-05T18:26:47.789421] [INFO ] [LOCAL ] HTGC: Starting deletion of derivative data. [2025-09-05T18:26:47.792423] [INFO ] [MAIN ] Update Progress: 1055/2363 symbols completed. HTGC took 2.0s. Estimated remaining: 33m 9s. Rate: 39.5 symbols/min [2025-09-05T18:26:47.873039] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-05T18:26:47.971029] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:47.988078] [INFO ] [MAIN ] HTH: Loaded 16393 existing records. [2025-09-05T18:26:48.164737] [INFO ] [MAIN ] HTH: Found 1 missing trading days. [2025-09-05T18:26:48.164941] [INFO ] [MAIN ] HTH: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:48.231415] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-05T18:26:48.663620] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:26:48.663433] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-05T18:26:48.664975] [INFO ] [REMOTE ] HSHP: Full fetch complete (17463 records). [2025-09-05T18:26:49.023373] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-05T18:26:49.091629] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-05T18:26:49.091812] [INFO ] [MAIN ] Update Progress: 1056/2363 symbols completed. HSHP took 19.7s. Estimated remaining: 33m 7s. Rate: 39.5 symbols/min [2025-09-05T18:26:49.263168] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:49.279970] [INFO ] [MAIN ] HUBB: Loaded 16625 existing records. [2025-09-05T18:26:49.452134] [INFO ] [MAIN ] HUBB: Found 1 missing trading days. [2025-09-05T18:26:49.452291] [INFO ] [MAIN ] HUBB: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:49.463424] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-05T18:26:49.936497] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:26:50.012912] [INFO ] [MAIN ] HUBB: Adding 0 new records, updating 0 existing records. [2025-09-05T18:26:50.014528] [INFO ] [MAIN ] HUBB: Combined dataset has 16625 total records. [2025-09-05T18:26:50.014986] [FATAL] [VALIDATOR ] HUBB: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:26:50.015073] [FATAL] [MAIN ] HUBB: Combined data validation failed. [2025-09-05T18:26:50.015108] [WARN ] [MAIN ] HUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:26:50.015145] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-05T18:26:50.015701] [INFO ] [LOCAL ] HUBB: Starting deletion of derivative data. [2025-09-05T18:26:50.017761] [INFO ] [MAIN ] Update Progress: 1057/2363 symbols completed. HUBB took 0.9s. Estimated remaining: 33m 5s. Rate: 39.5 symbols/min [2025-09-05T18:26:50.190315] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:50.212302] [INFO ] [MAIN ] HUBS: Loaded 18849 existing records. [2025-09-05T18:26:50.275131] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-05T18:26:50.389603] [INFO ] [MAIN ] HUBS: Found 1 missing trading days. [2025-09-05T18:26:50.389765] [INFO ] [MAIN ] HUBS: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:50.826388] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:26:50.933164] [INFO ] [MAIN ] HTH: Adding 303 new records, updating 0 existing records. [2025-09-05T18:26:50.949783] [INFO ] [MAIN ] HTH: Combined dataset has 16696 total records. [2025-09-05T18:26:51.068623] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-05T18:26:51.068761] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-05T18:26:51.175900] [WARN ] [VALIDATOR ] HTH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:51.367037] [WARN ] [VALIDATOR ] HTH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:51.367315] [INFO ] [MAIN ] HTH: Combined data validation passed. [2025-09-05T18:26:51.471904] [INFO ] [MAIN ] HTH: Update completed successfully. [2025-09-05T18:26:51.473910] [INFO ] [MAIN ] Update Progress: 1058/2363 symbols completed. HTH took 3.7s. Estimated remaining: 33m 3s. Rate: 39.5 symbols/min [2025-09-05T18:26:51.646260] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:51.646424] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-09-05T18:26:51.646573] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-05T18:26:51.646625] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-05T18:26:51.646730] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-05T18:26:51.868544] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-05T18:26:52.019505] [INFO ] [REMOTE ] HUM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:26:52.028006] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-05T18:26:52.663493] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-05T18:26:53.463472] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-05T18:26:53.863114] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-05T18:26:54.038324] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-05T18:26:54.263488] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-05T18:26:54.498696] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-05T18:26:55.063498] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-05T18:26:55.863505] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-05T18:26:56.570104] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-05T18:26:56.663453] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-05T18:26:56.687818] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-05T18:26:56.768148] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-05T18:26:57.251913] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:26:57.366850] [INFO ] [MAIN ] HUBS: Adding 326 new records, updating 0 existing records. [2025-09-05T18:26:57.370179] [INFO ] [MAIN ] HUBS: Combined dataset has 19175 total records. [2025-09-05T18:26:57.469531] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-05T18:26:57.552851] [WARN ] [VALIDATOR ] HUBS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:26:57.754374] [WARN ] [VALIDATOR ] HUBS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:26:57.754666] [INFO ] [MAIN ] HUBS: Combined data validation passed. [2025-09-05T18:26:57.882153] [INFO ] [MAIN ] HUBS: Update completed successfully. [2025-09-05T18:26:57.884489] [INFO ] [MAIN ] Update Progress: 1059/2363 symbols completed. HUBS took 7.9s. Estimated remaining: 33m 7s. Rate: 39.4 symbols/min [2025-09-05T18:26:58.059005] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:26:58.086418] [INFO ] [MAIN ] HUN: Loaded 25415 existing records. [2025-09-05T18:26:58.266188] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-05T18:26:58.266047] [INFO ] [MAIN ] HUN: Found 1 missing trading days. [2025-09-05T18:26:58.267825] [INFO ] [MAIN ] HUN: Need to fetch 1 months: 2025-09 [2025-09-05T18:26:59.063460] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-05T18:26:59.190628] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-05T18:26:59.469259] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-05T18:26:59.824696] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:26:59.868564] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-05T18:26:59.986844] [INFO ] [MAIN ] HUN: Adding 389 new records, updating 0 existing records. [2025-09-05T18:26:59.992662] [INFO ] [MAIN ] HUN: Combined dataset has 25804 total records. [2025-09-05T18:27:00.241406] [WARN ] [VALIDATOR ] HUN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:27:00.446609] [WARN ] [VALIDATOR ] HUN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:27:00.446846] [INFO ] [MAIN ] HUN: Combined data validation passed. [2025-09-05T18:27:00.608923] [INFO ] [MAIN ] HUN: Update completed successfully. [2025-09-05T18:27:00.612212] [INFO ] [MAIN ] Update Progress: 1060/2363 symbols completed. HUN took 2.7s. Estimated remaining: 33m 7s. Rate: 39.3 symbols/min [2025-09-05T18:27:00.670938] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-05T18:27:00.820771] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:00.847987] [INFO ] [MAIN ] HUYA: Loaded 21292 existing records. [2025-09-05T18:27:01.045902] [INFO ] [MAIN ] HUYA: Found 1 missing trading days. [2025-09-05T18:27:01.046080] [INFO ] [MAIN ] HUYA: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:01.071348] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-05T18:27:01.297361] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:27:01.303089] [INFO ] [REMOTE ] HSBC: Full fetch complete (55387 records). [2025-09-05T18:27:01.305996] [FATAL] [VALIDATOR ] HSBC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:27:01.306184] [FATAL] [MAIN ] HSBC: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:27:01.306254] [WARN ] [MAIN ] HSBC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:27:01.306317] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-05T18:27:01.306404] [INFO ] [LOCAL ] HSBC: Starting deletion of derivative data. [2025-09-05T18:27:01.306533] [INFO ] [MAIN ] Update Progress: 1061/2363 symbols completed. HSBC took 32.9s. Estimated remaining: 33m 5s. Rate: 39.4 symbols/min [2025-09-05T18:27:01.468601] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-05T18:27:01.525972] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:01.540244] [INFO ] [MAIN ] HVT: Loaded 11567 existing records. [2025-09-05T18:27:01.719092] [INFO ] [MAIN ] HVT: Found 1 missing trading days. [2025-09-05T18:27:01.719267] [INFO ] [MAIN ] HVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:02.263516] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-05T18:27:02.334892] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:27:02.474028] [INFO ] [MAIN ] HUYA: Adding 294 new records, updating 0 existing records. [2025-09-05T18:27:02.477190] [INFO ] [MAIN ] HUYA: Combined dataset has 21586 total records. [2025-09-05T18:27:02.661479] [WARN ] [VALIDATOR ] HUYA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:27:02.856404] [WARN ] [VALIDATOR ] HUYA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:27:02.856657] [INFO ] [MAIN ] HUYA: Combined data validation passed. [2025-09-05T18:27:02.983083] [INFO ] [MAIN ] HUYA: Update completed successfully. [2025-09-05T18:27:02.985985] [INFO ] [MAIN ] Update Progress: 1062/2363 symbols completed. HUYA took 2.4s. Estimated remaining: 33m 4s. Rate: 39.4 symbols/min [2025-09-05T18:27:03.068693] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-05T18:27:03.160591] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:03.160786] [WARN ] [MAIN ] HWM: No existing data found, performing full refresh instead. [2025-09-05T18:27:03.160964] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-05T18:27:03.161006] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-05T18:27:03.161059] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-05T18:27:03.331798] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-05T18:27:03.529948] [INFO ] [REMOTE ] HWM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:27:03.863517] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-05T18:27:04.387932] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:27:04.431862] [INFO ] [MAIN ] HVT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:27:04.433260] [INFO ] [MAIN ] HVT: Combined dataset has 11567 total records. [2025-09-05T18:27:04.433679] [FATAL] [VALIDATOR ] HVT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:27:04.433760] [FATAL] [MAIN ] HVT: Combined data validation failed. [2025-09-05T18:27:04.433800] [WARN ] [MAIN ] HVT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:27:04.433840] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-05T18:27:04.434283] [INFO ] [LOCAL ] HVT: Starting deletion of derivative data. [2025-09-05T18:27:04.435856] [INFO ] [MAIN ] Update Progress: 1063/2363 symbols completed. HVT took 3.1s. Estimated remaining: 33m 2s. Rate: 39.4 symbols/min [2025-09-05T18:27:04.609443] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:04.631559] [INFO ] [MAIN ] HXL: Loaded 21738 existing records. [2025-09-05T18:27:04.668620] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-05T18:27:04.810952] [INFO ] [MAIN ] HXL: Found 1 missing trading days. [2025-09-05T18:27:04.811335] [INFO ] [MAIN ] HXL: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:04.839555] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-05T18:27:05.463511] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-05T18:27:06.082166] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:27:06.213001] [INFO ] [MAIN ] HXL: Adding 354 new records, updating 0 existing records. [2025-09-05T18:27:06.216335] [INFO ] [MAIN ] HXL: Combined dataset has 22092 total records. [2025-09-05T18:27:06.268723] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-05T18:27:06.422161] [WARN ] [VALIDATOR ] HXL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:27:06.635003] [WARN ] [VALIDATOR ] HXL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:27:06.635226] [INFO ] [MAIN ] HXL: Combined data validation passed. [2025-09-05T18:27:06.772860] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-05T18:27:06.821054] [INFO ] [MAIN ] HXL: Update completed successfully. [2025-09-05T18:27:06.823760] [INFO ] [MAIN ] Update Progress: 1064/2363 symbols completed. HXL took 2.4s. Estimated remaining: 33m 1s. Rate: 39.3 symbols/min [2025-09-05T18:27:07.005102] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:07.005340] [WARN ] [MAIN ] HY: No existing data found, performing full refresh instead. [2025-09-05T18:27:07.005468] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-05T18:27:07.005509] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-05T18:27:07.005556] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-05T18:27:07.071081] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-05T18:27:07.390983] [INFO ] [REMOTE ] HY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:27:07.863511] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-05T18:27:08.415490] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-05T18:27:08.663529] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-05T18:27:08.744192] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-05T18:27:09.072164] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-05T18:27:09.463528] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-05T18:27:10.263488] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-05T18:27:10.319715] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-05T18:27:10.536562] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-05T18:27:11.063505] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-05T18:27:11.539619] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-05T18:27:11.863482] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-05T18:27:12.663600] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-05T18:27:12.775270] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-05T18:27:12.811366] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-05T18:27:13.463500] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-05T18:27:13.515437] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-05T18:27:14.263537] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-05T18:27:14.304440] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-05T18:27:15.063600] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-05T18:27:15.724411] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:27:15.725711] [INFO ] [REMOTE ] HTD: Full fetch complete (13979 records). [2025-09-05T18:27:15.868672] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-05T18:27:16.099720] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-05T18:27:16.167512] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-05T18:27:16.167720] [INFO ] [MAIN ] Update Progress: 1065/2363 symbols completed. HTD took 34.6s. Estimated remaining: 33m 9s. Rate: 39.1 symbols/min [2025-09-05T18:27:16.368701] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:16.385291] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-05T18:27:16.386470] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-05T18:27:16.388929] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-05T18:27:16.389155] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-05T18:27:16.389258] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-05T18:27:16.668614] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-05T18:27:16.757724] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:27:17.463500] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-05T18:27:18.031385] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-05T18:27:18.263494] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-05T18:27:18.421416] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-05T18:27:18.459510] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-05T18:27:19.063501] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-05T18:27:19.786489] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:27:19.790463] [INFO ] [REMOTE ] HUM: Full fetch complete (52918 records). [2025-09-05T18:27:19.791428] [FATAL] [VALIDATOR ] HUM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:27:19.791519] [FATAL] [MAIN ] HUM: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:27:19.791558] [WARN ] [MAIN ] HUM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:27:19.791604] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-05T18:27:19.791695] [INFO ] [LOCAL ] HUM: Starting deletion of derivative data. [2025-09-05T18:27:19.791793] [INFO ] [MAIN ] Update Progress: 1066/2363 symbols completed. HUM took 28.3s. Estimated remaining: 33m 10s. Rate: 39.1 symbols/min [2025-09-05T18:27:19.868562] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-05T18:27:19.966548] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:19.969132] [INFO ] [MAIN ] HYBX: Loaded 257 existing records. [2025-09-05T18:27:20.141603] [INFO ] [MAIN ] HYBX: Found 1 missing trading days. [2025-09-05T18:27:20.141819] [INFO ] [MAIN ] HYBX: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:20.196759] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-05T18:27:20.364036] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-05T18:27:20.663487] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-05T18:27:21.163044] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:27:21.165995] [INFO ] [MAIN ] HYBX: Adding 1 new records, updating 0 existing records. [2025-09-05T18:27:21.167661] [INFO ] [MAIN ] HYBX: Combined dataset has 258 total records. [2025-09-05T18:27:21.399197] [WARN ] [VALIDATOR ] HYBX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:27:21.468632] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-05T18:27:21.604355] [WARN ] [VALIDATOR ] HYBX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:27:21.604598] [INFO ] [MAIN ] HYBX: Combined data validation passed. [2025-09-05T18:27:21.607808] [INFO ] [MAIN ] HYBX: Update completed successfully. [2025-09-05T18:27:21.607984] [INFO ] [MAIN ] Update Progress: 1067/2363 symbols completed. HYBX took 1.8s. Estimated remaining: 33m 9s. Rate: 39.1 symbols/min [2025-09-05T18:27:21.778003] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:21.786538] [INFO ] [MAIN ] HYI: Loaded 6804 existing records. [2025-09-05T18:27:21.956804] [INFO ] [MAIN ] HYI: Found 1 missing trading days. [2025-09-05T18:27:21.956950] [INFO ] [MAIN ] HYI: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:22.263485] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-05T18:27:22.531133] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-05T18:27:22.579808] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-05T18:27:23.063488] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-05T18:27:23.449272] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-05T18:27:23.863486] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-05T18:27:24.646628] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-05T18:27:24.663418] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-05T18:27:25.463515] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-05T18:27:25.569410] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-05T18:27:25.788903] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-05T18:27:26.263530] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-05T18:27:26.897764] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:27:26.899038] [INFO ] [REMOTE ] HY: Full fetch complete (11263 records). [2025-09-05T18:27:27.070993] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-05T18:27:27.259319] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-05T18:27:27.308764] [INFO ] [MAIN ] HY: Full history saved. [2025-09-05T18:27:27.308918] [INFO ] [MAIN ] Update Progress: 1068/2363 symbols completed. HY took 20.5s. Estimated remaining: 33m 13s. Rate: 39.0 symbols/min [2025-09-05T18:27:27.482064] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:27.498677] [INFO ] [MAIN ] HYT: Loaded 15817 existing records. [2025-09-05T18:27:27.717411] [INFO ] [MAIN ] HYT: Found 1 missing trading days. [2025-09-05T18:27:27.717588] [INFO ] [MAIN ] HYT: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:27.825389] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:27:27.845120] [INFO ] [MAIN ] HYI: Adding 31 new records, updating 0 existing records. [2025-09-05T18:27:27.847331] [INFO ] [MAIN ] HYI: Combined dataset has 6835 total records. [2025-09-05T18:27:27.868562] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-05T18:27:28.034313] [WARN ] [VALIDATOR ] HYI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:27:28.234030] [WARN ] [VALIDATOR ] HYI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:27:28.234265] [INFO ] [MAIN ] HYI: Combined data validation passed. [2025-09-05T18:27:28.281119] [INFO ] [MAIN ] HYI: Update completed successfully. [2025-09-05T18:27:28.282005] [INFO ] [MAIN ] Update Progress: 1069/2363 symbols completed. HYI took 6.7s. Estimated remaining: 33m 11s. Rate: 39.0 symbols/min [2025-09-05T18:27:28.362046] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-05T18:27:28.462616] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:28.465795] [INFO ] [MAIN ] HYTR: Loaded 1354 existing records. [2025-09-05T18:27:28.643115] [INFO ] [MAIN ] HYTR: Found 1 missing trading days. [2025-09-05T18:27:28.643266] [INFO ] [MAIN ] HYTR: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:28.663476] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-05T18:27:29.463491] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-05T18:27:29.937995] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:27:29.946371] [INFO ] [MAIN ] HYTR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:27:29.947872] [INFO ] [MAIN ] HYTR: Combined dataset has 1354 total records. [2025-09-05T18:27:29.948341] [FATAL] [VALIDATOR ] HYTR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:27:29.948425] [FATAL] [MAIN ] HYTR: Combined data validation failed. [2025-09-05T18:27:29.948460] [WARN ] [MAIN ] HYTR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:27:29.948497] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-05T18:27:29.948772] [INFO ] [LOCAL ] HYTR: Starting deletion of derivative data. [2025-09-05T18:27:29.949385] [INFO ] [MAIN ] Update Progress: 1070/2363 symbols completed. HYTR took 1.7s. Estimated remaining: 33m 9s. Rate: 39.0 symbols/min [2025-09-05T18:27:30.172723] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:30.196506] [INFO ] [MAIN ] HZO: Loaded 21933 existing records. [2025-09-05T18:27:30.268617] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-05T18:27:30.387680] [INFO ] [MAIN ] HZO: Found 1 missing trading days. [2025-09-05T18:27:30.387869] [INFO ] [MAIN ] HZO: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:30.729717] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-05T18:27:31.063514] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-05T18:27:31.513688] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:27:31.587223] [INFO ] [MAIN ] HZO: Adding 185 new records, updating 0 existing records. [2025-09-05T18:27:31.590785] [INFO ] [MAIN ] HZO: Combined dataset has 22118 total records. [2025-09-05T18:27:31.732600] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:27:31.809432] [WARN ] [VALIDATOR ] HZO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:27:31.873861] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-05T18:27:31.980454] [INFO ] [MAIN ] HYT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:27:32.030539] [INFO ] [MAIN ] HYT: Combined dataset has 15817 total records. [2025-09-05T18:27:32.063306] [FATAL] [VALIDATOR ] HYT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:27:32.073445] [FATAL] [MAIN ] HYT: Combined data validation failed. [2025-09-05T18:27:32.073730] [WARN ] [MAIN ] HYT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:27:32.073810] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-05T18:27:32.074451] [INFO ] [LOCAL ] HYT: Starting deletion of derivative data. [2025-09-05T18:27:32.076390] [INFO ] [MAIN ] Update Progress: 1071/2363 symbols completed. HYT took 4.8s. Estimated remaining: 33m 8s. Rate: 39.0 symbols/min [2025-09-05T18:27:32.249482] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:32.249950] [WARN ] [MAIN ] IAE: No existing data found, performing full refresh instead. [2025-09-05T18:27:32.250606] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-05T18:27:32.250786] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-05T18:27:32.251043] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-05T18:27:32.608818] [INFO ] [REMOTE ] IAE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:27:32.614089] [WARN ] [VALIDATOR ] HZO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:27:32.614282] [INFO ] [MAIN ] HZO: Combined data validation passed. [2025-09-05T18:27:32.670671] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-05T18:27:32.670918] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-05T18:27:32.753569] [INFO ] [MAIN ] HZO: Update completed successfully. [2025-09-05T18:27:32.756153] [INFO ] [MAIN ] Update Progress: 1072/2363 symbols completed. HZO took 2.8s. Estimated remaining: 33m 6s. Rate: 39.0 symbols/min [2025-09-05T18:27:32.926536] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:32.926761] [WARN ] [MAIN ] IAG: No existing data found, performing full refresh instead. [2025-09-05T18:27:32.926891] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-05T18:27:32.926930] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-05T18:27:32.926981] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-05T18:27:33.285170] [INFO ] [REMOTE ] IAG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:27:33.454283] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-05T18:27:33.463414] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-05T18:27:33.869135] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-05T18:27:34.263492] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-05T18:27:35.063538] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-05T18:27:35.143565] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-05T18:27:35.863486] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-05T18:27:36.663528] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-05T18:27:37.026487] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-05T18:27:37.433635] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-05T18:27:37.463586] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-05T18:27:38.022125] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-05T18:27:38.175918] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-05T18:27:38.263464] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-05T18:27:39.063521] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-05T18:27:39.863449] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-05T18:27:39.863391] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-05T18:27:40.298194] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-05T18:27:40.663455] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-05T18:27:40.888545] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-05T18:27:40.901232] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-05T18:27:41.463471] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-05T18:27:42.263458] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-05T18:27:42.666090] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:27:42.666760] [INFO ] [REMOTE ] HYAC: Full fetch complete (673 records). [2025-09-05T18:27:42.667144] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-03) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:27:42.667222] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:27:42.667259] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:27:42.667296] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-05T18:27:42.667356] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-05T18:27:42.667439] [INFO ] [MAIN ] Update Progress: 1073/2363 symbols completed. HYAC took 26.5s. Estimated remaining: 33m 14s. Rate: 38.8 symbols/min [2025-09-05T18:27:42.840678] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:42.868613] [INFO ] [MAIN ] IBM: Loaded 25664 existing records. [2025-09-05T18:27:43.048381] [INFO ] [MAIN ] IBM: Found 1 missing trading days. [2025-09-05T18:27:43.048522] [INFO ] [MAIN ] IBM: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:43.063566] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-05T18:27:43.374019] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-05T18:27:43.400334] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-05T18:27:43.652862] [INFO ] [MAIN ] IBM: Adding 390 new records, updating 0 existing records. [2025-09-05T18:27:43.658005] [INFO ] [MAIN ] IBM: Combined dataset has 26054 total records. [2025-09-05T18:27:43.853670] [WARN ] [VALIDATOR ] IBM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:27:43.868576] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-05T18:27:44.051633] [WARN ] [VALIDATOR ] IBM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:27:44.051929] [INFO ] [MAIN ] IBM: Combined data validation passed. [2025-09-05T18:27:44.230590] [INFO ] [MAIN ] IBM: Update completed successfully. [2025-09-05T18:27:44.233764] [INFO ] [MAIN ] Update Progress: 1074/2363 symbols completed. IBM took 1.6s. Estimated remaining: 33m 13s. Rate: 38.8 symbols/min [2025-09-05T18:27:44.414424] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:44.438616] [INFO ] [MAIN ] IBN: Loaded 25183 existing records. [2025-09-05T18:27:44.636137] [INFO ] [MAIN ] IBN: Found 1 missing trading days. [2025-09-05T18:27:44.636352] [INFO ] [MAIN ] IBN: Need to fetch 1 months: 2025-09 [2025-09-05T18:27:44.663697] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-05T18:27:45.232570] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:27:45.386596] [INFO ] [MAIN ] IBN: Adding 389 new records, updating 0 existing records. [2025-09-05T18:27:45.390116] [INFO ] [MAIN ] IBN: Combined dataset has 25572 total records. [2025-09-05T18:27:45.468683] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-05T18:27:45.586748] [WARN ] [VALIDATOR ] IBN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:27:45.792532] [WARN ] [VALIDATOR ] IBN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:27:45.792774] [INFO ] [MAIN ] IBN: Combined data validation passed. [2025-09-05T18:27:45.960281] [INFO ] [MAIN ] IBN: Update completed successfully. [2025-09-05T18:27:45.963761] [INFO ] [MAIN ] Update Progress: 1075/2363 symbols completed. IBN took 1.7s. Estimated remaining: 33m 11s. Rate: 38.8 symbols/min [2025-09-05T18:27:46.144306] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:46.144540] [WARN ] [MAIN ] IBP: No existing data found, performing full refresh instead. [2025-09-05T18:27:46.144783] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-05T18:27:46.144854] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-05T18:27:46.144965] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-05T18:27:46.264824] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-05T18:27:46.565227] [INFO ] [REMOTE ] IBP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:27:46.585402] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-05T18:27:47.063523] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-05T18:27:47.095395] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-05T18:27:47.813933] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-05T18:27:47.863457] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-05T18:27:48.335348] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:27:48.338331] [INFO ] [REMOTE ] HWM: Full fetch complete (57702 records). [2025-09-05T18:27:48.668772] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-05T18:27:48.710954] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-05T18:27:48.979019] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-05T18:27:48.979167] [INFO ] [MAIN ] Update Progress: 1076/2363 symbols completed. HWM took 46.0s. Estimated remaining: 33m 12s. Rate: 38.8 symbols/min [2025-09-05T18:27:49.158468] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:27:49.158694] [WARN ] [MAIN ] IBTA: No existing data found, performing full refresh instead. [2025-09-05T18:27:49.158862] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-05T18:27:49.158907] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-05T18:27:49.158954] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-05T18:27:49.467806] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-05T18:27:49.521886] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:27:49.564840] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-05T18:27:49.852394] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-05T18:27:50.237325] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-05T18:27:50.263479] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-05T18:27:50.930969] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-05T18:27:51.063514] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-05T18:27:51.863533] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-05T18:27:52.610991] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-05T18:27:52.663450] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-05T18:27:53.463448] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-05T18:27:53.526086] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-05T18:27:53.948536] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-05T18:27:54.263512] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-05T18:27:54.776298] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-05T18:27:55.063515] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-05T18:27:55.863502] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-05T18:27:55.928059] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-05T18:27:56.184920] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-05T18:27:56.663491] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-05T18:27:57.463475] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-05T18:27:57.496745] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-05T18:27:57.835760] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-05T18:27:58.263492] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-05T18:27:58.876486] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-05T18:27:59.063485] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-05T18:27:59.588504] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-05T18:27:59.863489] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-05T18:28:00.507091] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:28:00.507873] [INFO ] [REMOTE ] IAE: Full fetch complete (6264 records). [2025-09-05T18:28:00.508305] [FATAL] [VALIDATOR ] IAE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:28:00.508379] [FATAL] [MAIN ] IAE: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:28:00.508416] [WARN ] [MAIN ] IAE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:28:00.508454] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-05T18:28:00.508553] [INFO ] [LOCAL ] IAE: Starting deletion of derivative data. [2025-09-05T18:28:00.508703] [INFO ] [MAIN ] Update Progress: 1077/2363 symbols completed. IAE took 28.4s. Estimated remaining: 33m 22s. Rate: 38.5 symbols/min [2025-09-05T18:28:00.663500] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-05T18:28:00.713752] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-05T18:28:01.463526] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-05T18:28:02.053499] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-05T18:28:02.263489] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-05T18:28:03.000079] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-05T18:28:03.063454] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-05T18:28:03.817930] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-05T18:28:03.863417] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-05T18:28:04.581190] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-05T18:28:04.663522] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-05T18:28:04.839949] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-05T18:28:05.463464] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-05T18:28:05.971520] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:28:05.973373] [INFO ] [REMOTE ] IBP: Full fetch complete (32025 records). [2025-09-05T18:28:06.267271] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-05T18:28:06.345337] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-05T18:28:06.476786] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-05T18:28:06.534178] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-05T18:28:06.534347] [INFO ] [MAIN ] Update Progress: 1078/2363 symbols completed. IBP took 20.6s. Estimated remaining: 33m 26s. Rate: 38.4 symbols/min [2025-09-05T18:28:07.063481] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-05T18:28:08.506147] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-05T18:28:08.517636] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-05T18:28:08.697064] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-05T18:28:08.699735] [INFO ] [REMOTE ] IBTA: Full fetch complete (39377 records). [2025-09-05T18:28:09.063837] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-05T18:28:09.226671] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-05T18:28:09.226841] [INFO ] [MAIN ] Update Progress: 1079/2363 symbols completed. IBTA took 20.2s. Estimated remaining: 33m 26s. Rate: 38.4 symbols/min [2025-09-05T18:28:09.661433] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:28:09.665298] [INFO ] [REMOTE ] IAG: Full fetch complete (58084 records). [2025-09-05T18:28:10.033840] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-05T18:28:10.277241] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-05T18:28:10.277387] [INFO ] [MAIN ] Update Progress: 1080/2363 symbols completed. IAG took 37.5s. Estimated remaining: 33m 23s. Rate: 38.4 symbols/min [2025-09-05T18:28:10.865239] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:10.900449] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:10.947755] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:10.979170] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:10.990763] [INFO ] [MAIN ] IDE: Loaded 4422 existing records. [2025-09-05T18:28:11.126260] [INFO ] [MAIN ] ICL: Loaded 18116 existing records. [2025-09-05T18:28:11.127007] [INFO ] [MAIN ] IDA: Loaded 16202 existing records. [2025-09-05T18:28:11.317123] [INFO ] [MAIN ] IDE: Found 1 missing trading days. [2025-09-05T18:28:11.317836] [INFO ] [MAIN ] ICE: Loaded 25194 existing records. [2025-09-05T18:28:11.377053] [INFO ] [MAIN ] IDE: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:11.454350] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-05T18:28:11.601773] [INFO ] [MAIN ] IDA: Found 1 missing trading days. [2025-09-05T18:28:11.646863] [INFO ] [MAIN ] IDA: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:11.673883] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-05T18:28:11.689638] [INFO ] [MAIN ] ICL: Found 1 missing trading days. [2025-09-05T18:28:11.714546] [INFO ] [MAIN ] ICL: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:11.720786] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-05T18:28:11.751530] [INFO ] [MAIN ] ICE: Found 1 missing trading days. [2025-09-05T18:28:11.751676] [INFO ] [MAIN ] ICE: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:11.751913] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-05T18:28:12.316779] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:28:12.395089] [INFO ] [MAIN ] IDA: Adding 186 new records, updating 0 existing records. [2025-09-05T18:28:12.397754] [INFO ] [MAIN ] IDA: Combined dataset has 16388 total records. [2025-09-05T18:28:12.582134] [WARN ] [VALIDATOR ] IDA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:12.784618] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:28:12.919106] [INFO ] [MAIN ] ICL: Adding 281 new records, updating 0 existing records. [2025-09-05T18:28:12.931923] [INFO ] [MAIN ] ICL: Combined dataset has 18397 total records. [2025-09-05T18:28:12.946876] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-05T18:28:12.996259] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:28:13.120440] [INFO ] [MAIN ] IDE: Adding 87 new records, updating 0 existing records. [2025-09-05T18:28:13.181496] [INFO ] [MAIN ] IDE: Combined dataset has 4509 total records. [2025-09-05T18:28:13.277053] [WARN ] [VALIDATOR ] ICL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:13.465813] [INFO ] [MAIN ] ICE: Adding 386 new records, updating 0 existing records. [2025-09-05T18:28:13.708214] [INFO ] [MAIN ] ICE: Combined dataset has 25580 total records. [2025-09-05T18:28:13.730495] [WARN ] [VALIDATOR ] IDE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:14.053849] [WARN ] [VALIDATOR ] ICE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:14.229025] [WARN ] [VALIDATOR ] IDA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:14.253240] [INFO ] [MAIN ] IDA: Combined data validation passed. [2025-09-05T18:28:14.433496] [INFO ] [MAIN ] IDA: Update completed successfully. [2025-09-05T18:28:14.441529] [INFO ] [MAIN ] Update Progress: 1081/2363 symbols completed. IDA took 4.2s. Estimated remaining: 33m 25s. Rate: 38.4 symbols/min [2025-09-05T18:28:14.542981] [WARN ] [VALIDATOR ] IDE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:14.543200] [WARN ] [VALIDATOR ] ICE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:14.543279] [WARN ] [VALIDATOR ] ICL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:14.549990] [INFO ] [MAIN ] ICL: Combined data validation passed. [2025-09-05T18:28:14.554383] [INFO ] [MAIN ] ICE: Combined data validation passed. [2025-09-05T18:28:14.549816] [INFO ] [MAIN ] IDE: Combined data validation passed. [2025-09-05T18:28:14.845680] [INFO ] [MAIN ] IDE: Update completed successfully. [2025-09-05T18:28:14.860300] [INFO ] [MAIN ] Update Progress: 1082/2363 symbols completed. IDE took 4.6s. Estimated remaining: 33m 22s. Rate: 38.4 symbols/min [2025-09-05T18:28:14.859577] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:15.013600] [INFO ] [MAIN ] ICL: Update completed successfully. [2025-09-05T18:28:15.015609] [INFO ] [MAIN ] Update Progress: 1083/2363 symbols completed. ICL took 4.7s. Estimated remaining: 33m 19s. Rate: 38.4 symbols/min [2025-09-05T18:28:15.058259] [INFO ] [MAIN ] IDT: Loaded 8813 existing records. [2025-09-05T18:28:15.182047] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:15.513818] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:15.510039] [INFO ] [MAIN ] IDT: Found 1 missing trading days. [2025-09-05T18:28:15.521759] [INFO ] [MAIN ] IDT: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:15.522358] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-05T18:28:15.523564] [INFO ] [MAIN ] IEX: Loaded 18565 existing records. [2025-09-05T18:28:15.582029] [INFO ] [MAIN ] ICE: Update completed successfully. [2025-09-05T18:28:15.622435] [INFO ] [MAIN ] Update Progress: 1084/2363 symbols completed. ICE took 5.3s. Estimated remaining: 33m 16s. Rate: 38.4 symbols/min [2025-09-05T18:28:15.817539] [INFO ] [MAIN ] IFF: Loaded 24274 existing records. [2025-09-05T18:28:15.827825] [INFO ] [MAIN ] IEX: Found 1 missing trading days. [2025-09-05T18:28:15.858670] [INFO ] [MAIN ] IEX: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:15.906772] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-05T18:28:15.989569] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:16.012946] [WARN ] [MAIN ] IFN: No existing data found, performing full refresh instead. [2025-09-05T18:28:16.053614] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-05T18:28:16.084139] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-05T18:28:16.091609] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-05T18:28:16.091549] [INFO ] [MAIN ] IFF: Found 1 missing trading days. [2025-09-05T18:28:16.133614] [INFO ] [MAIN ] IFF: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:16.170434] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-05T18:28:16.371269] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:28:16.488255] [INFO ] [MAIN ] IDT: Adding 146 new records, updating 0 existing records. [2025-09-05T18:28:16.492854] [INFO ] [REMOTE ] IFN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:28:16.493163] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-05T18:28:16.495983] [INFO ] [MAIN ] IDT: Combined dataset has 8959 total records. [2025-09-05T18:28:16.673157] [WARN ] [VALIDATOR ] IDT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:16.822118] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:28:17.001064] [INFO ] [MAIN ] IEX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:28:17.009602] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:28:17.019242] [INFO ] [MAIN ] IEX: Combined dataset has 18565 total records. [2025-09-05T18:28:17.034387] [FATAL] [VALIDATOR ] IEX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:28:17.037139] [FATAL] [MAIN ] IEX: Combined data validation failed. [2025-09-05T18:28:17.037455] [WARN ] [MAIN ] IEX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:28:17.037704] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-05T18:28:17.053559] [INFO ] [LOCAL ] IEX: Starting deletion of derivative data. [2025-09-05T18:28:17.081028] [INFO ] [MAIN ] Update Progress: 1085/2363 symbols completed. IEX took 2.2s. Estimated remaining: 33m 14s. Rate: 38.4 symbols/min [2025-09-05T18:28:17.182793] [INFO ] [MAIN ] IFF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:28:17.246530] [INFO ] [MAIN ] IFF: Combined dataset has 24274 total records. [2025-09-05T18:28:17.268629] [FATAL] [VALIDATOR ] IFF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:28:17.274128] [FATAL] [MAIN ] IFF: Combined data validation failed. [2025-09-05T18:28:17.295215] [WARN ] [MAIN ] IFF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:28:17.295861] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-05T18:28:17.322590] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:17.304502] [INFO ] [LOCAL ] IFF: Starting deletion of derivative data. [2025-09-05T18:28:17.326388] [INFO ] [MAIN ] Update Progress: 1086/2363 symbols completed. IFF took 2.3s. Estimated remaining: 33m 11s. Rate: 38.5 symbols/min [2025-09-05T18:28:17.441279] [INFO ] [MAIN ] IFS: Loaded 10705 existing records. [2025-09-05T18:28:17.598931] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:17.690970] [INFO ] [MAIN ] IFS: Found 1 missing trading days. [2025-09-05T18:28:17.694477] [INFO ] [MAIN ] IGA: Loaded 7227 existing records. [2025-09-05T18:28:17.694591] [INFO ] [MAIN ] IFS: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:17.705730] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-05T18:28:17.871771] [INFO ] [MAIN ] IGA: Found 1 missing trading days. [2025-09-05T18:28:17.871951] [INFO ] [MAIN ] IGA: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:17.872215] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-05T18:28:17.873846] [WARN ] [VALIDATOR ] IDT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:17.874065] [INFO ] [MAIN ] IDT: Combined data validation passed. [2025-09-05T18:28:17.928458] [INFO ] [MAIN ] IDT: Update completed successfully. [2025-09-05T18:28:17.929543] [INFO ] [MAIN ] Update Progress: 1087/2363 symbols completed. IDT took 3.5s. Estimated remaining: 33m 9s. Rate: 38.5 symbols/min [2025-09-05T18:28:18.100942] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:18.111195] [INFO ] [MAIN ] IGD: Loaded 9499 existing records. [2025-09-05T18:28:18.282992] [INFO ] [MAIN ] IGD: Found 1 missing trading days. [2025-09-05T18:28:18.283138] [INFO ] [MAIN ] IGD: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:18.283352] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-05T18:28:18.411722] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-05T18:28:18.417414] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-05T18:28:19.032840] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T18:28:19.092435] [INFO ] [MAIN ] IFS: Adding 116 new records, updating 0 existing records. [2025-09-05T18:28:19.094523] [INFO ] [MAIN ] IFS: Combined dataset has 10821 total records. [2025-09-05T18:28:19.272933] [WARN ] [VALIDATOR ] IFS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:19.461501] [WARN ] [VALIDATOR ] IFS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:19.461728] [INFO ] [MAIN ] IFS: Combined data validation passed. [2025-09-05T18:28:19.538160] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-05T18:28:19.545927] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-05T18:28:19.555402] [INFO ] [MAIN ] IFS: Update completed successfully. [2025-09-05T18:28:19.556823] [INFO ] [MAIN ] Update Progress: 1088/2363 symbols completed. IFS took 2.5s. Estimated remaining: 33m 7s. Rate: 38.5 symbols/min [2025-09-05T18:28:19.726474] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:19.730721] [INFO ] [MAIN ] IGI: Loaded 2253 existing records. [2025-09-05T18:28:19.833007] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-05T18:28:19.896959] [INFO ] [MAIN ] IGA: Adding 107 new records, updating 0 existing records. [2025-09-05T18:28:19.927931] [INFO ] [MAIN ] IGI: Found 1 missing trading days. [2025-09-05T18:28:19.928078] [INFO ] [MAIN ] IGI: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:19.928299] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-05T18:28:19.929344] [INFO ] [MAIN ] IGA: Combined dataset has 7334 total records. [2025-09-05T18:28:20.111095] [WARN ] [VALIDATOR ] IGA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:28:20.300841] [WARN ] [VALIDATOR ] IGA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:28:20.301061] [INFO ] [MAIN ] IGA: Combined data validation passed. [2025-09-05T18:28:20.345690] [INFO ] [MAIN ] IGA: Update completed successfully. [2025-09-05T18:28:20.346712] [INFO ] [MAIN ] Update Progress: 1089/2363 symbols completed. IGA took 3.0s. Estimated remaining: 33m 5s. Rate: 38.5 symbols/min [2025-09-05T18:28:20.451513] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-05T18:28:20.511198] [INFO ] [MAIN ] IGD: Adding 83 new records, updating 0 existing records. [2025-09-05T18:28:20.557379] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:20.558419] [INFO ] [MAIN ] IGD: Combined dataset has 9582 total records. [2025-09-05T18:28:20.730212] [INFO ] [MAIN ] IGR: Loaded 15225 existing records. [2025-09-05T18:28:20.750994] [WARN ] [VALIDATOR ] IGD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:20.992724] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-05T18:28:21.115757] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-05T18:28:21.121566] [INFO ] [MAIN ] IGR: Found 1 missing trading days. [2025-09-05T18:28:21.122525] [INFO ] [MAIN ] IGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:21.123460] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-05T18:28:21.134419] [WARN ] [VALIDATOR ] IGD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:21.134613] [INFO ] [MAIN ] IGD: Combined data validation passed. [2025-09-05T18:28:21.191274] [INFO ] [MAIN ] IGD: Update completed successfully. [2025-09-05T18:28:21.192542] [INFO ] [MAIN ] Update Progress: 1090/2363 symbols completed. IGD took 3.3s. Estimated remaining: 33m 2s. Rate: 38.5 symbols/min [2025-09-05T18:28:21.362529] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:21.365680] [INFO ] [MAIN ] IH: Loaded 1631 existing records. [2025-09-05T18:28:21.534165] [INFO ] [MAIN ] IH: Found 1 missing trading days. [2025-09-05T18:28:21.534307] [INFO ] [MAIN ] IH: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:21.534511] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-05T18:28:21.701587] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-05T18:28:21.710636] [INFO ] [MAIN ] IGI: Adding 18 new records, updating 0 existing records. [2025-09-05T18:28:21.712039] [INFO ] [MAIN ] IGI: Combined dataset has 2271 total records. [2025-09-05T18:28:21.917545] [WARN ] [VALIDATOR ] IGI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:22.131786] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-05T18:28:22.146296] [WARN ] [VALIDATOR ] IGI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:22.146510] [INFO ] [MAIN ] IGI: Combined data validation passed. [2025-09-05T18:28:22.161585] [INFO ] [MAIN ] IGI: Update completed successfully. [2025-09-05T18:28:22.162012] [INFO ] [MAIN ] Update Progress: 1091/2363 symbols completed. IGI took 2.6s. Estimated remaining: 33m 0s. Rate: 38.5 symbols/min [2025-09-05T18:28:22.273196] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-05T18:28:22.354942] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:22.359980] [INFO ] [MAIN ] IHD: Loaded 3044 existing records. [2025-09-05T18:28:22.550762] [INFO ] [MAIN ] IHD: Found 1 missing trading days. [2025-09-05T18:28:22.550888] [INFO ] [MAIN ] IHD: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:23.063485] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-05T18:28:23.373025] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-05T18:28:23.462117] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-05T18:28:23.481466] [INFO ] [MAIN ] IH: Adding 4 new records, updating 0 existing records. [2025-09-05T18:28:23.484092] [INFO ] [MAIN ] IH: Combined dataset has 1635 total records. [2025-09-05T18:28:23.670192] [WARN ] [VALIDATOR ] IH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:23.857979] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-05T18:28:23.866816] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-05T18:28:23.949072] [INFO ] [MAIN ] IGR: Adding 216 new records, updating 0 existing records. [2025-09-05T18:28:23.953298] [INFO ] [MAIN ] IGR: Combined dataset has 15441 total records. [2025-09-05T18:28:24.132557] [WARN ] [VALIDATOR ] IGR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:24.326737] [WARN ] [VALIDATOR ] IH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:24.327027] [INFO ] [MAIN ] IH: Combined data validation passed. [2025-09-05T18:28:24.338058] [INFO ] [MAIN ] IH: Update completed successfully. [2025-09-05T18:28:24.338549] [INFO ] [MAIN ] Update Progress: 1092/2363 symbols completed. IH took 3.1s. Estimated remaining: 32m 59s. Rate: 38.5 symbols/min [2025-09-05T18:28:24.443047] [WARN ] [VALIDATOR ] IGR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:24.443229] [INFO ] [MAIN ] IGR: Combined data validation passed. [2025-09-05T18:28:24.561917] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:24.614170] [INFO ] [MAIN ] IHG: Loaded 11063 existing records. [2025-09-05T18:28:24.654454] [INFO ] [MAIN ] IGR: Update completed successfully. [2025-09-05T18:28:24.689987] [INFO ] [MAIN ] Update Progress: 1093/2363 symbols completed. IGR took 4.3s. Estimated remaining: 32m 56s. Rate: 38.6 symbols/min [2025-09-05T18:28:24.921395] [INFO ] [MAIN ] IHG: Found 1 missing trading days. [2025-09-05T18:28:24.921592] [INFO ] [MAIN ] IHG: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:24.952023] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-05T18:28:24.983189] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:24.992882] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-05T18:28:25.011037] [INFO ] [MAIN ] IHS: Loaded 18655 existing records. [2025-09-05T18:28:25.185098] [INFO ] [MAIN ] IHS: Found 1 missing trading days. [2025-09-05T18:28:25.185885] [INFO ] [MAIN ] IHS: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:25.261494] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-05T18:28:25.275956] [INFO ] [MAIN ] IHD: Adding 39 new records, updating 0 existing records. [2025-09-05T18:28:25.277562] [INFO ] [MAIN ] IHD: Combined dataset has 3083 total records. [2025-09-05T18:28:25.456795] [WARN ] [VALIDATOR ] IHD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:25.468679] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-05T18:28:25.653727] [WARN ] [VALIDATOR ] IHD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:25.653961] [INFO ] [MAIN ] IHD: Combined data validation passed. [2025-09-05T18:28:25.673846] [INFO ] [MAIN ] IHD: Update completed successfully. [2025-09-05T18:28:25.674547] [INFO ] [MAIN ] Update Progress: 1094/2363 symbols completed. IHD took 3.5s. Estimated remaining: 32m 54s. Rate: 38.6 symbols/min [2025-09-05T18:28:25.849746] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:25.854263] [INFO ] [MAIN ] IIF: Loaded 2638 existing records. [2025-09-05T18:28:26.023450] [INFO ] [MAIN ] IIF: Found 1 missing trading days. [2025-09-05T18:28:26.023692] [INFO ] [MAIN ] IIF: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:26.177864] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T18:28:26.241170] [INFO ] [MAIN ] IHG: Adding 229 new records, updating 0 existing records. [2025-09-05T18:28:26.243422] [INFO ] [MAIN ] IHG: Combined dataset has 11292 total records. [2025-09-05T18:28:26.274116] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-05T18:28:26.422459] [WARN ] [VALIDATOR ] IHG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:26.612980] [WARN ] [VALIDATOR ] IHG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:26.613205] [INFO ] [MAIN ] IHG: Combined data validation passed. [2025-09-05T18:28:26.688800] [INFO ] [MAIN ] IHG: Update completed successfully. [2025-09-05T18:28:26.690224] [INFO ] [MAIN ] Update Progress: 1095/2363 symbols completed. IHG took 2.4s. Estimated remaining: 32m 52s. Rate: 38.6 symbols/min [2025-09-05T18:28:26.863687] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:26.872370] [INFO ] [MAIN ] IIIN: Loaded 7413 existing records. [2025-09-05T18:28:26.995040] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T18:28:27.099122] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-05T18:28:27.106737] [INFO ] [MAIN ] IIIN: Found 1 missing trading days. [2025-09-05T18:28:27.112067] [INFO ] [MAIN ] IIIN: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:27.224902] [INFO ] [MAIN ] IHS: Adding 214 new records, updating 0 existing records. [2025-09-05T18:28:27.230136] [INFO ] [MAIN ] IHS: Combined dataset has 18869 total records. [2025-09-05T18:28:27.526476] [WARN ] [VALIDATOR ] IHS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:27.686897] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-05T18:28:27.847314] [WARN ] [VALIDATOR ] IHS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:27.847601] [INFO ] [MAIN ] IHS: Combined data validation passed. [2025-09-05T18:28:27.908945] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-05T18:28:27.997907] [INFO ] [MAIN ] IHS: Update completed successfully. [2025-09-05T18:28:28.001331] [INFO ] [MAIN ] Update Progress: 1096/2363 symbols completed. IHS took 3.3s. Estimated remaining: 32m 50s. Rate: 38.6 symbols/min [2025-09-05T18:28:28.280931] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:28.290422] [INFO ] [MAIN ] IIM: Loaded 7586 existing records. [2025-09-05T18:28:28.484614] [INFO ] [MAIN ] IIM: Found 1 missing trading days. [2025-09-05T18:28:28.484768] [INFO ] [MAIN ] IIM: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:28.639922] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:28:28.654496] [INFO ] [MAIN ] IIF: Adding 9 new records, updating 0 existing records. [2025-09-05T18:28:28.655793] [INFO ] [MAIN ] IIF: Combined dataset has 2647 total records. [2025-09-05T18:28:28.668716] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-05T18:28:28.833040] [WARN ] [VALIDATOR ] IIF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:29.018375] [WARN ] [VALIDATOR ] IIF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:29.018593] [INFO ] [MAIN ] IIF: Combined data validation passed. [2025-09-05T18:28:29.035650] [INFO ] [MAIN ] IIF: Update completed successfully. [2025-09-05T18:28:29.036090] [INFO ] [MAIN ] Update Progress: 1097/2363 symbols completed. IIF took 3.4s. Estimated remaining: 32m 48s. Rate: 38.6 symbols/min [2025-09-05T18:28:29.207075] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:29.221185] [INFO ] [MAIN ] IIPR: Loaded 13897 existing records. [2025-09-05T18:28:29.394630] [INFO ] [MAIN ] IIPR: Found 1 missing trading days. [2025-09-05T18:28:29.394774] [INFO ] [MAIN ] IIPR: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:29.463421] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-05T18:28:29.512372] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-05T18:28:30.263551] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-05T18:28:30.332224] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:28:30.404632] [INFO ] [MAIN ] IIPR: Adding 187 new records, updating 0 existing records. [2025-09-05T18:28:30.407273] [INFO ] [MAIN ] IIPR: Combined dataset has 14084 total records. [2025-09-05T18:28:30.592330] [WARN ] [VALIDATOR ] IIPR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:30.699096] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-05T18:28:30.836419] [INFO ] [MAIN ] IIM: Adding 188 new records, updating 0 existing records. [2025-09-05T18:28:30.840320] [INFO ] [MAIN ] IIM: Combined dataset has 7774 total records. [2025-09-05T18:28:31.034873] [WARN ] [VALIDATOR ] IIM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:31.051705] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:28:31.070155] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-05T18:28:31.123168] [INFO ] [REMOTE ] IFN: Full fetch complete (20700 records). [2025-09-05T18:28:31.666892] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-05T18:28:31.667414] [WARN ] [VALIDATOR ] IIPR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:31.667742] [INFO ] [MAIN ] IIPR: Combined data validation passed. [2025-09-05T18:28:31.804865] [WARN ] [VALIDATOR ] IIM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:31.807277] [INFO ] [MAIN ] IIM: Combined data validation passed. [2025-09-05T18:28:31.876291] [INFO ] [MAIN ] IIM: Update completed successfully. [2025-09-05T18:28:31.879250] [INFO ] [MAIN ] Update Progress: 1098/2363 symbols completed. IIM took 3.9s. Estimated remaining: 32m 48s. Rate: 38.6 symbols/min [2025-09-05T18:28:31.916493] [INFO ] [MAIN ] IIPR: Update completed successfully. [2025-09-05T18:28:31.930880] [INFO ] [MAIN ] Update Progress: 1099/2363 symbols completed. IIPR took 2.9s. Estimated remaining: 32m 45s. Rate: 38.6 symbols/min [2025-09-05T18:28:32.028475] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:28:32.164776] [INFO ] [MAIN ] IIIN: Adding 68 new records, updating 0 existing records. [2025-09-05T18:28:32.214404] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:32.268145] [INFO ] [MAIN ] IIIN: Combined dataset has 7481 total records. [2025-09-05T18:28:32.289996] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:32.291371] [WARN ] [MAIN ] INFA: No existing data found, performing full refresh instead. [2025-09-05T18:28:32.326964] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-05T18:28:32.351290] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-05T18:28:32.383182] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-05T18:28:32.441102] [INFO ] [MAIN ] IMAX: Loaded 20649 existing records. [2025-09-05T18:28:32.474072] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-05T18:28:32.525789] [INFO ] [MAIN ] Update Progress: 1100/2363 symbols completed. IFN took 16.9s. Estimated remaining: 32m 42s. Rate: 38.6 symbols/min [2025-09-05T18:28:32.682539] [WARN ] [VALIDATOR ] IIIN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:33.200879] [INFO ] [MAIN ] IMAX: Found 1 missing trading days. [2025-09-05T18:28:33.236025] [INFO ] [MAIN ] IMAX: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:33.220487] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:33.286436] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-05T18:28:33.345052] [INFO ] [REMOTE ] INFA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:28:33.385758] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-05T18:28:33.410552] [INFO ] [MAIN ] INFY: Loaded 25618 existing records. [2025-09-05T18:28:33.596366] [INFO ] [MAIN ] INFY: Found 1 missing trading days. [2025-09-05T18:28:33.596680] [INFO ] [MAIN ] INFY: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:33.597089] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-05T18:28:33.600740] [WARN ] [VALIDATOR ] IIIN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:33.600925] [INFO ] [MAIN ] IIIN: Combined data validation passed. [2025-09-05T18:28:33.648716] [INFO ] [MAIN ] IIIN: Update completed successfully. [2025-09-05T18:28:33.649827] [INFO ] [MAIN ] Update Progress: 1101/2363 symbols completed. IIIN took 7.0s. Estimated remaining: 32m 40s. Rate: 38.6 symbols/min [2025-09-05T18:28:33.825285] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:33.849248] [INFO ] [MAIN ] ING: Loaded 24153 existing records. [2025-09-05T18:28:34.028980] [INFO ] [MAIN ] ING: Found 1 missing trading days. [2025-09-05T18:28:34.029138] [INFO ] [MAIN ] ING: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:34.263431] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-05T18:28:34.720791] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:28:34.852944] [INFO ] [MAIN ] IMAX: Adding 331 new records, updating 0 existing records. [2025-09-05T18:28:34.857128] [INFO ] [MAIN ] IMAX: Combined dataset has 20980 total records. [2025-09-05T18:28:35.074854] [WARN ] [VALIDATOR ] IMAX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:35.172906] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-05T18:28:35.194465] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-05T18:28:35.203375] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-05T18:28:35.422404] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:28:35.485466] [INFO ] [MAIN ] INFY: Adding 390 new records, updating 0 existing records. [2025-09-05T18:28:35.605324] [INFO ] [MAIN ] ING: Adding 357 new records, updating 0 existing records. [2025-09-05T18:28:35.606979] [INFO ] [MAIN ] INFY: Combined dataset has 26008 total records. [2025-09-05T18:28:35.702563] [INFO ] [MAIN ] ING: Combined dataset has 24510 total records. [2025-09-05T18:28:35.870248] [WARN ] [VALIDATOR ] INFY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:36.070923] [WARN ] [VALIDATOR ] ING: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:36.380017] [WARN ] [VALIDATOR ] IMAX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:36.387837] [INFO ] [MAIN ] IMAX: Combined data validation passed. [2025-09-05T18:28:36.385749] [WARN ] [VALIDATOR ] INFY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:36.387985] [WARN ] [VALIDATOR ] ING: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:36.388739] [INFO ] [MAIN ] INFY: Combined data validation passed. [2025-09-05T18:28:36.388868] [INFO ] [MAIN ] ING: Combined data validation passed. [2025-09-05T18:28:36.718540] [INFO ] [MAIN ] IMAX: Update completed successfully. [2025-09-05T18:28:36.723438] [INFO ] [MAIN ] Update Progress: 1102/2363 symbols completed. IMAX took 4.8s. Estimated remaining: 32m 40s. Rate: 38.6 symbols/min [2025-09-05T18:28:36.924808] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:36.984270] [INFO ] [MAIN ] INGM: Loaded 12966 existing records. [2025-09-05T18:28:37.014081] [INFO ] [MAIN ] INFY: Update completed successfully. [2025-09-05T18:28:37.018171] [INFO ] [MAIN ] Update Progress: 1103/2363 symbols completed. INFY took 4.5s. Estimated remaining: 32m 37s. Rate: 38.6 symbols/min [2025-09-05T18:28:37.305105] [INFO ] [MAIN ] INGM: Found 1 missing trading days. [2025-09-05T18:28:37.351727] [INFO ] [MAIN ] INGM: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:37.377730] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:37.375411] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-05T18:28:37.382528] [INFO ] [MAIN ] ING: Update completed successfully. [2025-09-05T18:28:37.385232] [INFO ] [MAIN ] Update Progress: 1104/2363 symbols completed. ING took 3.7s. Estimated remaining: 32m 34s. Rate: 38.7 symbols/min [2025-09-05T18:28:37.510711] [INFO ] [MAIN ] INGR: Loaded 15424 existing records. [2025-09-05T18:28:37.600687] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:37.783830] [INFO ] [MAIN ] INGR: Found 1 missing trading days. [2025-09-05T18:28:37.790516] [INFO ] [MAIN ] INGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:37.790377] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-05T18:28:37.791001] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-05T18:28:37.806765] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-05T18:28:37.809718] [INFO ] [MAIN ] INN: Loaded 20192 existing records. [2025-09-05T18:28:38.002575] [INFO ] [MAIN ] INN: Found 1 missing trading days. [2025-09-05T18:28:38.002763] [INFO ] [MAIN ] INN: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:38.263475] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-05T18:28:38.825455] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:28:38.936237] [INFO ] [MAIN ] INGR: Adding 238 new records, updating 0 existing records. [2025-09-05T18:28:38.940338] [INFO ] [MAIN ] INGR: Combined dataset has 15662 total records. [2025-09-05T18:28:39.133540] [WARN ] [VALIDATOR ] INGR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:39.222596] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-05T18:28:39.356404] [INFO ] [MAIN ] INGM: Adding 193 new records, updating 0 existing records. [2025-09-05T18:28:39.401924] [INFO ] [MAIN ] INGM: Combined dataset has 13159 total records. [2025-09-05T18:28:39.524526] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-05T18:28:39.684478] [WARN ] [VALIDATOR ] INGM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:39.740221] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-05T18:28:39.791297] [INFO ] [MAIN ] INN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:28:39.813898] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-05T18:28:39.854952] [INFO ] [MAIN ] INN: Combined dataset has 20192 total records. [2025-09-05T18:28:39.855891] [FATAL] [VALIDATOR ] INN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:28:39.877071] [FATAL] [MAIN ] INN: Combined data validation failed. [2025-09-05T18:28:39.882467] [WARN ] [MAIN ] INN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:28:39.900140] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-05T18:28:39.909193] [INFO ] [LOCAL ] INN: Starting deletion of derivative data. [2025-09-05T18:28:39.942501] [INFO ] [MAIN ] Update Progress: 1105/2363 symbols completed. INN took 2.6s. Estimated remaining: 32m 34s. Rate: 38.6 symbols/min [2025-09-05T18:28:40.141179] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:40.160687] [INFO ] [MAIN ] INR: Loaded 12989 existing records. [2025-09-05T18:28:40.221185] [WARN ] [VALIDATOR ] INGR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:40.259376] [INFO ] [MAIN ] INGR: Combined data validation passed. [2025-09-05T18:28:40.438045] [INFO ] [MAIN ] INR: Found 1 missing trading days. [2025-09-05T18:28:40.442489] [INFO ] [MAIN ] INR: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:40.444145] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-05T18:28:40.452898] [WARN ] [VALIDATOR ] INGM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:40.455546] [INFO ] [MAIN ] INGM: Combined data validation passed. [2025-09-05T18:28:40.547876] [INFO ] [MAIN ] INGR: Update completed successfully. [2025-09-05T18:28:40.552673] [INFO ] [MAIN ] Update Progress: 1106/2363 symbols completed. INGR took 3.5s. Estimated remaining: 32m 31s. Rate: 38.7 symbols/min [2025-09-05T18:28:40.661944] [INFO ] [MAIN ] INGM: Update completed successfully. [2025-09-05T18:28:40.666452] [INFO ] [MAIN ] Update Progress: 1107/2363 symbols completed. INGM took 3.9s. Estimated remaining: 32m 28s. Rate: 38.7 symbols/min [2025-09-05T18:28:40.842125] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:40.915507] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:40.930160] [INFO ] [MAIN ] INSP: Loaded 18775 existing records. [2025-09-05T18:28:41.054085] [INFO ] [MAIN ] INSW: Loaded 18476 existing records. [2025-09-05T18:28:41.227658] [INFO ] [MAIN ] INSP: Found 1 missing trading days. [2025-09-05T18:28:41.240321] [INFO ] [MAIN ] INSP: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:41.240742] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-05T18:28:41.320263] [INFO ] [MAIN ] INSW: Found 1 missing trading days. [2025-09-05T18:28:41.320393] [INFO ] [MAIN ] INSW: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:41.463426] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-05T18:28:41.537634] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-05T18:28:42.232494] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:28:42.268534] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-05T18:28:42.370610] [INFO ] [MAIN ] INSP: Adding 331 new records, updating 0 existing records. [2025-09-05T18:28:42.377333] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-05T18:28:42.472963] [INFO ] [MAIN ] INR: Adding 220 new records, updating 0 existing records. [2025-09-05T18:28:42.473680] [INFO ] [MAIN ] INSP: Combined dataset has 19106 total records. [2025-09-05T18:28:42.588624] [INFO ] [MAIN ] INR: Combined dataset has 13209 total records. [2025-09-05T18:28:42.781168] [WARN ] [VALIDATOR ] INSP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:42.925483] [WARN ] [VALIDATOR ] INR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:43.033766] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-05T18:28:43.297458] [INFO ] [MAIN ] INSW: Adding 0 new records, updating 0 existing records. [2025-09-05T18:28:43.372592] [INFO ] [MAIN ] INSW: Combined dataset has 18476 total records. [2025-09-05T18:28:43.401211] [FATAL] [VALIDATOR ] INSW: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:28:43.402583] [FATAL] [MAIN ] INSW: Combined data validation failed. [2025-09-05T18:28:43.402803] [WARN ] [MAIN ] INSW: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:28:43.402868] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-05T18:28:43.403621] [INFO ] [LOCAL ] INSW: Starting deletion of derivative data. [2025-09-05T18:28:43.407204] [INFO ] [MAIN ] Update Progress: 1108/2363 symbols completed. INSW took 2.7s. Estimated remaining: 32m 28s. Rate: 38.7 symbols/min [2025-09-05T18:28:43.602431] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:43.614893] [WARN ] [VALIDATOR ] INSP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:43.615171] [INFO ] [MAIN ] INSP: Combined data validation passed. [2025-09-05T18:28:43.614754] [WARN ] [VALIDATOR ] INR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:43.615964] [INFO ] [MAIN ] INR: Combined data validation passed. [2025-09-05T18:28:43.822235] [INFO ] [MAIN ] INR: Update completed successfully. [2025-09-05T18:28:43.825866] [INFO ] [MAIN ] Update Progress: 1109/2363 symbols completed. INR took 3.9s. Estimated remaining: 32m 25s. Rate: 38.7 symbols/min [2025-09-05T18:28:43.881988] [INFO ] [MAIN ] INSP: Update completed successfully. [2025-09-05T18:28:43.924374] [INFO ] [MAIN ] Update Progress: 1110/2363 symbols completed. INSP took 3.4s. Estimated remaining: 32m 22s. Rate: 38.7 symbols/min [2025-09-05T18:28:43.941084] [INFO ] [MAIN ] INVH: Loaded 40031 existing records. [2025-09-05T18:28:44.244752] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:44.422386] [INFO ] [MAIN ] INVH: Found 1 missing trading days. [2025-09-05T18:28:44.442953] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:44.443128] [INFO ] [MAIN ] INVH: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:44.443735] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-05T18:28:44.454207] [INFO ] [MAIN ] INVX: Loaded 22740 existing records. [2025-09-05T18:28:44.655676] [INFO ] [MAIN ] INVX: Found 1 missing trading days. [2025-09-05T18:28:44.656105] [INFO ] [MAIN ] INVX: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:44.667963] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-05T18:28:44.670971] [INFO ] [MAIN ] IONQ: Loaded 40528 existing records. [2025-09-05T18:28:44.857483] [INFO ] [MAIN ] IONQ: Found 1 missing trading days. [2025-09-05T18:28:44.857743] [INFO ] [MAIN ] IONQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:44.858128] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-05T18:28:45.055140] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-05T18:28:45.397954] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:28:45.468636] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-05T18:28:45.538575] [INFO ] [MAIN ] INVH: Adding 0 new records, updating 0 existing records. [2025-09-05T18:28:45.540939] [INFO ] [MAIN ] INVH: Combined dataset has 40031 total records. [2025-09-05T18:28:45.541435] [FATAL] [VALIDATOR ] INVH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:28:45.541563] [FATAL] [MAIN ] INVH: Combined data validation failed. [2025-09-05T18:28:45.541604] [WARN ] [MAIN ] INVH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:28:45.541673] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-05T18:28:45.542702] [INFO ] [LOCAL ] INVH: Starting deletion of derivative data. [2025-09-05T18:28:45.549291] [INFO ] [MAIN ] Update Progress: 1111/2363 symbols completed. INVH took 2.1s. Estimated remaining: 32m 20s. Rate: 38.7 symbols/min [2025-09-05T18:28:45.720414] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:45.753371] [INFO ] [MAIN ] IOT: Loaded 25638 existing records. [2025-09-05T18:28:45.928663] [INFO ] [MAIN ] IOT: Found 1 missing trading days. [2025-09-05T18:28:45.928840] [INFO ] [MAIN ] IOT: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:46.263515] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-05T18:28:46.537330] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-05T18:28:46.777882] [INFO ] [MAIN ] IONQ: Adding 390 new records, updating 0 existing records. [2025-09-05T18:28:46.781928] [INFO ] [MAIN ] IONQ: Combined dataset has 40918 total records. [2025-09-05T18:28:46.966986] [WARN ] [VALIDATOR ] IONQ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:28:47.043967] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-05T18:28:47.262226] [INFO ] [MAIN ] INVX: Adding 180 new records, updating 0 existing records. [2025-09-05T18:28:47.268803] [INFO ] [MAIN ] INVX: Combined dataset has 22920 total records. [2025-09-05T18:28:47.442046] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-05T18:28:47.453547] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-05T18:28:47.543526] [WARN ] [VALIDATOR ] INVX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:28:47.604275] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T18:28:47.914219] [INFO ] [MAIN ] IOT: Adding 390 new records, updating 0 existing records. [2025-09-05T18:28:47.922001] [INFO ] [MAIN ] IOT: Combined dataset has 26028 total records. [2025-09-05T18:28:47.921303] [WARN ] [VALIDATOR ] IONQ: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:28:47.922825] [INFO ] [MAIN ] IONQ: Combined data validation passed. [2025-09-05T18:28:48.178935] [WARN ] [VALIDATOR ] IOT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:48.494149] [WARN ] [VALIDATOR ] INVX: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:28:48.532849] [INFO ] [MAIN ] INVX: Combined data validation passed. [2025-09-05T18:28:48.637675] [INFO ] [MAIN ] IONQ: Update completed successfully. [2025-09-05T18:28:48.673872] [INFO ] [MAIN ] Update Progress: 1112/2363 symbols completed. IONQ took 4.7s. Estimated remaining: 32m 20s. Rate: 38.7 symbols/min [2025-09-05T18:28:48.680774] [WARN ] [VALIDATOR ] IOT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:48.690462] [INFO ] [MAIN ] IOT: Combined data validation passed. [2025-09-05T18:28:49.031842] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:49.043570] [INFO ] [MAIN ] INVX: Update completed successfully. [2025-09-05T18:28:49.048432] [INFO ] [MAIN ] Update Progress: 1113/2363 symbols completed. INVX took 5.2s. Estimated remaining: 32m 18s. Rate: 38.7 symbols/min [2025-09-05T18:28:49.288006] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:49.300585] [INFO ] [MAIN ] IP: Loaded 25425 existing records. [2025-09-05T18:28:49.307937] [INFO ] [MAIN ] IOT: Update completed successfully. [2025-09-05T18:28:49.348780] [INFO ] [MAIN ] Update Progress: 1114/2363 symbols completed. IOT took 3.8s. Estimated remaining: 32m 15s. Rate: 38.7 symbols/min [2025-09-05T18:28:49.548218] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-05T18:28:49.652310] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-05T18:28:49.727007] [INFO ] [MAIN ] IP: Found 1 missing trading days. [2025-09-05T18:28:49.734860] [INFO ] [MAIN ] IP: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:49.777704] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:49.778555] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-05T18:28:49.781631] [INFO ] [MAIN ] IPG: Loaded 40115 existing records. [2025-09-05T18:28:49.963086] [INFO ] [MAIN ] IPI: Loaded 15942 existing records. [2025-09-05T18:28:50.038201] [INFO ] [MAIN ] IPG: Found 1 missing trading days. [2025-09-05T18:28:50.071427] [INFO ] [MAIN ] IPG: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:50.090836] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-05T18:28:50.180563] [INFO ] [MAIN ] IPI: Found 1 missing trading days. [2025-09-05T18:28:50.180779] [INFO ] [MAIN ] IPI: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:50.263469] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-05T18:28:50.873297] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:28:51.027535] [INFO ] [MAIN ] IP: Adding 385 new records, updating 0 existing records. [2025-09-05T18:28:51.031284] [INFO ] [MAIN ] IP: Combined dataset has 25810 total records. [2025-09-05T18:28:51.226469] [WARN ] [VALIDATOR ] IP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:51.348090] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:28:51.511764] [INFO ] [MAIN ] IPI: Adding 129 new records, updating 0 existing records. [2025-09-05T18:28:51.516130] [INFO ] [MAIN ] IPI: Combined dataset has 16071 total records. [2025-09-05T18:28:51.708821] [WARN ] [VALIDATOR ] IPI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:28:51.852964] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-05T18:28:52.054862] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-05T18:28:52.120731] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-05T18:28:52.120020] [INFO ] [MAIN ] IPG: Adding 0 new records, updating 0 existing records. [2025-09-05T18:28:52.126017] [INFO ] [MAIN ] IPG: Combined dataset has 40115 total records. [2025-09-05T18:28:52.127998] [FATAL] [VALIDATOR ] IPG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:28:52.128489] [FATAL] [MAIN ] IPG: Combined data validation failed. [2025-09-05T18:28:52.128669] [WARN ] [MAIN ] IPG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:28:52.128809] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-05T18:28:52.129170] [WARN ] [VALIDATOR ] IP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:52.129390] [INFO ] [MAIN ] IP: Combined data validation passed. [2025-09-05T18:28:52.130343] [INFO ] [LOCAL ] IPG: Starting deletion of derivative data. [2025-09-05T18:28:52.139204] [INFO ] [MAIN ] Update Progress: 1115/2363 symbols completed. IPG took 3.1s. Estimated remaining: 32m 14s. Rate: 38.7 symbols/min [2025-09-05T18:28:52.379418] [WARN ] [VALIDATOR ] IPI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:28:52.407199] [INFO ] [MAIN ] IPI: Combined data validation passed. [2025-09-05T18:28:52.446420] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:52.618971] [INFO ] [MAIN ] IP: Update completed successfully. [2025-09-05T18:28:52.618894] [INFO ] [MAIN ] IQI: Loaded 8834 existing records. [2025-09-05T18:28:52.622476] [INFO ] [MAIN ] Update Progress: 1116/2363 symbols completed. IP took 3.9s. Estimated remaining: 32m 12s. Rate: 38.7 symbols/min [2025-09-05T18:28:52.988410] [INFO ] [MAIN ] IQI: Found 1 missing trading days. [2025-09-05T18:28:53.008553] [INFO ] [MAIN ] IQI: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:53.009176] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-05T18:28:53.007923] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:53.016925] [INFO ] [MAIN ] IPI: Update completed successfully. [2025-09-05T18:28:53.018918] [INFO ] [MAIN ] Update Progress: 1117/2363 symbols completed. IPI took 3.6s. Estimated remaining: 32m 9s. Rate: 38.8 symbols/min [2025-09-05T18:28:53.040398] [INFO ] [MAIN ] IQV: Loaded 23885 existing records. [2025-09-05T18:28:53.222611] [INFO ] [MAIN ] IQV: Found 1 missing trading days. [2025-09-05T18:28:53.229579] [INFO ] [MAIN ] IQV: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:53.230272] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-05T18:28:53.232874] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:28:53.237175] [INFO ] [REMOTE ] INFA: Full fetch complete (54524 records). [2025-09-05T18:28:53.644830] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-05T18:28:53.880453] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-05T18:28:53.880704] [INFO ] [MAIN ] Update Progress: 1118/2363 symbols completed. INFA took 21.9s. Estimated remaining: 32m 7s. Rate: 38.8 symbols/min [2025-09-05T18:28:54.077558] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:28:54.205692] [INFO ] [MAIN ] IQV: Adding 324 new records, updating 0 existing records. [2025-09-05T18:28:54.209008] [INFO ] [MAIN ] IQV: Combined dataset has 24209 total records. [2025-09-05T18:28:54.417310] [WARN ] [VALIDATOR ] IQV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:54.639100] [WARN ] [VALIDATOR ] IQV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:54.639346] [INFO ] [MAIN ] IQV: Combined data validation passed. [2025-09-05T18:28:54.800491] [INFO ] [MAIN ] IQV: Update completed successfully. [2025-09-05T18:28:54.803899] [INFO ] [MAIN ] Update Progress: 1119/2363 symbols completed. IQV took 2.2s. Estimated remaining: 32m 4s. Rate: 38.8 symbols/min [2025-09-05T18:28:55.325362] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-05T18:28:55.378706] [INFO ] [MAIN ] IQI: Adding 248 new records, updating 0 existing records. [2025-09-05T18:28:55.381383] [INFO ] [MAIN ] IQI: Combined dataset has 9082 total records. [2025-09-05T18:28:55.573542] [WARN ] [VALIDATOR ] IQI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:55.773298] [WARN ] [VALIDATOR ] IQI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:55.773506] [INFO ] [MAIN ] IQI: Combined data validation passed. [2025-09-05T18:28:55.831730] [INFO ] [MAIN ] IQI: Update completed successfully. [2025-09-05T18:28:55.833426] [INFO ] [MAIN ] Update Progress: 1120/2363 symbols completed. IQI took 3.7s. Estimated remaining: 32m 2s. Rate: 38.8 symbols/min [2025-09-05T18:28:56.526057] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:56.537868] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:56.549529] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:56.615694] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:56.624952] [INFO ] [MAIN ] IRS: Loaded 10410 existing records. [2025-09-05T18:28:56.798980] [INFO ] [MAIN ] IRT: Loaded 38013 existing records. [2025-09-05T18:28:56.853075] [INFO ] [MAIN ] IRM: Loaded 23121 existing records. [2025-09-05T18:28:56.857105] [INFO ] [MAIN ] IRS: Found 1 missing trading days. [2025-09-05T18:28:56.918296] [INFO ] [MAIN ] IRS: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:57.007705] [INFO ] [MAIN ] IR: Loaded 25026 existing records. [2025-09-05T18:28:56.964558] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-05T18:28:57.292723] [INFO ] [MAIN ] IRT: Found 1 missing trading days. [2025-09-05T18:28:57.349129] [INFO ] [MAIN ] IRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:57.367439] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-05T18:28:57.356699] [INFO ] [MAIN ] IRM: Found 1 missing trading days. [2025-09-05T18:28:57.373489] [INFO ] [MAIN ] IRM: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:57.378852] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-05T18:28:57.433719] [INFO ] [MAIN ] IR: Found 1 missing trading days. [2025-09-05T18:28:57.433857] [INFO ] [MAIN ] IR: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:57.434173] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-05T18:28:58.066475] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T18:28:58.146882] [INFO ] [MAIN ] IRS: Adding 204 new records, updating 0 existing records. [2025-09-05T18:28:58.149220] [INFO ] [MAIN ] IRS: Combined dataset has 10614 total records. [2025-09-05T18:28:58.328044] [WARN ] [VALIDATOR ] IRS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:58.521003] [WARN ] [VALIDATOR ] IRS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:28:58.521252] [INFO ] [MAIN ] IRS: Combined data validation passed. [2025-09-05T18:28:58.586173] [INFO ] [MAIN ] IRS: Update completed successfully. [2025-09-05T18:28:58.587437] [INFO ] [MAIN ] Update Progress: 1121/2363 symbols completed. IRS took 2.8s. Estimated remaining: 32m 2s. Rate: 38.8 symbols/min [2025-09-05T18:28:58.760630] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T18:28:58.777300] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:28:58.891029] [INFO ] [MAIN ] ISD: Loaded 7200 existing records. [2025-09-05T18:28:58.890740] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T18:28:59.079324] [INFO ] [MAIN ] IR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:28:59.278557] [INFO ] [MAIN ] ISD: Found 1 missing trading days. [2025-09-05T18:28:59.295447] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-05T18:28:59.300935] [INFO ] [MAIN ] IR: Combined dataset has 25416 total records. [2025-09-05T18:28:59.295549] [INFO ] [MAIN ] ISD: Need to fetch 1 months: 2025-09 [2025-09-05T18:28:59.326590] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-05T18:28:59.326309] [INFO ] [MAIN ] IRT: Adding 372 new records, updating 0 existing records. [2025-09-05T18:28:59.570009] [INFO ] [MAIN ] IRT: Combined dataset has 38385 total records. [2025-09-05T18:28:59.573511] [INFO ] [MAIN ] IRM: Adding 332 new records, updating 0 existing records. [2025-09-05T18:28:59.686179] [WARN ] [VALIDATOR ] IR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:28:59.865732] [INFO ] [MAIN ] IRM: Combined dataset has 23453 total records. [2025-09-05T18:29:00.011494] [WARN ] [VALIDATOR ] IRT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:29:00.307629] [WARN ] [VALIDATOR ] IRM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:00.629666] [WARN ] [VALIDATOR ] IR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:00.629851] [WARN ] [VALIDATOR ] IRT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:29:00.635877] [INFO ] [MAIN ] IR: Combined data validation passed. [2025-09-05T18:29:00.635521] [WARN ] [VALIDATOR ] IRM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:00.636061] [INFO ] [MAIN ] IRM: Combined data validation passed. [2025-09-05T18:29:00.635760] [INFO ] [MAIN ] IRT: Combined data validation passed. [2025-09-05T18:29:01.137513] [INFO ] [MAIN ] IRM: Update completed successfully. [2025-09-05T18:29:01.167179] [INFO ] [MAIN ] IR: Update completed successfully. [2025-09-05T18:29:01.166995] [INFO ] [MAIN ] Update Progress: 1122/2363 symbols completed. IRM took 5.3s. Estimated remaining: 32m 2s. Rate: 38.7 symbols/min [2025-09-05T18:29:01.178136] [INFO ] [MAIN ] Update Progress: 1123/2363 symbols completed. IR took 5.3s. Estimated remaining: 31m 58s. Rate: 38.8 symbols/min [2025-09-05T18:29:01.208077] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T18:29:01.377434] [INFO ] [MAIN ] ISD: Adding 86 new records, updating 0 existing records. [2025-09-05T18:29:01.465895] [INFO ] [MAIN ] IRT: Update completed successfully. [2025-09-05T18:29:01.539042] [INFO ] [MAIN ] ISD: Combined dataset has 7286 total records. [2025-09-05T18:29:01.565171] [INFO ] [MAIN ] Update Progress: 1124/2363 symbols completed. IRT took 5.7s. Estimated remaining: 31m 56s. Rate: 38.8 symbols/min [2025-09-05T18:29:01.611617] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:01.726380] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:02.047955] [INFO ] [MAIN ] ITGR: Loaded 13332 existing records. [2025-09-05T18:29:02.047089] [WARN ] [VALIDATOR ] ISD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:02.067658] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:02.257707] [INFO ] [MAIN ] IT: Loaded 30864 existing records. [2025-09-05T18:29:02.612315] [INFO ] [MAIN ] ITGR: Found 1 missing trading days. [2025-09-05T18:29:02.636706] [INFO ] [MAIN ] ITGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:02.568828] [INFO ] [MAIN ] ITT: Loaded 25021 existing records. [2025-09-05T18:29:02.641148] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-05T18:29:02.695192] [INFO ] [MAIN ] IT: Found 1 missing trading days. [2025-09-05T18:29:02.718526] [INFO ] [MAIN ] IT: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:02.741177] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-05T18:29:02.861003] [INFO ] [MAIN ] ITT: Found 1 missing trading days. [2025-09-05T18:29:02.861445] [INFO ] [MAIN ] ITT: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:02.861938] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-05T18:29:02.872241] [WARN ] [VALIDATOR ] ISD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:02.872506] [INFO ] [MAIN ] ISD: Combined data validation passed. [2025-09-05T18:29:02.926354] [INFO ] [MAIN ] ISD: Update completed successfully. [2025-09-05T18:29:02.927818] [INFO ] [MAIN ] Update Progress: 1125/2363 symbols completed. ISD took 4.3s. Estimated remaining: 31m 54s. Rate: 38.8 symbols/min [2025-09-05T18:29:03.098674] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:03.128385] [INFO ] [MAIN ] ITUB: Loaded 25499 existing records. [2025-09-05T18:29:03.305060] [INFO ] [MAIN ] ITUB: Found 1 missing trading days. [2025-09-05T18:29:03.305212] [INFO ] [MAIN ] ITUB: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:03.305418] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-05T18:29:03.931433] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:29:04.010061] [INFO ] [MAIN ] ITGR: Adding 241 new records, updating 0 existing records. [2025-09-05T18:29:04.017192] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:29:04.048529] [INFO ] [MAIN ] ITGR: Combined dataset has 13573 total records. [2025-09-05T18:29:04.188738] [INFO ] [MAIN ] ITT: Adding 180 new records, updating 0 existing records. [2025-09-05T18:29:04.255315] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-05T18:29:04.376417] [WARN ] [VALIDATOR ] ITGR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:04.381814] [INFO ] [MAIN ] ITT: Combined dataset has 25201 total records. [2025-09-05T18:29:04.681103] [INFO ] [MAIN ] IT: Adding 352 new records, updating 0 existing records. [2025-09-05T18:29:04.886958] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-05T18:29:04.884801] [WARN ] [VALIDATOR ] ITT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:29:04.895179] [INFO ] [MAIN ] IT: Combined dataset has 31216 total records. [2025-09-05T18:29:05.396720] [WARN ] [VALIDATOR ] IT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:29:05.420348] [INFO ] [MAIN ] ITUB: Adding 388 new records, updating 0 existing records. [2025-09-05T18:29:05.601142] [INFO ] [MAIN ] ITUB: Combined dataset has 25887 total records. [2025-09-05T18:29:05.815573] [WARN ] [VALIDATOR ] ITUB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:05.934396] [WARN ] [VALIDATOR ] IT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:29:05.934472] [WARN ] [VALIDATOR ] ITT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:29:05.950433] [INFO ] [MAIN ] IT: Combined data validation passed. [2025-09-05T18:29:05.945163] [WARN ] [VALIDATOR ] ITGR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:05.956194] [INFO ] [MAIN ] ITT: Combined data validation passed. [2025-09-05T18:29:05.970839] [INFO ] [MAIN ] ITGR: Combined data validation passed. [2025-09-05T18:29:06.289814] [INFO ] [MAIN ] ITGR: Update completed successfully. [2025-09-05T18:29:06.292966] [INFO ] [MAIN ] Update Progress: 1126/2363 symbols completed. ITGR took 5.1s. Estimated remaining: 31m 54s. Rate: 38.8 symbols/min [2025-09-05T18:29:06.489536] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:06.532174] [INFO ] [MAIN ] ITW: Loaded 21533 existing records. [2025-09-05T18:29:06.800790] [INFO ] [MAIN ] ITW: Found 1 missing trading days. [2025-09-05T18:29:06.803019] [INFO ] [MAIN ] ITW: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:06.803797] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-05T18:29:06.827278] [INFO ] [MAIN ] IT: Update completed successfully. [2025-09-05T18:29:06.831940] [INFO ] [MAIN ] Update Progress: 1127/2363 symbols completed. IT took 5.7s. Estimated remaining: 31m 52s. Rate: 38.8 symbols/min [2025-09-05T18:29:06.843689] [INFO ] [MAIN ] ITT: Update completed successfully. [2025-09-05T18:29:06.871659] [INFO ] [MAIN ] Update Progress: 1128/2363 symbols completed. ITT took 5.3s. Estimated remaining: 31m 48s. Rate: 38.8 symbols/min [2025-09-05T18:29:07.107231] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:07.177678] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:07.183838] [WARN ] [VALIDATOR ] ITUB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:07.184046] [INFO ] [MAIN ] ITUB: Combined data validation passed. [2025-09-05T18:29:07.284674] [INFO ] [MAIN ] IVR: Loaded 22504 existing records. [2025-09-05T18:29:07.339690] [INFO ] [MAIN ] IVT: Loaded 14560 existing records. [2025-09-05T18:29:07.680396] [INFO ] [MAIN ] ITUB: Update completed successfully. [2025-09-05T18:29:07.726012] [INFO ] [MAIN ] IVR: Found 1 missing trading days. [2025-09-05T18:29:07.729771] [INFO ] [MAIN ] Update Progress: 1129/2363 symbols completed. ITUB took 4.8s. Estimated remaining: 31m 46s. Rate: 38.8 symbols/min [2025-09-05T18:29:07.735024] [INFO ] [MAIN ] IVT: Found 1 missing trading days. [2025-09-05T18:29:07.735332] [INFO ] [MAIN ] IVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:07.735588] [INFO ] [MAIN ] IVR: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:07.736270] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-05T18:29:07.747850] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-05T18:29:07.909864] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:07.935521] [INFO ] [MAIN ] IVZ: Loaded 25341 existing records. [2025-09-05T18:29:08.110802] [INFO ] [MAIN ] IVZ: Found 1 missing trading days. [2025-09-05T18:29:08.110950] [INFO ] [MAIN ] IVZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:08.111176] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-05T18:29:08.293671] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-05T18:29:08.415946] [INFO ] [MAIN ] ITW: Adding 305 new records, updating 0 existing records. [2025-09-05T18:29:08.419004] [INFO ] [MAIN ] ITW: Combined dataset has 21838 total records. [2025-09-05T18:29:08.596011] [WARN ] [VALIDATOR ] ITW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:08.788885] [WARN ] [VALIDATOR ] ITW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:08.789085] [INFO ] [MAIN ] ITW: Combined data validation passed. [2025-09-05T18:29:08.928858] [INFO ] [MAIN ] ITW: Update completed successfully. [2025-09-05T18:29:08.931220] [INFO ] [MAIN ] Update Progress: 1130/2363 symbols completed. ITW took 2.6s. Estimated remaining: 31m 44s. Rate: 38.9 symbols/min [2025-09-05T18:29:09.108767] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:09.113931] [WARN ] [MAIN ] IX: No existing data found, performing full refresh instead. [2025-09-05T18:29:09.115053] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-05T18:29:09.115138] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-05T18:29:09.114845] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T18:29:09.124178] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-05T18:29:09.315703] [INFO ] [MAIN ] IVT: Adding 210 new records, updating 0 existing records. [2025-09-05T18:29:09.428757] [INFO ] [MAIN ] IVT: Combined dataset has 14770 total records. [2025-09-05T18:29:09.635425] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T18:29:09.616322] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T18:29:09.749763] [INFO ] [REMOTE ] IX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:29:09.776005] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-05T18:29:09.866041] [WARN ] [VALIDATOR ] IVT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:10.168282] [INFO ] [MAIN ] IVZ: Adding 389 new records, updating 0 existing records. [2025-09-05T18:29:10.195899] [INFO ] [MAIN ] IVR: Adding 370 new records, updating 0 existing records. [2025-09-05T18:29:10.310355] [INFO ] [MAIN ] IVZ: Combined dataset has 25730 total records. [2025-09-05T18:29:10.310867] [INFO ] [MAIN ] IVR: Combined dataset has 22874 total records. [2025-09-05T18:29:10.663169] [WARN ] [VALIDATOR ] IVR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:10.715428] [WARN ] [VALIDATOR ] IVZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:10.881927] [WARN ] [VALIDATOR ] IVT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:10.904059] [INFO ] [MAIN ] IVT: Combined data validation passed. [2025-09-05T18:29:11.129558] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-05T18:29:11.158108] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-05T18:29:11.198299] [INFO ] [MAIN ] IVT: Update completed successfully. [2025-09-05T18:29:11.201193] [INFO ] [MAIN ] Update Progress: 1131/2363 symbols completed. IVT took 4.3s. Estimated remaining: 31m 43s. Rate: 38.8 symbols/min [2025-09-05T18:29:11.384799] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:11.394022] [WARN ] [VALIDATOR ] IVZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:11.394093] [WARN ] [VALIDATOR ] IVR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:11.394340] [INFO ] [MAIN ] IVZ: Combined data validation passed. [2025-09-05T18:29:11.394796] [INFO ] [MAIN ] IVR: Combined data validation passed. [2025-09-05T18:29:11.653423] [INFO ] [MAIN ] J: Loaded 30044 existing records. [2025-09-05T18:29:11.782716] [INFO ] [MAIN ] IVZ: Update completed successfully. [2025-09-05T18:29:11.806727] [INFO ] [MAIN ] Update Progress: 1132/2363 symbols completed. IVZ took 4.1s. Estimated remaining: 31m 41s. Rate: 38.9 symbols/min [2025-09-05T18:29:11.830417] [INFO ] [MAIN ] IVR: Update completed successfully. [2025-09-05T18:29:11.858166] [INFO ] [MAIN ] Update Progress: 1133/2363 symbols completed. IVR took 5.0s. Estimated remaining: 31m 38s. Rate: 38.9 symbols/min [2025-09-05T18:29:12.044808] [INFO ] [MAIN ] J: Found 1 missing trading days. [2025-09-05T18:29:12.077215] [INFO ] [MAIN ] J: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:12.140503] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-05T18:29:12.181520] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:12.271128] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:12.272784] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-05T18:29:12.276978] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-05T18:29:12.311282] [INFO ] [MAIN ] JBI: Loaded 20116 existing records. [2025-09-05T18:29:12.393046] [INFO ] [MAIN ] JBGS: Loaded 31970 existing records. [2025-09-05T18:29:12.665070] [INFO ] [MAIN ] JBI: Found 1 missing trading days. [2025-09-05T18:29:12.690831] [INFO ] [MAIN ] JBI: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:12.692394] [INFO ] [MAIN ] JBGS: Found 1 missing trading days. [2025-09-05T18:29:12.692865] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-05T18:29:12.692956] [INFO ] [MAIN ] JBGS: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:12.693566] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-05T18:29:13.441349] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-05T18:29:13.446599] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-05T18:29:13.583183] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-05T18:29:13.705604] [INFO ] [MAIN ] J: Adding 297 new records, updating 0 existing records. [2025-09-05T18:29:13.709197] [INFO ] [MAIN ] J: Combined dataset has 30341 total records. [2025-09-05T18:29:13.913908] [WARN ] [VALIDATOR ] J: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:29:14.014134] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T18:29:14.237691] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:29:14.267525] [INFO ] [MAIN ] JBGS: Adding 0 new records, updating 0 existing records. [2025-09-05T18:29:14.324116] [INFO ] [MAIN ] JBGS: Combined dataset has 31970 total records. [2025-09-05T18:29:14.362337] [FATAL] [VALIDATOR ] JBGS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:29:14.370815] [INFO ] [MAIN ] JBI: Adding 270 new records, updating 0 existing records. [2025-09-05T18:29:14.372004] [FATAL] [MAIN ] JBGS: Combined data validation failed. [2025-09-05T18:29:14.372912] [WARN ] [MAIN ] JBGS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:29:14.377338] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-05T18:29:14.379261] [INFO ] [LOCAL ] JBGS: Starting deletion of derivative data. [2025-09-05T18:29:14.379558] [INFO ] [MAIN ] JBI: Combined dataset has 20386 total records. [2025-09-05T18:29:14.395104] [INFO ] [MAIN ] Update Progress: 1134/2363 symbols completed. JBGS took 2.6s. Estimated remaining: 31m 37s. Rate: 38.9 symbols/min [2025-09-05T18:29:14.646527] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-05T18:29:14.783399] [WARN ] [VALIDATOR ] JBI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:14.825283] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-05T18:29:14.958952] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:15.068439] [INFO ] [MAIN ] JBL: Loaded 23320 existing records. [2025-09-05T18:29:15.181375] [WARN ] [VALIDATOR ] J: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:29:15.197569] [INFO ] [MAIN ] J: Combined data validation passed. [2025-09-05T18:29:15.255203] [INFO ] [MAIN ] JBL: Found 1 missing trading days. [2025-09-05T18:29:15.255819] [INFO ] [MAIN ] JBL: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:15.256144] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-05T18:29:15.264911] [WARN ] [VALIDATOR ] JBI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:15.323585] [INFO ] [MAIN ] JBI: Combined data validation passed. [2025-09-05T18:29:15.550140] [INFO ] [MAIN ] J: Update completed successfully. [2025-09-05T18:29:15.556669] [INFO ] [MAIN ] Update Progress: 1135/2363 symbols completed. J took 4.4s. Estimated remaining: 31m 35s. Rate: 38.9 symbols/min [2025-09-05T18:29:15.779129] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:15.793479] [INFO ] [MAIN ] JBI: Update completed successfully. [2025-09-05T18:29:15.796538] [INFO ] [MAIN ] Update Progress: 1136/2363 symbols completed. JBI took 3.9s. Estimated remaining: 31m 32s. Rate: 38.9 symbols/min [2025-09-05T18:29:15.915061] [INFO ] [MAIN ] JBND: Loaded 12276 existing records. [2025-09-05T18:29:16.086027] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:16.159154] [INFO ] [MAIN ] JBND: Found 1 missing trading days. [2025-09-05T18:29:16.159321] [INFO ] [MAIN ] JBND: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:16.159540] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-05T18:29:16.175873] [INFO ] [MAIN ] JBS: Loaded 21408 existing records. [2025-09-05T18:29:16.353401] [INFO ] [MAIN ] JBS: Found 1 missing trading days. [2025-09-05T18:29:16.353548] [INFO ] [MAIN ] JBS: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:16.353806] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-05T18:29:16.369344] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:29:16.432323] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-05T18:29:16.469121] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-05T18:29:16.538658] [INFO ] [MAIN ] JBL: Adding 363 new records, updating 0 existing records. [2025-09-05T18:29:16.542122] [INFO ] [MAIN ] JBL: Combined dataset has 23683 total records. [2025-09-05T18:29:16.731174] [WARN ] [VALIDATOR ] JBL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:16.935202] [WARN ] [VALIDATOR ] JBL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:16.935428] [INFO ] [MAIN ] JBL: Combined data validation passed. [2025-09-05T18:29:17.095318] [INFO ] [MAIN ] JBL: Update completed successfully. [2025-09-05T18:29:17.098094] [INFO ] [MAIN ] Update Progress: 1137/2363 symbols completed. JBL took 2.7s. Estimated remaining: 31m 31s. Rate: 38.9 symbols/min [2025-09-05T18:29:17.269627] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:17.294296] [INFO ] [MAIN ] JBTM: Loaded 24805 existing records. [2025-09-05T18:29:17.471704] [INFO ] [MAIN ] JBTM: Found 1 missing trading days. [2025-09-05T18:29:17.471898] [INFO ] [MAIN ] JBTM: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:17.472131] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-05T18:29:17.647554] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-05T18:29:17.652771] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-05T18:29:18.508435] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T18:29:18.591454] [INFO ] [MAIN ] JBTM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:29:18.594049] [INFO ] [MAIN ] JBTM: Combined dataset has 24805 total records. [2025-09-05T18:29:18.594575] [FATAL] [VALIDATOR ] JBTM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:29:18.594682] [FATAL] [MAIN ] JBTM: Combined data validation failed. [2025-09-05T18:29:18.594723] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:29:18.594766] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-05T18:29:18.595335] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-05T18:29:18.598395] [INFO ] [MAIN ] Update Progress: 1138/2363 symbols completed. JBTM took 1.5s. Estimated remaining: 31m 29s. Rate: 38.9 symbols/min [2025-09-05T18:29:18.721200] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-05T18:29:18.819001] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:18.859609] [INFO ] [MAIN ] JBND: Adding 0 new records, updating 0 existing records. [2025-09-05T18:29:18.862446] [INFO ] [MAIN ] JCE: Loaded 3152 existing records. [2025-09-05T18:29:18.932821] [INFO ] [MAIN ] JBND: Combined dataset has 12276 total records. [2025-09-05T18:29:18.963402] [FATAL] [VALIDATOR ] JBND: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:29:18.966152] [FATAL] [MAIN ] JBND: Combined data validation failed. [2025-09-05T18:29:18.966221] [WARN ] [MAIN ] JBND: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:29:18.966552] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-05T18:29:18.982502] [INFO ] [LOCAL ] JBND: Starting deletion of derivative data. [2025-09-05T18:29:19.021153] [INFO ] [MAIN ] Update Progress: 1139/2363 symbols completed. JBND took 3.5s. Estimated remaining: 31m 26s. Rate: 38.9 symbols/min [2025-09-05T18:29:19.039847] [INFO ] [MAIN ] JCE: Found 1 missing trading days. [2025-09-05T18:29:19.115248] [INFO ] [MAIN ] JCE: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:19.132736] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-05T18:29:19.217024] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:19.243796] [INFO ] [MAIN ] JCI: Loaded 25587 existing records. [2025-09-05T18:29:19.419310] [INFO ] [MAIN ] JCI: Found 1 missing trading days. [2025-09-05T18:29:19.419495] [INFO ] [MAIN ] JCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:19.419735] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-05T18:29:19.602796] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-05T18:29:19.609005] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-05T18:29:19.753174] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (3.40 seconds). [2025-09-05T18:29:19.895576] [INFO ] [MAIN ] JBS: Adding 385 new records, updating 0 existing records. [2025-09-05T18:29:19.898760] [INFO ] [MAIN ] JBS: Combined dataset has 21793 total records. [2025-09-05T18:29:20.077085] [WARN ] [VALIDATOR ] JBS: Not fatal, but first date in data (2025-06-16) does not match expected start date (2025-01-31) [2025-09-05T18:29:20.272914] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-05T18:29:20.277383] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-05T18:29:20.287273] [WARN ] [VALIDATOR ] JBS: Missing days changed. Total missing: 93 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13 [2025-09-05T18:29:20.287527] [INFO ] [MAIN ] JBS: Combined data validation passed. [2025-09-05T18:29:20.428626] [INFO ] [MAIN ] JBS: Update completed successfully. [2025-09-05T18:29:20.431434] [INFO ] [MAIN ] Update Progress: 1140/2363 symbols completed. JBS took 4.6s. Estimated remaining: 31m 25s. Rate: 38.9 symbols/min [2025-09-05T18:29:20.605164] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:20.628207] [INFO ] [MAIN ] JEF: Loaded 23595 existing records. [2025-09-05T18:29:20.804768] [INFO ] [MAIN ] JEF: Found 1 missing trading days. [2025-09-05T18:29:20.804908] [INFO ] [MAIN ] JEF: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:20.805114] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-05T18:29:20.854674] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:29:21.010059] [INFO ] [MAIN ] JCI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:29:21.013639] [INFO ] [MAIN ] JCI: Combined dataset has 25977 total records. [2025-09-05T18:29:21.193175] [WARN ] [VALIDATOR ] JCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:21.359936] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-05T18:29:21.410485] [INFO ] [MAIN ] JCE: Adding 95 new records, updating 0 existing records. [2025-09-05T18:29:21.415783] [INFO ] [MAIN ] JCE: Combined dataset has 3247 total records. [2025-09-05T18:29:21.608677] [WARN ] [VALIDATOR ] JCE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:21.799463] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:29:21.945881] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T18:29:21.946011] [WARN ] [VALIDATOR ] JCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:21.951302] [INFO ] [MAIN ] JEF: Adding 377 new records, updating 0 existing records. [2025-09-05T18:29:21.951862] [INFO ] [MAIN ] JCI: Combined data validation passed. [2025-09-05T18:29:21.953540] [INFO ] [REMOTE ] IX: Full fetch complete (23365 records). [2025-09-05T18:29:22.156978] [INFO ] [MAIN ] JEF: Combined dataset has 23972 total records. [2025-09-05T18:29:22.392900] [WARN ] [VALIDATOR ] JCE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:22.424979] [INFO ] [MAIN ] JCE: Combined data validation passed. [2025-09-05T18:29:22.612895] [WARN ] [VALIDATOR ] JEF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:22.705636] [INFO ] [MAIN ] JCE: Update completed successfully. [2025-09-05T18:29:22.705806] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-05T18:29:22.713548] [INFO ] [MAIN ] Update Progress: 1141/2363 symbols completed. JCE took 4.1s. Estimated remaining: 31m 24s. Rate: 38.9 symbols/min [2025-09-05T18:29:23.138362] [INFO ] [MAIN ] JCI: Update completed successfully. [2025-09-05T18:29:23.158178] [INFO ] [MAIN ] Update Progress: 1142/2363 symbols completed. JCI took 4.1s. Estimated remaining: 31m 21s. Rate: 38.9 symbols/min [2025-09-05T18:29:23.178147] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:23.299917] [WARN ] [VALIDATOR ] JEF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:23.310568] [INFO ] [MAIN ] JEF: Combined data validation passed. [2025-09-05T18:29:23.467285] [INFO ] [MAIN ] JELD: Loaded 21439 existing records. [2025-09-05T18:29:23.488871] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:23.521815] [INFO ] [MAIN ] IX: Full history saved. [2025-09-05T18:29:23.568307] [INFO ] [MAIN ] Update Progress: 1143/2363 symbols completed. IX took 14.6s. Estimated remaining: 31m 18s. Rate: 39.0 symbols/min [2025-09-05T18:29:23.745210] [INFO ] [MAIN ] JEQ: Loaded 3914 existing records. [2025-09-05T18:29:23.833270] [INFO ] [MAIN ] JELD: Found 1 missing trading days. [2025-09-05T18:29:23.881736] [INFO ] [MAIN ] JELD: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:23.950416] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-05T18:29:24.006560] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:24.109095] [INFO ] [MAIN ] JEQ: Found 1 missing trading days. [2025-09-05T18:29:24.114511] [INFO ] [MAIN ] JEQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:24.119058] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-05T18:29:24.145087] [INFO ] [MAIN ] JFR: Loaded 14440 existing records. [2025-09-05T18:29:24.221555] [INFO ] [MAIN ] JEF: Update completed successfully. [2025-09-05T18:29:24.246545] [INFO ] [MAIN ] Update Progress: 1144/2363 symbols completed. JEF took 3.8s. Estimated remaining: 31m 16s. Rate: 39.0 symbols/min [2025-09-05T18:29:24.437126] [INFO ] [MAIN ] JFR: Found 1 missing trading days. [2025-09-05T18:29:24.452760] [INFO ] [MAIN ] JFR: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:24.463223] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-05T18:29:24.508541] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:24.516476] [INFO ] [MAIN ] JGH: Loaded 5476 existing records. [2025-09-05T18:29:24.694172] [INFO ] [MAIN ] JGH: Found 1 missing trading days. [2025-09-05T18:29:24.694832] [INFO ] [MAIN ] JGH: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:24.695072] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-05T18:29:25.116792] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T18:29:25.246240] [INFO ] [MAIN ] JELD: Adding 346 new records, updating 0 existing records. [2025-09-05T18:29:25.249420] [INFO ] [MAIN ] JELD: Combined dataset has 21785 total records. [2025-09-05T18:29:25.427898] [WARN ] [VALIDATOR ] JELD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:25.625261] [WARN ] [VALIDATOR ] JELD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:25.625462] [INFO ] [MAIN ] JELD: Combined data validation passed. [2025-09-05T18:29:25.749707] [INFO ] [MAIN ] JELD: Update completed successfully. [2025-09-05T18:29:25.752200] [INFO ] [MAIN ] Update Progress: 1145/2363 symbols completed. JELD took 3.0s. Estimated remaining: 31m 14s. Rate: 39.0 symbols/min [2025-09-05T18:29:25.929156] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:25.965541] [INFO ] [MAIN ] JHG: Loaded 36150 existing records. [2025-09-05T18:29:26.148743] [INFO ] [MAIN ] JHG: Found 1 missing trading days. [2025-09-05T18:29:26.148920] [INFO ] [MAIN ] JHG: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:26.149211] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-05T18:29:26.540436] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-05T18:29:26.560873] [INFO ] [MAIN ] JEQ: Adding 29 new records, updating 0 existing records. [2025-09-05T18:29:26.562625] [INFO ] [MAIN ] JEQ: Combined dataset has 3943 total records. [2025-09-05T18:29:26.744030] [WARN ] [VALIDATOR ] JEQ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:26.936278] [WARN ] [VALIDATOR ] JEQ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:26.936535] [INFO ] [MAIN ] JEQ: Combined data validation passed. [2025-09-05T18:29:26.962517] [INFO ] [MAIN ] JEQ: Update completed successfully. [2025-09-05T18:29:26.963207] [INFO ] [MAIN ] Update Progress: 1146/2363 symbols completed. JEQ took 3.8s. Estimated remaining: 31m 12s. Rate: 39.0 symbols/min [2025-09-05T18:29:27.079955] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-05T18:29:27.193747] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:27.205311] [INFO ] [MAIN ] JGH: Adding 72 new records, updating 0 existing records. [2025-09-05T18:29:27.205551] [WARN ] [MAIN ] JHI: No existing data found, performing full refresh instead. [2025-09-05T18:29:27.206419] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-05T18:29:27.207918] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-05T18:29:27.208033] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-05T18:29:27.285229] [INFO ] [MAIN ] JGH: Combined dataset has 5548 total records. [2025-09-05T18:29:27.561007] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (3.10 seconds). [2025-09-05T18:29:27.753192] [WARN ] [VALIDATOR ] JGH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:27.893198] [INFO ] [MAIN ] JFR: Adding 225 new records, updating 0 existing records. [2025-09-05T18:29:27.920002] [INFO ] [REMOTE ] JHI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:29:27.961711] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-05T18:29:27.955823] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-05T18:29:28.168506] [INFO ] [MAIN ] JFR: Combined dataset has 14665 total records. [2025-09-05T18:29:28.299931] [INFO ] [MAIN ] JHG: Adding 335 new records, updating 0 existing records. [2025-09-05T18:29:28.420312] [WARN ] [VALIDATOR ] JFR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:28.488870] [INFO ] [MAIN ] JHG: Combined dataset has 36485 total records. [2025-09-05T18:29:28.789835] [WARN ] [VALIDATOR ] JHG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:29:29.007367] [WARN ] [VALIDATOR ] JHG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:29:29.007481] [WARN ] [VALIDATOR ] JGH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:29.007750] [INFO ] [MAIN ] JHG: Combined data validation passed. [2025-09-05T18:29:29.007261] [WARN ] [VALIDATOR ] JFR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:29.008142] [INFO ] [MAIN ] JGH: Combined data validation passed. [2025-09-05T18:29:29.008414] [INFO ] [MAIN ] JFR: Combined data validation passed. [2025-09-05T18:29:29.216908] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-05T18:29:29.219455] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-05T18:29:29.241832] [INFO ] [MAIN ] JFR: Update completed successfully. [2025-09-05T18:29:29.244538] [INFO ] [MAIN ] Update Progress: 1147/2363 symbols completed. JFR took 5.7s. Estimated remaining: 31m 12s. Rate: 39.0 symbols/min [2025-09-05T18:29:29.268768] [INFO ] [MAIN ] JGH: Update completed successfully. [2025-09-05T18:29:29.292807] [INFO ] [MAIN ] Update Progress: 1148/2363 symbols completed. JGH took 5.0s. Estimated remaining: 31m 9s. Rate: 39.0 symbols/min [2025-09-05T18:29:29.621485] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:29.665989] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:29.664894] [WARN ] [MAIN ] JHS: No existing data found, performing full refresh instead. [2025-09-05T18:29:29.668977] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-05T18:29:29.669051] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-05T18:29:29.672487] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-05T18:29:29.795164] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-05T18:29:29.797446] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-05T18:29:29.950414] [INFO ] [MAIN ] JHX: Loaded 25503 existing records. [2025-09-05T18:29:30.334152] [INFO ] [REMOTE ] JHS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:29:30.341594] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-05T18:29:30.340781] [INFO ] [MAIN ] JHX: Found 1 missing trading days. [2025-09-05T18:29:30.342781] [INFO ] [MAIN ] JHX: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:30.344188] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-05T18:29:30.352600] [INFO ] [MAIN ] JHG: Update completed successfully. [2025-09-05T18:29:30.356595] [INFO ] [MAIN ] Update Progress: 1149/2363 symbols completed. JHG took 4.6s. Estimated remaining: 31m 6s. Rate: 39.0 symbols/min [2025-09-05T18:29:30.535567] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:30.545147] [INFO ] [MAIN ] JILL: Loaded 7759 existing records. [2025-09-05T18:29:30.655811] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-05T18:29:30.667941] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-05T18:29:30.730026] [INFO ] [MAIN ] JILL: Found 1 missing trading days. [2025-09-05T18:29:30.730144] [INFO ] [MAIN ] JILL: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:30.730348] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-05T18:29:31.374197] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-05T18:29:31.376001] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-05T18:29:31.687143] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-05T18:29:31.688571] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-05T18:29:31.694434] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:29:31.744310] [INFO ] [MAIN ] JILL: Adding 187 new records, updating 0 existing records. [2025-09-05T18:29:31.746288] [INFO ] [MAIN ] JILL: Combined dataset has 7946 total records. [2025-09-05T18:29:31.940538] [WARN ] [VALIDATOR ] JILL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:32.010268] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-05T18:29:32.028816] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-05T18:29:32.145175] [WARN ] [VALIDATOR ] JILL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:32.145414] [INFO ] [MAIN ] JILL: Combined data validation passed. [2025-09-05T18:29:32.200076] [INFO ] [MAIN ] JILL: Update completed successfully. [2025-09-05T18:29:32.201347] [INFO ] [MAIN ] Update Progress: 1150/2363 symbols completed. JILL took 1.8s. Estimated remaining: 31m 5s. Rate: 39.0 symbols/min [2025-09-05T18:29:32.326292] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-05T18:29:32.371739] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-05T18:29:32.390473] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:32.391854] [WARN ] [MAIN ] JKS: No existing data found, performing full refresh instead. [2025-09-05T18:29:32.391976] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-05T18:29:32.392015] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-05T18:29:32.392094] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-05T18:29:32.674806] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-05T18:29:32.692484] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-05T18:29:32.755500] [INFO ] [REMOTE ] JKS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:29:32.756111] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-05T18:29:32.914388] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-05T18:29:33.224540] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-09-05T18:29:33.377265] [INFO ] [MAIN ] JHX: Adding 389 new records, updating 0 existing records. [2025-09-05T18:29:33.380875] [INFO ] [MAIN ] JHX: Combined dataset has 25892 total records. [2025-09-05T18:29:33.473551] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-05T18:29:33.562572] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-05T18:29:33.568148] [WARN ] [VALIDATOR ] JHX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:33.763840] [WARN ] [VALIDATOR ] JHX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:33.764069] [INFO ] [MAIN ] JHX: Combined data validation passed. [2025-09-05T18:29:33.927707] [INFO ] [MAIN ] JHX: Update completed successfully. [2025-09-05T18:29:33.930739] [INFO ] [MAIN ] Update Progress: 1151/2363 symbols completed. JHX took 4.6s. Estimated remaining: 31m 4s. Rate: 39.0 symbols/min [2025-09-05T18:29:34.036528] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-05T18:29:34.107257] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:34.131844] [INFO ] [MAIN ] JLL: Loaded 24689 existing records. [2025-09-05T18:29:34.273246] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-05T18:29:34.308916] [INFO ] [MAIN ] JLL: Found 1 missing trading days. [2025-09-05T18:29:34.309028] [INFO ] [MAIN ] JLL: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:34.668494] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-05T18:29:34.873775] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-05T18:29:35.063512] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-05T18:29:35.863491] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-05T18:29:36.663945] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-05T18:29:36.669797] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-05T18:29:36.940911] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:29:36.941878] [INFO ] [REMOTE ] JHI: Full fetch complete (3769 records). [2025-09-05T18:29:37.226889] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-05T18:29:37.306266] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-05T18:29:37.322298] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-05T18:29:37.322388] [INFO ] [MAIN ] Update Progress: 1152/2363 symbols completed. JHI took 10.4s. Estimated remaining: 31m 4s. Rate: 39.0 symbols/min [2025-09-05T18:29:37.471323] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-05T18:29:37.496969] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:37.501041] [INFO ] [MAIN ] JLS: Loaded 1804 existing records. [2025-09-05T18:29:37.675934] [INFO ] [MAIN ] JLS: Found 1 missing trading days. [2025-09-05T18:29:37.676113] [INFO ] [MAIN ] JLS: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:38.263486] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-05T18:29:38.696676] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-05T18:29:39.063473] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-05T18:29:39.746416] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-05T18:29:39.759234] [INFO ] [MAIN ] JLS: Adding 43 new records, updating 0 existing records. [2025-09-05T18:29:39.761097] [INFO ] [MAIN ] JLS: Combined dataset has 1847 total records. [2025-09-05T18:29:39.868538] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-05T18:29:39.954697] [WARN ] [VALIDATOR ] JLS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:40.164286] [WARN ] [VALIDATOR ] JLS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:40.164517] [INFO ] [MAIN ] JLS: Combined data validation passed. [2025-09-05T18:29:40.177784] [INFO ] [MAIN ] JLS: Update completed successfully. [2025-09-05T18:29:40.178193] [INFO ] [MAIN ] Update Progress: 1153/2363 symbols completed. JLS took 2.9s. Estimated remaining: 31m 4s. Rate: 38.9 symbols/min [2025-09-05T18:29:40.360929] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:40.385238] [INFO ] [MAIN ] JMIA: Loaded 24564 existing records. [2025-09-05T18:29:40.571030] [INFO ] [MAIN ] JMIA: Found 1 missing trading days. [2025-09-05T18:29:40.571173] [INFO ] [MAIN ] JMIA: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:40.663443] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-05T18:29:40.699838] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-05T18:29:40.737973] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-05T18:29:41.463477] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-05T18:29:42.078182] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-05T18:29:42.234559] [INFO ] [MAIN ] JMIA: Adding 388 new records, updating 0 existing records. [2025-09-05T18:29:42.238665] [INFO ] [MAIN ] JMIA: Combined dataset has 24952 total records. [2025-09-05T18:29:42.270183] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-05T18:29:42.434793] [WARN ] [VALIDATOR ] JMIA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:42.644962] [WARN ] [VALIDATOR ] JMIA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:42.645205] [INFO ] [MAIN ] JMIA: Combined data validation passed. [2025-09-05T18:29:42.810994] [INFO ] [MAIN ] JMIA: Update completed successfully. [2025-09-05T18:29:42.815289] [INFO ] [MAIN ] Update Progress: 1154/2363 symbols completed. JMIA took 2.6s. Estimated remaining: 31m 4s. Rate: 38.9 symbols/min [2025-09-05T18:29:43.016955] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-05T18:29:43.067366] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-05T18:29:43.086964] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:43.106085] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-05T18:29:43.127441] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-05T18:29:43.154555] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-05T18:29:43.188128] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-05T18:29:43.196540] [INFO ] [MAIN ] JLL: Adding 229 new records, updating 0 existing records. [2025-09-05T18:29:43.372832] [INFO ] [MAIN ] JLL: Combined dataset has 24918 total records. [2025-09-05T18:29:43.899580] [WARN ] [VALIDATOR ] JLL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:29:43.950475] [INFO ] [REMOTE ] JMM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:29:44.004068] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-05T18:29:44.192180] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-05T18:29:44.210714] [WARN ] [VALIDATOR ] JLL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:29:44.211008] [INFO ] [MAIN ] JLL: Combined data validation passed. [2025-09-05T18:29:44.216300] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-05T18:29:44.391795] [INFO ] [MAIN ] JLL: Update completed successfully. [2025-09-05T18:29:44.395348] [INFO ] [MAIN ] Update Progress: 1155/2363 symbols completed. JLL took 10.5s. Estimated remaining: 31m 2s. Rate: 38.9 symbols/min [2025-09-05T18:29:44.570155] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:44.598546] [INFO ] [MAIN ] JNJ: Loaded 25734 existing records. [2025-09-05T18:29:44.668597] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-05T18:29:44.783443] [INFO ] [MAIN ] JNJ: Found 1 missing trading days. [2025-09-05T18:29:44.783598] [INFO ] [MAIN ] JNJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:45.148108] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-05T18:29:45.163154] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-05T18:29:45.463466] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-05T18:29:46.263464] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-05T18:29:46.997485] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T18:29:47.068693] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-05T18:29:47.160175] [INFO ] [MAIN ] JNJ: Adding 390 new records, updating 0 existing records. [2025-09-05T18:29:47.164021] [INFO ] [MAIN ] JNJ: Combined dataset has 26124 total records. [2025-09-05T18:29:47.352161] [WARN ] [VALIDATOR ] JNJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:29:47.575854] [WARN ] [VALIDATOR ] JNJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:29:47.576135] [INFO ] [MAIN ] JNJ: Combined data validation passed. [2025-09-05T18:29:47.759117] [INFO ] [MAIN ] JNJ: Update completed successfully. [2025-09-05T18:29:47.762495] [INFO ] [MAIN ] Update Progress: 1156/2363 symbols completed. JNJ took 3.4s. Estimated remaining: 31m 3s. Rate: 38.9 symbols/min [2025-09-05T18:29:47.866389] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-05T18:29:47.940835] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:29:47.994597] [INFO ] [MAIN ] JOBY: Loaded 40549 existing records. [2025-09-05T18:29:48.182067] [INFO ] [MAIN ] JOBY: Found 1 missing trading days. [2025-09-05T18:29:48.182249] [INFO ] [MAIN ] JOBY: Need to fetch 1 months: 2025-09 [2025-09-05T18:29:48.275089] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:29:48.276975] [INFO ] [REMOTE ] JHS: Full fetch complete (3341 records). [2025-09-05T18:29:48.355053] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-05T18:29:48.665948] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-05T18:29:48.670714] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-05T18:29:48.687950] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-05T18:29:48.688104] [INFO ] [MAIN ] Update Progress: 1157/2363 symbols completed. JHS took 19.4s. Estimated remaining: 31m 0s. Rate: 38.9 symbols/min [2025-09-05T18:29:48.979667] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-05T18:29:49.463488] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-05T18:29:49.987337] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-05T18:29:50.041115] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T18:29:50.213316] [INFO ] [MAIN ] JOBY: Adding 390 new records, updating 0 existing records. [2025-09-05T18:29:50.218273] [INFO ] [MAIN ] JOBY: Combined dataset has 40939 total records. [2025-09-05T18:29:50.274888] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-05T18:29:50.406968] [WARN ] [VALIDATOR ] JOBY: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:29:50.633136] [WARN ] [VALIDATOR ] JOBY: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:29:50.633383] [INFO ] [MAIN ] JOBY: Combined data validation passed. [2025-09-05T18:29:50.859751] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-05T18:29:50.903074] [INFO ] [MAIN ] JOBY: Update completed successfully. [2025-09-05T18:29:50.909113] [INFO ] [MAIN ] Update Progress: 1158/2363 symbols completed. JOBY took 3.1s. Estimated remaining: 30m 60s. Rate: 38.9 symbols/min [2025-09-05T18:29:51.063529] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-05T18:29:51.448031] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-05T18:29:51.863528] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-05T18:29:52.254605] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-05T18:29:52.663525] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-05T18:29:53.124350] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-05T18:29:53.463522] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-05T18:29:53.917024] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-05T18:29:54.263511] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-05T18:29:55.063624] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-05T18:29:56.070028] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-05T18:29:56.080425] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-05T18:29:57.173630] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-05T18:29:57.174445] [INFO ] [REMOTE ] JMM: Full fetch complete (1960 records). [2025-09-05T18:29:57.554145] [WARN ] [VALIDATOR ] JMM: Missing days changed. Total missing: 4 No longer missing: 2025-01-29, 2025-01-30, 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-10, 2025-03-11, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-03-07, 2025-03-12, 2025-03-18, 2025-03-24 [2025-09-05T18:29:57.554462] [INFO ] [MAIN ] JMM: Fetched primary data is valid. [2025-09-05T18:29:57.567030] [INFO ] [MAIN ] JMM: Full history saved. [2025-09-05T18:29:57.567167] [INFO ] [MAIN ] Update Progress: 1159/2363 symbols completed. JMM took 14.8s. Estimated remaining: 31m 3s. Rate: 38.8 symbols/min [2025-09-05T18:29:57.663390] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-05T18:29:57.676731] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-05T18:29:59.088596] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-05T18:29:59.091981] [INFO ] [REMOTE ] JKS: Full fetch complete (43897 records). [2025-09-05T18:29:59.484986] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-05T18:29:59.685362] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-05T18:29:59.685532] [INFO ] [MAIN ] Update Progress: 1160/2363 symbols completed. JKS took 27.5s. Estimated remaining: 31m 2s. Rate: 38.8 symbols/min [2025-09-05T18:30:00.309029] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:00.375342] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:00.380523] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:00.438160] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:00.442146] [INFO ] [MAIN ] JPI: Loaded 2165 existing records. [2025-09-05T18:30:00.524713] [INFO ] [MAIN ] JOF: Loaded 3324 existing records. [2025-09-05T18:30:00.547888] [INFO ] [MAIN ] JPC: Loaded 17341 existing records. [2025-09-05T18:30:00.598280] [INFO ] [MAIN ] JOE: Loaded 11312 existing records. [2025-09-05T18:30:01.030937] [INFO ] [MAIN ] JPI: Found 1 missing trading days. [2025-09-05T18:30:01.117395] [INFO ] [MAIN ] JOF: Found 1 missing trading days. [2025-09-05T18:30:01.086185] [INFO ] [MAIN ] JPI: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:01.160881] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-05T18:30:01.134101] [INFO ] [MAIN ] JOF: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:01.169279] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-05T18:30:01.214913] [INFO ] [MAIN ] JPC: Found 1 missing trading days. [2025-09-05T18:30:01.221033] [INFO ] [MAIN ] JPC: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:01.253299] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-05T18:30:01.277400] [INFO ] [MAIN ] JOE: Found 1 missing trading days. [2025-09-05T18:30:01.278291] [INFO ] [MAIN ] JOE: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:01.278530] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-05T18:30:03.663559] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-05T18:30:03.718217] [INFO ] [MAIN ] JOE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:30:03.719696] [INFO ] [MAIN ] JOE: Combined dataset has 11312 total records. [2025-09-05T18:30:03.720084] [FATAL] [VALIDATOR ] JOE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:30:03.720170] [FATAL] [MAIN ] JOE: Combined data validation failed. [2025-09-05T18:30:03.720206] [WARN ] [MAIN ] JOE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:30:03.720244] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-05T18:30:03.720683] [INFO ] [LOCAL ] JOE: Starting deletion of derivative data. [2025-09-05T18:30:03.722088] [INFO ] [MAIN ] Update Progress: 1161/2363 symbols completed. JOE took 4.0s. Estimated remaining: 31m 3s. Rate: 38.7 symbols/min [2025-09-05T18:30:03.805954] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-05T18:30:03.886858] [INFO ] [MAIN ] JOF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:30:03.902582] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-05T18:30:03.919878] [INFO ] [MAIN ] JOF: Combined dataset has 3324 total records. [2025-09-05T18:30:03.919705] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:03.923087] [FATAL] [VALIDATOR ] JOF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:30:03.936011] [INFO ] [MAIN ] JPI: Adding 36 new records, updating 0 existing records. [2025-09-05T18:30:03.933421] [FATAL] [MAIN ] JOF: Combined data validation failed. [2025-09-05T18:30:03.936758] [WARN ] [MAIN ] JOF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:30:03.937675] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-05T18:30:03.938105] [INFO ] [LOCAL ] JOF: Starting deletion of derivative data. [2025-09-05T18:30:03.938069] [INFO ] [MAIN ] JPI: Combined dataset has 2201 total records. [2025-09-05T18:30:03.949924] [INFO ] [MAIN ] Update Progress: 1162/2363 symbols completed. JOF took 4.3s. Estimated remaining: 31m 1s. Rate: 38.7 symbols/min [2025-09-05T18:30:04.234894] [WARN ] [VALIDATOR ] JPI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:04.278101] [INFO ] [MAIN ] JPM: Loaded 25775 existing records. [2025-09-05T18:30:04.382385] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:04.669632] [INFO ] [MAIN ] JPM: Found 1 missing trading days. [2025-09-05T18:30:04.670375] [INFO ] [MAIN ] JQC: Loaded 15741 existing records. [2025-09-05T18:30:04.670619] [INFO ] [MAIN ] JPM: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:04.682007] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-05T18:30:04.847352] [INFO ] [MAIN ] JQC: Found 1 missing trading days. [2025-09-05T18:30:04.847662] [INFO ] [MAIN ] JQC: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:04.848032] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-05T18:30:04.856914] [WARN ] [VALIDATOR ] JPI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:04.857109] [INFO ] [MAIN ] JPI: Combined data validation passed. [2025-09-05T18:30:04.871837] [INFO ] [MAIN ] JPI: Update completed successfully. [2025-09-05T18:30:04.872200] [INFO ] [MAIN ] Update Progress: 1163/2363 symbols completed. JPI took 5.2s. Estimated remaining: 30m 58s. Rate: 38.7 symbols/min [2025-09-05T18:30:05.040096] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:05.048511] [INFO ] [MAIN ] JRI: Loaded 7107 existing records. [2025-09-05T18:30:05.218284] [INFO ] [MAIN ] JRI: Found 1 missing trading days. [2025-09-05T18:30:05.218407] [INFO ] [MAIN ] JRI: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:05.218602] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-05T18:30:05.425206] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (4.17 seconds). [2025-09-05T18:30:05.513311] [INFO ] [MAIN ] JPC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:30:05.514992] [INFO ] [MAIN ] JPC: Combined dataset has 17341 total records. [2025-09-05T18:30:05.515410] [FATAL] [VALIDATOR ] JPC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:30:05.515494] [FATAL] [MAIN ] JPC: Combined data validation failed. [2025-09-05T18:30:05.515534] [WARN ] [MAIN ] JPC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:30:05.515577] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-05T18:30:05.516043] [INFO ] [LOCAL ] JPC: Starting deletion of derivative data. [2025-09-05T18:30:05.517896] [INFO ] [MAIN ] Update Progress: 1164/2363 symbols completed. JPC took 5.8s. Estimated remaining: 30m 56s. Rate: 38.8 symbols/min [2025-09-05T18:30:05.686942] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:05.687151] [WARN ] [MAIN ] JRS: No existing data found, performing full refresh instead. [2025-09-05T18:30:05.687277] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-05T18:30:05.687316] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-05T18:30:05.687362] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-05T18:30:06.044248] [INFO ] [REMOTE ] JRS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:30:06.044572] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-05T18:30:06.108548] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:30:06.295520] [INFO ] [MAIN ] JPM: Adding 390 new records, updating 0 existing records. [2025-09-05T18:30:06.303378] [INFO ] [MAIN ] JPM: Combined dataset has 26165 total records. [2025-09-05T18:30:06.558213] [WARN ] [VALIDATOR ] JPM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:06.764674] [WARN ] [VALIDATOR ] JPM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:06.764911] [INFO ] [MAIN ] JPM: Combined data validation passed. [2025-09-05T18:30:06.940978] [INFO ] [MAIN ] JPM: Update completed successfully. [2025-09-05T18:30:06.944331] [INFO ] [MAIN ] Update Progress: 1165/2363 symbols completed. JPM took 3.2s. Estimated remaining: 30m 54s. Rate: 38.8 symbols/min [2025-09-05T18:30:07.118387] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:07.151976] [INFO ] [MAIN ] JXN: Loaded 34003 existing records. [2025-09-05T18:30:07.329692] [INFO ] [MAIN ] JXN: Found 1 missing trading days. [2025-09-05T18:30:07.329887] [INFO ] [MAIN ] JXN: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:07.330165] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-05T18:30:07.706775] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-05T18:30:07.784380] [INFO ] [MAIN ] JQC: Adding 217 new records, updating 0 existing records. [2025-09-05T18:30:07.787184] [INFO ] [MAIN ] JQC: Combined dataset has 15958 total records. [2025-09-05T18:30:07.943690] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-05T18:30:07.981275] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-05T18:30:07.985263] [WARN ] [VALIDATOR ] JQC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:08.174474] [WARN ] [VALIDATOR ] JQC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:08.174704] [INFO ] [MAIN ] JQC: Combined data validation passed. [2025-09-05T18:30:08.248824] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (3.03 seconds). [2025-09-05T18:30:08.303460] [INFO ] [MAIN ] JRI: Adding 150 new records, updating 0 existing records. [2025-09-05T18:30:08.324360] [INFO ] [MAIN ] JQC: Update completed successfully. [2025-09-05T18:30:08.326617] [INFO ] [MAIN ] Update Progress: 1166/2363 symbols completed. JQC took 4.3s. Estimated remaining: 30m 52s. Rate: 38.8 symbols/min [2025-09-05T18:30:08.359062] [INFO ] [MAIN ] JRI: Combined dataset has 7257 total records. [2025-09-05T18:30:08.657743] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:08.681354] [WARN ] [VALIDATOR ] JRI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:08.726444] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T18:30:09.033146] [INFO ] [MAIN ] K: Loaded 24129 existing records. [2025-09-05T18:30:09.043385] [INFO ] [MAIN ] JXN: Adding 325 new records, updating 0 existing records. [2025-09-05T18:30:09.136437] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-05T18:30:09.155269] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-05T18:30:09.181753] [INFO ] [MAIN ] JXN: Combined dataset has 34328 total records. [2025-09-05T18:30:09.323579] [INFO ] [MAIN ] K: Found 1 missing trading days. [2025-09-05T18:30:09.341131] [INFO ] [MAIN ] K: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:09.353901] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-05T18:30:09.447484] [WARN ] [VALIDATOR ] JXN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:30:09.663592] [WARN ] [VALIDATOR ] JRI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:09.663709] [WARN ] [VALIDATOR ] JXN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:30:09.664143] [INFO ] [MAIN ] JXN: Combined data validation passed. [2025-09-05T18:30:09.664269] [INFO ] [MAIN ] JRI: Combined data validation passed. [2025-09-05T18:30:09.815835] [INFO ] [MAIN ] JRI: Update completed successfully. [2025-09-05T18:30:09.827817] [INFO ] [MAIN ] Update Progress: 1167/2363 symbols completed. JRI took 5.0s. Estimated remaining: 30m 51s. Rate: 38.8 symbols/min [2025-09-05T18:30:10.094384] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:10.099895] [WARN ] [MAIN ] KAI: No existing data found, performing full refresh instead. [2025-09-05T18:30:10.112990] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-05T18:30:10.117302] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-05T18:30:10.117435] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-05T18:30:10.130150] [INFO ] [MAIN ] JXN: Update completed successfully. [2025-09-05T18:30:10.175151] [INFO ] [MAIN ] Update Progress: 1168/2363 symbols completed. JXN took 3.2s. Estimated remaining: 30m 48s. Rate: 38.8 symbols/min [2025-09-05T18:30:10.175065] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-05T18:30:10.250960] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-05T18:30:10.607702] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:10.718795] [INFO ] [REMOTE ] KAI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:30:10.724267] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-05T18:30:10.733795] [INFO ] [MAIN ] KAR: Loaded 19493 existing records. [2025-09-05T18:30:10.909082] [INFO ] [MAIN ] KAR: Found 1 missing trading days. [2025-09-05T18:30:10.909237] [INFO ] [MAIN ] KAR: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:10.909610] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-05T18:30:10.917612] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T18:30:11.069140] [INFO ] [MAIN ] K: Adding 368 new records, updating 0 existing records. [2025-09-05T18:30:11.072815] [INFO ] [MAIN ] K: Combined dataset has 24497 total records. [2025-09-05T18:30:11.268552] [WARN ] [VALIDATOR ] K: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:11.474486] [WARN ] [VALIDATOR ] K: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:11.474737] [INFO ] [MAIN ] K: Combined data validation passed. [2025-09-05T18:30:11.577609] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-05T18:30:11.583052] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-05T18:30:11.649144] [INFO ] [MAIN ] K: Update completed successfully. [2025-09-05T18:30:11.652933] [INFO ] [MAIN ] Update Progress: 1169/2363 symbols completed. K took 3.3s. Estimated remaining: 30m 46s. Rate: 38.8 symbols/min [2025-09-05T18:30:11.840004] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:11.853190] [INFO ] [MAIN ] KB: Loaded 11754 existing records. [2025-09-05T18:30:12.038299] [INFO ] [MAIN ] KB: Found 1 missing trading days. [2025-09-05T18:30:12.038447] [INFO ] [MAIN ] KB: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:12.038690] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-05T18:30:12.322145] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-05T18:30:12.440662] [INFO ] [MAIN ] KAR: Adding 267 new records, updating 0 existing records. [2025-09-05T18:30:12.448698] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-05T18:30:12.452846] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-05T18:30:12.454717] [INFO ] [MAIN ] KAR: Combined dataset has 19760 total records. [2025-09-05T18:30:12.644743] [WARN ] [VALIDATOR ] KAR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:12.853306] [WARN ] [VALIDATOR ] KAR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:12.853551] [INFO ] [MAIN ] KAR: Combined data validation passed. [2025-09-05T18:30:12.978958] [INFO ] [MAIN ] KAR: Update completed successfully. [2025-09-05T18:30:12.981849] [INFO ] [MAIN ] Update Progress: 1170/2363 symbols completed. KAR took 2.8s. Estimated remaining: 30m 45s. Rate: 38.8 symbols/min [2025-09-05T18:30:13.114423] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-05T18:30:13.149739] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-05T18:30:13.174540] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:13.184458] [INFO ] [MAIN ] KBDC: Loaded 8834 existing records. [2025-09-05T18:30:13.342962] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:30:13.362057] [INFO ] [MAIN ] KBDC: Found 1 missing trading days. [2025-09-05T18:30:13.376438] [INFO ] [MAIN ] KBDC: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:13.376718] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-05T18:30:13.418133] [INFO ] [MAIN ] KB: Adding 109 new records, updating 0 existing records. [2025-09-05T18:30:13.434806] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-05T18:30:13.435170] [INFO ] [MAIN ] KB: Combined dataset has 11863 total records. [2025-09-05T18:30:13.475286] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-05T18:30:13.641289] [WARN ] [VALIDATOR ] KB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:13.851854] [WARN ] [VALIDATOR ] KB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:13.852083] [INFO ] [MAIN ] KB: Combined data validation passed. [2025-09-05T18:30:13.932148] [INFO ] [MAIN ] KB: Update completed successfully. [2025-09-05T18:30:13.933852] [INFO ] [MAIN ] Update Progress: 1171/2363 symbols completed. KB took 2.3s. Estimated remaining: 30m 43s. Rate: 38.8 symbols/min [2025-09-05T18:30:14.125904] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:14.152669] [INFO ] [MAIN ] KBH: Loaded 23451 existing records. [2025-09-05T18:30:14.348786] [INFO ] [MAIN ] KBH: Found 1 missing trading days. [2025-09-05T18:30:14.348948] [INFO ] [MAIN ] KBH: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:14.349205] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-05T18:30:14.379432] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-05T18:30:14.534892] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-05T18:30:15.063554] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-05T18:30:15.622333] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-05T18:30:15.701925] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T18:30:15.840573] [INFO ] [MAIN ] KBH: Adding 388 new records, updating 0 existing records. [2025-09-05T18:30:15.843811] [INFO ] [MAIN ] KBH: Combined dataset has 23839 total records. [2025-09-05T18:30:15.868630] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-05T18:30:16.032879] [WARN ] [VALIDATOR ] KBH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:16.226161] [WARN ] [VALIDATOR ] KBH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:16.226364] [INFO ] [MAIN ] KBH: Combined data validation passed. [2025-09-05T18:30:16.374815] [INFO ] [MAIN ] KBH: Update completed successfully. [2025-09-05T18:30:16.377682] [INFO ] [MAIN ] Update Progress: 1172/2363 symbols completed. KBH took 2.4s. Estimated remaining: 30m 42s. Rate: 38.8 symbols/min [2025-09-05T18:30:16.547377] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:16.569438] [INFO ] [MAIN ] KBR: Loaded 23045 existing records. [2025-09-05T18:30:16.669098] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-05T18:30:16.747004] [INFO ] [MAIN ] KBR: Found 1 missing trading days. [2025-09-05T18:30:16.747153] [INFO ] [MAIN ] KBR: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:16.851228] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (3.47 seconds). [2025-09-05T18:30:16.923253] [INFO ] [MAIN ] KBDC: Adding 174 new records, updating 0 existing records. [2025-09-05T18:30:16.925670] [INFO ] [MAIN ] KBDC: Combined dataset has 9008 total records. [2025-09-05T18:30:17.113892] [WARN ] [VALIDATOR ] KBDC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:17.353603] [WARN ] [VALIDATOR ] KBDC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:17.353897] [INFO ] [MAIN ] KBDC: Combined data validation passed. [2025-09-05T18:30:17.411874] [INFO ] [MAIN ] KBDC: Update completed successfully. [2025-09-05T18:30:17.413167] [INFO ] [MAIN ] Update Progress: 1173/2363 symbols completed. KBDC took 4.4s. Estimated remaining: 30m 40s. Rate: 38.8 symbols/min [2025-09-05T18:30:17.474401] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-05T18:30:17.611178] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:17.635599] [INFO ] [MAIN ] KD: Loaded 25035 existing records. [2025-09-05T18:30:17.813191] [INFO ] [MAIN ] KD: Found 1 missing trading days. [2025-09-05T18:30:17.813365] [INFO ] [MAIN ] KD: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:18.069505] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-05T18:30:18.070602] [INFO ] [REMOTE ] JRS: Full fetch complete (11856 records). [2025-09-05T18:30:18.277365] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-05T18:30:18.429179] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-05T18:30:18.489489] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-05T18:30:18.489676] [INFO ] [MAIN ] Update Progress: 1174/2363 symbols completed. JRS took 13.0s. Estimated remaining: 30m 38s. Rate: 38.8 symbols/min [2025-09-05T18:30:18.685511] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:18.697681] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-05T18:30:18.703742] [INFO ] [MAIN ] KEN: Loaded 2237 existing records. [2025-09-05T18:30:18.882220] [INFO ] [MAIN ] KEN: Found 1 missing trading days. [2025-09-05T18:30:18.882391] [INFO ] [MAIN ] KEN: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:18.959874] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-05T18:30:19.068601] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-05T18:30:19.100065] [INFO ] [MAIN ] KBR: Adding 344 new records, updating 0 existing records. [2025-09-05T18:30:19.103735] [INFO ] [MAIN ] KBR: Combined dataset has 23389 total records. [2025-09-05T18:30:19.294313] [WARN ] [VALIDATOR ] KBR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:19.497875] [WARN ] [VALIDATOR ] KBR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:19.498110] [INFO ] [MAIN ] KBR: Combined data validation passed. [2025-09-05T18:30:19.653508] [INFO ] [MAIN ] KBR: Update completed successfully. [2025-09-05T18:30:19.656662] [INFO ] [MAIN ] Update Progress: 1175/2363 symbols completed. KBR took 3.3s. Estimated remaining: 30m 36s. Rate: 38.8 symbols/min [2025-09-05T18:30:19.848078] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:19.848280] [WARN ] [MAIN ] KEP: No existing data found, performing full refresh instead. [2025-09-05T18:30:19.848430] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-05T18:30:19.848471] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-05T18:30:19.848517] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-05T18:30:19.880827] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-05T18:30:20.161608] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T18:30:20.299935] [INFO ] [REMOTE ] KEP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:30:20.391990] [INFO ] [MAIN ] KD: Adding 385 new records, updating 0 existing records. [2025-09-05T18:30:20.395493] [INFO ] [MAIN ] KD: Combined dataset has 25420 total records. [2025-09-05T18:30:20.574986] [WARN ] [VALIDATOR ] KD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:20.673831] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-05T18:30:20.779021] [WARN ] [VALIDATOR ] KD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:20.779249] [INFO ] [MAIN ] KD: Combined data validation passed. [2025-09-05T18:30:20.945619] [INFO ] [MAIN ] KD: Update completed successfully. [2025-09-05T18:30:20.949468] [INFO ] [MAIN ] Update Progress: 1176/2363 symbols completed. KD took 3.5s. Estimated remaining: 30m 34s. Rate: 38.8 symbols/min [2025-09-05T18:30:21.135676] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:21.156546] [INFO ] [MAIN ] KEX: Loaded 17436 existing records. [2025-09-05T18:30:21.337806] [INFO ] [MAIN ] KEX: Found 1 missing trading days. [2025-09-05T18:30:21.338071] [INFO ] [MAIN ] KEX: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:21.352984] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-05T18:30:21.376137] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-05T18:30:21.386976] [INFO ] [MAIN ] KEN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:30:21.387937] [INFO ] [MAIN ] KEN: Combined dataset has 2237 total records. [2025-09-05T18:30:21.388264] [FATAL] [VALIDATOR ] KEN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:30:21.388339] [FATAL] [MAIN ] KEN: Combined data validation failed. [2025-09-05T18:30:21.388375] [WARN ] [MAIN ] KEN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:30:21.388412] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-05T18:30:21.388635] [INFO ] [LOCAL ] KEN: Starting deletion of derivative data. [2025-09-05T18:30:21.389060] [INFO ] [MAIN ] Update Progress: 1177/2363 symbols completed. KEN took 2.9s. Estimated remaining: 30m 31s. Rate: 38.9 symbols/min [2025-09-05T18:30:21.468661] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-05T18:30:21.560022] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:21.588737] [INFO ] [MAIN ] KEY: Loaded 25628 existing records. [2025-09-05T18:30:21.764928] [INFO ] [MAIN ] KEY: Found 1 missing trading days. [2025-09-05T18:30:21.765099] [INFO ] [MAIN ] KEY: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:22.144597] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-05T18:30:22.263512] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-05T18:30:22.988248] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-05T18:30:23.063436] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-05T18:30:23.214089] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-05T18:30:23.863470] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-05T18:30:24.430023] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-05T18:30:24.663523] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-05T18:30:25.463524] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-05T18:30:25.922415] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-05T18:30:26.260999] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-05T18:30:26.270614] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-05T18:30:26.382837] [INFO ] [MAIN ] KEY: Adding 390 new records, updating 0 existing records. [2025-09-05T18:30:26.386874] [INFO ] [MAIN ] KEY: Combined dataset has 26018 total records. [2025-09-05T18:30:26.574522] [WARN ] [VALIDATOR ] KEY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:26.776580] [WARN ] [VALIDATOR ] KEY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:26.776836] [INFO ] [MAIN ] KEY: Combined data validation passed. [2025-09-05T18:30:26.883290] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:30:27.032852] [INFO ] [MAIN ] KEX: Adding 341 new records, updating 0 existing records. [2025-09-05T18:30:27.049491] [INFO ] [MAIN ] KEX: Combined dataset has 17777 total records. [2025-09-05T18:30:27.068903] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-05T18:30:27.247629] [WARN ] [VALIDATOR ] KEX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:27.394942] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-05T18:30:27.495251] [INFO ] [MAIN ] KEY: Update completed successfully. [2025-09-05T18:30:27.501051] [INFO ] [MAIN ] Update Progress: 1178/2363 symbols completed. KEY took 6.1s. Estimated remaining: 30m 35s. Rate: 38.8 symbols/min [2025-09-05T18:30:27.684175] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:27.689775] [WARN ] [VALIDATOR ] KEX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:27.689993] [INFO ] [MAIN ] KEX: Combined data validation passed. [2025-09-05T18:30:27.794349] [INFO ] [MAIN ] KEYS: Loaded 20098 existing records. [2025-09-05T18:30:27.873066] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-05T18:30:27.894585] [INFO ] [MAIN ] KEX: Update completed successfully. [2025-09-05T18:30:27.918795] [INFO ] [MAIN ] Update Progress: 1179/2363 symbols completed. KEX took 7.0s. Estimated remaining: 30m 32s. Rate: 38.8 symbols/min [2025-09-05T18:30:28.105303] [INFO ] [MAIN ] KEYS: Found 1 missing trading days. [2025-09-05T18:30:28.121086] [INFO ] [MAIN ] KEYS: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:28.179508] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:28.182349] [INFO ] [MAIN ] KF: Loaded 1090 existing records. [2025-09-05T18:30:28.350338] [INFO ] [MAIN ] KF: Found 1 missing trading days. [2025-09-05T18:30:28.355690] [INFO ] [MAIN ] KF: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:28.365319] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-05T18:30:28.663515] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-05T18:30:29.191123] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T18:30:29.192520] [INFO ] [REMOTE ] KAI: Full fetch complete (15236 records). [2025-09-05T18:30:29.467627] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-05T18:30:29.549987] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-05T18:30:29.619164] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-05T18:30:29.619316] [INFO ] [MAIN ] Update Progress: 1180/2363 symbols completed. KAI took 19.8s. Estimated remaining: 30m 30s. Rate: 38.8 symbols/min [2025-09-05T18:30:29.790551] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:29.801326] [INFO ] [MAIN ] KFRC: Loaded 9757 existing records. [2025-09-05T18:30:29.980122] [INFO ] [MAIN ] KFRC: Found 1 missing trading days. [2025-09-05T18:30:29.980457] [INFO ] [MAIN ] KFRC: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:29.987204] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T18:30:30.114897] [INFO ] [MAIN ] KEYS: Adding 318 new records, updating 0 existing records. [2025-09-05T18:30:30.117907] [INFO ] [MAIN ] KEYS: Combined dataset has 20416 total records. [2025-09-05T18:30:30.267388] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-05T18:30:30.304296] [WARN ] [VALIDATOR ] KEYS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:30.511235] [WARN ] [VALIDATOR ] KEYS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:30.511456] [INFO ] [MAIN ] KEYS: Combined data validation passed. [2025-09-05T18:30:30.648243] [INFO ] [MAIN ] KEYS: Update completed successfully. [2025-09-05T18:30:30.650791] [INFO ] [MAIN ] Update Progress: 1181/2363 symbols completed. KEYS took 3.1s. Estimated remaining: 30m 28s. Rate: 38.8 symbols/min [2025-09-05T18:30:30.839199] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:30.862795] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-05T18:30:30.873409] [INFO ] [MAIN ] KFS: Loaded 6378 existing records. [2025-09-05T18:30:31.052283] [INFO ] [MAIN ] KFS: Found 1 missing trading days. [2025-09-05T18:30:31.052453] [INFO ] [MAIN ] KFS: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:31.063452] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-05T18:30:31.863565] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-05T18:30:32.586312] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-05T18:30:32.593212] [INFO ] [MAIN ] KF: Adding 7 new records, updating 0 existing records. [2025-09-05T18:30:32.594582] [INFO ] [MAIN ] KF: Combined dataset has 1097 total records. [2025-09-05T18:30:32.670196] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-05T18:30:32.777070] [WARN ] [VALIDATOR ] KF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:32.972847] [WARN ] [VALIDATOR ] KF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:32.973106] [INFO ] [MAIN ] KF: Combined data validation passed. [2025-09-05T18:30:32.981388] [INFO ] [MAIN ] KF: Update completed successfully. [2025-09-05T18:30:32.981799] [INFO ] [MAIN ] Update Progress: 1182/2363 symbols completed. KF took 5.1s. Estimated remaining: 30m 28s. Rate: 38.8 symbols/min [2025-09-05T18:30:33.162551] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:33.180762] [INFO ] [MAIN ] KFY: Loaded 14093 existing records. [2025-09-05T18:30:33.357613] [INFO ] [MAIN ] KFY: Found 1 missing trading days. [2025-09-05T18:30:33.357859] [INFO ] [MAIN ] KFY: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:33.458732] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-05T18:30:33.469548] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-05T18:30:33.523705] [INFO ] [MAIN ] KFRC: Adding 178 new records, updating 0 existing records. [2025-09-05T18:30:33.527719] [INFO ] [MAIN ] KFRC: Combined dataset has 9935 total records. [2025-09-05T18:30:33.636187] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-05T18:30:33.699246] [INFO ] [MAIN ] KFS: Adding 92 new records, updating 0 existing records. [2025-09-05T18:30:33.755114] [WARN ] [VALIDATOR ] KFRC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:33.842941] [INFO ] [MAIN ] KFS: Combined dataset has 6470 total records. [2025-09-05T18:30:34.140496] [WARN ] [VALIDATOR ] KFS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:30:34.350408] [WARN ] [VALIDATOR ] KFS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:30:34.350488] [WARN ] [VALIDATOR ] KFRC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:34.350889] [INFO ] [MAIN ] KFRC: Combined data validation passed. [2025-09-05T18:30:34.350788] [INFO ] [MAIN ] KFS: Combined data validation passed. [2025-09-05T18:30:34.437607] [INFO ] [MAIN ] KFS: Update completed successfully. [2025-09-05T18:30:34.441589] [INFO ] [MAIN ] Update Progress: 1183/2363 symbols completed. KFS took 3.8s. Estimated remaining: 30m 26s. Rate: 38.8 symbols/min [2025-09-05T18:30:34.564978] [INFO ] [MAIN ] KFRC: Update completed successfully. [2025-09-05T18:30:34.581538] [INFO ] [MAIN ] Update Progress: 1184/2363 symbols completed. KFRC took 5.0s. Estimated remaining: 30m 23s. Rate: 38.8 symbols/min [2025-09-05T18:30:34.657399] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:34.800124] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:34.825567] [INFO ] [MAIN ] KGC: Loaded 25686 existing records. [2025-09-05T18:30:34.962373] [INFO ] [MAIN ] KGS: Loaded 21992 existing records. [2025-09-05T18:30:35.128392] [INFO ] [MAIN ] KGC: Found 1 missing trading days. [2025-09-05T18:30:35.138397] [INFO ] [MAIN ] KGC: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:35.182393] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-05T18:30:35.206206] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-05T18:30:35.215379] [INFO ] [MAIN ] KGS: Found 1 missing trading days. [2025-09-05T18:30:35.235408] [INFO ] [MAIN ] KGS: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:35.273433] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-05T18:30:35.320689] [INFO ] [MAIN ] KFY: Adding 216 new records, updating 0 existing records. [2025-09-05T18:30:35.349012] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-05T18:30:35.359044] [INFO ] [MAIN ] KFY: Combined dataset has 14309 total records. [2025-09-05T18:30:35.601519] [WARN ] [VALIDATOR ] KFY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:35.875460] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-05T18:30:35.910190] [WARN ] [VALIDATOR ] KFY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:35.911433] [INFO ] [MAIN ] KFY: Combined data validation passed. [2025-09-05T18:30:36.039548] [INFO ] [MAIN ] KFY: Update completed successfully. [2025-09-05T18:30:36.042406] [INFO ] [MAIN ] Update Progress: 1185/2363 symbols completed. KFY took 3.1s. Estimated remaining: 30m 21s. Rate: 38.8 symbols/min [2025-09-05T18:30:36.292111] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:36.332574] [INFO ] [MAIN ] KIM: Loaded 25289 existing records. [2025-09-05T18:30:36.569259] [INFO ] [MAIN ] KIM: Found 1 missing trading days. [2025-09-05T18:30:36.569494] [INFO ] [MAIN ] KIM: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:36.663526] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-05T18:30:36.699164] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:30:36.888256] [INFO ] [MAIN ] KGS: Adding 376 new records, updating 0 existing records. [2025-09-05T18:30:36.891562] [INFO ] [MAIN ] KGS: Combined dataset has 22368 total records. [2025-09-05T18:30:37.086921] [WARN ] [VALIDATOR ] KGS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:37.195669] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-05T18:30:37.435730] [INFO ] [MAIN ] KGC: Adding 390 new records, updating 0 existing records. [2025-09-05T18:30:37.441267] [INFO ] [MAIN ] KGC: Combined dataset has 26076 total records. [2025-09-05T18:30:37.634090] [WARN ] [VALIDATOR ] KGC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:37.861354] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-05T18:30:37.870259] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-05T18:30:37.879087] [WARN ] [VALIDATOR ] KGS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:37.879552] [INFO ] [MAIN ] KGS: Combined data validation passed. [2025-09-05T18:30:37.886799] [WARN ] [VALIDATOR ] KGC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:37.887027] [INFO ] [MAIN ] KGC: Combined data validation passed. [2025-09-05T18:30:38.087016] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:30:38.267471] [INFO ] [MAIN ] KIM: Adding 385 new records, updating 0 existing records. [2025-09-05T18:30:38.322696] [INFO ] [MAIN ] KIM: Combined dataset has 25674 total records. [2025-09-05T18:30:38.323583] [INFO ] [MAIN ] KGC: Update completed successfully. [2025-09-05T18:30:38.326297] [INFO ] [MAIN ] Update Progress: 1186/2363 symbols completed. KGC took 3.9s. Estimated remaining: 30m 21s. Rate: 38.8 symbols/min [2025-09-05T18:30:38.666797] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:38.723523] [WARN ] [VALIDATOR ] KIM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:38.837511] [INFO ] [MAIN ] KIO: Loaded 10484 existing records. [2025-09-05T18:30:39.095892] [INFO ] [MAIN ] KGS: Update completed successfully. [2025-09-05T18:30:39.126800] [INFO ] [MAIN ] Update Progress: 1187/2363 symbols completed. KGS took 4.5s. Estimated remaining: 30m 18s. Rate: 38.8 symbols/min [2025-09-05T18:30:39.150250] [INFO ] [MAIN ] KIO: Found 1 missing trading days. [2025-09-05T18:30:39.184683] [INFO ] [MAIN ] KIO: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:39.206419] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-05T18:30:39.329860] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:39.346157] [WARN ] [VALIDATOR ] KIM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:39.346375] [INFO ] [MAIN ] KIM: Combined data validation passed. [2025-09-05T18:30:39.410066] [INFO ] [MAIN ] KKR: Loaded 25538 existing records. [2025-09-05T18:30:39.644920] [INFO ] [MAIN ] KKR: Found 1 missing trading days. [2025-09-05T18:30:39.646456] [INFO ] [MAIN ] KKR: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:39.648077] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-05T18:30:39.687957] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-05T18:30:39.739799] [INFO ] [MAIN ] KIM: Update completed successfully. [2025-09-05T18:30:39.742411] [INFO ] [MAIN ] Update Progress: 1188/2363 symbols completed. KIM took 3.7s. Estimated remaining: 30m 16s. Rate: 38.8 symbols/min [2025-09-05T18:30:39.868538] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-05T18:30:39.917005] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:39.921143] [INFO ] [MAIN ] KKRS: Loaded 2482 existing records. [2025-09-05T18:30:40.092506] [INFO ] [MAIN ] KKRS: Found 1 missing trading days. [2025-09-05T18:30:40.092706] [INFO ] [MAIN ] KKRS: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:40.663511] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-05T18:30:40.941835] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-05T18:30:41.435496] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-05T18:30:41.468528] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-05T18:30:41.584809] [INFO ] [MAIN ] KKR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:30:41.588246] [INFO ] [MAIN ] KKR: Combined dataset has 25928 total records. [2025-09-05T18:30:41.788591] [WARN ] [VALIDATOR ] KKR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:41.992222] [WARN ] [VALIDATOR ] KKR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:41.992443] [INFO ] [MAIN ] KKR: Combined data validation passed. [2025-09-05T18:30:42.161953] [INFO ] [MAIN ] KKR: Update completed successfully. [2025-09-05T18:30:42.164728] [INFO ] [MAIN ] Update Progress: 1189/2363 symbols completed. KKR took 3.0s. Estimated remaining: 30m 15s. Rate: 38.8 symbols/min [2025-09-05T18:30:42.275744] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (3.07 seconds). [2025-09-05T18:30:42.370307] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:42.400562] [INFO ] [MAIN ] KIO: Adding 154 new records, updating 0 existing records. [2025-09-05T18:30:42.404907] [INFO ] [MAIN ] KIO: Combined dataset has 10638 total records. [2025-09-05T18:30:42.501669] [INFO ] [MAIN ] KKRT: Loaded 7259 existing records. [2025-09-05T18:30:42.713000] [WARN ] [VALIDATOR ] KIO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:42.827350] [INFO ] [MAIN ] KKRT: Found 1 missing trading days. [2025-09-05T18:30:42.858439] [INFO ] [MAIN ] KKRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:42.901039] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:30:42.888854] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-05T18:30:42.909457] [INFO ] [REMOTE ] KEP: Full fetch complete (31849 records). [2025-09-05T18:30:43.239399] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-05T18:30:43.278159] [INFO ] [MAIN ] KKRS: Adding 15 new records, updating 0 existing records. [2025-09-05T18:30:43.306062] [INFO ] [MAIN ] KKRS: Combined dataset has 2497 total records. [2025-09-05T18:30:43.465843] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-05T18:30:43.650666] [WARN ] [VALIDATOR ] KKRS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:43.936617] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-05T18:30:43.937144] [INFO ] [MAIN ] Update Progress: 1190/2363 symbols completed. KEP took 24.3s. Estimated remaining: 30m 14s. Rate: 38.8 symbols/min [2025-09-05T18:30:44.132507] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:44.139499] [WARN ] [VALIDATOR ] KKRS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:44.139567] [WARN ] [VALIDATOR ] KIO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:44.139786] [INFO ] [MAIN ] KKRS: Combined data validation passed. [2025-09-05T18:30:44.139869] [INFO ] [MAIN ] KIO: Combined data validation passed. [2025-09-05T18:30:44.225580] [INFO ] [MAIN ] KLC: Loaded 16749 existing records. [2025-09-05T18:30:44.264816] [INFO ] [MAIN ] KKRS: Update completed successfully. [2025-09-05T18:30:44.279141] [INFO ] [MAIN ] Update Progress: 1191/2363 symbols completed. KKRS took 4.5s. Estimated remaining: 30m 11s. Rate: 38.8 symbols/min [2025-09-05T18:30:44.278754] [INFO ] [MAIN ] KIO: Update completed successfully. [2025-09-05T18:30:44.301828] [INFO ] [MAIN ] Update Progress: 1192/2363 symbols completed. KIO took 6.0s. Estimated remaining: 30m 8s. Rate: 38.9 symbols/min [2025-09-05T18:30:44.603825] [INFO ] [MAIN ] KLC: Found 1 missing trading days. [2025-09-05T18:30:44.632208] [INFO ] [MAIN ] KLC: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:44.697178] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-05T18:30:44.748421] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:44.780823] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:44.781302] [WARN ] [MAIN ] KLG: No existing data found, performing full refresh instead. [2025-09-05T18:30:44.781449] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-05T18:30:44.781494] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-05T18:30:44.781540] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-05T18:30:45.015697] [INFO ] [MAIN ] KMI: Loaded 25677 existing records. [2025-09-05T18:30:45.290624] [INFO ] [REMOTE ] KLG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:30:45.293270] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-05T18:30:45.371874] [INFO ] [MAIN ] KMI: Found 1 missing trading days. [2025-09-05T18:30:45.372043] [INFO ] [MAIN ] KMI: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:45.372265] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-05T18:30:45.781143] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-09-05T18:30:45.809856] [INFO ] [MAIN ] KKRT: Adding 80 new records, updating 0 existing records. [2025-09-05T18:30:45.811865] [INFO ] [MAIN ] KKRT: Combined dataset has 7339 total records. [2025-09-05T18:30:45.990994] [WARN ] [VALIDATOR ] KKRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:46.186715] [WARN ] [VALIDATOR ] KKRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:46.186926] [INFO ] [MAIN ] KKRT: Combined data validation passed. [2025-09-05T18:30:46.232005] [INFO ] [MAIN ] KKRT: Update completed successfully. [2025-09-05T18:30:46.233094] [INFO ] [MAIN ] Update Progress: 1193/2363 symbols completed. KKRT took 4.1s. Estimated remaining: 30m 7s. Rate: 38.9 symbols/min [2025-09-05T18:30:46.406968] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:46.411478] [INFO ] [MAIN ] KMPB: Loaded 2639 existing records. [2025-09-05T18:30:46.586387] [INFO ] [MAIN ] KMPB: Found 1 missing trading days. [2025-09-05T18:30:46.586530] [INFO ] [MAIN ] KMPB: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:46.586767] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-05T18:30:46.753800] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T18:30:46.889578] [INFO ] [MAIN ] KMI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:30:46.891840] [INFO ] [MAIN ] KMI: Combined dataset has 25677 total records. [2025-09-05T18:30:46.892383] [FATAL] [VALIDATOR ] KMI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:30:46.892484] [FATAL] [MAIN ] KMI: Combined data validation failed. [2025-09-05T18:30:46.892543] [WARN ] [MAIN ] KMI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:30:46.892596] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-05T18:30:46.893271] [INFO ] [LOCAL ] KMI: Starting deletion of derivative data. [2025-09-05T18:30:46.896224] [INFO ] [MAIN ] Update Progress: 1194/2363 symbols completed. KMI took 2.6s. Estimated remaining: 30m 4s. Rate: 38.9 symbols/min [2025-09-05T18:30:47.070549] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:47.090073] [INFO ] [MAIN ] KMPR: Loaded 19845 existing records. [2025-09-05T18:30:47.270614] [INFO ] [MAIN ] KMPR: Found 1 missing trading days. [2025-09-05T18:30:47.270795] [INFO ] [MAIN ] KMPR: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:47.271024] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-05T18:30:48.100629] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-05T18:30:48.109964] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-05T18:30:48.164433] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (3.47 seconds). [2025-09-05T18:30:48.259873] [INFO ] [MAIN ] KLC: Adding 284 new records, updating 0 existing records. [2025-09-05T18:30:48.262875] [INFO ] [MAIN ] KLC: Combined dataset has 17033 total records. [2025-09-05T18:30:48.441704] [WARN ] [VALIDATOR ] KLC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:48.630005] [WARN ] [VALIDATOR ] KLC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:48.630207] [INFO ] [MAIN ] KLC: Combined data validation passed. [2025-09-05T18:30:48.732204] [INFO ] [MAIN ] KLC: Update completed successfully. [2025-09-05T18:30:48.734262] [INFO ] [MAIN ] Update Progress: 1195/2363 symbols completed. KLC took 4.8s. Estimated remaining: 30m 3s. Rate: 38.9 symbols/min [2025-09-05T18:30:48.843075] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-05T18:30:48.959972] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:49.045847] [INFO ] [MAIN ] KMPR: Adding 358 new records, updating 0 existing records. [2025-09-05T18:30:49.054887] [INFO ] [MAIN ] KMPR: Combined dataset has 20203 total records. [2025-09-05T18:30:49.067296] [INFO ] [MAIN ] KMT: Loaded 20499 existing records. [2025-09-05T18:30:49.238201] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-05T18:30:49.269050] [INFO ] [MAIN ] KMPB: Adding 9 new records, updating 0 existing records. [2025-09-05T18:30:49.409337] [INFO ] [MAIN ] KMPB: Combined dataset has 2648 total records. [2025-09-05T18:30:49.471579] [WARN ] [VALIDATOR ] KMPR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:49.500630] [INFO ] [MAIN ] KMT: Found 1 missing trading days. [2025-09-05T18:30:49.560482] [INFO ] [MAIN ] KMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:49.608608] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-05T18:30:49.826364] [WARN ] [VALIDATOR ] KMPB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:30:50.051896] [WARN ] [VALIDATOR ] KMPR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:50.051766] [WARN ] [VALIDATOR ] KMPB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:30:50.067782] [INFO ] [MAIN ] KMPR: Combined data validation passed. [2025-09-05T18:30:50.067943] [INFO ] [MAIN ] KMPB: Combined data validation passed. [2025-09-05T18:30:50.070591] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-05T18:30:50.080870] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-05T18:30:50.151602] [INFO ] [MAIN ] KMPB: Update completed successfully. [2025-09-05T18:30:50.161473] [INFO ] [MAIN ] Update Progress: 1196/2363 symbols completed. KMPB took 3.9s. Estimated remaining: 30m 2s. Rate: 38.9 symbols/min [2025-09-05T18:30:50.355816] [INFO ] [MAIN ] KMPR: Update completed successfully. [2025-09-05T18:30:50.375255] [INFO ] [MAIN ] Update Progress: 1197/2363 symbols completed. KMPR took 3.5s. Estimated remaining: 29m 59s. Rate: 38.9 symbols/min [2025-09-05T18:30:50.437335] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:30:50.477323] [INFO ] [MAIN ] KMX: Loaded 40079 existing records. [2025-09-05T18:30:50.681031] [INFO ] [MAIN ] KMX: Found 1 missing trading days. [2025-09-05T18:30:50.681319] [INFO ] [MAIN ] KMX: Need to fetch 1 months: 2025-09 [2025-09-05T18:30:50.681687] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-05T18:30:51.242522] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-05T18:30:51.350950] [INFO ] [MAIN ] KMT: Adding 267 new records, updating 0 existing records. [2025-09-05T18:30:51.354089] [INFO ] [MAIN ] KMT: Combined dataset has 20766 total records. [2025-09-05T18:30:51.536506] [WARN ] [VALIDATOR ] KMT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:30:51.782535] [WARN ] [VALIDATOR ] KMT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:30:51.782798] [INFO ] [MAIN ] KMT: Combined data validation passed. [2025-09-05T18:30:51.915170] [INFO ] [MAIN ] KMT: Update completed successfully. [2025-09-05T18:30:51.917741] [INFO ] [MAIN ] Update Progress: 1198/2363 symbols completed. KMT took 3.2s. Estimated remaining: 29m 57s. Rate: 38.9 symbols/min [2025-09-05T18:30:52.555744] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-05T18:30:52.719285] [INFO ] [MAIN ] KMX: Adding 384 new records, updating 0 existing records. [2025-09-05T18:30:52.724093] [INFO ] [MAIN ] KMX: Combined dataset has 40463 total records. [2025-09-05T18:30:52.947689] [WARN ] [VALIDATOR ] KMX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:30:53.019408] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-05T18:30:53.069313] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-05T18:30:53.177826] [WARN ] [VALIDATOR ] KMX: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:30:53.178052] [INFO ] [MAIN ] KMX: Combined data validation passed. [2025-09-05T18:30:53.422726] [INFO ] [MAIN ] KMX: Update completed successfully. [2025-09-05T18:30:53.427315] [INFO ] [MAIN ] Update Progress: 1199/2363 symbols completed. KMX took 3.2s. Estimated remaining: 29m 56s. Rate: 38.9 symbols/min [2025-09-05T18:30:54.808891] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-05T18:30:54.817878] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-05T18:30:56.441417] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-05T18:30:56.450345] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-05T18:30:57.997587] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-05T18:30:58.006706] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-05T18:31:00.649410] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-05T18:31:00.660288] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-05T18:31:03.056420] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-05T18:31:03.064754] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-05T18:31:05.086427] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-05T18:31:05.088887] [INFO ] [REMOTE ] KLG: Full fetch complete (46053 records). [2025-09-05T18:31:05.457980] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-05T18:31:05.658269] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-05T18:31:05.658434] [INFO ] [MAIN ] Update Progress: 1200/2363 symbols completed. KLG took 21.4s. Estimated remaining: 30m 4s. Rate: 38.7 symbols/min [2025-09-05T18:31:06.320981] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:06.307338] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:06.362130] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:06.358463] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:06.362827] [WARN ] [MAIN ] KN: No existing data found, performing full refresh instead. [2025-09-05T18:31:06.364098] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-05T18:31:06.364168] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-05T18:31:06.364229] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-05T18:31:06.465282] [INFO ] [MAIN ] KNOP: Loaded 7001 existing records. [2025-09-05T18:31:06.500275] [INFO ] [MAIN ] KNSL: Loaded 9146 existing records. [2025-09-05T18:31:06.699747] [INFO ] [MAIN ] KNF: Loaded 27041 existing records. [2025-09-05T18:31:07.046967] [INFO ] [MAIN ] KNOP: Found 1 missing trading days. [2025-09-05T18:31:07.093015] [INFO ] [MAIN ] KNOP: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:07.269060] [INFO ] [REMOTE ] KN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:31:07.265383] [INFO ] [MAIN ] KNSL: Found 1 missing trading days. [2025-09-05T18:31:07.276732] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-05T18:31:07.277075] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-05T18:31:07.279124] [INFO ] [MAIN ] KNSL: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:07.280778] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-05T18:31:07.306702] [INFO ] [MAIN ] KNF: Found 1 missing trading days. [2025-09-05T18:31:07.307391] [INFO ] [MAIN ] KNF: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:07.307736] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-05T18:31:08.650934] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T18:31:08.681538] [INFO ] [MAIN ] KNOP: Adding 43 new records, updating 0 existing records. [2025-09-05T18:31:08.692360] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T18:31:08.692465] [INFO ] [MAIN ] KNOP: Combined dataset has 7044 total records. [2025-09-05T18:31:08.987053] [INFO ] [MAIN ] KNF: Adding 345 new records, updating 0 existing records. [2025-09-05T18:31:09.021894] [WARN ] [VALIDATOR ] KNOP: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:31:09.031194] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-05T18:31:09.155090] [INFO ] [MAIN ] KNSL: Adding 96 new records, updating 0 existing records. [2025-09-05T18:31:09.176928] [INFO ] [MAIN ] KNF: Combined dataset has 27386 total records. [2025-09-05T18:31:09.348737] [INFO ] [MAIN ] KNSL: Combined dataset has 9242 total records. [2025-09-05T18:31:09.526242] [WARN ] [VALIDATOR ] KNF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:31:09.624690] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-05T18:31:09.662356] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-05T18:31:09.840465] [WARN ] [VALIDATOR ] KNSL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:10.156216] [WARN ] [VALIDATOR ] KNOP: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:31:10.156742] [INFO ] [MAIN ] KNOP: Combined data validation passed. [2025-09-05T18:31:10.156460] [WARN ] [VALIDATOR ] KNSL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:10.156948] [INFO ] [MAIN ] KNSL: Combined data validation passed. [2025-09-05T18:31:10.156361] [WARN ] [VALIDATOR ] KNF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:31:10.158463] [INFO ] [MAIN ] KNF: Combined data validation passed. [2025-09-05T18:31:10.323896] [INFO ] [MAIN ] KNSL: Update completed successfully. [2025-09-05T18:31:10.353322] [INFO ] [MAIN ] Update Progress: 1201/2363 symbols completed. KNSL took 4.7s. Estimated remaining: 30m 6s. Rate: 38.6 symbols/min [2025-09-05T18:31:10.351890] [INFO ] [MAIN ] KNOP: Update completed successfully. [2025-09-05T18:31:10.388778] [INFO ] [MAIN ] Update Progress: 1202/2363 symbols completed. KNOP took 4.7s. Estimated remaining: 30m 3s. Rate: 38.6 symbols/min [2025-09-05T18:31:10.676123] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:10.737793] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:10.836181] [INFO ] [MAIN ] KNF: Update completed successfully. [2025-09-05T18:31:10.841233] [INFO ] [MAIN ] Update Progress: 1203/2363 symbols completed. KNF took 5.1s. Estimated remaining: 30m 0s. Rate: 38.7 symbols/min [2025-09-05T18:31:10.853101] [INFO ] [MAIN ] KNTK: Loaded 35326 existing records. [2025-09-05T18:31:10.866754] [INFO ] [MAIN ] KNX: Loaded 39482 existing records. [2025-09-05T18:31:11.372796] [INFO ] [MAIN ] KNX: Found 1 missing trading days. [2025-09-05T18:31:11.388228] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:11.399820] [INFO ] [MAIN ] KNX: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:11.399703] [INFO ] [MAIN ] KNTK: Found 1 missing trading days. [2025-09-05T18:31:11.399984] [INFO ] [MAIN ] KNTK: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:11.400453] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-05T18:31:11.400852] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-05T18:31:11.453805] [INFO ] [MAIN ] KO: Loaded 40558 existing records. [2025-09-05T18:31:11.645198] [INFO ] [MAIN ] KO: Found 1 missing trading days. [2025-09-05T18:31:11.645465] [INFO ] [MAIN ] KO: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:11.645919] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-05T18:31:11.673129] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-05T18:31:11.682452] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-05T18:31:12.657072] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-05T18:31:12.818353] [INFO ] [MAIN ] KNX: Adding 387 new records, updating 0 existing records. [2025-09-05T18:31:12.826617] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:31:12.906879] [INFO ] [MAIN ] KNX: Combined dataset has 39869 total records. [2025-09-05T18:31:13.075437] [INFO ] [MAIN ] KNTK: Adding 361 new records, updating 0 existing records. [2025-09-05T18:31:13.172347] [WARN ] [VALIDATOR ] KNX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:31:13.204301] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T18:31:13.240398] [INFO ] [MAIN ] KNTK: Combined dataset has 35687 total records. [2025-09-05T18:31:13.736307] [INFO ] [MAIN ] KO: Adding 390 new records, updating 0 existing records. [2025-09-05T18:31:13.766732] [WARN ] [VALIDATOR ] KNTK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:31:13.877757] [INFO ] [MAIN ] KO: Combined dataset has 40948 total records. [2025-09-05T18:31:14.165124] [WARN ] [VALIDATOR ] KO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:31:14.406965] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-05T18:31:14.419557] [WARN ] [VALIDATOR ] KNX: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:31:14.420528] [INFO ] [MAIN ] KNX: Combined data validation passed. [2025-09-05T18:31:14.421555] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-05T18:31:14.686104] [WARN ] [VALIDATOR ] KNTK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:31:14.685539] [WARN ] [VALIDATOR ] KO: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:31:14.687518] [INFO ] [MAIN ] KO: Combined data validation passed. [2025-09-05T18:31:14.687743] [INFO ] [MAIN ] KNTK: Combined data validation passed. [2025-09-05T18:31:14.909824] [INFO ] [MAIN ] KNX: Update completed successfully. [2025-09-05T18:31:14.918158] [INFO ] [MAIN ] Update Progress: 1204/2363 symbols completed. KNX took 4.5s. Estimated remaining: 30m 1s. Rate: 38.6 symbols/min [2025-09-05T18:31:15.122435] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:15.124156] [WARN ] [MAIN ] KODK: No existing data found, performing full refresh instead. [2025-09-05T18:31:15.127986] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-05T18:31:15.128590] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-05T18:31:15.133333] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-05T18:31:15.610539] [INFO ] [REMOTE ] KODK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:31:15.613891] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-05T18:31:15.705389] [INFO ] [MAIN ] KNTK: Update completed successfully. [2025-09-05T18:31:15.710286] [INFO ] [MAIN ] Update Progress: 1205/2363 symbols completed. KNTK took 5.4s. Estimated remaining: 29m 59s. Rate: 38.6 symbols/min [2025-09-05T18:31:15.933235] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:15.970791] [INFO ] [MAIN ] KOF: Loaded 12621 existing records. [2025-09-05T18:31:15.970429] [INFO ] [MAIN ] KO: Update completed successfully. [2025-09-05T18:31:15.977211] [INFO ] [MAIN ] Update Progress: 1206/2363 symbols completed. KO took 5.1s. Estimated remaining: 29m 56s. Rate: 38.7 symbols/min [2025-09-05T18:31:16.351211] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:16.392215] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-05T18:31:16.388121] [INFO ] [MAIN ] KOF: Found 1 missing trading days. [2025-09-05T18:31:16.404849] [INFO ] [MAIN ] KOF: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:16.406132] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-05T18:31:16.406556] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-05T18:31:16.415351] [INFO ] [MAIN ] KOP: Loaded 7585 existing records. [2025-09-05T18:31:16.606260] [INFO ] [MAIN ] KOP: Found 1 missing trading days. [2025-09-05T18:31:16.606461] [INFO ] [MAIN ] KOP: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:16.606760] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-05T18:31:17.318476] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-05T18:31:17.327298] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-05T18:31:17.700561] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:31:17.729839] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T18:31:17.858507] [INFO ] [MAIN ] KOP: Adding 165 new records, updating 0 existing records. [2025-09-05T18:31:17.857959] [INFO ] [MAIN ] KOF: Adding 227 new records, updating 0 existing records. [2025-09-05T18:31:17.862880] [INFO ] [MAIN ] KOP: Combined dataset has 7750 total records. [2025-09-05T18:31:17.899311] [INFO ] [MAIN ] KOF: Combined dataset has 12848 total records. [2025-09-05T18:31:18.192252] [WARN ] [VALIDATOR ] KOP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:18.314268] [WARN ] [VALIDATOR ] KOF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:18.674276] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-09-05T18:31:18.684003] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-05T18:31:18.707434] [WARN ] [VALIDATOR ] KOP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:18.707700] [INFO ] [MAIN ] KOP: Combined data validation passed. [2025-09-05T18:31:18.707523] [WARN ] [VALIDATOR ] KOF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:18.708480] [INFO ] [MAIN ] KOF: Combined data validation passed. [2025-09-05T18:31:18.836961] [INFO ] [MAIN ] KOF: Update completed successfully. [2025-09-05T18:31:18.840155] [INFO ] [MAIN ] Update Progress: 1207/2363 symbols completed. KOF took 3.1s. Estimated remaining: 29m 56s. Rate: 38.6 symbols/min [2025-09-05T18:31:18.898705] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-05T18:31:18.904085] [INFO ] [MAIN ] KOP: Update completed successfully. [2025-09-05T18:31:18.932031] [INFO ] [MAIN ] Update Progress: 1208/2363 symbols completed. KOP took 2.9s. Estimated remaining: 29m 53s. Rate: 38.7 symbols/min [2025-09-05T18:31:18.960421] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-05T18:31:19.175828] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:19.213942] [WARN ] [MAIN ] KORE: No existing data found, performing full refresh instead. [2025-09-05T18:31:19.232780] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-05T18:31:19.232566] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:19.233358] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-05T18:31:19.233464] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-05T18:31:19.479490] [INFO ] [MAIN ] KOS: Loaded 25357 existing records. [2025-09-05T18:31:19.824808] [INFO ] [REMOTE ] KORE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:31:19.837951] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-05T18:31:19.863774] [INFO ] [MAIN ] KOS: Found 1 missing trading days. [2025-09-05T18:31:19.863921] [INFO ] [MAIN ] KOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:19.864350] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-05T18:31:19.914058] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-05T18:31:19.922435] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-05T18:31:20.733702] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-05T18:31:20.742698] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-05T18:31:21.325746] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:31:21.461925] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-05T18:31:21.507925] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-05T18:31:21.524833] [INFO ] [MAIN ] KOS: Adding 385 new records, updating 0 existing records. [2025-09-05T18:31:21.530218] [INFO ] [MAIN ] KOS: Combined dataset has 25742 total records. [2025-09-05T18:31:21.722311] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-05T18:31:21.725765] [WARN ] [VALIDATOR ] KOS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:21.728539] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-05T18:31:21.929375] [WARN ] [VALIDATOR ] KOS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:21.929584] [INFO ] [MAIN ] KOS: Combined data validation passed. [2025-09-05T18:31:22.098459] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-05T18:31:22.110255] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-05T18:31:22.117476] [INFO ] [MAIN ] KOS: Update completed successfully. [2025-09-05T18:31:22.120597] [INFO ] [MAIN ] Update Progress: 1209/2363 symbols completed. KOS took 3.1s. Estimated remaining: 29m 53s. Rate: 38.6 symbols/min [2025-09-05T18:31:22.305942] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:22.331824] [INFO ] [MAIN ] KR: Loaded 25666 existing records. [2025-09-05T18:31:22.434790] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-05T18:31:22.438476] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-05T18:31:22.516249] [INFO ] [MAIN ] KR: Found 1 missing trading days. [2025-09-05T18:31:22.516380] [INFO ] [MAIN ] KR: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:22.516600] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-05T18:31:22.795991] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-05T18:31:22.808718] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-05T18:31:22.951603] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-05T18:31:22.952729] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-05T18:31:23.190048] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:31:23.193212] [INFO ] [REMOTE ] KN: Full fetch complete (42925 records). [2025-09-05T18:31:23.570821] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-05T18:31:23.570573] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-05T18:31:23.572354] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-05T18:31:23.581473] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:31:23.897869] [INFO ] [MAIN ] KN: Full history saved. [2025-09-05T18:31:23.908258] [INFO ] [MAIN ] Update Progress: 1210/2363 symbols completed. KN took 18.2s. Estimated remaining: 29m 52s. Rate: 38.6 symbols/min [2025-09-05T18:31:23.910452] [INFO ] [MAIN ] KR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:31:24.081928] [INFO ] [MAIN ] KR: Combined dataset has 26056 total records. [2025-09-05T18:31:24.084239] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:24.134070] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-05T18:31:24.135783] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-05T18:31:24.296348] [WARN ] [VALIDATOR ] KR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:24.347880] [INFO ] [MAIN ] KRC: Loaded 36239 existing records. [2025-09-05T18:31:24.690725] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-05T18:31:24.734666] [INFO ] [MAIN ] KRC: Found 1 missing trading days. [2025-09-05T18:31:24.736503] [INFO ] [MAIN ] KRC: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:24.736925] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-05T18:31:24.737238] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-05T18:31:24.747601] [WARN ] [VALIDATOR ] KR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:24.747894] [INFO ] [MAIN ] KR: Combined data validation passed. [2025-09-05T18:31:24.847185] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-05T18:31:24.856611] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-05T18:31:24.921156] [INFO ] [MAIN ] KR: Update completed successfully. [2025-09-05T18:31:24.924187] [INFO ] [MAIN ] Update Progress: 1211/2363 symbols completed. KR took 2.8s. Estimated remaining: 29m 49s. Rate: 38.6 symbols/min [2025-09-05T18:31:25.119790] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:25.119984] [WARN ] [MAIN ] KREF: No existing data found, performing full refresh instead. [2025-09-05T18:31:25.120126] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-05T18:31:25.120168] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-05T18:31:25.120223] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-05T18:31:25.495797] [INFO ] [REMOTE ] KREF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:31:25.496111] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-05T18:31:25.506488] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-05T18:31:25.508032] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-05T18:31:26.051156] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-05T18:31:26.199507] [INFO ] [MAIN ] KRC: Adding 378 new records, updating 0 existing records. [2025-09-05T18:31:26.231060] [INFO ] [MAIN ] KRC: Combined dataset has 36617 total records. [2025-09-05T18:31:26.289384] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-05T18:31:26.345145] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-05T18:31:26.394871] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-05T18:31:26.431273] [WARN ] [VALIDATOR ] KRC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:31:26.431624] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-05T18:31:26.629104] [WARN ] [VALIDATOR ] KRC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:31:26.629338] [INFO ] [MAIN ] KRC: Combined data validation passed. [2025-09-05T18:31:26.858027] [INFO ] [MAIN ] KRC: Update completed successfully. [2025-09-05T18:31:26.862105] [INFO ] [MAIN ] Update Progress: 1212/2363 symbols completed. KRC took 3.0s. Estimated remaining: 29m 48s. Rate: 38.6 symbols/min [2025-09-05T18:31:27.034582] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:27.058040] [INFO ] [MAIN ] KRG: Loaded 23177 existing records. [2025-09-05T18:31:27.237762] [INFO ] [MAIN ] KRG: Found 1 missing trading days. [2025-09-05T18:31:27.237940] [INFO ] [MAIN ] KRG: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:27.238162] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-05T18:31:27.461702] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:31:27.462379] [INFO ] [REMOTE ] KORE: Full fetch complete (2341 records). [2025-09-05T18:31:27.829853] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-05T18:31:27.841131] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-05T18:31:27.841270] [INFO ] [MAIN ] Update Progress: 1213/2363 symbols completed. KORE took 9.0s. Estimated remaining: 29m 46s. Rate: 38.6 symbols/min [2025-09-05T18:31:28.016577] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:28.038340] [INFO ] [MAIN ] KRMN: Loaded 22385 existing records. [2025-09-05T18:31:28.218089] [INFO ] [MAIN ] KRMN: Found 1 missing trading days. [2025-09-05T18:31:28.218242] [INFO ] [MAIN ] KRMN: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:28.218466] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-05T18:31:28.264927] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-09-05T18:31:28.271429] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-05T18:31:28.459273] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T18:31:28.646716] [INFO ] [MAIN ] KRG: Adding 341 new records, updating 0 existing records. [2025-09-05T18:31:28.651439] [INFO ] [MAIN ] KRG: Combined dataset has 23518 total records. [2025-09-05T18:31:28.894236] [WARN ] [VALIDATOR ] KRG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:29.236945] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-05T18:31:29.254498] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-05T18:31:29.267194] [WARN ] [VALIDATOR ] KRG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:29.267460] [INFO ] [MAIN ] KRG: Combined data validation passed. [2025-09-05T18:31:29.491361] [INFO ] [MAIN ] KRG: Update completed successfully. [2025-09-05T18:31:29.495788] [INFO ] [MAIN ] Update Progress: 1214/2363 symbols completed. KRG took 2.6s. Estimated remaining: 29m 45s. Rate: 38.6 symbols/min [2025-09-05T18:31:29.693923] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:29.716700] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-05T18:31:29.723773] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-05T18:31:29.736400] [INFO ] [MAIN ] KRO: Loaded 12784 existing records. [2025-09-05T18:31:29.925683] [INFO ] [MAIN ] KRO: Found 1 missing trading days. [2025-09-05T18:31:29.925903] [INFO ] [MAIN ] KRO: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:29.926216] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-05T18:31:30.565572] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-05T18:31:30.576238] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-05T18:31:30.962419] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-05T18:31:31.077227] [INFO ] [MAIN ] KRMN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:31:31.079033] [INFO ] [MAIN ] KRMN: Combined dataset has 22385 total records. [2025-09-05T18:31:31.079472] [FATAL] [VALIDATOR ] KRMN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:31:31.079557] [FATAL] [MAIN ] KRMN: Combined data validation failed. [2025-09-05T18:31:31.079596] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:31:31.079665] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-05T18:31:31.080255] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-05T18:31:31.083793] [INFO ] [MAIN ] Update Progress: 1215/2363 symbols completed. KRMN took 3.2s. Estimated remaining: 29m 43s. Rate: 38.6 symbols/min [2025-09-05T18:31:31.224058] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:31:31.291314] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:31.304068] [WARN ] [MAIN ] KRP: No existing data found, performing full refresh instead. [2025-09-05T18:31:31.325291] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-05T18:31:31.340801] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-05T18:31:31.362605] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-05T18:31:31.362477] [INFO ] [MAIN ] KRO: Adding 182 new records, updating 0 existing records. [2025-09-05T18:31:31.518079] [INFO ] [MAIN ] KRO: Combined dataset has 12966 total records. [2025-09-05T18:31:31.524566] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-05T18:31:31.655426] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-05T18:31:31.866038] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:31:31.908948] [WARN ] [VALIDATOR ] KRO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:32.004513] [INFO ] [REMOTE ] KODK: Full fetch complete (47482 records). [2025-09-05T18:31:31.976658] [INFO ] [REMOTE ] KRP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:31:32.010035] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-05T18:31:32.571335] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-05T18:31:32.580044] [WARN ] [VALIDATOR ] KRO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:32.580295] [INFO ] [MAIN ] KRO: Combined data validation passed. [2025-09-05T18:31:32.755176] [INFO ] [MAIN ] KRO: Update completed successfully. [2025-09-05T18:31:32.757939] [INFO ] [MAIN ] Update Progress: 1216/2363 symbols completed. KRO took 3.3s. Estimated remaining: 29m 42s. Rate: 38.6 symbols/min [2025-09-05T18:31:32.946889] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:32.950055] [WARN ] [MAIN ] KSS: No existing data found, performing full refresh instead. [2025-09-05T18:31:32.950191] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-05T18:31:32.950232] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-05T18:31:32.950277] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-05T18:31:33.386685] [INFO ] [REMOTE ] KSS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:31:33.388454] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-05T18:31:33.399631] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-05T18:31:33.399855] [INFO ] [MAIN ] Update Progress: 1217/2363 symbols completed. KODK took 18.5s. Estimated remaining: 29m 39s. Rate: 38.6 symbols/min [2025-09-05T18:31:33.582554] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-05T18:31:33.600147] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:33.609708] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-05T18:31:33.630838] [INFO ] [MAIN ] KT: Loaded 21173 existing records. [2025-09-05T18:31:33.811332] [INFO ] [MAIN ] KT: Found 1 missing trading days. [2025-09-05T18:31:33.811919] [INFO ] [MAIN ] KT: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:33.812153] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-05T18:31:34.532523] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-05T18:31:34.540869] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-05T18:31:35.010985] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-05T18:31:35.063484] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-05T18:31:35.700434] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-05T18:31:35.840636] [INFO ] [MAIN ] KT: Adding 331 new records, updating 0 existing records. [2025-09-05T18:31:35.843829] [INFO ] [MAIN ] KT: Combined dataset has 21504 total records. [2025-09-05T18:31:36.032462] [WARN ] [VALIDATOR ] KT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:36.248080] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-05T18:31:36.256731] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-05T18:31:36.268863] [WARN ] [VALIDATOR ] KT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:36.269099] [INFO ] [MAIN ] KT: Combined data validation passed. [2025-09-05T18:31:36.445807] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-09-05T18:31:36.447200] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-05T18:31:36.484390] [INFO ] [MAIN ] KT: Update completed successfully. [2025-09-05T18:31:36.487156] [INFO ] [MAIN ] Update Progress: 1218/2363 symbols completed. KT took 3.1s. Estimated remaining: 29m 39s. Rate: 38.6 symbols/min [2025-09-05T18:31:36.660394] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:36.663459] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-05T18:31:36.679752] [INFO ] [MAIN ] KTB: Loaded 19832 existing records. [2025-09-05T18:31:36.855994] [INFO ] [MAIN ] KTB: Found 1 missing trading days. [2025-09-05T18:31:36.856176] [INFO ] [MAIN ] KTB: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:37.463492] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-05T18:31:38.120013] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-05T18:31:38.224397] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-05T18:31:38.263423] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-05T18:31:38.908075] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-05T18:31:39.069758] [INFO ] [MAIN ] KTB: Adding 273 new records, updating 0 existing records. [2025-09-05T18:31:39.068567] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-05T18:31:39.074238] [INFO ] [MAIN ] KTB: Combined dataset has 20105 total records. [2025-09-05T18:31:39.262096] [WARN ] [VALIDATOR ] KTB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:39.472260] [WARN ] [VALIDATOR ] KTB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:39.472554] [INFO ] [MAIN ] KTB: Combined data validation passed. [2025-09-05T18:31:39.605904] [INFO ] [MAIN ] KTB: Update completed successfully. [2025-09-05T18:31:39.609552] [INFO ] [MAIN ] Update Progress: 1219/2363 symbols completed. KTB took 3.1s. Estimated remaining: 29m 39s. Rate: 38.6 symbols/min [2025-09-05T18:31:39.802668] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:39.802889] [WARN ] [MAIN ] KTF: No existing data found, performing full refresh instead. [2025-09-05T18:31:39.803029] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-05T18:31:39.803068] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-05T18:31:39.803115] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-05T18:31:39.876007] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-05T18:31:40.202822] [INFO ] [REMOTE ] KTF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:31:40.235689] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-05T18:31:40.663506] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-05T18:31:41.310554] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-05T18:31:41.463512] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-05T18:31:42.096881] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-05T18:31:42.149535] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-05T18:31:42.263470] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-05T18:31:42.610745] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-05T18:31:43.063475] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-05T18:31:43.578634] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-05T18:31:43.652429] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-05T18:31:43.863481] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-05T18:31:44.663519] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-05T18:31:45.463527] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-05T18:31:45.843943] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-05T18:31:46.263471] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-05T18:31:46.781080] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-05T18:31:47.063478] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-05T18:31:47.456166] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-05T18:31:47.844834] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-05T18:31:47.863437] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-05T18:31:48.118477] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-05T18:31:48.663464] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-05T18:31:49.131289] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T18:31:49.133626] [INFO ] [REMOTE ] KREF: Full fetch complete (39528 records). [2025-09-05T18:31:49.468532] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-05T18:31:49.515320] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-05T18:31:49.682611] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-05T18:31:49.682782] [INFO ] [MAIN ] Update Progress: 1220/2363 symbols completed. KREF took 24.8s. Estimated remaining: 29m 46s. Rate: 38.4 symbols/min [2025-09-05T18:31:49.852982] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:49.856062] [INFO ] [MAIN ] KUKE: Loaded 1330 existing records. [2025-09-05T18:31:50.023968] [INFO ] [MAIN ] KUKE: Found 1 missing trading days. [2025-09-05T18:31:50.024152] [INFO ] [MAIN ] KUKE: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:50.263501] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-05T18:31:50.488933] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-05T18:31:50.631294] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-05T18:31:51.063527] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-05T18:31:51.472586] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:31:51.474884] [INFO ] [REMOTE ] KRP: Full fetch complete (41942 records). [2025-09-05T18:31:51.846018] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-05T18:31:51.905086] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-05T18:31:52.025921] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-05T18:31:52.026079] [INFO ] [MAIN ] Update Progress: 1221/2363 symbols completed. KRP took 20.9s. Estimated remaining: 29m 45s. Rate: 38.4 symbols/min [2025-09-05T18:31:52.200273] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:52.226180] [INFO ] [MAIN ] KVUE: Loaded 25649 existing records. [2025-09-05T18:31:52.401536] [INFO ] [MAIN ] KVUE: Found 1 missing trading days. [2025-09-05T18:31:52.401714] [INFO ] [MAIN ] KVUE: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:52.668562] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-05T18:31:52.692093] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-05T18:31:53.463526] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-05T18:31:53.897033] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-05T18:31:54.083366] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-05T18:31:54.103244] [INFO ] [MAIN ] KUKE: Adding 33 new records, updating 0 existing records. [2025-09-05T18:31:54.105260] [INFO ] [MAIN ] KUKE: Combined dataset has 1363 total records. [2025-09-05T18:31:54.286907] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-05T18:31:54.292897] [WARN ] [VALIDATOR ] KUKE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:54.493251] [WARN ] [VALIDATOR ] KUKE: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-07-25 [2025-09-05T18:31:54.493458] [INFO ] [MAIN ] KUKE: Combined data validation passed. [2025-09-05T18:31:54.503081] [INFO ] [MAIN ] KUKE: Update completed successfully. [2025-09-05T18:31:54.503443] [INFO ] [MAIN ] Update Progress: 1222/2363 symbols completed. KUKE took 4.8s. Estimated remaining: 29m 44s. Rate: 38.4 symbols/min [2025-09-05T18:31:54.682343] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:54.694006] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T18:31:54.852412] [INFO ] [MAIN ] KVYO: Loaded 23695 existing records. [2025-09-05T18:31:54.914562] [INFO ] [MAIN ] KVUE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:31:55.050336] [INFO ] [MAIN ] KVUE: Combined dataset has 26039 total records. [2025-09-05T18:31:55.065301] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-05T18:31:55.065541] [INFO ] [MAIN ] KVYO: Found 1 missing trading days. [2025-09-05T18:31:55.089078] [INFO ] [MAIN ] KVYO: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:55.262791] [WARN ] [VALIDATOR ] KVUE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:55.455978] [WARN ] [VALIDATOR ] KVUE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:55.456202] [INFO ] [MAIN ] KVUE: Combined data validation passed. [2025-09-05T18:31:55.625475] [INFO ] [MAIN ] KVUE: Update completed successfully. [2025-09-05T18:31:55.628247] [INFO ] [MAIN ] Update Progress: 1223/2363 symbols completed. KVUE took 3.6s. Estimated remaining: 29m 42s. Rate: 38.4 symbols/min [2025-09-05T18:31:55.801288] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:55.820958] [INFO ] [MAIN ] KW: Loaded 19005 existing records. [2025-09-05T18:31:55.875436] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-05T18:31:56.002894] [INFO ] [MAIN ] KW: Found 1 missing trading days. [2025-09-05T18:31:56.003094] [INFO ] [MAIN ] KW: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:56.198807] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-05T18:31:56.218997] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-05T18:31:56.663484] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-05T18:31:57.111096] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T18:31:57.249437] [INFO ] [MAIN ] KVYO: Adding 357 new records, updating 0 existing records. [2025-09-05T18:31:57.253404] [INFO ] [MAIN ] KVYO: Combined dataset has 24052 total records. [2025-09-05T18:31:57.430683] [WARN ] [VALIDATOR ] KVYO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:57.472877] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-05T18:31:57.625336] [WARN ] [VALIDATOR ] KVYO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:57.625582] [INFO ] [MAIN ] KVYO: Combined data validation passed. [2025-09-05T18:31:57.779241] [INFO ] [MAIN ] KVYO: Update completed successfully. [2025-09-05T18:31:57.782581] [INFO ] [MAIN ] Update Progress: 1224/2363 symbols completed. KVYO took 3.3s. Estimated remaining: 29m 41s. Rate: 38.4 symbols/min [2025-09-05T18:31:57.954261] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:57.962112] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:31:58.040992] [INFO ] [MAIN ] KWR: Loaded 12986 existing records. [2025-09-05T18:31:58.173908] [INFO ] [MAIN ] KW: Adding 308 new records, updating 0 existing records. [2025-09-05T18:31:58.254745] [INFO ] [MAIN ] KW: Combined dataset has 19313 total records. [2025-09-05T18:31:58.260353] [INFO ] [MAIN ] KWR: Found 1 missing trading days. [2025-09-05T18:31:58.260779] [INFO ] [MAIN ] KWR: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:58.273064] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-05T18:31:58.444533] [WARN ] [VALIDATOR ] KW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:31:58.635629] [WARN ] [VALIDATOR ] KW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:31:58.635862] [INFO ] [MAIN ] KW: Combined data validation passed. [2025-09-05T18:31:58.755744] [INFO ] [MAIN ] KW: Update completed successfully. [2025-09-05T18:31:58.757968] [INFO ] [MAIN ] Update Progress: 1225/2363 symbols completed. KW took 3.1s. Estimated remaining: 29m 39s. Rate: 38.4 symbols/min [2025-09-05T18:31:58.946965] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:31:58.974727] [INFO ] [MAIN ] KYN: Loaded 23262 existing records. [2025-09-05T18:31:59.069624] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-05T18:31:59.160876] [INFO ] [MAIN ] KYN: Found 1 missing trading days. [2025-09-05T18:31:59.161050] [INFO ] [MAIN ] KYN: Need to fetch 1 months: 2025-09 [2025-09-05T18:31:59.218848] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-05T18:31:59.863490] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-05T18:31:59.904545] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:31:59.955553] [INFO ] [MAIN ] KWR: Adding 143 new records, updating 0 existing records. [2025-09-05T18:31:59.976232] [INFO ] [MAIN ] KWR: Combined dataset has 13129 total records. [2025-09-05T18:32:00.077402] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-05T18:32:00.189444] [WARN ] [VALIDATOR ] KWR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:32:00.389115] [WARN ] [VALIDATOR ] KWR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:32:00.389343] [INFO ] [MAIN ] KWR: Combined data validation passed. [2025-09-05T18:32:00.482334] [INFO ] [MAIN ] KWR: Update completed successfully. [2025-09-05T18:32:00.484361] [INFO ] [MAIN ] Update Progress: 1226/2363 symbols completed. KWR took 2.7s. Estimated remaining: 29m 38s. Rate: 38.4 symbols/min [2025-09-05T18:32:00.603928] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:32:00.664777] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-05T18:32:00.674099] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:00.759517] [INFO ] [MAIN ] KYN: Adding 146 new records, updating 0 existing records. [2025-09-05T18:32:00.768552] [INFO ] [MAIN ] KYN: Combined dataset has 23408 total records. [2025-09-05T18:32:00.881037] [INFO ] [MAIN ] L: Loaded 20136 existing records. [2025-09-05T18:32:01.075999] [WARN ] [VALIDATOR ] KYN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:32:01.232003] [INFO ] [MAIN ] L: Found 1 missing trading days. [2025-09-05T18:32:01.258545] [INFO ] [MAIN ] L: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:01.356980] [WARN ] [VALIDATOR ] KYN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:32:01.357229] [INFO ] [MAIN ] KYN: Combined data validation passed. [2025-09-05T18:32:01.464989] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-05T18:32:01.517561] [INFO ] [MAIN ] KYN: Update completed successfully. [2025-09-05T18:32:01.520326] [INFO ] [MAIN ] Update Progress: 1227/2363 symbols completed. KYN took 2.8s. Estimated remaining: 29m 35s. Rate: 38.4 symbols/min [2025-09-05T18:32:01.700427] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:01.723600] [INFO ] [MAIN ] LAC: Loaded 25097 existing records. [2025-09-05T18:32:01.856042] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-05T18:32:01.920193] [INFO ] [MAIN ] LAC: Found 1 missing trading days. [2025-09-05T18:32:01.920374] [INFO ] [MAIN ] LAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:02.263492] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-05T18:32:02.973207] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-05T18:32:03.068587] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-05T18:32:03.096738] [INFO ] [MAIN ] L: Adding 322 new records, updating 0 existing records. [2025-09-05T18:32:03.100110] [INFO ] [MAIN ] L: Combined dataset has 20458 total records. [2025-09-05T18:32:03.287925] [WARN ] [VALIDATOR ] L: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:03.477604] [WARN ] [VALIDATOR ] L: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:03.477817] [INFO ] [MAIN ] L: Combined data validation passed. [2025-09-05T18:32:03.624872] [INFO ] [MAIN ] L: Update completed successfully. [2025-09-05T18:32:03.627793] [INFO ] [MAIN ] Update Progress: 1228/2363 symbols completed. L took 3.1s. Estimated remaining: 29m 34s. Rate: 38.4 symbols/min [2025-09-05T18:32:03.713800] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-05T18:32:03.751099] [INFO ] [REMOTE ] KTF: Full fetch complete (14024 records). [2025-09-05T18:32:03.867532] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-05T18:32:03.932195] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:03.935944] [WARN ] [MAIN ] LAD: No existing data found, performing full refresh instead. [2025-09-05T18:32:03.942071] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-05T18:32:03.957451] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-05T18:32:03.986274] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-05T18:32:04.521339] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-05T18:32:04.594540] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T18:32:04.613287] [INFO ] [REMOTE ] LAD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:32:04.659332] [INFO ] [REMOTE ] KSS: Full fetch complete (58293 records). [2025-09-05T18:32:04.674388] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-05T18:32:04.907897] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-05T18:32:04.920540] [INFO ] [MAIN ] Update Progress: 1229/2363 symbols completed. KTF took 25.3s. Estimated remaining: 29m 33s. Rate: 38.4 symbols/min [2025-09-05T18:32:05.001806] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:32:05.425528] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:05.430899] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-05T18:32:05.489421] [INFO ] [MAIN ] LAC: Adding 382 new records, updating 0 existing records. [2025-09-05T18:32:05.493681] [INFO ] [MAIN ] LAC: Combined dataset has 25479 total records. [2025-09-05T18:32:05.728530] [INFO ] [MAIN ] LADR: Loaded 29404 existing records. [2025-09-05T18:32:05.824954] [WARN ] [VALIDATOR ] LAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:06.180314] [INFO ] [MAIN ] LADR: Found 1 missing trading days. [2025-09-05T18:32:06.186902] [INFO ] [MAIN ] LADR: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:06.187919] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-05T18:32:06.331477] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-05T18:32:06.342021] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-05T18:32:06.402359] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-05T18:32:06.405513] [INFO ] [MAIN ] Update Progress: 1230/2363 symbols completed. KSS took 33.6s. Estimated remaining: 29m 31s. Rate: 38.4 symbols/min [2025-09-05T18:32:06.405828] [WARN ] [VALIDATOR ] LAC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:06.424929] [INFO ] [MAIN ] LAC: Combined data validation passed. [2025-09-05T18:32:06.700411] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:06.708037] [INFO ] [MAIN ] LANV: Loaded 1402 existing records. [2025-09-05T18:32:06.889307] [INFO ] [MAIN ] LANV: Found 1 missing trading days. [2025-09-05T18:32:06.889971] [INFO ] [MAIN ] LANV: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:06.936445] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:32:07.038274] [INFO ] [MAIN ] LADR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:32:07.043344] [INFO ] [MAIN ] LADR: Combined dataset has 29404 total records. [2025-09-05T18:32:07.043285] [INFO ] [MAIN ] LAC: Update completed successfully. [2025-09-05T18:32:07.046397] [INFO ] [MAIN ] Update Progress: 1231/2363 symbols completed. LAC took 5.5s. Estimated remaining: 29m 29s. Rate: 38.4 symbols/min [2025-09-05T18:32:07.047096] [FATAL] [VALIDATOR ] LADR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:32:07.047775] [FATAL] [MAIN ] LADR: Combined data validation failed. [2025-09-05T18:32:07.047893] [WARN ] [MAIN ] LADR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:32:07.078529] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-05T18:32:07.078595] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-05T18:32:07.118091] [INFO ] [LOCAL ] LADR: Starting deletion of derivative data. [2025-09-05T18:32:07.156610] [INFO ] [MAIN ] Update Progress: 1232/2363 symbols completed. LADR took 2.2s. Estimated remaining: 29m 26s. Rate: 38.4 symbols/min [2025-09-05T18:32:07.302300] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:07.414213] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:07.419694] [WARN ] [MAIN ] LAW: No existing data found, performing full refresh instead. [2025-09-05T18:32:07.419889] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-05T18:32:07.419942] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-05T18:32:07.420008] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-05T18:32:07.531232] [INFO ] [MAIN ] LAR: Loaded 21863 existing records. [2025-09-05T18:32:07.913196] [INFO ] [MAIN ] LAR: Found 1 missing trading days. [2025-09-05T18:32:07.928804] [INFO ] [MAIN ] LAR: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:07.929258] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-05T18:32:07.981946] [INFO ] [REMOTE ] LAW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:32:07.997684] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-05T18:32:08.178785] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T18:32:08.191085] [INFO ] [MAIN ] LANV: Adding 40 new records, updating 0 existing records. [2025-09-05T18:32:08.192462] [INFO ] [MAIN ] LANV: Combined dataset has 1442 total records. [2025-09-05T18:32:08.367776] [WARN ] [VALIDATOR ] LANV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:08.554364] [WARN ] [VALIDATOR ] LANV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:08.554582] [INFO ] [MAIN ] LANV: Combined data validation passed. [2025-09-05T18:32:08.563720] [INFO ] [MAIN ] LANV: Update completed successfully. [2025-09-05T18:32:08.564083] [INFO ] [MAIN ] Update Progress: 1233/2363 symbols completed. LANV took 2.2s. Estimated remaining: 29m 24s. Rate: 38.4 symbols/min [2025-09-05T18:32:08.668545] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-05T18:32:08.734029] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:08.756141] [INFO ] [MAIN ] LAZ: Loaded 21317 existing records. [2025-09-05T18:32:08.929632] [INFO ] [MAIN ] LAZ: Found 1 missing trading days. [2025-09-05T18:32:08.929850] [INFO ] [MAIN ] LAZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:09.463444] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-05T18:32:09.635722] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-05T18:32:09.737988] [INFO ] [MAIN ] LAR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:32:09.739869] [INFO ] [MAIN ] LAR: Combined dataset has 21863 total records. [2025-09-05T18:32:09.740341] [FATAL] [VALIDATOR ] LAR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:32:09.740425] [FATAL] [MAIN ] LAR: Combined data validation failed. [2025-09-05T18:32:09.740467] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:32:09.740514] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-05T18:32:09.741091] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-05T18:32:09.744121] [INFO ] [MAIN ] Update Progress: 1234/2363 symbols completed. LAR took 2.7s. Estimated remaining: 29m 22s. Rate: 38.4 symbols/min [2025-09-05T18:32:09.936694] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:09.956630] [INFO ] [MAIN ] LB: Loaded 18671 existing records. [2025-09-05T18:32:10.168283] [INFO ] [MAIN ] LB: Found 1 missing trading days. [2025-09-05T18:32:10.168033] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-05T18:32:10.174566] [INFO ] [MAIN ] LB: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:10.180593] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:32:10.268717] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-05T18:32:10.287662] [INFO ] [MAIN ] LAZ: Adding 0 new records, updating 0 existing records. [2025-09-05T18:32:10.289587] [INFO ] [MAIN ] LAZ: Combined dataset has 21317 total records. [2025-09-05T18:32:10.290056] [FATAL] [VALIDATOR ] LAZ: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:32:10.290316] [FATAL] [MAIN ] LAZ: Combined data validation failed. [2025-09-05T18:32:10.290479] [WARN ] [MAIN ] LAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:32:10.290535] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-05T18:32:10.291262] [INFO ] [LOCAL ] LAZ: Starting deletion of derivative data. [2025-09-05T18:32:10.294340] [INFO ] [MAIN ] Update Progress: 1235/2363 symbols completed. LAZ took 1.7s. Estimated remaining: 29m 20s. Rate: 38.5 symbols/min [2025-09-05T18:32:10.465117] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:10.491295] [INFO ] [MAIN ] LBRT: Loaded 25297 existing records. [2025-09-05T18:32:10.668799] [INFO ] [MAIN ] LBRT: Found 1 missing trading days. [2025-09-05T18:32:10.668947] [INFO ] [MAIN ] LBRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:10.899877] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:32:11.056102] [INFO ] [MAIN ] LB: Adding 0 new records, updating 579 existing records. [2025-09-05T18:32:11.060188] [INFO ] [MAIN ] LB: Combined dataset has 18671 total records. [2025-09-05T18:32:11.060695] [FATAL] [VALIDATOR ] LB: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:32:11.060774] [FATAL] [MAIN ] LB: Combined data validation failed. [2025-09-05T18:32:11.060811] [WARN ] [MAIN ] LB: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:32:11.060848] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-05T18:32:11.061347] [INFO ] [LOCAL ] LB: Starting deletion of derivative data. [2025-09-05T18:32:11.063465] [INFO ] [MAIN ] Update Progress: 1236/2363 symbols completed. LB took 1.3s. Estimated remaining: 29m 17s. Rate: 38.5 symbols/min [2025-09-05T18:32:11.063507] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-05T18:32:11.238497] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:11.238724] [WARN ] [MAIN ] LC: No existing data found, performing full refresh instead. [2025-09-05T18:32:11.238871] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-05T18:32:11.238924] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-05T18:32:11.238985] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-05T18:32:11.609914] [INFO ] [REMOTE ] LC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:32:11.714180] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-05T18:32:11.863479] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-05T18:32:12.663515] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-05T18:32:13.029571] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-05T18:32:13.358568] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:32:13.468545] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-05T18:32:13.617342] [INFO ] [MAIN ] LBRT: Adding 390 new records, updating 770 existing records. [2025-09-05T18:32:13.623797] [INFO ] [MAIN ] LBRT: Combined dataset has 25687 total records. [2025-09-05T18:32:13.803918] [WARN ] [VALIDATOR ] LBRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:13.997157] [WARN ] [VALIDATOR ] LBRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:13.997374] [INFO ] [MAIN ] LBRT: Combined data validation passed. [2025-09-05T18:32:14.157437] [INFO ] [MAIN ] LBRT: Update completed successfully. [2025-09-05T18:32:14.160908] [INFO ] [MAIN ] Update Progress: 1237/2363 symbols completed. LBRT took 3.9s. Estimated remaining: 29m 17s. Rate: 38.4 symbols/min [2025-09-05T18:32:14.263554] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-05T18:32:14.841324] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-05T18:32:15.063508] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-05T18:32:15.798615] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-05T18:32:15.863493] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-05T18:32:16.644581] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-05T18:32:16.663429] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-05T18:32:16.698448] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-05T18:32:17.463534] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-05T18:32:17.979244] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-05T18:32:18.263484] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-05T18:32:19.063523] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-05T18:32:19.199516] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-05T18:32:19.291317] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-05T18:32:19.863520] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-05T18:32:20.323539] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-05T18:32:20.663514] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-05T18:32:21.463467] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-05T18:32:21.572750] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-05T18:32:21.808836] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-05T18:32:22.263542] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-05T18:32:22.668569] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-05T18:32:22.892420] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-05T18:32:23.063546] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-05T18:32:23.863478] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-05T18:32:23.975334] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-05T18:32:24.663485] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-05T18:32:25.047009] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-05T18:32:25.261882] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:32:25.263209] [INFO ] [REMOTE ] LAW: Full fetch complete (15260 records). [2025-09-05T18:32:25.471919] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-05T18:32:25.625884] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-05T18:32:25.687482] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-05T18:32:25.687629] [INFO ] [MAIN ] Update Progress: 1238/2363 symbols completed. LAW took 18.5s. Estimated remaining: 29m 25s. Rate: 38.3 symbols/min [2025-09-05T18:32:26.263490] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-05T18:32:26.525101] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-05T18:32:26.526694] [INFO ] [REMOTE ] LAD: Full fetch complete (26479 records). [2025-09-05T18:32:26.904713] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-05T18:32:27.024967] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-05T18:32:27.025119] [INFO ] [MAIN ] Update Progress: 1239/2363 symbols completed. LAD took 23.4s. Estimated remaining: 29m 23s. Rate: 38.3 symbols/min [2025-09-05T18:32:27.479467] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-05T18:32:27.490382] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-05T18:32:29.306220] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-05T18:32:29.316471] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-05T18:32:31.105663] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-05T18:32:31.115257] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-05T18:32:33.085592] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-05T18:32:33.097721] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-05T18:32:34.809056] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-05T18:32:34.820824] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-05T18:32:35.427108] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:32:35.429982] [INFO ] [REMOTE ] LC: Full fetch complete (52755 records). [2025-09-05T18:32:35.797541] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-05T18:32:36.012973] [INFO ] [MAIN ] LC: Full history saved. [2025-09-05T18:32:36.013118] [INFO ] [MAIN ] Update Progress: 1240/2363 symbols completed. LC took 24.9s. Estimated remaining: 29m 28s. Rate: 38.1 symbols/min [2025-09-05T18:32:36.602784] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:36.601984] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:36.713948] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:36.737939] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:36.738295] [WARN ] [MAIN ] LDP: No existing data found, performing full refresh instead. [2025-09-05T18:32:36.738442] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-05T18:32:36.738484] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-05T18:32:36.738530] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-05T18:32:36.870573] [INFO ] [MAIN ] LDI: Loaded 20954 existing records. [2025-09-05T18:32:36.990069] [INFO ] [MAIN ] LCII: Loaded 21659 existing records. [2025-09-05T18:32:36.999577] [INFO ] [MAIN ] LDOS: Loaded 20913 existing records. [2025-09-05T18:32:37.462615] [INFO ] [MAIN ] LDI: Found 1 missing trading days. [2025-09-05T18:32:37.517733] [INFO ] [MAIN ] LDI: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:37.574961] [INFO ] [MAIN ] LCII: Found 1 missing trading days. [2025-09-05T18:32:37.590670] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-05T18:32:37.675900] [INFO ] [MAIN ] LCII: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:37.675783] [INFO ] [REMOTE ] LDP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:32:37.701348] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-05T18:32:37.709358] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-05T18:32:37.709113] [INFO ] [MAIN ] LDOS: Found 1 missing trading days. [2025-09-05T18:32:37.710515] [INFO ] [MAIN ] LDOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:37.711236] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-05T18:32:38.012062] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:32:38.077187] [INFO ] [MAIN ] LCII: Adding 205 new records, updating 0 existing records. [2025-09-05T18:32:38.080168] [INFO ] [MAIN ] LCII: Combined dataset has 21864 total records. [2025-09-05T18:32:38.256850] [WARN ] [VALIDATOR ] LCII: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:32:38.454692] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:32:38.454952] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:32:38.708136] [INFO ] [MAIN ] LDOS: Adding 320 new records, updating 0 existing records. [2025-09-05T18:32:38.731244] [INFO ] [MAIN ] LDI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:32:38.737895] [INFO ] [MAIN ] LDI: Combined dataset has 21344 total records. [2025-09-05T18:32:38.738132] [INFO ] [MAIN ] LDOS: Combined dataset has 21233 total records. [2025-09-05T18:32:39.142611] [WARN ] [VALIDATOR ] LDOS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:39.198006] [WARN ] [VALIDATOR ] LDI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:39.199278] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-05T18:32:39.258866] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-05T18:32:39.606282] [WARN ] [VALIDATOR ] LCII: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:32:39.607322] [INFO ] [MAIN ] LCII: Combined data validation passed. [2025-09-05T18:32:39.616987] [WARN ] [VALIDATOR ] LDI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:39.619347] [WARN ] [VALIDATOR ] LDOS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:39.619547] [INFO ] [MAIN ] LDOS: Combined data validation passed. [2025-09-05T18:32:39.619671] [INFO ] [MAIN ] LDI: Combined data validation passed. [2025-09-05T18:32:39.978865] [INFO ] [MAIN ] LDI: Update completed successfully. [2025-09-05T18:32:39.982499] [INFO ] [MAIN ] Update Progress: 1241/2363 symbols completed. LDI took 4.0s. Estimated remaining: 29m 29s. Rate: 38.1 symbols/min [2025-09-05T18:32:40.090889] [INFO ] [MAIN ] LDOS: Update completed successfully. [2025-09-05T18:32:40.109207] [INFO ] [MAIN ] Update Progress: 1242/2363 symbols completed. LDOS took 4.1s. Estimated remaining: 29m 26s. Rate: 38.1 symbols/min [2025-09-05T18:32:40.283001] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:40.406780] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-05T18:32:40.406371] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:40.416139] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-05T18:32:40.430001] [INFO ] [MAIN ] LEA: Loaded 19974 existing records. [2025-09-05T18:32:40.608105] [INFO ] [MAIN ] LEG: Loaded 23823 existing records. [2025-09-05T18:32:40.647529] [INFO ] [MAIN ] LEA: Found 1 missing trading days. [2025-09-05T18:32:40.656389] [INFO ] [MAIN ] LEA: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:40.657373] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-05T18:32:40.723543] [INFO ] [MAIN ] LCII: Update completed successfully. [2025-09-05T18:32:40.767477] [INFO ] [MAIN ] Update Progress: 1243/2363 symbols completed. LCII took 4.8s. Estimated remaining: 29m 23s. Rate: 38.1 symbols/min [2025-09-05T18:32:40.952196] [INFO ] [MAIN ] LEG: Found 1 missing trading days. [2025-09-05T18:32:40.952368] [INFO ] [MAIN ] LEG: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:40.952845] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-05T18:32:41.024663] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:41.034776] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-05T18:32:41.038439] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-05T18:32:41.063521] [INFO ] [MAIN ] LEN: Loaded 25428 existing records. [2025-09-05T18:32:41.220291] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:32:41.274231] [INFO ] [MAIN ] LEN: Found 1 missing trading days. [2025-09-05T18:32:41.283802] [INFO ] [MAIN ] LEN: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:41.284317] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-05T18:32:41.379280] [INFO ] [MAIN ] LEA: Adding 278 new records, updating 0 existing records. [2025-09-05T18:32:41.380292] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:32:41.443878] [INFO ] [MAIN ] LEA: Combined dataset has 20252 total records. [2025-09-05T18:32:41.623046] [INFO ] [MAIN ] LEG: Adding 369 new records, updating 0 existing records. [2025-09-05T18:32:41.706682] [WARN ] [VALIDATOR ] LEA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:41.782425] [INFO ] [MAIN ] LEG: Combined dataset has 24192 total records. [2025-09-05T18:32:42.046930] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:32:42.102565] [WARN ] [VALIDATOR ] LEG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:42.356371] [INFO ] [MAIN ] LEN: Adding 390 new records, updating 0 existing records. [2025-09-05T18:32:42.421035] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-05T18:32:42.451085] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-05T18:32:42.454250] [INFO ] [MAIN ] LEN: Combined dataset has 25818 total records. [2025-09-05T18:32:42.651120] [WARN ] [VALIDATOR ] LEN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:42.741568] [WARN ] [VALIDATOR ] LEA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:42.741681] [WARN ] [VALIDATOR ] LEG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:42.770434] [INFO ] [MAIN ] LEA: Combined data validation passed. [2025-09-05T18:32:42.770330] [INFO ] [MAIN ] LEG: Combined data validation passed. [2025-09-05T18:32:43.113915] [INFO ] [MAIN ] LEA: Update completed successfully. [2025-09-05T18:32:43.120046] [INFO ] [MAIN ] Update Progress: 1244/2363 symbols completed. LEA took 3.1s. Estimated remaining: 29m 22s. Rate: 38.1 symbols/min [2025-09-05T18:32:43.256901] [INFO ] [MAIN ] LEG: Update completed successfully. [2025-09-05T18:32:43.275728] [INFO ] [MAIN ] Update Progress: 1245/2363 symbols completed. LEG took 3.2s. Estimated remaining: 29m 20s. Rate: 38.1 symbols/min [2025-09-05T18:32:43.329970] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:43.466428] [INFO ] [MAIN ] LEO: Loaded 13132 existing records. [2025-09-05T18:32:43.548067] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:43.710379] [INFO ] [MAIN ] LEO: Found 1 missing trading days. [2025-09-05T18:32:43.712635] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-05T18:32:43.711837] [INFO ] [MAIN ] LEO: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:43.717949] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-05T18:32:43.717667] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-05T18:32:43.749309] [WARN ] [VALIDATOR ] LEN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:43.749253] [INFO ] [MAIN ] LEVI: Loaded 38833 existing records. [2025-09-05T18:32:43.781235] [INFO ] [MAIN ] LEN: Combined data validation passed. [2025-09-05T18:32:44.083326] [INFO ] [MAIN ] LEVI: Found 1 missing trading days. [2025-09-05T18:32:44.094430] [INFO ] [MAIN ] LEVI: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:44.097779] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-05T18:32:44.106272] [INFO ] [MAIN ] LEN: Update completed successfully. [2025-09-05T18:32:44.109338] [INFO ] [MAIN ] Update Progress: 1246/2363 symbols completed. LEN took 3.3s. Estimated remaining: 29m 17s. Rate: 38.1 symbols/min [2025-09-05T18:32:44.278810] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:44.289327] [INFO ] [MAIN ] LFT: Loaded 9713 existing records. [2025-09-05T18:32:44.459999] [INFO ] [MAIN ] LFT: Found 1 missing trading days. [2025-09-05T18:32:44.460151] [INFO ] [MAIN ] LFT: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:44.460354] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-05T18:32:44.635113] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-05T18:32:44.638071] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-05T18:32:44.770509] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:32:44.820907] [INFO ] [MAIN ] LEO: Adding 182 new records, updating 0 existing records. [2025-09-05T18:32:44.823302] [INFO ] [MAIN ] LEO: Combined dataset has 13314 total records. [2025-09-05T18:32:45.021552] [WARN ] [VALIDATOR ] LEO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:32:45.054132] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:32:45.387090] [INFO ] [MAIN ] LEVI: Adding 382 new records, updating 0 existing records. [2025-09-05T18:32:45.397570] [INFO ] [MAIN ] LEVI: Combined dataset has 39215 total records. [2025-09-05T18:32:45.589112] [WARN ] [VALIDATOR ] LEVI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:32:45.584177] [WARN ] [VALIDATOR ] LEO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:32:45.636775] [INFO ] [MAIN ] LEO: Combined data validation passed. [2025-09-05T18:32:45.656567] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:32:45.756379] [INFO ] [MAIN ] LFT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:32:45.878160] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-05T18:32:45.912026] [INFO ] [MAIN ] LFT: Combined dataset has 9713 total records. [2025-09-05T18:32:45.938273] [INFO ] [MAIN ] LEO: Update completed successfully. [2025-09-05T18:32:45.938836] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-05T18:32:45.939552] [FATAL] [VALIDATOR ] LFT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:32:45.941836] [INFO ] [MAIN ] Update Progress: 1247/2363 symbols completed. LEO took 2.8s. Estimated remaining: 29m 16s. Rate: 38.1 symbols/min [2025-09-05T18:32:45.942987] [FATAL] [MAIN ] LFT: Combined data validation failed. [2025-09-05T18:32:45.943384] [WARN ] [MAIN ] LFT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:32:45.965189] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-05T18:32:45.975976] [INFO ] [LOCAL ] LFT: Starting deletion of derivative data. [2025-09-05T18:32:45.993581] [INFO ] [MAIN ] Update Progress: 1248/2363 symbols completed. LFT took 1.9s. Estimated remaining: 29m 13s. Rate: 38.2 symbols/min [2025-09-05T18:32:46.279034] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:46.284878] [WARN ] [MAIN ] LGI: No existing data found, performing full refresh instead. [2025-09-05T18:32:46.302436] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-05T18:32:46.304737] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:46.304858] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-05T18:32:46.305050] [WARN ] [MAIN ] LH: No existing data found, performing full refresh instead. [2025-09-05T18:32:46.305306] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-05T18:32:46.316802] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-05T18:32:46.316945] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-05T18:32:46.326542] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-05T18:32:46.966375] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-05T18:32:47.018370] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-05T18:32:47.037865] [INFO ] [REMOTE ] LH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:32:47.040545] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-05T18:32:47.044973] [INFO ] [REMOTE ] LGI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:32:47.045568] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-05T18:32:47.054337] [WARN ] [VALIDATOR ] LEVI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:32:47.054555] [INFO ] [MAIN ] LEVI: Combined data validation passed. [2025-09-05T18:32:47.310556] [INFO ] [MAIN ] LEVI: Update completed successfully. [2025-09-05T18:32:47.317224] [INFO ] [MAIN ] Update Progress: 1249/2363 symbols completed. LEVI took 4.0s. Estimated remaining: 29m 11s. Rate: 38.2 symbols/min [2025-09-05T18:32:47.494447] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:47.518388] [INFO ] [MAIN ] LHX: Loaded 23055 existing records. [2025-09-05T18:32:47.725380] [INFO ] [MAIN ] LHX: Found 1 missing trading days. [2025-09-05T18:32:47.725906] [INFO ] [MAIN ] LHX: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:47.726295] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-05T18:32:47.787399] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:32:47.789028] [INFO ] [REMOTE ] LDP: Full fetch complete (14339 records). [2025-09-05T18:32:48.138845] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-05T18:32:48.159449] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-05T18:32:48.169827] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-05T18:32:48.240174] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-05T18:32:48.240440] [INFO ] [MAIN ] Update Progress: 1250/2363 symbols completed. LDP took 12.2s. Estimated remaining: 29m 9s. Rate: 38.2 symbols/min [2025-09-05T18:32:48.416393] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:48.429944] [INFO ] [MAIN ] LII: Loaded 12482 existing records. [2025-09-05T18:32:48.609327] [INFO ] [MAIN ] LII: Found 1 missing trading days. [2025-09-05T18:32:48.615743] [INFO ] [MAIN ] LII: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:48.616007] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:32:48.676524] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-05T18:32:48.754958] [INFO ] [MAIN ] LHX: Adding 331 new records, updating 0 existing records. [2025-09-05T18:32:48.784321] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-05T18:32:48.793077] [INFO ] [MAIN ] LHX: Combined dataset has 23386 total records. [2025-09-05T18:32:48.978980] [WARN ] [VALIDATOR ] LHX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:49.096476] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-05T18:32:49.203663] [WARN ] [VALIDATOR ] LHX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:49.203895] [INFO ] [MAIN ] LHX: Combined data validation passed. [2025-09-05T18:32:49.363879] [INFO ] [MAIN ] LHX: Update completed successfully. [2025-09-05T18:32:49.366639] [INFO ] [MAIN ] Update Progress: 1251/2363 symbols completed. LHX took 2.0s. Estimated remaining: 29m 7s. Rate: 38.2 symbols/min [2025-09-05T18:32:49.468670] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-05T18:32:49.504593] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:32:49.592990] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:49.649098] [INFO ] [MAIN ] LII: Adding 179 new records, updating 0 existing records. [2025-09-05T18:32:49.659331] [INFO ] [MAIN ] LII: Combined dataset has 12661 total records. [2025-09-05T18:32:49.777390] [INFO ] [MAIN ] LION: Loaded 23736 existing records. [2025-09-05T18:32:49.957043] [WARN ] [VALIDATOR ] LII: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:50.153905] [INFO ] [MAIN ] LION: Found 1 missing trading days. [2025-09-05T18:32:50.174622] [INFO ] [MAIN ] LION: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:50.252937] [WARN ] [VALIDATOR ] LII: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:50.253189] [INFO ] [MAIN ] LII: Combined data validation passed. [2025-09-05T18:32:50.293575] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-05T18:32:50.345508] [INFO ] [MAIN ] LII: Update completed successfully. [2025-09-05T18:32:50.347362] [INFO ] [MAIN ] Update Progress: 1252/2363 symbols completed. LII took 2.1s. Estimated remaining: 29m 5s. Rate: 38.2 symbols/min [2025-09-05T18:32:50.529979] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:50.539938] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-05T18:32:50.545380] [INFO ] [MAIN ] LITB: Loaded 1233 existing records. [2025-09-05T18:32:50.726279] [INFO ] [MAIN ] LITB: Found 1 missing trading days. [2025-09-05T18:32:50.726494] [INFO ] [MAIN ] LITB: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:51.063510] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-05T18:32:51.668163] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:32:51.696618] [INFO ] [MAIN ] LITB: Adding 81 new records, updating 0 existing records. [2025-09-05T18:32:51.698278] [INFO ] [MAIN ] LITB: Combined dataset has 1314 total records. [2025-09-05T18:32:51.863922] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-05T18:32:51.884377] [WARN ] [VALIDATOR ] LITB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:51.961621] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T18:32:52.302119] [INFO ] [MAIN ] LION: Adding 362 new records, updating 0 existing records. [2025-09-05T18:32:52.308416] [INFO ] [MAIN ] LION: Combined dataset has 24098 total records. [2025-09-05T18:32:52.502661] [WARN ] [VALIDATOR ] LION: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:52.686686] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-05T18:32:52.713700] [WARN ] [VALIDATOR ] LITB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:52.714517] [INFO ] [MAIN ] LITB: Combined data validation passed. [2025-09-05T18:32:52.716389] [WARN ] [VALIDATOR ] LION: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:52.717408] [INFO ] [MAIN ] LION: Combined data validation passed. [2025-09-05T18:32:52.726336] [INFO ] [MAIN ] LITB: Update completed successfully. [2025-09-05T18:32:52.726728] [INFO ] [MAIN ] Update Progress: 1253/2363 symbols completed. LITB took 2.4s. Estimated remaining: 29m 4s. Rate: 38.2 symbols/min [2025-09-05T18:32:53.017764] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:53.013834] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-05T18:32:53.084813] [INFO ] [MAIN ] LION: Update completed successfully. [2025-09-05T18:32:53.084741] [INFO ] [MAIN ] LLY: Loaded 25443 existing records. [2025-09-05T18:32:53.087822] [INFO ] [MAIN ] Update Progress: 1254/2363 symbols completed. LION took 3.7s. Estimated remaining: 29m 2s. Rate: 38.2 symbols/min [2025-09-05T18:32:53.428802] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:53.436317] [INFO ] [MAIN ] LLY: Found 1 missing trading days. [2025-09-05T18:32:53.436666] [INFO ] [MAIN ] LLY: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:53.459831] [INFO ] [MAIN ] LMND: Loaded 25220 existing records. [2025-09-05T18:32:53.471182] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-05T18:32:53.644677] [INFO ] [MAIN ] LMND: Found 1 missing trading days. [2025-09-05T18:32:53.644840] [INFO ] [MAIN ] LMND: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:53.985265] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-05T18:32:54.263524] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-05T18:32:54.548845] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-05T18:32:55.063485] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-05T18:32:55.485866] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-05T18:32:55.829979] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-05T18:32:55.863416] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-05T18:32:56.618787] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-05T18:32:56.663416] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-05T18:32:57.463469] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-05T18:32:57.591120] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-05T18:32:58.047254] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:32:58.201412] [INFO ] [MAIN ] LLY: Adding 387 new records, updating 0 existing records. [2025-09-05T18:32:58.205035] [INFO ] [MAIN ] LLY: Combined dataset has 25830 total records. [2025-09-05T18:32:58.269324] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-05T18:32:58.390002] [WARN ] [VALIDATOR ] LLY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:32:58.585580] [WARN ] [VALIDATOR ] LLY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:32:58.585804] [INFO ] [MAIN ] LLY: Combined data validation passed. [2025-09-05T18:32:58.765283] [INFO ] [MAIN ] LLY: Update completed successfully. [2025-09-05T18:32:58.768653] [INFO ] [MAIN ] Update Progress: 1255/2363 symbols completed. LLY took 6.0s. Estimated remaining: 29m 4s. Rate: 38.1 symbols/min [2025-09-05T18:32:58.938792] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:32:58.963541] [INFO ] [MAIN ] LMT: Loaded 24177 existing records. [2025-09-05T18:32:59.066312] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-05T18:32:59.145295] [INFO ] [MAIN ] LMT: Found 1 missing trading days. [2025-09-05T18:32:59.145452] [INFO ] [MAIN ] LMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:32:59.863513] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-05T18:32:59.916835] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-05T18:33:00.074434] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:33:00.075706] [INFO ] [REMOTE ] LGI: Full fetch complete (11147 records). [2025-09-05T18:33:00.076283] [FATAL] [VALIDATOR ] LGI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:33:00.076425] [FATAL] [MAIN ] LGI: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:33:00.076478] [WARN ] [MAIN ] LGI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:33:00.076531] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-05T18:33:00.076620] [INFO ] [LOCAL ] LGI: Starting deletion of derivative data. [2025-09-05T18:33:00.076916] [INFO ] [MAIN ] Update Progress: 1256/2363 symbols completed. LGI took 14.1s. Estimated remaining: 29m 2s. Rate: 38.1 symbols/min [2025-09-05T18:33:00.269233] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:00.297978] [INFO ] [MAIN ] LNC: Loaded 24536 existing records. [2025-09-05T18:33:00.490455] [INFO ] [MAIN ] LNC: Found 1 missing trading days. [2025-09-05T18:33:00.490672] [INFO ] [MAIN ] LNC: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:00.607295] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:33:00.668550] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-05T18:33:00.735079] [INFO ] [MAIN ] LMND: Adding 0 new records, updating 0 existing records. [2025-09-05T18:33:00.737001] [INFO ] [MAIN ] LMND: Combined dataset has 25220 total records. [2025-09-05T18:33:00.737444] [FATAL] [VALIDATOR ] LMND: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:33:00.737522] [FATAL] [MAIN ] LMND: Combined data validation failed. [2025-09-05T18:33:00.737559] [WARN ] [MAIN ] LMND: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:33:00.737605] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-05T18:33:00.738189] [INFO ] [LOCAL ] LMND: Starting deletion of derivative data. [2025-09-05T18:33:00.741122] [INFO ] [MAIN ] Update Progress: 1257/2363 symbols completed. LMND took 7.7s. Estimated remaining: 28m 59s. Rate: 38.2 symbols/min [2025-09-05T18:33:00.942206] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:00.946349] [INFO ] [MAIN ] LND: Loaded 2407 existing records. [2025-09-05T18:33:01.128554] [INFO ] [MAIN ] LND: Found 1 missing trading days. [2025-09-05T18:33:01.128888] [INFO ] [MAIN ] LND: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:01.135455] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:33:01.258499] [INFO ] [MAIN ] LMT: Adding 0 new records, updating 0 existing records. [2025-09-05T18:33:01.260320] [INFO ] [MAIN ] LMT: Combined dataset has 24177 total records. [2025-09-05T18:33:01.260806] [FATAL] [VALIDATOR ] LMT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:33:01.260923] [FATAL] [MAIN ] LMT: Combined data validation failed. [2025-09-05T18:33:01.260974] [WARN ] [MAIN ] LMT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:33:01.261025] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-05T18:33:01.261686] [INFO ] [LOCAL ] LMT: Starting deletion of derivative data. [2025-09-05T18:33:01.264944] [INFO ] [MAIN ] Update Progress: 1258/2363 symbols completed. LMT took 2.5s. Estimated remaining: 28m 57s. Rate: 38.2 symbols/min [2025-09-05T18:33:01.437270] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:01.437479] [WARN ] [MAIN ] LNG: No existing data found, performing full refresh instead. [2025-09-05T18:33:01.437675] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-05T18:33:01.437729] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-05T18:33:01.437777] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-05T18:33:01.468561] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-05T18:33:01.796463] [INFO ] [REMOTE ] LNG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:33:02.263464] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-05T18:33:02.429966] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:33:02.577776] [INFO ] [MAIN ] LNC: Adding 385 new records, updating 0 existing records. [2025-09-05T18:33:02.582399] [INFO ] [MAIN ] LNC: Combined dataset has 24921 total records. [2025-09-05T18:33:02.757885] [WARN ] [VALIDATOR ] LNC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:02.949455] [WARN ] [VALIDATOR ] LNC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:02.949692] [INFO ] [MAIN ] LNC: Combined data validation passed. [2025-09-05T18:33:03.067885] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-05T18:33:03.117236] [INFO ] [MAIN ] LNC: Update completed successfully. [2025-09-05T18:33:03.120690] [INFO ] [MAIN ] Update Progress: 1259/2363 symbols completed. LNC took 3.0s. Estimated remaining: 28m 56s. Rate: 38.2 symbols/min [2025-09-05T18:33:03.292533] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:03.302980] [INFO ] [MAIN ] LNN: Loaded 8625 existing records. [2025-09-05T18:33:03.473410] [INFO ] [MAIN ] LNN: Found 1 missing trading days. [2025-09-05T18:33:03.473545] [INFO ] [MAIN ] LNN: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:03.863492] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-05T18:33:04.218678] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-05T18:33:04.631666] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:33:04.633920] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-05T18:33:04.645501] [INFO ] [MAIN ] LND: Adding 27 new records, updating 0 existing records. [2025-09-05T18:33:04.656260] [INFO ] [MAIN ] LND: Combined dataset has 2434 total records. [2025-09-05T18:33:04.668695] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-05T18:33:04.834027] [WARN ] [VALIDATOR ] LND: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:05.019521] [WARN ] [VALIDATOR ] LND: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:05.019740] [INFO ] [MAIN ] LND: Combined data validation passed. [2025-09-05T18:33:05.034542] [INFO ] [MAIN ] LND: Update completed successfully. [2025-09-05T18:33:05.035008] [INFO ] [MAIN ] Update Progress: 1260/2363 symbols completed. LND took 4.3s. Estimated remaining: 28m 54s. Rate: 38.2 symbols/min [2025-09-05T18:33:05.203470] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:05.223453] [INFO ] [MAIN ] LOAR: Loaded 20354 existing records. [2025-09-05T18:33:05.399924] [INFO ] [MAIN ] LOAR: Found 1 missing trading days. [2025-09-05T18:33:05.400120] [INFO ] [MAIN ] LOAR: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:05.463447] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-05T18:33:06.263509] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-05T18:33:06.425391] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-05T18:33:06.592873] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:33:06.709962] [INFO ] [MAIN ] LOAR: Adding 294 new records, updating 0 existing records. [2025-09-05T18:33:06.713202] [INFO ] [MAIN ] LOAR: Combined dataset has 20648 total records. [2025-09-05T18:33:06.902912] [WARN ] [VALIDATOR ] LOAR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:07.074775] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-05T18:33:07.113974] [WARN ] [VALIDATOR ] LOAR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:07.114228] [INFO ] [MAIN ] LOAR: Combined data validation passed. [2025-09-05T18:33:07.244836] [INFO ] [MAIN ] LOAR: Update completed successfully. [2025-09-05T18:33:07.247667] [INFO ] [MAIN ] Update Progress: 1261/2363 symbols completed. LOAR took 2.2s. Estimated remaining: 28m 53s. Rate: 38.1 symbols/min [2025-09-05T18:33:07.417051] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:07.428839] [INFO ] [MAIN ] LOB: Loaded 12001 existing records. [2025-09-05T18:33:07.602467] [INFO ] [MAIN ] LOB: Found 1 missing trading days. [2025-09-05T18:33:07.602610] [INFO ] [MAIN ] LOB: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:07.863507] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-05T18:33:08.077393] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-05T18:33:08.481827] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:33:08.548950] [INFO ] [MAIN ] LOB: Adding 207 new records, updating 0 existing records. [2025-09-05T18:33:08.551513] [INFO ] [MAIN ] LOB: Combined dataset has 12208 total records. [2025-09-05T18:33:08.664626] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-05T18:33:08.733363] [WARN ] [VALIDATOR ] LOB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:08.944281] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-05T18:33:08.965184] [WARN ] [VALIDATOR ] LOB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:08.965429] [INFO ] [MAIN ] LOB: Combined data validation passed. [2025-09-05T18:33:09.039116] [INFO ] [MAIN ] LOB: Update completed successfully. [2025-09-05T18:33:09.040547] [INFO ] [MAIN ] Update Progress: 1262/2363 symbols completed. LOB took 1.8s. Estimated remaining: 28m 52s. Rate: 38.1 symbols/min [2025-09-05T18:33:09.145367] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:33:09.234675] [INFO ] [MAIN ] LNN: Adding 61 new records, updating 0 existing records. [2025-09-05T18:33:09.253898] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:09.255710] [WARN ] [MAIN ] LOCL: No existing data found, performing full refresh instead. [2025-09-05T18:33:09.256037] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-05T18:33:09.256099] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-05T18:33:09.256250] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-05T18:33:09.300281] [INFO ] [MAIN ] LNN: Combined dataset has 8686 total records. [2025-09-05T18:33:09.468563] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-05T18:33:09.730627] [WARN ] [VALIDATOR ] LNN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:33:09.913851] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:33:10.000392] [WARN ] [VALIDATOR ] LNN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:33:10.000630] [INFO ] [MAIN ] LNN: Combined data validation passed. [2025-09-05T18:33:10.057835] [INFO ] [MAIN ] LNN: Update completed successfully. [2025-09-05T18:33:10.059090] [INFO ] [MAIN ] Update Progress: 1263/2363 symbols completed. LNN took 6.9s. Estimated remaining: 28m 50s. Rate: 38.2 symbols/min [2025-09-05T18:33:10.230286] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:10.253581] [INFO ] [MAIN ] LOMA: Loaded 22914 existing records. [2025-09-05T18:33:10.268743] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-05T18:33:10.432891] [INFO ] [MAIN ] LOMA: Found 1 missing trading days. [2025-09-05T18:33:10.433038] [INFO ] [MAIN ] LOMA: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:10.887950] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-05T18:33:11.063492] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-05T18:33:11.612171] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-05T18:33:11.863474] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-05T18:33:12.445498] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:33:12.568418] [INFO ] [MAIN ] LOMA: Adding 305 new records, updating 0 existing records. [2025-09-05T18:33:12.572239] [INFO ] [MAIN ] LOMA: Combined dataset has 23219 total records. [2025-09-05T18:33:12.664442] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-05T18:33:12.753978] [WARN ] [VALIDATOR ] LOMA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:33:12.978017] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-05T18:33:12.998170] [WARN ] [VALIDATOR ] LOMA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:33:12.998402] [INFO ] [MAIN ] LOMA: Combined data validation passed. [2025-09-05T18:33:13.134057] [INFO ] [MAIN ] LOMA: Update completed successfully. [2025-09-05T18:33:13.136916] [INFO ] [MAIN ] Update Progress: 1264/2363 symbols completed. LOMA took 3.1s. Estimated remaining: 28m 50s. Rate: 38.1 symbols/min [2025-09-05T18:33:13.315380] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:13.320946] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:33:13.323851] [INFO ] [REMOTE ] LH: Full fetch complete (42765 records). [2025-09-05T18:33:13.468551] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-05T18:33:13.669016] [INFO ] [MAIN ] LOW: Loaded 39904 existing records. [2025-09-05T18:33:13.930350] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-05T18:33:13.943453] [INFO ] [MAIN ] LOW: Found 1 missing trading days. [2025-09-05T18:33:13.943718] [INFO ] [MAIN ] LOW: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:14.146090] [INFO ] [MAIN ] LH: Full history saved. [2025-09-05T18:33:14.146239] [INFO ] [MAIN ] Update Progress: 1265/2363 symbols completed. LH took 28.1s. Estimated remaining: 28m 48s. Rate: 38.1 symbols/min [2025-09-05T18:33:14.268735] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-05T18:33:14.329418] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:14.348184] [INFO ] [MAIN ] LPG: Loaded 18828 existing records. [2025-09-05T18:33:14.528988] [INFO ] [MAIN ] LPG: Found 1 missing trading days. [2025-09-05T18:33:14.529167] [INFO ] [MAIN ] LPG: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:14.817975] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:33:15.013985] [INFO ] [MAIN ] LOW: Adding 389 new records, updating 0 existing records. [2025-09-05T18:33:15.020186] [INFO ] [MAIN ] LOW: Combined dataset has 40293 total records. [2025-09-05T18:33:15.068715] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-05T18:33:15.205237] [WARN ] [VALIDATOR ] LOW: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:33:15.402360] [WARN ] [VALIDATOR ] LOW: Missing data for 45 trading days: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:33:15.402567] [INFO ] [MAIN ] LOW: Combined data validation passed. [2025-09-05T18:33:15.512243] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:33:15.642239] [INFO ] [MAIN ] LPG: Adding 318 new records, updating 0 existing records. [2025-09-05T18:33:15.648714] [INFO ] [MAIN ] LPG: Combined dataset has 19146 total records. [2025-09-05T18:33:15.842515] [WARN ] [VALIDATOR ] LPG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:15.866419] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-05T18:33:16.185117] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-05T18:33:16.234535] [INFO ] [MAIN ] LOW: Update completed successfully. [2025-09-05T18:33:16.238547] [INFO ] [MAIN ] Update Progress: 1266/2363 symbols completed. LOW took 3.1s. Estimated remaining: 28m 46s. Rate: 38.1 symbols/min [2025-09-05T18:33:16.339213] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-05T18:33:16.413532] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:16.415980] [WARN ] [VALIDATOR ] LPG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:16.416131] [INFO ] [MAIN ] LPG: Combined data validation passed. [2025-09-05T18:33:16.517397] [INFO ] [MAIN ] LPL: Loaded 13336 existing records. [2025-09-05T18:33:16.664174] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-05T18:33:16.718223] [INFO ] [MAIN ] LPL: Found 1 missing trading days. [2025-09-05T18:33:16.723237] [INFO ] [MAIN ] LPL: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:16.726355] [INFO ] [MAIN ] LPG: Update completed successfully. [2025-09-05T18:33:16.728136] [INFO ] [MAIN ] Update Progress: 1267/2363 symbols completed. LPG took 2.6s. Estimated remaining: 28m 44s. Rate: 38.1 symbols/min [2025-09-05T18:33:16.912482] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:16.944348] [INFO ] [MAIN ] LPX: Loaded 30044 existing records. [2025-09-05T18:33:17.137192] [INFO ] [MAIN ] LPX: Found 1 missing trading days. [2025-09-05T18:33:17.137358] [INFO ] [MAIN ] LPX: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:17.463517] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-05T18:33:17.728573] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-05T18:33:17.829330] [INFO ] [MAIN ] LPL: Adding 195 new records, updating 0 existing records. [2025-09-05T18:33:17.831731] [INFO ] [MAIN ] LPL: Combined dataset has 13531 total records. [2025-09-05T18:33:18.007971] [WARN ] [VALIDATOR ] LPL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:18.195693] [WARN ] [VALIDATOR ] LPL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:18.195919] [INFO ] [MAIN ] LPL: Combined data validation passed. [2025-09-05T18:33:18.263606] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-05T18:33:18.276556] [INFO ] [MAIN ] LPL: Update completed successfully. [2025-09-05T18:33:18.278083] [INFO ] [MAIN ] Update Progress: 1268/2363 symbols completed. LPL took 2.0s. Estimated remaining: 28m 42s. Rate: 38.1 symbols/min [2025-09-05T18:33:18.451847] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:18.452100] [WARN ] [MAIN ] LRN: No existing data found, performing full refresh instead. [2025-09-05T18:33:18.452352] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-05T18:33:18.452450] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-05T18:33:18.452508] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-05T18:33:18.818115] [INFO ] [REMOTE ] LRN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:33:18.850982] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-05T18:33:18.903439] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:33:19.021936] [INFO ] [MAIN ] LPX: Adding 338 new records, updating 0 existing records. [2025-09-05T18:33:19.025422] [INFO ] [MAIN ] LPX: Combined dataset has 30382 total records. [2025-09-05T18:33:19.068627] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-05T18:33:19.205305] [WARN ] [VALIDATOR ] LPX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:33:19.397206] [WARN ] [VALIDATOR ] LPX: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:33:19.397445] [INFO ] [MAIN ] LPX: Combined data validation passed. [2025-09-05T18:33:19.587920] [INFO ] [MAIN ] LPX: Update completed successfully. [2025-09-05T18:33:19.591283] [INFO ] [MAIN ] Update Progress: 1269/2363 symbols completed. LPX took 2.9s. Estimated remaining: 28m 41s. Rate: 38.2 symbols/min [2025-09-05T18:33:19.762680] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:19.762869] [WARN ] [MAIN ] LSPD: No existing data found, performing full refresh instead. [2025-09-05T18:33:19.762996] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-05T18:33:19.763036] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-05T18:33:19.763082] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-05T18:33:19.864107] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-05T18:33:20.120260] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:33:20.378673] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-05T18:33:20.663432] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-05T18:33:21.181570] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-05T18:33:21.463491] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-05T18:33:21.537120] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-05T18:33:22.263473] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-05T18:33:22.774554] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-05T18:33:23.063477] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-05T18:33:23.093598] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-05T18:33:23.863470] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-05T18:33:24.578942] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-05T18:33:24.663449] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-05T18:33:25.434689] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-05T18:33:25.463458] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-05T18:33:26.073409] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-05T18:33:26.177501] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-05T18:33:26.263429] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-05T18:33:27.063513] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-05T18:33:27.864248] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-05T18:33:27.870135] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-05T18:33:28.663492] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-05T18:33:29.161110] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-05T18:33:29.463443] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-05T18:33:29.499258] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-05T18:33:29.895789] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-05T18:33:29.993517] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-05T18:33:30.263475] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-05T18:33:31.063475] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-05T18:33:31.554282] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-05T18:33:31.863475] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-05T18:33:31.897972] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-05T18:33:32.097126] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-05T18:33:32.097931] [INFO ] [REMOTE ] LOCL: Full fetch complete (3234 records). [2025-09-05T18:33:32.464100] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-05T18:33:32.478981] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-05T18:33:32.479062] [INFO ] [MAIN ] Update Progress: 1270/2363 symbols completed. LOCL took 23.4s. Estimated remaining: 28m 49s. Rate: 37.9 symbols/min [2025-09-05T18:33:32.649535] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:32.663441] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-05T18:33:32.674699] [INFO ] [MAIN ] LTC: Loaded 22961 existing records. [2025-09-05T18:33:32.863099] [INFO ] [MAIN ] LTC: Found 1 missing trading days. [2025-09-05T18:33:32.863299] [INFO ] [MAIN ] LTC: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:33.463499] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-05T18:33:34.012580] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:33:34.099883] [INFO ] [MAIN ] LTC: Adding 209 new records, updating 0 existing records. [2025-09-05T18:33:34.104840] [INFO ] [MAIN ] LTC: Combined dataset has 23170 total records. [2025-09-05T18:33:34.274553] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-05T18:33:34.317962] [WARN ] [VALIDATOR ] LTC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:33:34.525275] [WARN ] [VALIDATOR ] LTC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:33:34.525511] [INFO ] [MAIN ] LTC: Combined data validation passed. [2025-09-05T18:33:34.683582] [INFO ] [MAIN ] LTC: Update completed successfully. [2025-09-05T18:33:34.686536] [INFO ] [MAIN ] Update Progress: 1271/2363 symbols completed. LTC took 2.2s. Estimated remaining: 28m 48s. Rate: 37.9 symbols/min [2025-09-05T18:33:34.879116] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-05T18:33:34.911270] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:34.956887] [INFO ] [MAIN ] LTH: Loaded 39067 existing records. [2025-09-05T18:33:35.068678] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-05T18:33:35.139091] [INFO ] [MAIN ] LTH: Found 1 missing trading days. [2025-09-05T18:33:35.139256] [INFO ] [MAIN ] LTH: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:35.863501] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-05T18:33:35.907520] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-05T18:33:36.556192] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-05T18:33:36.651963] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:33:36.663743] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-05T18:33:36.813907] [INFO ] [MAIN ] LTH: Adding 378 new records, updating 0 existing records. [2025-09-05T18:33:36.817872] [INFO ] [MAIN ] LTH: Combined dataset has 39445 total records. [2025-09-05T18:33:36.993945] [WARN ] [VALIDATOR ] LTH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:33:37.194370] [WARN ] [VALIDATOR ] LTH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:33:37.194621] [INFO ] [MAIN ] LTH: Combined data validation passed. [2025-09-05T18:33:37.427539] [INFO ] [MAIN ] LTH: Update completed successfully. [2025-09-05T18:33:37.433932] [INFO ] [MAIN ] Update Progress: 1272/2363 symbols completed. LTH took 2.7s. Estimated remaining: 28m 47s. Rate: 37.9 symbols/min [2025-09-05T18:33:37.468636] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-05T18:33:37.613978] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:37.635769] [INFO ] [MAIN ] LTM: Loaded 18763 existing records. [2025-09-05T18:33:37.852430] [INFO ] [MAIN ] LTM: Found 1 missing trading days. [2025-09-05T18:33:37.852629] [INFO ] [MAIN ] LTM: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:37.918721] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-05T18:33:38.263541] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-05T18:33:38.880720] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:33:38.884991] [INFO ] [REMOTE ] LNG: Full fetch complete (56383 records). [2025-09-05T18:33:39.079467] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-05T18:33:39.359067] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-05T18:33:39.391848] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-05T18:33:39.684123] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-05T18:33:39.684451] [INFO ] [MAIN ] Update Progress: 1273/2363 symbols completed. LNG took 38.4s. Estimated remaining: 28m 46s. Rate: 37.9 symbols/min [2025-09-05T18:33:39.869345] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-05T18:33:39.872578] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:39.873830] [WARN ] [MAIN ] LU: No existing data found, performing full refresh instead. [2025-09-05T18:33:39.874009] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-05T18:33:39.874086] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-05T18:33:39.874137] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-05T18:33:40.270635] [INFO ] [REMOTE ] LU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:33:40.277280] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:33:40.402771] [INFO ] [MAIN ] LTM: Adding 366 new records, updating 0 existing records. [2025-09-05T18:33:40.405844] [INFO ] [MAIN ] LTM: Combined dataset has 19129 total records. [2025-09-05T18:33:40.590267] [WARN ] [VALIDATOR ] LTM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:40.668537] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-05T18:33:40.787296] [WARN ] [VALIDATOR ] LTM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:40.787560] [INFO ] [MAIN ] LTM: Combined data validation passed. [2025-09-05T18:33:40.901721] [INFO ] [MAIN ] LTM: Update completed successfully. [2025-09-05T18:33:40.903522] [INFO ] [MAIN ] Update Progress: 1274/2363 symbols completed. LTM took 3.5s. Estimated remaining: 28m 44s. Rate: 37.9 symbols/min [2025-09-05T18:33:41.076850] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:41.088155] [INFO ] [MAIN ] LUCK: Loaded 10915 existing records. [2025-09-05T18:33:41.261939] [INFO ] [MAIN ] LUCK: Found 1 missing trading days. [2025-09-05T18:33:41.262120] [INFO ] [MAIN ] LUCK: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:41.463467] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-05T18:33:41.491604] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-05T18:33:42.263473] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-05T18:33:42.665058] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:33:42.667227] [INFO ] [REMOTE ] LRN: Full fetch complete (43738 records). [2025-09-05T18:33:43.047882] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-05T18:33:43.078413] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-05T18:33:43.104893] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-05T18:33:43.111762] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-05T18:33:43.317168] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-05T18:33:43.317337] [INFO ] [MAIN ] Update Progress: 1275/2363 symbols completed. LRN took 25.0s. Estimated remaining: 28m 43s. Rate: 37.9 symbols/min [2025-09-05T18:33:43.487327] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:43.487549] [WARN ] [MAIN ] LUMN: No existing data found, performing full refresh instead. [2025-09-05T18:33:43.487697] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-05T18:33:43.487739] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-05T18:33:43.487783] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-05T18:33:43.872130] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-05T18:33:43.901781] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:33:44.210559] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:33:44.275201] [INFO ] [MAIN ] LUCK: Adding 206 new records, updating 0 existing records. [2025-09-05T18:33:44.277846] [INFO ] [MAIN ] LUCK: Combined dataset has 11121 total records. [2025-09-05T18:33:44.482905] [WARN ] [VALIDATOR ] LUCK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:44.664707] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-05T18:33:44.701954] [WARN ] [VALIDATOR ] LUCK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:44.702194] [INFO ] [MAIN ] LUCK: Combined data validation passed. [2025-09-05T18:33:44.769927] [INFO ] [MAIN ] LUCK: Update completed successfully. [2025-09-05T18:33:44.771162] [INFO ] [MAIN ] Update Progress: 1276/2363 symbols completed. LUCK took 3.9s. Estimated remaining: 28m 42s. Rate: 37.9 symbols/min [2025-09-05T18:33:44.961895] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:33:44.987858] [INFO ] [MAIN ] LUV: Loaded 25672 existing records. [2025-09-05T18:33:45.177183] [INFO ] [MAIN ] LUV: Found 1 missing trading days. [2025-09-05T18:33:45.177323] [INFO ] [MAIN ] LUV: Need to fetch 1 months: 2025-09 [2025-09-05T18:33:45.463466] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-05T18:33:45.993728] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-05T18:33:46.263457] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-05T18:33:46.718489] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-05T18:33:47.063443] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-05T18:33:47.154817] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-05T18:33:47.863463] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-05T18:33:48.152144] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-05T18:33:48.663460] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-05T18:33:49.128733] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-05T18:33:49.196346] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-05T18:33:49.463468] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-05T18:33:50.091935] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:33:50.243398] [INFO ] [MAIN ] LUV: Adding 390 new records, updating 0 existing records. [2025-09-05T18:33:50.246995] [INFO ] [MAIN ] LUV: Combined dataset has 26062 total records. [2025-09-05T18:33:50.270064] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-05T18:33:50.450115] [WARN ] [VALIDATOR ] LUV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:33:50.693673] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-05T18:33:50.712299] [WARN ] [VALIDATOR ] LUV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:33:50.712552] [INFO ] [MAIN ] LUV: Combined data validation passed. [2025-09-05T18:33:50.879601] [INFO ] [MAIN ] LUV: Update completed successfully. [2025-09-05T18:33:50.882605] [INFO ] [MAIN ] Update Progress: 1277/2363 symbols completed. LUV took 6.1s. Estimated remaining: 28m 44s. Rate: 37.8 symbols/min [2025-09-05T18:33:51.063506] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-05T18:33:51.639793] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:33:51.642232] [INFO ] [REMOTE ] LSPD: Full fetch complete (48090 records). [2025-09-05T18:33:51.868550] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-05T18:33:52.019810] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-05T18:33:52.223376] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-05T18:33:52.223531] [INFO ] [MAIN ] Update Progress: 1278/2363 symbols completed. LSPD took 32.6s. Estimated remaining: 28m 42s. Rate: 37.8 symbols/min [2025-09-05T18:33:52.300347] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-05T18:33:52.663446] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-05T18:33:53.691746] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-05T18:33:53.702402] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-05T18:33:54.602266] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-05T18:33:54.613850] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-05T18:33:55.264797] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-05T18:33:55.275989] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-05T18:33:56.773086] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-05T18:33:56.783997] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-05T18:33:56.955975] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-05T18:33:56.967440] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-05T18:33:58.001334] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-05T18:33:58.011456] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-05T18:33:58.681474] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:33:58.684746] [INFO ] [REMOTE ] LU: Full fetch complete (53096 records). [2025-09-05T18:33:59.004628] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-05T18:33:59.056790] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-05T18:33:59.114525] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-05T18:33:59.325680] [INFO ] [MAIN ] LU: Full history saved. [2025-09-05T18:33:59.325826] [INFO ] [MAIN ] Update Progress: 1279/2363 symbols completed. LU took 19.6s. Estimated remaining: 28m 45s. Rate: 37.7 symbols/min [2025-09-05T18:34:01.214592] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-05T18:34:01.227748] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-05T18:34:03.258895] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-05T18:34:03.270464] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-05T18:34:03.654223] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:34:03.657114] [INFO ] [REMOTE ] LUMN: Full fetch complete (58305 records). [2025-09-05T18:34:04.030431] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-05T18:34:04.267055] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-05T18:34:04.267200] [INFO ] [MAIN ] Update Progress: 1280/2363 symbols completed. LUMN took 20.9s. Estimated remaining: 28m 46s. Rate: 37.6 symbols/min [2025-09-05T18:34:04.948657] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:04.979380] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:05.003733] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:05.002528] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:05.004472] [WARN ] [MAIN ] LVWR: No existing data found, performing full refresh instead. [2025-09-05T18:34:05.005713] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-05T18:34:05.005770] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-05T18:34:05.005941] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-05T18:34:05.125485] [INFO ] [MAIN ] LUXE: Loaded 7765 existing records. [2025-09-05T18:34:05.276563] [INFO ] [MAIN ] LW: Loaded 24310 existing records. [2025-09-05T18:34:05.445066] [INFO ] [MAIN ] LVS: Loaded 25572 existing records. [2025-09-05T18:34:05.667179] [INFO ] [MAIN ] LUXE: Found 1 missing trading days. [2025-09-05T18:34:05.817220] [INFO ] [MAIN ] LUXE: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:05.857932] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:34:05.869207] [INFO ] [MAIN ] LW: Found 1 missing trading days. [2025-09-05T18:34:05.869443] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-05T18:34:05.883928] [INFO ] [MAIN ] LW: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:05.882899] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-05T18:34:05.884323] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-05T18:34:05.962504] [INFO ] [MAIN ] LVS: Found 1 missing trading days. [2025-09-05T18:34:05.963175] [INFO ] [MAIN ] LVS: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:05.963415] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-05T18:34:06.630216] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:34:06.771741] [INFO ] [MAIN ] LW: Adding 375 new records, updating 0 existing records. [2025-09-05T18:34:06.780946] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:34:06.826506] [INFO ] [MAIN ] LW: Combined dataset has 24685 total records. [2025-09-05T18:34:06.832242] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-05T18:34:06.875740] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-05T18:34:07.053690] [INFO ] [MAIN ] LVS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:34:07.131718] [WARN ] [VALIDATOR ] LW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:07.197870] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T18:34:07.224052] [INFO ] [MAIN ] LVS: Combined dataset has 25962 total records. [2025-09-05T18:34:07.353123] [INFO ] [MAIN ] LUXE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:34:07.461714] [INFO ] [MAIN ] LUXE: Combined dataset has 7765 total records. [2025-09-05T18:34:07.487127] [FATAL] [VALIDATOR ] LUXE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:34:07.511879] [FATAL] [MAIN ] LUXE: Combined data validation failed. [2025-09-05T18:34:07.545891] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:34:07.549167] [WARN ] [VALIDATOR ] LVS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:07.549425] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-05T18:34:07.589546] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-05T18:34:07.657234] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-05T18:34:07.671389] [INFO ] [MAIN ] Update Progress: 1281/2363 symbols completed. LUXE took 3.4s. Estimated remaining: 28m 46s. Rate: 37.6 symbols/min [2025-09-05T18:34:07.665112] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-05T18:34:07.924331] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:07.939455] [INFO ] [MAIN ] LXFR: Loaded 8091 existing records. [2025-09-05T18:34:08.119022] [INFO ] [MAIN ] LXFR: Found 1 missing trading days. [2025-09-05T18:34:08.121107] [INFO ] [MAIN ] LXFR: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:08.121343] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-05T18:34:08.122133] [WARN ] [VALIDATOR ] LVS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:08.122305] [INFO ] [MAIN ] LVS: Combined data validation passed. [2025-09-05T18:34:08.122192] [WARN ] [VALIDATOR ] LW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:08.123342] [INFO ] [MAIN ] LW: Combined data validation passed. [2025-09-05T18:34:08.423073] [INFO ] [MAIN ] LVS: Update completed successfully. [2025-09-05T18:34:08.428839] [INFO ] [MAIN ] Update Progress: 1282/2363 symbols completed. LVS took 4.2s. Estimated remaining: 28m 44s. Rate: 37.6 symbols/min [2025-09-05T18:34:08.538628] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:34:08.628528] [INFO ] [MAIN ] LXFR: Adding 92 new records, updating 0 existing records. [2025-09-05T18:34:08.631190] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-05T18:34:08.652289] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-05T18:34:08.652368] [INFO ] [MAIN ] LW: Update completed successfully. [2025-09-05T18:34:08.661270] [INFO ] [MAIN ] Update Progress: 1283/2363 symbols completed. LW took 4.4s. Estimated remaining: 28m 41s. Rate: 37.6 symbols/min [2025-09-05T18:34:08.661953] [INFO ] [MAIN ] LXFR: Combined dataset has 8183 total records. [2025-09-05T18:34:08.864004] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:08.908048] [WARN ] [MAIN ] LXP: No existing data found, performing full refresh instead. [2025-09-05T18:34:08.941013] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-05T18:34:08.987976] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-05T18:34:09.011305] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:09.045232] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-05T18:34:09.045131] [WARN ] [MAIN ] LXU: No existing data found, performing full refresh instead. [2025-09-05T18:34:09.064896] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-05T18:34:09.074955] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-05T18:34:09.103445] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-05T18:34:09.107187] [WARN ] [VALIDATOR ] LXFR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:09.493712] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-05T18:34:09.599719] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-05T18:34:09.913265] [INFO ] [REMOTE ] LXP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:34:09.918855] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-05T18:34:09.986475] [INFO ] [REMOTE ] LXU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:34:09.987079] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-05T18:34:09.996997] [WARN ] [VALIDATOR ] LXFR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:09.997229] [INFO ] [MAIN ] LXFR: Combined data validation passed. [2025-09-05T18:34:10.048892] [INFO ] [MAIN ] LXFR: Update completed successfully. [2025-09-05T18:34:10.050036] [INFO ] [MAIN ] Update Progress: 1284/2363 symbols completed. LXFR took 2.4s. Estimated remaining: 28m 40s. Rate: 37.6 symbols/min [2025-09-05T18:34:10.229681] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:10.255005] [INFO ] [MAIN ] LYB: Loaded 25624 existing records. [2025-09-05T18:34:10.441938] [INFO ] [MAIN ] LYB: Found 1 missing trading days. [2025-09-05T18:34:10.442097] [INFO ] [MAIN ] LYB: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:10.442338] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-05T18:34:10.725685] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-05T18:34:10.729812] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-05T18:34:10.818895] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:34:10.979046] [INFO ] [MAIN ] LYB: Adding 390 new records, updating 0 existing records. [2025-09-05T18:34:10.982409] [INFO ] [MAIN ] LYB: Combined dataset has 26014 total records. [2025-09-05T18:34:11.161027] [WARN ] [VALIDATOR ] LYB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:11.360581] [WARN ] [VALIDATOR ] LYB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:11.360834] [INFO ] [MAIN ] LYB: Combined data validation passed. [2025-09-05T18:34:11.538249] [INFO ] [MAIN ] LYB: Update completed successfully. [2025-09-05T18:34:11.541738] [INFO ] [MAIN ] Update Progress: 1285/2363 symbols completed. LYB took 1.5s. Estimated remaining: 28m 38s. Rate: 37.7 symbols/min [2025-09-05T18:34:11.713047] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:11.737299] [INFO ] [MAIN ] LYG: Loaded 25139 existing records. [2025-09-05T18:34:11.917555] [INFO ] [MAIN ] LYG: Found 1 missing trading days. [2025-09-05T18:34:11.917894] [INFO ] [MAIN ] LYG: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:11.918270] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-05T18:34:11.943361] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-05T18:34:11.951123] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-05T18:34:11.994274] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-05T18:34:12.194774] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-05T18:34:12.663477] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-05T18:34:12.751217] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-05T18:34:13.463499] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-05T18:34:13.696321] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-05T18:34:13.847387] [INFO ] [MAIN ] LYG: Adding 388 new records, updating 0 existing records. [2025-09-05T18:34:13.851015] [INFO ] [MAIN ] LYG: Combined dataset has 25527 total records. [2025-09-05T18:34:14.090794] [WARN ] [VALIDATOR ] LYG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:14.269159] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-05T18:34:14.318969] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-05T18:34:14.333399] [WARN ] [VALIDATOR ] LYG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:14.333628] [INFO ] [MAIN ] LYG: Combined data validation passed. [2025-09-05T18:34:14.497594] [INFO ] [MAIN ] LYG: Update completed successfully. [2025-09-05T18:34:14.501238] [INFO ] [MAIN ] Update Progress: 1286/2363 symbols completed. LYG took 3.0s. Estimated remaining: 28m 37s. Rate: 37.6 symbols/min [2025-09-05T18:34:14.673398] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:14.699314] [INFO ] [MAIN ] LYV: Loaded 24308 existing records. [2025-09-05T18:34:14.875106] [INFO ] [MAIN ] LYV: Found 1 missing trading days. [2025-09-05T18:34:14.875367] [INFO ] [MAIN ] LYV: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:14.895893] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-05T18:34:15.063476] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-05T18:34:15.750276] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-05T18:34:15.863473] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-05T18:34:16.663489] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-05T18:34:16.712253] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-05T18:34:17.365884] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-05T18:34:17.463463] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-05T18:34:17.793474] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-05T18:34:18.263492] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-05T18:34:18.686789] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:34:18.836703] [INFO ] [MAIN ] LYV: Adding 361 new records, updating 0 existing records. [2025-09-05T18:34:18.847977] [INFO ] [MAIN ] LYV: Combined dataset has 24669 total records. [2025-09-05T18:34:18.861786] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-05T18:34:19.060918] [WARN ] [VALIDATOR ] LYV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:19.071784] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-05T18:34:19.277443] [WARN ] [VALIDATOR ] LYV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:19.277703] [INFO ] [MAIN ] LYV: Combined data validation passed. [2025-09-05T18:34:19.436965] [INFO ] [MAIN ] LYV: Update completed successfully. [2025-09-05T18:34:19.440709] [INFO ] [MAIN ] Update Progress: 1287/2363 symbols completed. LYV took 4.9s. Estimated remaining: 28m 39s. Rate: 37.6 symbols/min [2025-09-05T18:34:19.620145] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:19.640317] [INFO ] [MAIN ] LZB: Loaded 17345 existing records. [2025-09-05T18:34:19.813821] [INFO ] [MAIN ] LZB: Found 1 missing trading days. [2025-09-05T18:34:19.813976] [INFO ] [MAIN ] LZB: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:19.863470] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-05T18:34:20.520818] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:34:20.668472] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-05T18:34:20.691199] [INFO ] [MAIN ] LZB: Adding 236 new records, updating 521 existing records. [2025-09-05T18:34:20.719031] [INFO ] [MAIN ] LZB: Combined dataset has 17581 total records. [2025-09-05T18:34:20.718914] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-05T18:34:20.917056] [WARN ] [VALIDATOR ] LZB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:21.118213] [WARN ] [VALIDATOR ] LZB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:21.118422] [INFO ] [MAIN ] LZB: Combined data validation passed. [2025-09-05T18:34:21.226169] [INFO ] [MAIN ] LZB: Update completed successfully. [2025-09-05T18:34:21.228387] [INFO ] [MAIN ] Update Progress: 1288/2363 symbols completed. LZB took 1.8s. Estimated remaining: 28m 37s. Rate: 37.6 symbols/min [2025-09-05T18:34:21.401239] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:21.407887] [INFO ] [MAIN ] LZM: Loaded 5309 existing records. [2025-09-05T18:34:21.470876] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-05T18:34:21.505480] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:34:21.524466] [INFO ] [REMOTE ] LVWR: Full fetch complete (16161 records). [2025-09-05T18:34:21.687582] [INFO ] [MAIN ] LZM: Found 1 missing trading days. [2025-09-05T18:34:21.698328] [INFO ] [MAIN ] LZM: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:21.962846] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-05T18:34:22.059017] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-05T18:34:22.059190] [INFO ] [MAIN ] Update Progress: 1289/2363 symbols completed. LVWR took 17.8s. Estimated remaining: 28m 35s. Rate: 37.6 symbols/min [2025-09-05T18:34:22.237872] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:22.266860] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-05T18:34:22.268385] [INFO ] [MAIN ] M: Loaded 25578 existing records. [2025-09-05T18:34:22.458017] [INFO ] [MAIN ] M: Found 1 missing trading days. [2025-09-05T18:34:22.458163] [INFO ] [MAIN ] M: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:23.063445] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-05T18:34:23.309678] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T18:34:23.338396] [INFO ] [MAIN ] LZM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:34:23.339730] [INFO ] [MAIN ] LZM: Combined dataset has 5309 total records. [2025-09-05T18:34:23.340240] [FATAL] [VALIDATOR ] LZM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:34:23.340321] [FATAL] [MAIN ] LZM: Combined data validation failed. [2025-09-05T18:34:23.340357] [WARN ] [MAIN ] LZM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:34:23.340394] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-05T18:34:23.340922] [INFO ] [LOCAL ] LZM: Starting deletion of derivative data. [2025-09-05T18:34:23.341837] [INFO ] [MAIN ] Update Progress: 1290/2363 symbols completed. LZM took 2.1s. Estimated remaining: 28m 33s. Rate: 37.6 symbols/min [2025-09-05T18:34:23.513566] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:23.548709] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-05T18:34:23.575730] [INFO ] [MAIN ] MA: Loaded 25055 existing records. [2025-09-05T18:34:23.749174] [INFO ] [MAIN ] MA: Found 1 missing trading days. [2025-09-05T18:34:23.749307] [INFO ] [MAIN ] MA: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:23.863437] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-05T18:34:24.581080] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-05T18:34:24.663480] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-05T18:34:25.037001] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:34:25.186581] [INFO ] [MAIN ] M: Adding 390 new records, updating 0 existing records. [2025-09-05T18:34:25.190069] [INFO ] [MAIN ] M: Combined dataset has 25968 total records. [2025-09-05T18:34:25.376777] [WARN ] [VALIDATOR ] M: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:25.472844] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-05T18:34:25.609553] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-05T18:34:25.627705] [WARN ] [VALIDATOR ] M: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:25.627908] [INFO ] [MAIN ] M: Combined data validation passed. [2025-09-05T18:34:25.791471] [INFO ] [MAIN ] M: Update completed successfully. [2025-09-05T18:34:25.794384] [INFO ] [MAIN ] Update Progress: 1291/2363 symbols completed. M took 3.7s. Estimated remaining: 28m 32s. Rate: 37.6 symbols/min [2025-09-05T18:34:25.971792] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:25.993505] [INFO ] [MAIN ] MAA: Loaded 21224 existing records. [2025-09-05T18:34:26.182223] [INFO ] [MAIN ] MAA: Found 1 missing trading days. [2025-09-05T18:34:26.182366] [INFO ] [MAIN ] MAA: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:26.263468] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-05T18:34:26.366809] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:34:26.516503] [INFO ] [MAIN ] MA: Adding 384 new records, updating 0 existing records. [2025-09-05T18:34:26.519881] [INFO ] [MAIN ] MA: Combined dataset has 25439 total records. [2025-09-05T18:34:26.700470] [WARN ] [VALIDATOR ] MA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:26.898373] [WARN ] [VALIDATOR ] MA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:26.898583] [INFO ] [MAIN ] MA: Combined data validation passed. [2025-09-05T18:34:27.060855] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:34:27.070566] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-05T18:34:27.159118] [INFO ] [MAIN ] MA: Update completed successfully. [2025-09-05T18:34:27.172510] [INFO ] [MAIN ] Update Progress: 1292/2363 symbols completed. MA took 3.8s. Estimated remaining: 28m 30s. Rate: 37.6 symbols/min [2025-09-05T18:34:27.221161] [INFO ] [MAIN ] MAA: Adding 0 new records, updating 0 existing records. [2025-09-05T18:34:27.299160] [INFO ] [MAIN ] MAA: Combined dataset has 21224 total records. [2025-09-05T18:34:27.315534] [FATAL] [VALIDATOR ] MAA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:34:27.341332] [FATAL] [MAIN ] MAA: Combined data validation failed. [2025-09-05T18:34:27.355085] [WARN ] [MAIN ] MAA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:34:27.374436] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:27.371206] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-05T18:34:27.375527] [INFO ] [LOCAL ] MAA: Starting deletion of derivative data. [2025-09-05T18:34:27.378387] [INFO ] [MAIN ] Update Progress: 1293/2363 symbols completed. MAA took 1.6s. Estimated remaining: 28m 28s. Rate: 37.6 symbols/min [2025-09-05T18:34:27.585187] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:27.586634] [INFO ] [MAIN ] MAC: Loaded 23457 existing records. [2025-09-05T18:34:27.775257] [INFO ] [MAIN ] MAGN: Loaded 16812 existing records. [2025-09-05T18:34:27.781231] [INFO ] [MAIN ] MAC: Found 1 missing trading days. [2025-09-05T18:34:27.781391] [INFO ] [MAIN ] MAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:27.868525] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-05T18:34:27.964699] [INFO ] [MAIN ] MAGN: Found 1 missing trading days. [2025-09-05T18:34:27.964851] [INFO ] [MAIN ] MAGN: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:28.663472] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-05T18:34:28.785361] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-05T18:34:29.179622] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-05T18:34:29.257138] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:34:29.392529] [INFO ] [MAIN ] MAC: Adding 373 new records, updating 0 existing records. [2025-09-05T18:34:29.395805] [INFO ] [MAIN ] MAC: Combined dataset has 23830 total records. [2025-09-05T18:34:29.468717] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-05T18:34:29.585198] [WARN ] [VALIDATOR ] MAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:29.781704] [WARN ] [VALIDATOR ] MAC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:29.781921] [INFO ] [MAIN ] MAC: Combined data validation passed. [2025-09-05T18:34:29.924366] [INFO ] [MAIN ] MAC: Update completed successfully. [2025-09-05T18:34:29.927539] [INFO ] [MAIN ] Update Progress: 1294/2363 symbols completed. MAC took 2.7s. Estimated remaining: 28m 27s. Rate: 37.6 symbols/min [2025-09-05T18:34:30.103186] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:30.109343] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:34:30.218002] [INFO ] [MAIN ] MAGN: Adding 242 new records, updating 0 existing records. [2025-09-05T18:34:30.220039] [INFO ] [MAIN ] MAIN: Loaded 19328 existing records. [2025-09-05T18:34:30.264012] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-05T18:34:30.335899] [INFO ] [MAIN ] MAGN: Combined dataset has 17054 total records. [2025-09-05T18:34:30.506501] [INFO ] [MAIN ] MAIN: Found 1 missing trading days. [2025-09-05T18:34:30.512261] [INFO ] [MAIN ] MAIN: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:30.610734] [WARN ] [VALIDATOR ] MAGN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:30.833674] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:34:30.837372] [INFO ] [REMOTE ] LXU: Full fetch complete (34606 records). [2025-09-05T18:34:31.070754] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-05T18:34:31.400680] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-05T18:34:31.412004] [WARN ] [VALIDATOR ] MAGN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:31.412331] [INFO ] [MAIN ] MAGN: Combined data validation passed. [2025-09-05T18:34:31.696706] [INFO ] [MAIN ] MAGN: Update completed successfully. [2025-09-05T18:34:31.701149] [INFO ] [MAIN ] Update Progress: 1295/2363 symbols completed. MAGN took 4.3s. Estimated remaining: 28m 25s. Rate: 37.6 symbols/min [2025-09-05T18:34:31.869797] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-05T18:34:32.045393] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:34:32.064452] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:32.155504] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-05T18:34:32.189447] [INFO ] [MAIN ] MAIN: Adding 306 new records, updating 0 existing records. [2025-09-05T18:34:32.182809] [INFO ] [MAIN ] Update Progress: 1296/2363 symbols completed. LXU took 23.5s. Estimated remaining: 28m 23s. Rate: 37.6 symbols/min [2025-09-05T18:34:32.316478] [INFO ] [MAIN ] MAN: Loaded 20965 existing records. [2025-09-05T18:34:32.379881] [INFO ] [MAIN ] MAIN: Combined dataset has 19634 total records. [2025-09-05T18:34:32.462430] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:32.683754] [INFO ] [MAIN ] MAN: Found 1 missing trading days. [2025-09-05T18:34:32.689831] [INFO ] [MAIN ] MANU: Loaded 13000 existing records. [2025-09-05T18:34:32.702316] [INFO ] [MAIN ] MAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:32.737300] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-05T18:34:32.930937] [WARN ] [VALIDATOR ] MAIN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:33.128072] [INFO ] [MAIN ] MANU: Found 1 missing trading days. [2025-09-05T18:34:33.144232] [INFO ] [MAIN ] MANU: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:33.220063] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:34:33.340681] [INFO ] [MAIN ] MAN: Adding 303 new records, updating 0 existing records. [2025-09-05T18:34:33.344960] [INFO ] [MAIN ] MAN: Combined dataset has 21268 total records. [2025-09-05T18:34:33.463998] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-05T18:34:33.527049] [WARN ] [VALIDATOR ] MAN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:33.727703] [WARN ] [VALIDATOR ] MAIN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:33.727818] [WARN ] [VALIDATOR ] MAN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:33.728089] [INFO ] [MAIN ] MAIN: Combined data validation passed. [2025-09-05T18:34:33.728224] [INFO ] [MAIN ] MAN: Combined data validation passed. [2025-09-05T18:34:33.928693] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:34:34.039100] [INFO ] [MAIN ] MANU: Adding 196 new records, updating 0 existing records. [2025-09-05T18:34:34.052942] [INFO ] [MAIN ] MANU: Combined dataset has 13196 total records. [2025-09-05T18:34:34.323550] [WARN ] [VALIDATOR ] MANU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:34.414874] [INFO ] [MAIN ] MAIN: Update completed successfully. [2025-09-05T18:34:34.443201] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-05T18:34:34.445594] [INFO ] [MAIN ] Update Progress: 1297/2363 symbols completed. MAIN took 4.5s. Estimated remaining: 28m 22s. Rate: 37.6 symbols/min [2025-09-05T18:34:34.618536] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-05T18:34:34.654248] [INFO ] [MAIN ] MAN: Update completed successfully. [2025-09-05T18:34:34.698991] [INFO ] [MAIN ] Update Progress: 1298/2363 symbols completed. MAN took 3.0s. Estimated remaining: 28m 19s. Rate: 37.6 symbols/min [2025-09-05T18:34:34.816623] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:34.844544] [WARN ] [MAIN ] MAS: No existing data found, performing full refresh instead. [2025-09-05T18:34:34.857102] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-05T18:34:34.857352] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-05T18:34:34.862726] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-05T18:34:35.069608] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:35.080542] [WARN ] [MAIN ] MATV: No existing data found, performing full refresh instead. [2025-09-05T18:34:35.081062] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-05T18:34:35.086353] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-05T18:34:35.112405] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-05T18:34:35.490124] [INFO ] [REMOTE ] MAS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:34:35.516670] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-05T18:34:35.704100] [INFO ] [REMOTE ] MATV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:34:35.709296] [WARN ] [VALIDATOR ] MANU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:35.709492] [INFO ] [MAIN ] MANU: Combined data validation passed. [2025-09-05T18:34:35.795384] [INFO ] [MAIN ] MANU: Update completed successfully. [2025-09-05T18:34:35.796766] [INFO ] [MAIN ] Update Progress: 1299/2363 symbols completed. MANU took 3.6s. Estimated remaining: 28m 17s. Rate: 37.6 symbols/min [2025-09-05T18:34:35.873785] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-05T18:34:35.971603] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:35.987721] [INFO ] [MAIN ] MATX: Loaded 14508 existing records. [2025-09-05T18:34:36.161088] [INFO ] [MAIN ] MATX: Found 1 missing trading days. [2025-09-05T18:34:36.161257] [INFO ] [MAIN ] MATX: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:36.437312] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-05T18:34:36.663515] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-05T18:34:36.987339] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:34:36.990349] [INFO ] [REMOTE ] LXP: Full fetch complete (54732 records). [2025-09-05T18:34:37.374211] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-05T18:34:37.500788] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-05T18:34:37.468440] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-05T18:34:37.661700] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-05T18:34:37.661937] [INFO ] [MAIN ] Update Progress: 1300/2363 symbols completed. LXP took 29.2s. Estimated remaining: 28m 16s. Rate: 37.6 symbols/min [2025-09-05T18:34:37.845418] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:37.860583] [INFO ] [MAIN ] MAX: Loaded 13430 existing records. [2025-09-05T18:34:38.046529] [INFO ] [MAIN ] MAX: Found 1 missing trading days. [2025-09-05T18:34:38.046767] [INFO ] [MAIN ] MAX: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:38.064853] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-05T18:34:38.157994] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:34:38.242999] [INFO ] [MAIN ] MATX: Adding 195 new records, updating 0 existing records. [2025-09-05T18:34:38.245545] [INFO ] [MAIN ] MATX: Combined dataset has 14703 total records. [2025-09-05T18:34:38.268617] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-05T18:34:38.435511] [WARN ] [VALIDATOR ] MATX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:38.638546] [WARN ] [VALIDATOR ] MATX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:38.638828] [INFO ] [MAIN ] MATX: Combined data validation passed. [2025-09-05T18:34:38.751439] [INFO ] [MAIN ] MATX: Update completed successfully. [2025-09-05T18:34:38.753154] [INFO ] [MAIN ] Update Progress: 1301/2363 symbols completed. MATX took 3.0s. Estimated remaining: 28m 14s. Rate: 37.6 symbols/min [2025-09-05T18:34:38.864712] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:34:39.027037] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:39.042743] [INFO ] [MAIN ] MAX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:34:39.042914] [WARN ] [MAIN ] MBC: No existing data found, performing full refresh instead. [2025-09-05T18:34:39.043195] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-05T18:34:39.043604] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-05T18:34:39.043971] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-05T18:34:39.068776] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-05T18:34:39.125867] [INFO ] [MAIN ] MAX: Combined dataset has 13430 total records. [2025-09-05T18:34:39.138133] [FATAL] [VALIDATOR ] MAX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:34:39.143446] [FATAL] [MAIN ] MAX: Combined data validation failed. [2025-09-05T18:34:39.163239] [WARN ] [MAIN ] MAX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:34:39.165746] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-05T18:34:39.176904] [INFO ] [LOCAL ] MAX: Starting deletion of derivative data. [2025-09-05T18:34:39.225549] [INFO ] [MAIN ] Update Progress: 1302/2363 symbols completed. MAX took 1.6s. Estimated remaining: 28m 11s. Rate: 37.6 symbols/min [2025-09-05T18:34:39.617965] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:39.616539] [INFO ] [REMOTE ] MBC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:34:39.630421] [INFO ] [MAIN ] MBI: Loaded 11475 existing records. [2025-09-05T18:34:39.810110] [INFO ] [MAIN ] MBI: Found 1 missing trading days. [2025-09-05T18:34:39.810383] [INFO ] [MAIN ] MBI: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:39.863438] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-05T18:34:40.104383] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-05T18:34:40.663511] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-05T18:34:41.183939] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:34:41.253942] [INFO ] [MAIN ] MBI: Adding 227 new records, updating 0 existing records. [2025-09-05T18:34:41.256522] [INFO ] [MAIN ] MBI: Combined dataset has 11702 total records. [2025-09-05T18:34:41.443292] [WARN ] [VALIDATOR ] MBI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:41.479171] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-05T18:34:41.685189] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-05T18:34:41.711657] [WARN ] [VALIDATOR ] MBI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:41.711923] [INFO ] [MAIN ] MBI: Combined data validation passed. [2025-09-05T18:34:41.785599] [INFO ] [MAIN ] MBI: Update completed successfully. [2025-09-05T18:34:41.787732] [INFO ] [MAIN ] Update Progress: 1303/2363 symbols completed. MBI took 2.5s. Estimated remaining: 28m 10s. Rate: 37.6 symbols/min [2025-09-05T18:34:41.975464] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:42.010960] [INFO ] [MAIN ] MC: Loaded 33648 existing records. [2025-09-05T18:34:42.193277] [INFO ] [MAIN ] MC: Found 1 missing trading days. [2025-09-05T18:34:42.193469] [INFO ] [MAIN ] MC: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:42.263487] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-05T18:34:43.063470] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-05T18:34:43.318181] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-05T18:34:43.709033] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-05T18:34:43.825505] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:34:43.868589] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-05T18:34:43.948138] [INFO ] [MAIN ] MC: Adding 276 new records, updating 0 existing records. [2025-09-05T18:34:43.954813] [INFO ] [MAIN ] MC: Combined dataset has 33924 total records. [2025-09-05T18:34:44.133519] [WARN ] [VALIDATOR ] MC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:34:44.331480] [WARN ] [VALIDATOR ] MC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:34:44.331704] [INFO ] [MAIN ] MC: Combined data validation passed. [2025-09-05T18:34:44.547824] [INFO ] [MAIN ] MC: Update completed successfully. [2025-09-05T18:34:44.551360] [INFO ] [MAIN ] Update Progress: 1304/2363 symbols completed. MC took 2.8s. Estimated remaining: 28m 10s. Rate: 37.6 symbols/min [2025-09-05T18:34:44.668572] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-05T18:34:44.722927] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:44.729416] [INFO ] [MAIN ] MCB: Loaded 4928 existing records. [2025-09-05T18:34:44.900380] [INFO ] [MAIN ] MCB: Found 1 missing trading days. [2025-09-05T18:34:44.900567] [INFO ] [MAIN ] MCB: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:45.463493] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-05T18:34:45.673169] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-05T18:34:45.986593] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:34:46.005925] [INFO ] [MAIN ] MCB: Adding 40 new records, updating 0 existing records. [2025-09-05T18:34:46.007481] [INFO ] [MAIN ] MCB: Combined dataset has 4968 total records. [2025-09-05T18:34:46.185997] [WARN ] [VALIDATOR ] MCB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:46.265667] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-05T18:34:46.398107] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-05T18:34:46.415927] [WARN ] [VALIDATOR ] MCB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:46.416165] [INFO ] [MAIN ] MCB: Combined data validation passed. [2025-09-05T18:34:46.448733] [INFO ] [MAIN ] MCB: Update completed successfully. [2025-09-05T18:34:46.449525] [INFO ] [MAIN ] Update Progress: 1305/2363 symbols completed. MCB took 1.9s. Estimated remaining: 28m 8s. Rate: 37.6 symbols/min [2025-09-05T18:34:46.630930] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:46.658064] [INFO ] [MAIN ] MCD: Loaded 25632 existing records. [2025-09-05T18:34:46.846843] [INFO ] [MAIN ] MCD: Found 1 missing trading days. [2025-09-05T18:34:46.846986] [INFO ] [MAIN ] MCD: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:47.063481] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-05T18:34:47.863431] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-05T18:34:48.462859] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-05T18:34:48.663471] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-05T18:34:48.896139] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-05T18:34:49.463479] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-05T18:34:49.610595] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-05T18:34:50.263475] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-05T18:34:50.416671] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-05T18:34:50.920067] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:34:51.068543] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-05T18:34:51.077618] [INFO ] [MAIN ] MCD: Adding 390 new records, updating 0 existing records. [2025-09-05T18:34:51.082028] [INFO ] [MAIN ] MCD: Combined dataset has 26022 total records. [2025-09-05T18:34:51.272230] [WARN ] [VALIDATOR ] MCD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:51.488716] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-05T18:34:51.505533] [WARN ] [VALIDATOR ] MCD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:51.505789] [INFO ] [MAIN ] MCD: Combined data validation passed. [2025-09-05T18:34:51.672799] [INFO ] [MAIN ] MCD: Update completed successfully. [2025-09-05T18:34:51.676320] [INFO ] [MAIN ] Update Progress: 1306/2363 symbols completed. MCD took 5.2s. Estimated remaining: 28m 10s. Rate: 37.5 symbols/min [2025-09-05T18:34:51.852854] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:51.857544] [INFO ] [MAIN ] MCI: Loaded 2785 existing records. [2025-09-05T18:34:51.869573] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-05T18:34:52.036452] [INFO ] [MAIN ] MCI: Found 1 missing trading days. [2025-09-05T18:34:52.036596] [INFO ] [MAIN ] MCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:34:52.663478] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-05T18:34:52.743837] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-05T18:34:53.463467] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-05T18:34:53.561582] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-05T18:34:54.263497] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-05T18:34:54.774935] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-05T18:34:55.063481] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-05T18:34:55.094723] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:34:55.107589] [INFO ] [MAIN ] MCI: Adding 31 new records, updating 0 existing records. [2025-09-05T18:34:55.109409] [INFO ] [MAIN ] MCI: Combined dataset has 2816 total records. [2025-09-05T18:34:55.318111] [WARN ] [VALIDATOR ] MCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:34:55.356188] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-05T18:34:55.541930] [WARN ] [VALIDATOR ] MCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:34:55.542178] [INFO ] [MAIN ] MCI: Combined data validation passed. [2025-09-05T18:34:55.560268] [INFO ] [MAIN ] MCI: Update completed successfully. [2025-09-05T18:34:55.560998] [INFO ] [MAIN ] Update Progress: 1307/2363 symbols completed. MCI took 3.9s. Estimated remaining: 28m 10s. Rate: 37.5 symbols/min [2025-09-05T18:34:55.748190] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:34:55.748404] [WARN ] [MAIN ] MCK: No existing data found, performing full refresh instead. [2025-09-05T18:34:55.748542] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-05T18:34:55.748588] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-05T18:34:55.748636] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-05T18:34:55.868693] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-05T18:34:56.105631] [INFO ] [REMOTE ] MCK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:34:56.663515] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-05T18:34:56.812934] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-05T18:34:57.094525] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-05T18:34:57.463571] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-05T18:34:58.263583] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-05T18:34:58.292559] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-05T18:34:59.063524] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-05T18:34:59.554869] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-05T18:34:59.863480] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-05T18:35:00.016536] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-05T18:35:00.301899] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-05T18:35:00.663527] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-05T18:35:01.463517] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-05T18:35:01.518698] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-05T18:35:02.263560] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-05T18:35:02.625343] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-05T18:35:02.962225] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-05T18:35:02.965789] [INFO ] [REMOTE ] MBC: Full fetch complete (46522 records). [2025-09-05T18:35:03.069210] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-05T18:35:03.358552] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-05T18:35:03.565564] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-05T18:35:03.565761] [INFO ] [MAIN ] Update Progress: 1308/2363 symbols completed. MBC took 24.8s. Estimated remaining: 28m 14s. Rate: 37.4 symbols/min [2025-09-05T18:35:03.747376] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:03.755398] [INFO ] [MAIN ] MCN: Loaded 3842 existing records. [2025-09-05T18:35:03.865917] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-05T18:35:03.967111] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-05T18:35:03.970209] [INFO ] [MAIN ] MCN: Found 1 missing trading days. [2025-09-05T18:35:03.970436] [INFO ] [MAIN ] MCN: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:04.663436] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-05T18:35:05.233869] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-05T18:35:05.334737] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T18:35:05.337772] [INFO ] [REMOTE ] MATV: Full fetch complete (41458 records). [2025-09-05T18:35:05.468583] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-05T18:35:05.708778] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-05T18:35:05.885618] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-05T18:35:05.885816] [INFO ] [MAIN ] Update Progress: 1309/2363 symbols completed. MATV took 31.2s. Estimated remaining: 28m 13s. Rate: 37.4 symbols/min [2025-09-05T18:35:06.061014] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:06.078705] [INFO ] [MAIN ] MCO: Loaded 17715 existing records. [2025-09-05T18:35:06.254680] [INFO ] [MAIN ] MCO: Found 1 missing trading days. [2025-09-05T18:35:06.254921] [INFO ] [MAIN ] MCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:06.263423] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-05T18:35:06.348671] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:35:06.351598] [INFO ] [REMOTE ] MAS: Full fetch complete (56684 records). [2025-09-05T18:35:06.730400] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-05T18:35:06.858595] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-05T18:35:06.879150] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:35:06.993361] [INFO ] [MAIN ] MCO: Adding 263 new records, updating 0 existing records. [2025-09-05T18:35:07.002456] [INFO ] [MAIN ] MCO: Combined dataset has 17978 total records. [2025-09-05T18:35:07.068585] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-05T18:35:07.195897] [WARN ] [VALIDATOR ] MCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:07.537241] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-05T18:35:07.537759] [INFO ] [MAIN ] Update Progress: 1310/2363 symbols completed. MAS took 33.1s. Estimated remaining: 28m 11s. Rate: 37.4 symbols/min [2025-09-05T18:35:07.570487] [WARN ] [VALIDATOR ] MCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:07.630120] [INFO ] [MAIN ] MCO: Combined data validation passed. [2025-09-05T18:35:07.774422] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:07.813997] [INFO ] [MAIN ] MCR: Loaded 4460 existing records. [2025-09-05T18:35:07.873338] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-05T18:35:08.011135] [INFO ] [MAIN ] MCO: Update completed successfully. [2025-09-05T18:35:08.014363] [INFO ] [MAIN ] MCR: Found 1 missing trading days. [2025-09-05T18:35:08.016251] [INFO ] [MAIN ] Update Progress: 1311/2363 symbols completed. MCO took 2.1s. Estimated remaining: 28m 8s. Rate: 37.4 symbols/min [2025-09-05T18:35:08.014488] [INFO ] [MAIN ] MCR: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:08.193002] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:08.204389] [INFO ] [MAIN ] MCS: Loaded 10325 existing records. [2025-09-05T18:35:08.360348] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:35:08.380560] [INFO ] [MAIN ] MCS: Found 1 missing trading days. [2025-09-05T18:35:08.390563] [INFO ] [MAIN ] MCS: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:08.400426] [INFO ] [MAIN ] MCN: Adding 26 new records, updating 0 existing records. [2025-09-05T18:35:08.401998] [INFO ] [MAIN ] MCN: Combined dataset has 3868 total records. [2025-09-05T18:35:08.578933] [WARN ] [VALIDATOR ] MCN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:08.672119] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-05T18:35:08.781690] [WARN ] [VALIDATOR ] MCN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:08.781907] [INFO ] [MAIN ] MCN: Combined data validation passed. [2025-09-05T18:35:08.807364] [INFO ] [MAIN ] MCN: Update completed successfully. [2025-09-05T18:35:08.808228] [INFO ] [MAIN ] Update Progress: 1312/2363 symbols completed. MCN took 5.2s. Estimated remaining: 28m 6s. Rate: 37.4 symbols/min [2025-09-05T18:35:08.991241] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:08.991463] [WARN ] [MAIN ] MCY: No existing data found, performing full refresh instead. [2025-09-05T18:35:08.991626] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-05T18:35:08.991716] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-05T18:35:08.991803] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-05T18:35:09.289815] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:35:09.442352] [INFO ] [REMOTE ] MCY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:35:09.442774] [INFO ] [MAIN ] MCS: Adding 122 new records, updating 0 existing records. [2025-09-05T18:35:09.446421] [INFO ] [MAIN ] MCS: Combined dataset has 10447 total records. [2025-09-05T18:35:09.473383] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-05T18:35:09.634783] [WARN ] [VALIDATOR ] MCS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:09.858385] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-05T18:35:09.875383] [WARN ] [VALIDATOR ] MCS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:09.875662] [INFO ] [MAIN ] MCS: Combined data validation passed. [2025-09-05T18:35:09.942815] [INFO ] [MAIN ] MCS: Update completed successfully. [2025-09-05T18:35:09.944117] [INFO ] [MAIN ] Update Progress: 1313/2363 symbols completed. MCS took 1.9s. Estimated remaining: 28m 4s. Rate: 37.4 symbols/min [2025-09-05T18:35:10.117052] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:10.135775] [INFO ] [MAIN ] MD: Loaded 18375 existing records. [2025-09-05T18:35:10.276555] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-05T18:35:10.312225] [INFO ] [MAIN ] MD: Found 1 missing trading days. [2025-09-05T18:35:10.312365] [INFO ] [MAIN ] MD: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:11.063540] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-05T18:35:11.422383] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:35:11.454920] [INFO ] [MAIN ] MCR: Adding 18 new records, updating 0 existing records. [2025-09-05T18:35:11.456733] [INFO ] [MAIN ] MCR: Combined dataset has 4478 total records. [2025-09-05T18:35:11.637031] [WARN ] [VALIDATOR ] MCR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:11.854378] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-05T18:35:11.863421] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-05T18:35:11.871668] [WARN ] [VALIDATOR ] MCR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:11.871898] [INFO ] [MAIN ] MCR: Combined data validation passed. [2025-09-05T18:35:11.899607] [INFO ] [MAIN ] MCR: Update completed successfully. [2025-09-05T18:35:11.900290] [INFO ] [MAIN ] Update Progress: 1314/2363 symbols completed. MCR took 4.4s. Estimated remaining: 28m 3s. Rate: 37.4 symbols/min [2025-09-05T18:35:12.069780] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:12.074476] [INFO ] [MAIN ] MDST: Loaded 2838 existing records. [2025-09-05T18:35:12.247110] [INFO ] [MAIN ] MDST: Found 1 missing trading days. [2025-09-05T18:35:12.247303] [INFO ] [MAIN ] MDST: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:12.663478] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-05T18:35:12.795766] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-05T18:35:13.457903] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-05T18:35:13.465496] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-05T18:35:13.496620] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:35:13.511421] [INFO ] [MAIN ] MDST: Adding 41 new records, updating 0 existing records. [2025-09-05T18:35:13.512854] [INFO ] [MAIN ] MDST: Combined dataset has 2879 total records. [2025-09-05T18:35:13.699079] [WARN ] [VALIDATOR ] MDST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:13.889104] [WARN ] [VALIDATOR ] MDST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:13.889334] [INFO ] [MAIN ] MDST: Combined data validation passed. [2025-09-05T18:35:13.908366] [INFO ] [MAIN ] MDST: Update completed successfully. [2025-09-05T18:35:13.908884] [INFO ] [MAIN ] Update Progress: 1315/2363 symbols completed. MDST took 2.0s. Estimated remaining: 28m 2s. Rate: 37.4 symbols/min [2025-09-05T18:35:14.082506] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:14.108073] [INFO ] [MAIN ] MDT: Loaded 25659 existing records. [2025-09-05T18:35:14.228108] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:35:14.267405] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-05T18:35:14.353416] [INFO ] [MAIN ] MDT: Found 1 missing trading days. [2025-09-05T18:35:14.363906] [INFO ] [MAIN ] MDT: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:14.420254] [INFO ] [MAIN ] MD: Adding 356 new records, updating 0 existing records. [2025-09-05T18:35:14.423742] [INFO ] [MAIN ] MD: Combined dataset has 18731 total records. [2025-09-05T18:35:14.602897] [WARN ] [VALIDATOR ] MD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:14.793697] [WARN ] [VALIDATOR ] MD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:14.793913] [INFO ] [MAIN ] MD: Combined data validation passed. [2025-09-05T18:35:14.906196] [INFO ] [MAIN ] MD: Update completed successfully. [2025-09-05T18:35:14.908222] [INFO ] [MAIN ] Update Progress: 1316/2363 symbols completed. MD took 5.0s. Estimated remaining: 27m 60s. Rate: 37.4 symbols/min [2025-09-05T18:35:15.080099] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-05T18:35:15.082520] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:15.106054] [INFO ] [MAIN ] MDU: Loaded 22573 existing records. [2025-09-05T18:35:15.279163] [INFO ] [MAIN ] MDU: Found 1 missing trading days. [2025-09-05T18:35:15.279326] [INFO ] [MAIN ] MDU: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:15.863497] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-05T18:35:16.178189] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-05T18:35:16.521266] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-05T18:35:16.644916] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:35:16.669614] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-05T18:35:16.793936] [INFO ] [MAIN ] MDT: Adding 389 new records, updating 0 existing records. [2025-09-05T18:35:16.797551] [INFO ] [MAIN ] MDT: Combined dataset has 26048 total records. [2025-09-05T18:35:16.973769] [WARN ] [VALIDATOR ] MDT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:17.170402] [WARN ] [VALIDATOR ] MDT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:17.170656] [INFO ] [MAIN ] MDT: Combined data validation passed. [2025-09-05T18:35:17.333843] [INFO ] [MAIN ] MDT: Update completed successfully. [2025-09-05T18:35:17.336967] [INFO ] [MAIN ] Update Progress: 1317/2363 symbols completed. MDT took 3.4s. Estimated remaining: 27m 59s. Rate: 37.4 symbols/min [2025-09-05T18:35:17.463492] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-05T18:35:17.760829] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-05T18:35:18.219567] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:35:18.268577] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-05T18:35:18.358016] [INFO ] [MAIN ] MDU: Adding 358 new records, updating 0 existing records. [2025-09-05T18:35:18.361203] [INFO ] [MAIN ] MDU: Combined dataset has 22931 total records. [2025-09-05T18:35:18.547819] [WARN ] [VALIDATOR ] MDU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:18.749941] [WARN ] [VALIDATOR ] MDU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:18.750182] [INFO ] [MAIN ] MDU: Combined data validation passed. [2025-09-05T18:35:18.895694] [INFO ] [MAIN ] MDU: Update completed successfully. [2025-09-05T18:35:18.898865] [INFO ] [MAIN ] Update Progress: 1318/2363 symbols completed. MDU took 4.0s. Estimated remaining: 27m 57s. Rate: 37.4 symbols/min [2025-09-05T18:35:19.063571] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-05T18:35:19.660103] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-05T18:35:19.863515] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-05T18:35:20.844585] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-05T18:35:20.849598] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-05T18:35:21.042168] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-05T18:35:21.463583] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-05T18:35:22.079842] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:35:22.082565] [INFO ] [REMOTE ] MCK: Full fetch complete (43500 records). [2025-09-05T18:35:22.477394] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-05T18:35:22.488908] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-05T18:35:22.495220] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-05T18:35:22.696999] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-05T18:35:22.697150] [INFO ] [MAIN ] Update Progress: 1319/2363 symbols completed. MCK took 27.1s. Estimated remaining: 27m 57s. Rate: 37.4 symbols/min [2025-09-05T18:35:23.820109] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-05T18:35:23.826021] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-05T18:35:24.474210] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:35:24.477041] [INFO ] [REMOTE ] MCY: Full fetch complete (30541 records). [2025-09-05T18:35:25.011386] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-05T18:35:25.165047] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-05T18:35:25.165255] [INFO ] [MAIN ] Update Progress: 1320/2363 symbols completed. MCY took 16.4s. Estimated remaining: 27m 56s. Rate: 37.3 symbols/min [2025-09-05T18:35:25.688098] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:25.851725] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:25.882072] [WARN ] [MAIN ] MEC: No existing data found, performing full refresh instead. [2025-09-05T18:35:25.880027] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:25.883921] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:25.884329] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-05T18:35:25.884381] [WARN ] [MAIN ] MEG: No existing data found, performing full refresh instead. [2025-09-05T18:35:25.884889] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-05T18:35:25.885116] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-05T18:35:25.888858] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-05T18:35:25.885865] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-05T18:35:25.889131] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-05T18:35:26.018723] [INFO ] [MAIN ] MED: Loaded 10333 existing records. [2025-09-05T18:35:26.128950] [INFO ] [MAIN ] MDV: Loaded 6794 existing records. [2025-09-05T18:35:26.848773] [INFO ] [MAIN ] MDV: Found 1 missing trading days. [2025-09-05T18:35:26.853633] [INFO ] [MAIN ] MED: Found 1 missing trading days. [2025-09-05T18:35:26.851045] [INFO ] [MAIN ] MDV: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:26.879678] [INFO ] [MAIN ] MED: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:26.890281] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-05T18:35:26.917041] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-05T18:35:26.968740] [INFO ] [REMOTE ] MEC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:35:27.010494] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-05T18:35:27.039814] [INFO ] [REMOTE ] MEG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:35:27.041054] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-05T18:35:27.512829] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:35:27.634319] [INFO ] [MAIN ] MED: Adding 140 new records, updating 0 existing records. [2025-09-05T18:35:27.637991] [INFO ] [MAIN ] MED: Combined dataset has 10473 total records. [2025-09-05T18:35:27.714840] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:35:27.768177] [INFO ] [MAIN ] MDV: Adding 41 new records, updating 0 existing records. [2025-09-05T18:35:27.850740] [WARN ] [VALIDATOR ] MED: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:27.918325] [INFO ] [MAIN ] MDV: Combined dataset has 6835 total records. [2025-09-05T18:35:28.120215] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-05T18:35:28.159114] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-05T18:35:28.236459] [WARN ] [VALIDATOR ] MDV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:35:28.452049] [WARN ] [VALIDATOR ] MED: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:28.452148] [WARN ] [VALIDATOR ] MDV: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:35:28.452392] [INFO ] [MAIN ] MED: Combined data validation passed. [2025-09-05T18:35:28.452777] [INFO ] [MAIN ] MDV: Combined data validation passed. [2025-09-05T18:35:28.554078] [INFO ] [MAIN ] MDV: Update completed successfully. [2025-09-05T18:35:28.562507] [INFO ] [MAIN ] Update Progress: 1321/2363 symbols completed. MDV took 3.4s. Estimated remaining: 27m 56s. Rate: 37.3 symbols/min [2025-09-05T18:35:28.596710] [INFO ] [MAIN ] MED: Update completed successfully. [2025-09-05T18:35:28.631403] [INFO ] [MAIN ] Update Progress: 1322/2363 symbols completed. MED took 3.5s. Estimated remaining: 27m 53s. Rate: 37.3 symbols/min [2025-09-05T18:35:28.833182] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:28.925212] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:28.925492] [WARN ] [MAIN ] MEI: No existing data found, performing full refresh instead. [2025-09-05T18:35:28.925622] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-05T18:35:28.925684] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-05T18:35:28.925736] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-05T18:35:29.036364] [INFO ] [MAIN ] MEGI: Loaded 10344 existing records. [2025-09-05T18:35:29.074882] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-05T18:35:29.098171] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-05T18:35:29.118635] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-05T18:35:29.180747] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-05T18:35:29.478370] [INFO ] [MAIN ] MEGI: Found 1 missing trading days. [2025-09-05T18:35:29.484354] [INFO ] [MAIN ] MEGI: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:29.489830] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-05T18:35:29.560853] [INFO ] [REMOTE ] MEI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:35:29.979526] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-05T18:35:30.263499] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-05T18:35:30.605402] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-05T18:35:30.690572] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:35:30.735908] [INFO ] [MAIN ] MEGI: Adding 78 new records, updating 0 existing records. [2025-09-05T18:35:30.738399] [INFO ] [MAIN ] MEGI: Combined dataset has 10422 total records. [2025-09-05T18:35:30.932459] [WARN ] [VALIDATOR ] MEGI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:31.068766] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-05T18:35:31.144394] [WARN ] [VALIDATOR ] MEGI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:31.144658] [INFO ] [MAIN ] MEGI: Combined data validation passed. [2025-09-05T18:35:31.218315] [INFO ] [MAIN ] MEGI: Update completed successfully. [2025-09-05T18:35:31.219860] [INFO ] [MAIN ] Update Progress: 1323/2363 symbols completed. MEGI took 2.7s. Estimated remaining: 27m 52s. Rate: 37.3 symbols/min [2025-09-05T18:35:31.415435] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:31.416430] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-05T18:35:31.448019] [INFO ] [MAIN ] MET: Loaded 25459 existing records. [2025-09-05T18:35:31.624482] [INFO ] [MAIN ] MET: Found 1 missing trading days. [2025-09-05T18:35:31.624687] [INFO ] [MAIN ] MET: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:31.863472] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-05T18:35:32.663459] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-05T18:35:32.690063] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-05T18:35:32.904063] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-05T18:35:33.463538] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-05T18:35:33.991969] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-05T18:35:34.029232] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:35:34.186611] [INFO ] [MAIN ] MET: Adding 390 new records, updating 0 existing records. [2025-09-05T18:35:34.190378] [INFO ] [MAIN ] MET: Combined dataset has 25849 total records. [2025-09-05T18:35:34.268683] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-05T18:35:34.374100] [WARN ] [VALIDATOR ] MET: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:34.580000] [WARN ] [VALIDATOR ] MET: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:34.580229] [INFO ] [MAIN ] MET: Combined data validation passed. [2025-09-05T18:35:34.757621] [INFO ] [MAIN ] MET: Update completed successfully. [2025-09-05T18:35:34.760980] [INFO ] [MAIN ] Update Progress: 1324/2363 symbols completed. MET took 3.5s. Estimated remaining: 27m 52s. Rate: 37.3 symbols/min [2025-09-05T18:35:34.953114] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:34.975250] [INFO ] [MAIN ] MFA: Loaded 21191 existing records. [2025-09-05T18:35:35.068706] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-05T18:35:35.166580] [INFO ] [MAIN ] MFA: Found 1 missing trading days. [2025-09-05T18:35:35.166884] [INFO ] [MAIN ] MFA: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:35.788356] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-05T18:35:35.863459] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-05T18:35:36.137093] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-05T18:35:36.663483] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-05T18:35:37.416371] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-05T18:35:37.463460] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-05T18:35:37.572079] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-05T18:35:38.263476] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-05T18:35:38.785326] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-05T18:35:39.063474] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-05T18:35:39.551495] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-05T18:35:39.863495] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-05T18:35:40.601418] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-05T18:35:40.663462] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-05T18:35:41.024897] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-05T18:35:41.463502] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-05T18:35:42.053052] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:35:42.172957] [INFO ] [MAIN ] MFA: Adding 316 new records, updating 0 existing records. [2025-09-05T18:35:42.200550] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-05T18:35:42.200890] [INFO ] [MAIN ] MFA: Combined dataset has 21507 total records. [2025-09-05T18:35:42.272882] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-05T18:35:42.393452] [WARN ] [VALIDATOR ] MFA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:42.595601] [WARN ] [VALIDATOR ] MFA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:42.595848] [INFO ] [MAIN ] MFA: Combined data validation passed. [2025-09-05T18:35:42.732788] [INFO ] [MAIN ] MFA: Update completed successfully. [2025-09-05T18:35:42.735605] [INFO ] [MAIN ] Update Progress: 1325/2363 symbols completed. MFA took 8.0s. Estimated remaining: 27m 56s. Rate: 37.2 symbols/min [2025-09-05T18:35:42.894604] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:35:42.920018] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:42.921471] [INFO ] [REMOTE ] MEG: Full fetch complete (34851 records). [2025-09-05T18:35:43.019234] [INFO ] [MAIN ] MFAN: Loaded 1894 existing records. [2025-09-05T18:35:43.069170] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-05T18:35:43.403528] [INFO ] [MAIN ] MFAN: Found 1 missing trading days. [2025-09-05T18:35:43.418951] [INFO ] [MAIN ] MFAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:43.484989] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-05T18:35:43.626896] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-05T18:35:43.627043] [INFO ] [MAIN ] Update Progress: 1326/2363 symbols completed. MEG took 18.5s. Estimated remaining: 27m 53s. Rate: 37.2 symbols/min [2025-09-05T18:35:43.803702] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:43.807421] [INFO ] [MAIN ] MFAO: Loaded 1711 existing records. [2025-09-05T18:35:43.871510] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-05T18:35:43.984680] [INFO ] [MAIN ] MFAO: Found 1 missing trading days. [2025-09-05T18:35:43.984854] [INFO ] [MAIN ] MFAO: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:44.208419] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:35:44.209955] [INFO ] [REMOTE ] MEC: Full fetch complete (17149 records). [2025-09-05T18:35:44.594961] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-05T18:35:44.637943] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:35:44.669411] [INFO ] [MAIN ] MFAN: Adding 22 new records, updating 0 existing records. [2025-09-05T18:35:44.669452] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-05T18:35:44.673936] [INFO ] [MAIN ] MFAN: Combined dataset has 1916 total records. [2025-09-05T18:35:44.867049] [WARN ] [VALIDATOR ] MFAN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:45.064907] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-05T18:35:45.065123] [INFO ] [MAIN ] Update Progress: 1327/2363 symbols completed. MEC took 19.9s. Estimated remaining: 27m 52s. Rate: 37.2 symbols/min [2025-09-05T18:35:45.253443] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:45.261807] [WARN ] [VALIDATOR ] MFAN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:45.262041] [INFO ] [MAIN ] MFAN: Combined data validation passed. [2025-09-05T18:35:45.283071] [INFO ] [MAIN ] MFAN: Update completed successfully. [2025-09-05T18:35:45.283509] [INFO ] [MAIN ] Update Progress: 1328/2363 symbols completed. MFAN took 2.5s. Estimated remaining: 27m 49s. Rate: 37.2 symbols/min [2025-09-05T18:35:45.400015] [INFO ] [MAIN ] MFC: Loaded 24308 existing records. [2025-09-05T18:35:45.465484] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-05T18:35:45.532160] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:35:45.569376] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:45.587038] [WARN ] [MAIN ] MFG: No existing data found, performing full refresh instead. [2025-09-05T18:35:45.595812] [INFO ] [MAIN ] MFAO: Adding 9 new records, updating 0 existing records. [2025-09-05T18:35:45.598559] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-05T18:35:45.599256] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-05T18:35:45.599175] [INFO ] [MAIN ] MFAO: Combined dataset has 1720 total records. [2025-09-05T18:35:45.630886] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-05T18:35:45.791421] [INFO ] [MAIN ] MFC: Found 1 missing trading days. [2025-09-05T18:35:45.825760] [INFO ] [MAIN ] MFC: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:46.030395] [WARN ] [VALIDATOR ] MFAO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:46.286730] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-05T18:35:46.414795] [INFO ] [REMOTE ] MFG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:35:46.424778] [WARN ] [VALIDATOR ] MFAO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:46.424986] [INFO ] [MAIN ] MFAO: Combined data validation passed. [2025-09-05T18:35:46.436621] [INFO ] [MAIN ] MFAO: Update completed successfully. [2025-09-05T18:35:46.437031] [INFO ] [MAIN ] Update Progress: 1329/2363 symbols completed. MFAO took 2.8s. Estimated remaining: 27m 47s. Rate: 37.2 symbols/min [2025-09-05T18:35:46.605471] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:46.614763] [INFO ] [MAIN ] MFM: Loaded 6322 existing records. [2025-09-05T18:35:46.783698] [INFO ] [MAIN ] MFM: Found 1 missing trading days. [2025-09-05T18:35:46.783830] [INFO ] [MAIN ] MFM: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:47.063477] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-05T18:35:47.066163] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:35:47.205138] [INFO ] [MAIN ] MFC: Adding 367 new records, updating 0 existing records. [2025-09-05T18:35:47.208490] [INFO ] [MAIN ] MFC: Combined dataset has 24675 total records. [2025-09-05T18:35:47.387913] [WARN ] [VALIDATOR ] MFC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:47.594762] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-05T18:35:47.610573] [WARN ] [VALIDATOR ] MFC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:47.610789] [INFO ] [MAIN ] MFC: Combined data validation passed. [2025-09-05T18:35:47.765714] [INFO ] [MAIN ] MFC: Update completed successfully. [2025-09-05T18:35:47.768337] [INFO ] [MAIN ] Update Progress: 1330/2363 symbols completed. MFC took 2.7s. Estimated remaining: 27m 45s. Rate: 37.2 symbols/min [2025-09-05T18:35:47.868224] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-05T18:35:47.942913] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:47.945403] [INFO ] [MAIN ] MFSB: Loaded 803 existing records. [2025-09-05T18:35:48.113280] [INFO ] [MAIN ] MFSB: Found 1 missing trading days. [2025-09-05T18:35:48.113404] [INFO ] [MAIN ] MFSB: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:48.477573] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-05T18:35:48.521302] [INFO ] [MAIN ] MFM: Adding 174 new records, updating 0 existing records. [2025-09-05T18:35:48.523340] [INFO ] [MAIN ] MFM: Combined dataset has 6496 total records. [2025-09-05T18:35:48.669749] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-05T18:35:48.714291] [WARN ] [VALIDATOR ] MFM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:48.909754] [WARN ] [VALIDATOR ] MFM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:48.909996] [INFO ] [MAIN ] MFM: Combined data validation passed. [2025-09-05T18:35:48.950209] [INFO ] [MAIN ] MFM: Update completed successfully. [2025-09-05T18:35:48.951186] [INFO ] [MAIN ] Update Progress: 1331/2363 symbols completed. MFM took 2.5s. Estimated remaining: 27m 43s. Rate: 37.2 symbols/min [2025-09-05T18:35:49.125772] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:49.130225] [INFO ] [MAIN ] MFSG: Loaded 2821 existing records. [2025-09-05T18:35:49.299096] [INFO ] [MAIN ] MFSG: Found 1 missing trading days. [2025-09-05T18:35:49.299249] [INFO ] [MAIN ] MFSG: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:49.463502] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-05T18:35:49.609400] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-05T18:35:50.087347] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:35:50.094940] [INFO ] [MAIN ] MFSB: Adding 11 new records, updating 0 existing records. [2025-09-05T18:35:50.096294] [INFO ] [MAIN ] MFSB: Combined dataset has 814 total records. [2025-09-05T18:35:50.267690] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-05T18:35:50.278074] [WARN ] [VALIDATOR ] MFSB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:50.468336] [WARN ] [VALIDATOR ] MFSB: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-06 [2025-09-05T18:35:50.468571] [INFO ] [MAIN ] MFSB: Combined data validation passed. [2025-09-05T18:35:50.475025] [INFO ] [MAIN ] MFSB: Update completed successfully. [2025-09-05T18:35:50.475274] [INFO ] [MAIN ] Update Progress: 1332/2363 symbols completed. MFSB took 2.7s. Estimated remaining: 27m 42s. Rate: 37.2 symbols/min [2025-09-05T18:35:50.684420] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:50.714881] [INFO ] [MAIN ] MFSI: Loaded 6512 existing records. [2025-09-05T18:35:50.748406] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-05T18:35:50.896884] [INFO ] [MAIN ] MFSI: Found 1 missing trading days. [2025-09-05T18:35:50.897018] [INFO ] [MAIN ] MFSI: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:51.063428] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-05T18:35:51.598176] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-05T18:35:51.863498] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-05T18:35:52.029077] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:35:52.065923] [INFO ] [MAIN ] MFSI: Adding 0 new records, updating 0 existing records. [2025-09-05T18:35:52.067155] [INFO ] [MAIN ] MFSI: Combined dataset has 6512 total records. [2025-09-05T18:35:52.067517] [FATAL] [VALIDATOR ] MFSI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:35:52.067592] [FATAL] [MAIN ] MFSI: Combined data validation failed. [2025-09-05T18:35:52.067628] [WARN ] [MAIN ] MFSI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:35:52.067689] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-05T18:35:52.068041] [INFO ] [LOCAL ] MFSI: Starting deletion of derivative data. [2025-09-05T18:35:52.069049] [INFO ] [MAIN ] Update Progress: 1333/2363 symbols completed. MFSI took 1.6s. Estimated remaining: 27m 40s. Rate: 37.2 symbols/min [2025-09-05T18:35:52.240051] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:52.240239] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-09-05T18:35:52.240370] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-05T18:35:52.240411] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-05T18:35:52.240459] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-05T18:35:52.601030] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:35:52.663451] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-05T18:35:53.255513] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-05T18:35:53.463478] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-05T18:35:53.499025] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-05T18:35:54.263484] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-05T18:35:54.855277] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-05T18:35:55.029528] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:35:55.051456] [INFO ] [MAIN ] MFSG: Adding 57 new records, updating 0 existing records. [2025-09-05T18:35:55.052876] [INFO ] [MAIN ] MFSG: Combined dataset has 2878 total records. [2025-09-05T18:35:55.073129] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-05T18:35:55.231009] [WARN ] [VALIDATOR ] MFSG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:55.426143] [WARN ] [VALIDATOR ] MFSG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:55.426390] [INFO ] [MAIN ] MFSG: Combined data validation passed. [2025-09-05T18:35:55.445855] [INFO ] [MAIN ] MFSG: Update completed successfully. [2025-09-05T18:35:55.446401] [INFO ] [MAIN ] Update Progress: 1334/2363 symbols completed. MFSG took 6.5s. Estimated remaining: 27m 40s. Rate: 37.2 symbols/min [2025-09-05T18:35:55.616543] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:55.625237] [INFO ] [MAIN ] MG: Loaded 7265 existing records. [2025-09-05T18:35:55.796561] [INFO ] [MAIN ] MG: Found 1 missing trading days. [2025-09-05T18:35:55.796738] [INFO ] [MAIN ] MG: Need to fetch 1 months: 2025-09 [2025-09-05T18:35:55.863459] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-05T18:35:56.353110] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:35:56.392424] [INFO ] [MAIN ] MG: Adding 118 new records, updating 0 existing records. [2025-09-05T18:35:56.394326] [INFO ] [MAIN ] MG: Combined dataset has 7383 total records. [2025-09-05T18:35:56.570117] [WARN ] [VALIDATOR ] MG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:35:56.671022] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-05T18:35:56.763376] [WARN ] [VALIDATOR ] MG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:35:56.763583] [INFO ] [MAIN ] MG: Combined data validation passed. [2025-09-05T18:35:56.806534] [INFO ] [MAIN ] MG: Update completed successfully. [2025-09-05T18:35:56.807585] [INFO ] [MAIN ] Update Progress: 1335/2363 symbols completed. MG took 1.4s. Estimated remaining: 27m 38s. Rate: 37.2 symbols/min [2025-09-05T18:35:56.979432] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:35:56.979719] [WARN ] [MAIN ] MGA: No existing data found, performing full refresh instead. [2025-09-05T18:35:56.980055] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-05T18:35:56.980329] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-05T18:35:56.980463] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-05T18:35:57.370309] [INFO ] [REMOTE ] MGA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:35:57.370884] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-05T18:35:57.374506] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-05T18:35:57.463433] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-05T18:35:58.263485] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-05T18:35:59.063501] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-05T18:35:59.292008] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-05T18:35:59.863542] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-05T18:35:59.981891] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-05T18:36:00.663532] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-05T18:36:01.217627] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-05T18:36:01.463523] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-05T18:36:01.583920] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-05T18:36:02.263497] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-05T18:36:02.370369] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-05T18:36:02.459549] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-05T18:36:03.063512] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-05T18:36:03.863441] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-05T18:36:03.941248] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:36:03.943336] [INFO ] [REMOTE ] MEI: Full fetch complete (34164 records). [2025-09-05T18:36:04.332706] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-05T18:36:04.338072] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-05T18:36:04.489972] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-05T18:36:04.490109] [INFO ] [MAIN ] Update Progress: 1336/2363 symbols completed. MEI took 35.8s. Estimated remaining: 27m 41s. Rate: 37.1 symbols/min [2025-09-05T18:36:04.663990] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-05T18:36:04.665356] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:04.669798] [INFO ] [MAIN ] MGF: Loaded 2098 existing records. [2025-09-05T18:36:04.840683] [INFO ] [MAIN ] MGF: Found 1 missing trading days. [2025-09-05T18:36:04.840838] [INFO ] [MAIN ] MGF: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:05.237061] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-05T18:36:05.463471] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-05T18:36:05.865451] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-05T18:36:06.052282] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-05T18:36:06.263488] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-05T18:36:06.604173] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-05T18:36:07.063479] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-05T18:36:07.863492] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-05T18:36:08.366626] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-05T18:36:08.663475] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-05T18:36:08.844729] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-05T18:36:09.463537] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-05T18:36:09.673491] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:36:09.691705] [INFO ] [MAIN ] MGF: Adding 34 new records, updating 0 existing records. [2025-09-05T18:36:09.693459] [INFO ] [MAIN ] MGF: Combined dataset has 2132 total records. [2025-09-05T18:36:09.877430] [WARN ] [VALIDATOR ] MGF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:36:10.075772] [WARN ] [VALIDATOR ] MGF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:36:10.075993] [INFO ] [MAIN ] MGF: Combined data validation passed. [2025-09-05T18:36:10.093790] [INFO ] [MAIN ] MGF: Update completed successfully. [2025-09-05T18:36:10.094385] [INFO ] [MAIN ] Update Progress: 1337/2363 symbols completed. MGF took 5.6s. Estimated remaining: 27m 42s. Rate: 37.0 symbols/min [2025-09-05T18:36:10.266025] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-05T18:36:10.267546] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:10.312432] [INFO ] [MAIN ] MGM: Loaded 40359 existing records. [2025-09-05T18:36:10.492430] [INFO ] [MAIN ] MGM: Found 1 missing trading days. [2025-09-05T18:36:10.492593] [INFO ] [MAIN ] MGM: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:11.029594] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-05T18:36:11.063436] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-05T18:36:11.519978] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-05T18:36:11.583373] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:36:11.584238] [INFO ] [REMOTE ] MFSV: Full fetch complete (2185 records). [2025-09-05T18:36:11.584758] [FATAL] [VALIDATOR ] MFSV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:36:11.584845] [FATAL] [MAIN ] MFSV: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:36:11.584885] [WARN ] [MAIN ] MFSV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:36:11.584924] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-05T18:36:11.584997] [INFO ] [LOCAL ] MFSV: Starting deletion of derivative data. [2025-09-05T18:36:11.585080] [INFO ] [MAIN ] Update Progress: 1338/2363 symbols completed. MFSV took 19.5s. Estimated remaining: 27m 41s. Rate: 37.0 symbols/min [2025-09-05T18:36:11.778989] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:11.783799] [INFO ] [MAIN ] MGR: Loaded 3026 existing records. [2025-09-05T18:36:11.868637] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-05T18:36:11.993004] [INFO ] [MAIN ] MGR: Found 1 missing trading days. [2025-09-05T18:36:11.993146] [INFO ] [MAIN ] MGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:12.426050] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:36:12.570452] [INFO ] [MAIN ] MGM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:36:12.573375] [INFO ] [MAIN ] MGM: Combined dataset has 40359 total records. [2025-09-05T18:36:12.573970] [FATAL] [VALIDATOR ] MGM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:36:12.574074] [FATAL] [MAIN ] MGM: Combined data validation failed. [2025-09-05T18:36:12.574119] [WARN ] [MAIN ] MGM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:36:12.574191] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-05T18:36:12.575003] [INFO ] [LOCAL ] MGM: Starting deletion of derivative data. [2025-09-05T18:36:12.579336] [INFO ] [MAIN ] Update Progress: 1339/2363 symbols completed. MGM took 2.5s. Estimated remaining: 27m 39s. Rate: 37.0 symbols/min [2025-09-05T18:36:12.668685] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-05T18:36:12.764326] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:12.769263] [INFO ] [MAIN ] MGRB: Loaded 1874 existing records. [2025-09-05T18:36:12.942309] [INFO ] [MAIN ] MGRB: Found 1 missing trading days. [2025-09-05T18:36:12.942496] [INFO ] [MAIN ] MGRB: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:13.463512] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-05T18:36:14.263542] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-05T18:36:14.527932] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-05T18:36:14.572510] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:36:14.585381] [INFO ] [MAIN ] MGR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:36:14.587575] [INFO ] [MAIN ] MGR: Combined dataset has 3026 total records. [2025-09-05T18:36:14.588145] [FATAL] [VALIDATOR ] MGR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:36:14.588240] [FATAL] [MAIN ] MGR: Combined data validation failed. [2025-09-05T18:36:14.588300] [WARN ] [MAIN ] MGR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:36:14.588350] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-05T18:36:14.588746] [INFO ] [LOCAL ] MGR: Starting deletion of derivative data. [2025-09-05T18:36:14.589750] [INFO ] [MAIN ] Update Progress: 1340/2363 symbols completed. MGR took 3.0s. Estimated remaining: 27m 37s. Rate: 37.0 symbols/min [2025-09-05T18:36:14.775742] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:14.779740] [INFO ] [MAIN ] MGRD: Loaded 1078 existing records. [2025-09-05T18:36:14.960639] [INFO ] [MAIN ] MGRD: Found 1 missing trading days. [2025-09-05T18:36:14.960831] [INFO ] [MAIN ] MGRD: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:15.042700] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:36:15.052044] [INFO ] [MAIN ] MGRB: Adding 22 new records, updating 0 existing records. [2025-09-05T18:36:15.053436] [INFO ] [MAIN ] MGRB: Combined dataset has 1896 total records. [2025-09-05T18:36:15.068738] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-05T18:36:15.249070] [WARN ] [VALIDATOR ] MGRB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:36:15.447899] [WARN ] [VALIDATOR ] MGRB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:36:15.448115] [INFO ] [MAIN ] MGRB: Combined data validation passed. [2025-09-05T18:36:15.461605] [INFO ] [MAIN ] MGRB: Update completed successfully. [2025-09-05T18:36:15.461987] [INFO ] [MAIN ] Update Progress: 1341/2363 symbols completed. MGRB took 2.9s. Estimated remaining: 27m 35s. Rate: 37.1 symbols/min [2025-09-05T18:36:15.635616] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:15.640530] [INFO ] [MAIN ] MGRE: Loaded 3198 existing records. [2025-09-05T18:36:15.810604] [INFO ] [MAIN ] MGRE: Found 1 missing trading days. [2025-09-05T18:36:15.810843] [INFO ] [MAIN ] MGRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:15.863428] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-05T18:36:16.645574] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:36:16.656325] [INFO ] [MAIN ] MGRE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:36:16.657315] [INFO ] [MAIN ] MGRE: Combined dataset has 3198 total records. [2025-09-05T18:36:16.657636] [FATAL] [VALIDATOR ] MGRE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:36:16.657727] [FATAL] [MAIN ] MGRE: Combined data validation failed. [2025-09-05T18:36:16.657763] [WARN ] [MAIN ] MGRE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:36:16.657800] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-05T18:36:16.658088] [INFO ] [LOCAL ] MGRE: Starting deletion of derivative data. [2025-09-05T18:36:16.658536] [INFO ] [MAIN ] Update Progress: 1342/2363 symbols completed. MGRE took 1.2s. Estimated remaining: 27m 33s. Rate: 37.1 symbols/min [2025-09-05T18:36:16.670730] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-05T18:36:16.847695] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:16.896456] [INFO ] [MAIN ] MGY: Loaded 39433 existing records. [2025-09-05T18:36:17.101501] [INFO ] [MAIN ] MGY: Found 1 missing trading days. [2025-09-05T18:36:17.101956] [INFO ] [MAIN ] MGY: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:17.143479] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-05T18:36:17.463545] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-05T18:36:18.263538] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-05T18:36:18.723234] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-05T18:36:18.743774] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-05T18:36:18.747667] [INFO ] [REMOTE ] MFG: Full fetch complete (52698 records). [2025-09-05T18:36:19.068738] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-05T18:36:19.156918] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:36:19.157300] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-05T18:36:19.162265] [INFO ] [MAIN ] MGRD: Adding 14 new records, updating 0 existing records. [2025-09-05T18:36:19.164911] [INFO ] [MAIN ] MGRD: Combined dataset has 1092 total records. [2025-09-05T18:36:19.462176] [WARN ] [VALIDATOR ] MGRD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:36:19.689951] [WARN ] [VALIDATOR ] MGRD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:36:19.699472] [INFO ] [MAIN ] MGRD: Combined data validation passed. [2025-09-05T18:36:19.782459] [INFO ] [MAIN ] MGRD: Update completed successfully. [2025-09-05T18:36:19.783754] [INFO ] [MAIN ] Update Progress: 1343/2363 symbols completed. MGRD took 5.2s. Estimated remaining: 27m 33s. Rate: 37.0 symbols/min [2025-09-05T18:36:19.793302] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:36:19.873315] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-05T18:36:20.127124] [INFO ] [MAIN ] MGY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:36:20.130920] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:20.143125] [INFO ] [MAIN ] MGY: Combined dataset has 39433 total records. [2025-09-05T18:36:20.145055] [FATAL] [VALIDATOR ] MGY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:36:20.151362] [INFO ] [MAIN ] MH: Loaded 8795 existing records. [2025-09-05T18:36:20.146381] [FATAL] [MAIN ] MGY: Combined data validation failed. [2025-09-05T18:36:20.186317] [WARN ] [MAIN ] MGY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:36:20.212885] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-05T18:36:20.252156] [INFO ] [LOCAL ] MGY: Starting deletion of derivative data. [2025-09-05T18:36:20.268661] [INFO ] [MAIN ] Update Progress: 1344/2363 symbols completed. MGY took 3.6s. Estimated remaining: 27m 30s. Rate: 37.1 symbols/min [2025-09-05T18:36:20.386356] [INFO ] [MAIN ] MH: Found 1 missing trading days. [2025-09-05T18:36:20.418146] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-05T18:36:20.418193] [INFO ] [MAIN ] MH: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:20.430362] [INFO ] [MAIN ] Update Progress: 1345/2363 symbols completed. MFG took 35.1s. Estimated remaining: 27m 27s. Rate: 37.1 symbols/min [2025-09-05T18:36:20.638905] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:20.654415] [WARN ] [MAIN ] MHD: No existing data found, performing full refresh instead. [2025-09-05T18:36:20.673473] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-05T18:36:20.687777] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-05T18:36:20.705177] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-05T18:36:20.705107] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:20.705448] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-05T18:36:20.705314] [WARN ] [MAIN ] MHF: No existing data found, performing full refresh instead. [2025-09-05T18:36:20.775905] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-05T18:36:20.787260] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-05T18:36:20.806426] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-05T18:36:21.363097] [INFO ] [REMOTE ] MHD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:36:21.442682] [INFO ] [REMOTE ] MHF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:36:21.468162] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-05T18:36:21.473775] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-05T18:36:22.222977] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-05T18:36:22.268572] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-05T18:36:22.314020] [INFO ] [MAIN ] MH: Adding 292 new records, updating 0 existing records. [2025-09-05T18:36:22.316704] [INFO ] [MAIN ] MH: Combined dataset has 9087 total records. [2025-09-05T18:36:22.496451] [WARN ] [VALIDATOR ] MH: Not fatal, but first date in data (2025-07-24) does not match expected start date (2025-01-31) [2025-09-05T18:36:22.736032] [WARN ] [VALIDATOR ] MH: Missing days changed. Total missing: 119 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23 [2025-09-05T18:36:22.736263] [INFO ] [MAIN ] MH: Combined data validation passed. [2025-09-05T18:36:22.793623] [INFO ] [MAIN ] MH: Update completed successfully. [2025-09-05T18:36:22.794816] [INFO ] [MAIN ] Update Progress: 1346/2363 symbols completed. MH took 3.0s. Estimated remaining: 27m 26s. Rate: 37.1 symbols/min [2025-09-05T18:36:22.965712] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:22.965914] [WARN ] [MAIN ] MHK: No existing data found, performing full refresh instead. [2025-09-05T18:36:22.966078] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-05T18:36:22.966126] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-05T18:36:22.966172] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-05T18:36:23.067699] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-05T18:36:23.254329] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-05T18:36:23.344630] [INFO ] [REMOTE ] MHK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:36:23.863488] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-05T18:36:24.040203] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-05T18:36:24.395306] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-05T18:36:24.663498] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-05T18:36:25.463501] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-05T18:36:25.768212] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-05T18:36:26.060296] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-05T18:36:26.263457] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-05T18:36:26.460584] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-05T18:36:26.585750] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:36:26.588474] [INFO ] [REMOTE ] MGA: Full fetch complete (55179 records). [2025-09-05T18:36:26.965402] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-05T18:36:27.064827] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-05T18:36:27.216111] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-05T18:36:27.216527] [INFO ] [MAIN ] Update Progress: 1347/2363 symbols completed. MGA took 30.4s. Estimated remaining: 27m 27s. Rate: 37.0 symbols/min [2025-09-05T18:36:27.398412] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:27.398595] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-05T18:36:27.398772] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-05T18:36:27.398812] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-05T18:36:27.398861] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-05T18:36:27.775285] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:36:27.863470] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-05T18:36:27.875224] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-05T18:36:28.495161] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-05T18:36:28.663479] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-05T18:36:29.463518] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-05T18:36:29.485269] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-05T18:36:29.966688] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-05T18:36:30.263498] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-05T18:36:31.021687] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-05T18:36:31.063513] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-05T18:36:31.863470] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-05T18:36:32.019704] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-05T18:36:32.670135] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-05T18:36:32.673295] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-05T18:36:33.463479] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-05T18:36:34.135350] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-05T18:36:34.242612] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-05T18:36:34.263433] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-05T18:36:35.063534] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-05T18:36:35.582899] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-05T18:36:35.863532] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-05T18:36:36.075356] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-05T18:36:36.412920] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-05T18:36:36.663475] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-05T18:36:37.463462] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-05T18:36:37.772579] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-05T18:36:38.263447] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-05T18:36:38.405982] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-05T18:36:38.793906] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-05T18:36:39.063468] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-05T18:36:39.863519] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-05T18:36:40.387080] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-05T18:36:40.663498] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-05T18:36:40.882242] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-05T18:36:41.031546] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-05T18:36:41.463528] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-05T18:36:42.263461] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-05T18:36:42.727871] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-05T18:36:43.063463] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-05T18:36:43.195741] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-05T18:36:43.823664] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:36:43.824818] [INFO ] [REMOTE ] MHF: Full fetch complete (9420 records). [2025-09-05T18:36:43.868582] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-05T18:36:44.194094] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-05T18:36:44.184129] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-05T18:36:44.236535] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-05T18:36:44.236707] [INFO ] [MAIN ] Update Progress: 1348/2363 symbols completed. MHF took 23.8s. Estimated remaining: 27m 37s. Rate: 36.8 symbols/min [2025-09-05T18:36:44.433567] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:44.433871] [WARN ] [MAIN ] MHN: No existing data found, performing full refresh instead. [2025-09-05T18:36:44.434083] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-05T18:36:44.434144] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-05T18:36:44.434208] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-05T18:36:44.668559] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-05T18:36:44.821834] [INFO ] [REMOTE ] MHN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:36:45.245310] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-05T18:36:45.463461] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-05T18:36:45.881359] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:36:45.882061] [INFO ] [REMOTE ] MHLA: Full fetch complete (1178 records). [2025-09-05T18:36:45.882458] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:36:45.882529] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:36:45.882571] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:36:45.882615] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-05T18:36:45.882693] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-05T18:36:45.882780] [INFO ] [MAIN ] Update Progress: 1349/2363 symbols completed. MHLA took 18.7s. Estimated remaining: 27m 35s. Rate: 36.8 symbols/min [2025-09-05T18:36:46.055296] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:46.070407] [INFO ] [MAIN ] MHO: Loaded 11962 existing records. [2025-09-05T18:36:46.246295] [INFO ] [MAIN ] MHO: Found 1 missing trading days. [2025-09-05T18:36:46.246457] [INFO ] [MAIN ] MHO: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:46.263426] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-05T18:36:46.951374] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:36:47.014898] [INFO ] [MAIN ] MHO: Adding 177 new records, updating 0 existing records. [2025-09-05T18:36:47.017530] [INFO ] [MAIN ] MHO: Combined dataset has 12139 total records. [2025-09-05T18:36:47.068606] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-05T18:36:47.200082] [WARN ] [VALIDATOR ] MHO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:36:47.399951] [WARN ] [VALIDATOR ] MHO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:36:47.400180] [INFO ] [MAIN ] MHO: Combined data validation passed. [2025-09-05T18:36:47.477987] [INFO ] [MAIN ] MHO: Update completed successfully. [2025-09-05T18:36:47.479409] [INFO ] [MAIN ] Update Progress: 1350/2363 symbols completed. MHO took 1.6s. Estimated remaining: 27m 34s. Rate: 36.8 symbols/min [2025-09-05T18:36:47.654569] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:47.661845] [INFO ] [MAIN ] MIAX: Loaded 5022 existing records. [2025-09-05T18:36:47.830973] [INFO ] [MAIN ] MIAX: Found 1 missing trading days. [2025-09-05T18:36:47.831130] [INFO ] [MAIN ] MIAX: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:47.863419] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-05T18:36:47.953324] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-05T18:36:48.663539] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-05T18:36:49.197840] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T18:36:49.311316] [INFO ] [MAIN ] MIAX: Adding 385 new records, updating 0 existing records. [2025-09-05T18:36:49.313675] [INFO ] [MAIN ] MIAX: Combined dataset has 5407 total records. [2025-09-05T18:36:49.468719] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-05T18:36:49.497865] [WARN ] [VALIDATOR ] MIAX: Not fatal, but first date in data (2025-08-14) does not match expected start date (2025-01-31) [2025-09-05T18:36:49.689517] [WARN ] [VALIDATOR ] MIAX: Missing days changed. Total missing: 134 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30, 2025-07-31, 2025-08-01, 2025-08-04, 2025-08-05, 2025-08-06, 2025-08-07, 2025-08-08, 2025-08-11, 2025-08-12, 2025-08-13 [2025-09-05T18:36:49.689773] [INFO ] [MAIN ] MIAX: Combined data validation passed. [2025-09-05T18:36:49.723184] [INFO ] [MAIN ] MIAX: Update completed successfully. [2025-09-05T18:36:49.724294] [INFO ] [MAIN ] Update Progress: 1351/2363 symbols completed. MIAX took 2.2s. Estimated remaining: 27m 32s. Rate: 36.7 symbols/min [2025-09-05T18:36:49.895607] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:49.904804] [INFO ] [MAIN ] MIN: Loaded 7927 existing records. [2025-09-05T18:36:50.081883] [INFO ] [MAIN ] MIN: Found 1 missing trading days. [2025-09-05T18:36:50.082065] [INFO ] [MAIN ] MIN: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:50.263458] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-05T18:36:50.448412] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-05T18:36:50.481872] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-05T18:36:51.063478] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-05T18:36:51.260832] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:36:51.309820] [INFO ] [MAIN ] MIN: Adding 185 new records, updating 0 existing records. [2025-09-05T18:36:51.311858] [INFO ] [MAIN ] MIN: Combined dataset has 8112 total records. [2025-09-05T18:36:51.504466] [WARN ] [VALIDATOR ] MIN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:36:51.696277] [WARN ] [VALIDATOR ] MIN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:36:51.696516] [INFO ] [MAIN ] MIN: Combined data validation passed. [2025-09-05T18:36:51.747061] [INFO ] [MAIN ] MIN: Update completed successfully. [2025-09-05T18:36:51.748379] [INFO ] [MAIN ] Update Progress: 1352/2363 symbols completed. MIN took 2.0s. Estimated remaining: 27m 31s. Rate: 36.7 symbols/min [2025-09-05T18:36:51.868666] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-05T18:36:51.930721] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:51.972747] [INFO ] [MAIN ] MIR: Loaded 38265 existing records. [2025-09-05T18:36:52.079864] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-05T18:36:52.163468] [INFO ] [MAIN ] MIR: Found 1 missing trading days. [2025-09-05T18:36:52.163615] [INFO ] [MAIN ] MIR: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:52.437030] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-05T18:36:52.663474] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-05T18:36:53.463495] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-05T18:36:53.603294] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-05T18:36:54.263548] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-05T18:36:54.733697] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-05T18:36:54.923845] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-05T18:36:55.063525] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-05T18:36:55.863515] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-05T18:36:55.887002] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:36:55.888397] [INFO ] [REMOTE ] MHD: Full fetch complete (13392 records). [2025-09-05T18:36:56.251389] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-05T18:36:56.310086] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-05T18:36:56.310248] [INFO ] [MAIN ] Update Progress: 1353/2363 symbols completed. MHD took 36.0s. Estimated remaining: 27m 32s. Rate: 36.7 symbols/min [2025-09-05T18:36:56.486953] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:56.489617] [INFO ] [MAIN ] MITN: Loaded 551 existing records. [2025-09-05T18:36:56.662459] [INFO ] [MAIN ] MITN: Found 1 missing trading days. [2025-09-05T18:36:56.662687] [INFO ] [MAIN ] MITN: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:56.669874] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-05T18:36:56.671749] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:36:56.825601] [INFO ] [MAIN ] MIR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:36:56.829448] [INFO ] [MAIN ] MIR: Combined dataset has 38655 total records. [2025-09-05T18:36:57.006569] [WARN ] [VALIDATOR ] MIR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:36:57.202360] [WARN ] [VALIDATOR ] MIR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:36:57.202571] [INFO ] [MAIN ] MIR: Combined data validation passed. [2025-09-05T18:36:57.381526] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:36:57.407442] [INFO ] [MAIN ] MITN: Adding 4 new records, updating 0 existing records. [2025-09-05T18:36:57.411744] [INFO ] [MAIN ] MITN: Combined dataset has 555 total records. [2025-09-05T18:36:57.479677] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-05T18:36:57.605042] [INFO ] [MAIN ] MIR: Update completed successfully. [2025-09-05T18:36:57.629073] [INFO ] [MAIN ] Update Progress: 1354/2363 symbols completed. MIR took 5.9s. Estimated remaining: 27m 30s. Rate: 36.7 symbols/min [2025-09-05T18:36:57.632628] [WARN ] [VALIDATOR ] MITN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:36:58.000082] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:58.003833] [INFO ] [MAIN ] MITP: Loaded 836 existing records. [2025-09-05T18:36:58.180801] [INFO ] [MAIN ] MITP: Found 1 missing trading days. [2025-09-05T18:36:58.181125] [INFO ] [MAIN ] MITP: Need to fetch 1 months: 2025-09 [2025-09-05T18:36:58.190871] [WARN ] [VALIDATOR ] MITN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:36:58.191122] [INFO ] [MAIN ] MITN: Combined data validation passed. [2025-09-05T18:36:58.196256] [INFO ] [MAIN ] MITN: Update completed successfully. [2025-09-05T18:36:58.196492] [INFO ] [MAIN ] Update Progress: 1355/2363 symbols completed. MITN took 1.9s. Estimated remaining: 27m 27s. Rate: 36.7 symbols/min [2025-09-05T18:36:58.272458] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-05T18:36:58.372226] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:36:58.372402] [WARN ] [MAIN ] MITT: No existing data found, performing full refresh instead. [2025-09-05T18:36:58.372545] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-05T18:36:58.372587] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-05T18:36:58.372635] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-05T18:36:58.727858] [INFO ] [REMOTE ] MITT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:36:58.965478] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-05T18:36:59.052955] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-05T18:36:59.063422] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-05T18:36:59.700103] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:36:59.702553] [INFO ] [REMOTE ] MHK: Full fetch complete (46487 records). [2025-09-05T18:36:59.875454] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-05T18:37:00.070475] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-05T18:37:00.273382] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-05T18:37:00.273530] [INFO ] [MAIN ] Update Progress: 1356/2363 symbols completed. MHK took 37.5s. Estimated remaining: 27m 26s. Rate: 36.7 symbols/min [2025-09-05T18:37:00.458986] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:00.464079] [INFO ] [MAIN ] MIY: Loaded 3117 existing records. [2025-09-05T18:37:00.648822] [INFO ] [MAIN ] MIY: Found 1 missing trading days. [2025-09-05T18:37:00.648984] [INFO ] [MAIN ] MIY: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:00.663436] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-05T18:37:00.752257] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-05T18:37:01.242993] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:37:01.245614] [INFO ] [MAIN ] MITP: Adding 0 new records, updating 0 existing records. [2025-09-05T18:37:01.246593] [INFO ] [MAIN ] MITP: Combined dataset has 836 total records. [2025-09-05T18:37:01.246964] [FATAL] [VALIDATOR ] MITP: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:37:01.247049] [FATAL] [MAIN ] MITP: Combined data validation failed. [2025-09-05T18:37:01.247088] [WARN ] [MAIN ] MITP: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:37:01.247127] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-05T18:37:01.247367] [INFO ] [LOCAL ] MITP: Starting deletion of derivative data. [2025-09-05T18:37:01.247722] [INFO ] [MAIN ] Update Progress: 1357/2363 symbols completed. MITP took 3.6s. Estimated remaining: 27m 24s. Rate: 36.7 symbols/min [2025-09-05T18:37:01.463522] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-05T18:37:02.263512] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-05T18:37:02.488015] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:37:02.504118] [INFO ] [MAIN ] MIY: Adding 28 new records, updating 0 existing records. [2025-09-05T18:37:02.505928] [INFO ] [MAIN ] MIY: Combined dataset has 3145 total records. [2025-09-05T18:37:02.685924] [WARN ] [VALIDATOR ] MIY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:02.872695] [WARN ] [VALIDATOR ] MIY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:02.872931] [INFO ] [MAIN ] MIY: Combined data validation passed. [2025-09-05T18:37:02.898018] [INFO ] [MAIN ] MIY: Update completed successfully. [2025-09-05T18:37:02.898745] [INFO ] [MAIN ] Update Progress: 1358/2363 symbols completed. MIY took 2.6s. Estimated remaining: 27m 22s. Rate: 36.7 symbols/min [2025-09-05T18:37:03.063503] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-05T18:37:03.741922] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-05T18:37:03.778161] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-05T18:37:03.863461] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-05T18:37:04.663539] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-05T18:37:05.165752] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-05T18:37:05.463499] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-05T18:37:05.728548] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-05T18:37:06.263480] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-05T18:37:06.785320] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-05T18:37:07.067070] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-05T18:37:07.068839] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-05T18:37:07.863525] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-05T18:37:08.473123] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-05T18:37:08.505244] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:37:08.506514] [INFO ] [REMOTE ] MHN: Full fetch complete (8588 records). [2025-09-05T18:37:08.663884] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-05T18:37:08.863987] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-05T18:37:08.898810] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-05T18:37:08.898935] [INFO ] [MAIN ] Update Progress: 1359/2363 symbols completed. MHN took 24.7s. Estimated remaining: 27m 24s. Rate: 36.6 symbols/min [2025-09-05T18:37:09.875168] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-05T18:37:09.880107] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-05T18:37:11.070815] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-05T18:37:11.076222] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-05T18:37:12.146411] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-05T18:37:12.151185] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-05T18:37:13.580539] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-05T18:37:13.585956] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-05T18:37:14.244082] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:37:14.245754] [INFO ] [REMOTE ] MITT: Full fetch complete (25286 records). [2025-09-05T18:37:14.663737] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-05T18:37:14.766263] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-05T18:37:14.766415] [INFO ] [MAIN ] Update Progress: 1360/2363 symbols completed. MITT took 16.6s. Estimated remaining: 27m 25s. Rate: 36.6 symbols/min [2025-09-05T18:37:15.261754] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:15.337638] [WARN ] [MAIN ] MLM: No existing data found, performing full refresh instead. [2025-09-05T18:37:15.413006] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:15.464248] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:15.464535] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-05T18:37:15.469759] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:15.464612] [WARN ] [MAIN ] MLI: No existing data found, performing full refresh instead. [2025-09-05T18:37:15.470098] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-05T18:37:15.470330] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-05T18:37:15.470731] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-05T18:37:15.487923] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-05T18:37:15.526768] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-05T18:37:15.759925] [INFO ] [MAIN ] MKL: Loaded 15765 existing records. [2025-09-05T18:37:15.946677] [INFO ] [MAIN ] MKC: Loaded 25155 existing records. [2025-09-05T18:37:16.424015] [INFO ] [REMOTE ] MLM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:37:16.459061] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-05T18:37:16.458724] [INFO ] [MAIN ] MKL: Found 1 missing trading days. [2025-09-05T18:37:16.466796] [INFO ] [MAIN ] MKL: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:16.498424] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-05T18:37:16.622968] [INFO ] [MAIN ] MKC: Found 1 missing trading days. [2025-09-05T18:37:16.628744] [INFO ] [REMOTE ] MLI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:37:16.628986] [INFO ] [MAIN ] MKC: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:16.629710] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-05T18:37:16.629421] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-05T18:37:17.157625] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:37:17.232535] [INFO ] [MAIN ] MKL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:37:17.234942] [INFO ] [MAIN ] MKL: Combined dataset has 15765 total records. [2025-09-05T18:37:17.235382] [FATAL] [VALIDATOR ] MKL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:37:17.235465] [FATAL] [MAIN ] MKL: Combined data validation failed. [2025-09-05T18:37:17.235501] [WARN ] [MAIN ] MKL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:37:17.235538] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-05T18:37:17.236048] [INFO ] [LOCAL ] MKL: Starting deletion of derivative data. [2025-09-05T18:37:17.237780] [INFO ] [MAIN ] Update Progress: 1361/2363 symbols completed. MKL took 2.5s. Estimated remaining: 27m 24s. Rate: 36.6 symbols/min [2025-09-05T18:37:17.394574] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:37:17.449407] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:17.556145] [INFO ] [MAIN ] MKC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:37:17.561709] [INFO ] [MAIN ] MLNK: Loaded 12724 existing records. [2025-09-05T18:37:17.663711] [INFO ] [MAIN ] MKC: Combined dataset has 25155 total records. [2025-09-05T18:37:17.667511] [FATAL] [VALIDATOR ] MKC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:37:17.693542] [FATAL] [MAIN ] MKC: Combined data validation failed. [2025-09-05T18:37:17.714694] [WARN ] [MAIN ] MKC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:37:17.720137] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-05T18:37:17.735593] [INFO ] [LOCAL ] MKC: Starting deletion of derivative data. [2025-09-05T18:37:17.740997] [INFO ] [MAIN ] MLNK: Found 1 missing trading days. [2025-09-05T18:37:17.741272] [INFO ] [MAIN ] MLNK: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:17.741518] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-05T18:37:17.744756] [INFO ] [MAIN ] Update Progress: 1362/2363 symbols completed. MKC took 3.0s. Estimated remaining: 27m 22s. Rate: 36.6 symbols/min [2025-09-05T18:37:17.926141] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:17.929060] [INFO ] [MAIN ] MLP: Loaded 1275 existing records. [2025-09-05T18:37:18.107737] [INFO ] [MAIN ] MLP: Found 1 missing trading days. [2025-09-05T18:37:18.108626] [INFO ] [MAIN ] MLP: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:18.109177] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-05T18:37:18.131934] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-05T18:37:18.138059] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-05T18:37:18.216518] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-05T18:37:18.263414] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-05T18:37:19.254504] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:37:19.261770] [INFO ] [MAIN ] MLP: Adding 19 new records, updating 0 existing records. [2025-09-05T18:37:19.263099] [INFO ] [MAIN ] MLP: Combined dataset has 1294 total records. [2025-09-05T18:37:19.473273] [WARN ] [VALIDATOR ] MLP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:19.557287] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-05T18:37:19.727441] [INFO ] [MAIN ] MLNK: Adding 176 new records, updating 0 existing records. [2025-09-05T18:37:19.755718] [INFO ] [MAIN ] MLNK: Combined dataset has 12900 total records. [2025-09-05T18:37:19.952399] [WARN ] [VALIDATOR ] MLNK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:20.202825] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-05T18:37:20.213798] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-05T18:37:20.214310] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-05T18:37:20.224759] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-05T18:37:20.231797] [WARN ] [VALIDATOR ] MLP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:20.232220] [INFO ] [MAIN ] MLP: Combined data validation passed. [2025-09-05T18:37:20.241973] [INFO ] [MAIN ] MLP: Update completed successfully. [2025-09-05T18:37:20.242343] [INFO ] [MAIN ] Update Progress: 1363/2363 symbols completed. MLP took 2.5s. Estimated remaining: 27m 21s. Rate: 36.6 symbols/min [2025-09-05T18:37:20.347818] [WARN ] [VALIDATOR ] MLNK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:20.348025] [INFO ] [MAIN ] MLNK: Combined data validation passed. [2025-09-05T18:37:20.448870] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:20.449050] [WARN ] [MAIN ] MLR: No existing data found, performing full refresh instead. [2025-09-05T18:37:20.449216] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-05T18:37:20.449265] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-05T18:37:20.449313] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-05T18:37:20.710968] [INFO ] [MAIN ] MLNK: Update completed successfully. [2025-09-05T18:37:20.751959] [INFO ] [MAIN ] Update Progress: 1364/2363 symbols completed. MLNK took 3.5s. Estimated remaining: 27m 18s. Rate: 36.6 symbols/min [2025-09-05T18:37:20.977263] [INFO ] [REMOTE ] MLR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:37:21.006773] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-05T18:37:21.037977] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:21.062901] [INFO ] [MAIN ] MMC: Loaded 24881 existing records. [2025-09-05T18:37:21.239811] [INFO ] [MAIN ] MMC: Found 1 missing trading days. [2025-09-05T18:37:21.240000] [INFO ] [MAIN ] MMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:21.463494] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-05T18:37:21.971774] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-05T18:37:22.155092] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:37:22.251597] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-05T18:37:22.267057] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-05T18:37:22.343153] [INFO ] [MAIN ] MMC: Adding 377 new records, updating 0 existing records. [2025-09-05T18:37:22.352907] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-05T18:37:22.357106] [INFO ] [MAIN ] MMC: Combined dataset has 25258 total records. [2025-09-05T18:37:22.538138] [WARN ] [VALIDATOR ] MMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:22.732617] [WARN ] [VALIDATOR ] MMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:22.732890] [INFO ] [MAIN ] MMC: Combined data validation passed. [2025-09-05T18:37:22.898295] [INFO ] [MAIN ] MMC: Update completed successfully. [2025-09-05T18:37:22.901361] [INFO ] [MAIN ] Update Progress: 1365/2363 symbols completed. MMC took 2.1s. Estimated remaining: 27m 17s. Rate: 36.6 symbols/min [2025-09-05T18:37:23.072118] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-05T18:37:23.074587] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:23.081897] [INFO ] [MAIN ] MMD: Loaded 5007 existing records. [2025-09-05T18:37:23.253190] [INFO ] [MAIN ] MMD: Found 1 missing trading days. [2025-09-05T18:37:23.253324] [INFO ] [MAIN ] MMD: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:23.863478] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-05T18:37:23.903071] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-05T18:37:24.199725] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-05T18:37:24.663531] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-05T18:37:25.063343] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:37:25.105615] [INFO ] [MAIN ] MMD: Adding 121 new records, updating 0 existing records. [2025-09-05T18:37:25.107498] [INFO ] [MAIN ] MMD: Combined dataset has 5128 total records. [2025-09-05T18:37:25.305957] [WARN ] [VALIDATOR ] MMD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:25.468728] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-05T18:37:25.509968] [WARN ] [VALIDATOR ] MMD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:25.510189] [INFO ] [MAIN ] MMD: Combined data validation passed. [2025-09-05T18:37:25.547968] [INFO ] [MAIN ] MMD: Update completed successfully. [2025-09-05T18:37:25.548947] [INFO ] [MAIN ] Update Progress: 1366/2363 symbols completed. MMD took 2.6s. Estimated remaining: 27m 16s. Rate: 36.6 symbols/min [2025-09-05T18:37:25.720159] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:25.728383] [INFO ] [MAIN ] MMI: Loaded 7129 existing records. [2025-09-05T18:37:25.897191] [INFO ] [MAIN ] MMI: Found 1 missing trading days. [2025-09-05T18:37:25.897378] [INFO ] [MAIN ] MMI: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:26.263492] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-05T18:37:26.454467] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-05T18:37:26.588975] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-05T18:37:26.710141] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:37:26.755808] [INFO ] [MAIN ] MMI: Adding 82 new records, updating 0 existing records. [2025-09-05T18:37:26.757748] [INFO ] [MAIN ] MMI: Combined dataset has 7211 total records. [2025-09-05T18:37:26.936634] [WARN ] [VALIDATOR ] MMI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:27.077991] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-05T18:37:27.128668] [WARN ] [VALIDATOR ] MMI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:27.128864] [INFO ] [MAIN ] MMI: Combined data validation passed. [2025-09-05T18:37:27.171379] [INFO ] [MAIN ] MMI: Update completed successfully. [2025-09-05T18:37:27.172471] [INFO ] [MAIN ] Update Progress: 1367/2363 symbols completed. MMI took 1.6s. Estimated remaining: 27m 15s. Rate: 36.6 symbols/min [2025-09-05T18:37:27.345833] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:27.348590] [INFO ] [MAIN ] MMKT: Loaded 1001 existing records. [2025-09-05T18:37:27.531371] [INFO ] [MAIN ] MMKT: Found 1 missing trading days. [2025-09-05T18:37:27.531562] [INFO ] [MAIN ] MMKT: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:27.863473] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-05T18:37:28.100764] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-05T18:37:28.455268] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:37:28.460759] [INFO ] [MAIN ] MMKT: Adding 0 new records, updating 19 existing records. [2025-09-05T18:37:28.461976] [INFO ] [MAIN ] MMKT: Combined dataset has 1001 total records. [2025-09-05T18:37:28.462288] [FATAL] [VALIDATOR ] MMKT: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:37:28.462367] [FATAL] [MAIN ] MMKT: Combined data validation failed. [2025-09-05T18:37:28.462403] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:37:28.462445] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-05T18:37:28.462669] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-05T18:37:28.462999] [INFO ] [MAIN ] Update Progress: 1368/2363 symbols completed. MMKT took 1.3s. Estimated remaining: 27m 13s. Rate: 36.6 symbols/min [2025-09-05T18:37:28.633226] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:28.660052] [INFO ] [MAIN ] MMM: Loaded 25368 existing records. [2025-09-05T18:37:28.671070] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-05T18:37:28.842022] [INFO ] [MAIN ] MMM: Found 1 missing trading days. [2025-09-05T18:37:28.842207] [INFO ] [MAIN ] MMM: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:29.463497] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-05T18:37:29.788397] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-05T18:37:30.263489] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-05T18:37:31.063533] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-05T18:37:31.118012] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-05T18:37:31.173599] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-05T18:37:31.863691] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-05T18:37:32.613057] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-05T18:37:32.663486] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-05T18:37:33.010948] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-05T18:37:33.463481] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-05T18:37:33.657562] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-05T18:37:34.084609] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-05T18:37:34.263511] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-05T18:37:35.063540] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-05T18:37:35.581750] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-05T18:37:35.863487] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-05T18:37:36.663528] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-05T18:37:36.969893] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-05T18:37:37.204355] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:37:37.205814] [INFO ] [REMOTE ] MLR: Full fetch complete (14296 records). [2025-09-05T18:37:37.473762] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-05T18:37:37.563248] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-05T18:37:37.635589] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-05T18:37:37.657999] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-05T18:37:37.658203] [INFO ] [MAIN ] Update Progress: 1369/2363 symbols completed. MLR took 17.4s. Estimated remaining: 27m 16s. Rate: 36.4 symbols/min [2025-09-05T18:37:37.845102] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:37.870074] [INFO ] [MAIN ] MMS: Loaded 24761 existing records. [2025-09-05T18:37:38.049810] [INFO ] [MAIN ] MMS: Found 1 missing trading days. [2025-09-05T18:37:38.049967] [INFO ] [MAIN ] MMS: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:38.080139] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:37:38.205001] [INFO ] [MAIN ] MMM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:37:38.206752] [INFO ] [MAIN ] MMM: Combined dataset has 25368 total records. [2025-09-05T18:37:38.207176] [FATAL] [VALIDATOR ] MMM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:37:38.207299] [FATAL] [MAIN ] MMM: Combined data validation failed. [2025-09-05T18:37:38.207337] [WARN ] [MAIN ] MMM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:37:38.207375] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-05T18:37:38.208159] [INFO ] [LOCAL ] MMM: Starting deletion of derivative data. [2025-09-05T18:37:38.210966] [INFO ] [MAIN ] Update Progress: 1370/2363 symbols completed. MMM took 9.7s. Estimated remaining: 27m 14s. Rate: 36.5 symbols/min [2025-09-05T18:37:38.272952] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-05T18:37:38.384088] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:38.392871] [INFO ] [MAIN ] MMT: Loaded 8198 existing records. [2025-09-05T18:37:38.595847] [INFO ] [MAIN ] MMT: Found 1 missing trading days. [2025-09-05T18:37:38.596164] [INFO ] [MAIN ] MMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:38.839922] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:37:38.948064] [INFO ] [MAIN ] MMS: Adding 282 new records, updating 0 existing records. [2025-09-05T18:37:38.951224] [INFO ] [MAIN ] MMS: Combined dataset has 25043 total records. [2025-09-05T18:37:39.068570] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-05T18:37:39.132767] [WARN ] [VALIDATOR ] MMS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:37:39.326922] [WARN ] [VALIDATOR ] MMS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:37:39.327136] [INFO ] [MAIN ] MMS: Combined data validation passed. [2025-09-05T18:37:39.488381] [INFO ] [MAIN ] MMS: Update completed successfully. [2025-09-05T18:37:39.491523] [INFO ] [MAIN ] Update Progress: 1371/2363 symbols completed. MMS took 1.8s. Estimated remaining: 27m 12s. Rate: 36.5 symbols/min [2025-09-05T18:37:39.704078] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:39.718089] [INFO ] [MAIN ] MMU: Loaded 12687 existing records. [2025-09-05T18:37:39.863738] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-05T18:37:39.889244] [INFO ] [MAIN ] MMU: Found 1 missing trading days. [2025-09-05T18:37:39.889951] [INFO ] [MAIN ] MMU: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:40.663485] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-05T18:37:40.764313] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-05T18:37:40.840713] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:37:40.863943] [INFO ] [MAIN ] MMT: Adding 36 new records, updating 0 existing records. [2025-09-05T18:37:40.866063] [INFO ] [MAIN ] MMT: Combined dataset has 8234 total records. [2025-09-05T18:37:41.047562] [WARN ] [VALIDATOR ] MMT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:37:41.202558] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:37:41.238717] [INFO ] [REMOTE ] MLM: Full fetch complete (35605 records). [2025-09-05T18:37:41.470057] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-05T18:37:41.609880] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-05T18:37:41.711698] [WARN ] [VALIDATOR ] MMT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:37:41.713253] [INFO ] [MAIN ] MMT: Combined data validation passed. [2025-09-05T18:37:41.804342] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-05T18:37:41.806710] [INFO ] [MAIN ] Update Progress: 1372/2363 symbols completed. MLM took 27.0s. Estimated remaining: 27m 11s. Rate: 36.5 symbols/min [2025-09-05T18:37:41.813720] [INFO ] [MAIN ] MMT: Update completed successfully. [2025-09-05T18:37:41.890740] [INFO ] [MAIN ] Update Progress: 1373/2363 symbols completed. MMT took 3.7s. Estimated remaining: 27m 8s. Rate: 36.5 symbols/min [2025-09-05T18:37:42.164242] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:42.189222] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:42.211317] [INFO ] [MAIN ] MNR: Loaded 19188 existing records. [2025-09-05T18:37:42.274667] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-05T18:37:42.321557] [INFO ] [MAIN ] MNSO: Loaded 20019 existing records. [2025-09-05T18:37:42.460051] [INFO ] [MAIN ] MNR: Found 1 missing trading days. [2025-09-05T18:37:42.476708] [INFO ] [MAIN ] MNR: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:42.571547] [INFO ] [MAIN ] MNSO: Found 1 missing trading days. [2025-09-05T18:37:42.571765] [INFO ] [MAIN ] MNSO: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:42.820550] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T18:37:42.871672] [INFO ] [MAIN ] MMU: Adding 226 new records, updating 0 existing records. [2025-09-05T18:37:42.873977] [INFO ] [MAIN ] MMU: Combined dataset has 12913 total records. [2025-09-05T18:37:43.055380] [WARN ] [VALIDATOR ] MMU: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:37:43.068671] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-05T18:37:43.247017] [WARN ] [VALIDATOR ] MMU: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:37:43.247222] [INFO ] [MAIN ] MMU: Combined data validation passed. [2025-09-05T18:37:43.327244] [INFO ] [MAIN ] MMU: Update completed successfully. [2025-09-05T18:37:43.328778] [INFO ] [MAIN ] Update Progress: 1374/2363 symbols completed. MMU took 3.8s. Estimated remaining: 27m 6s. Rate: 36.5 symbols/min [2025-09-05T18:37:43.500058] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:43.520114] [INFO ] [MAIN ] MNTN: Loaded 19034 existing records. [2025-09-05T18:37:43.696936] [INFO ] [MAIN ] MNTN: Found 1 missing trading days. [2025-09-05T18:37:43.697060] [INFO ] [MAIN ] MNTN: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:43.751544] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:37:43.868512] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-05T18:37:43.889761] [INFO ] [MAIN ] MNSO: Adding 308 new records, updating 0 existing records. [2025-09-05T18:37:43.892604] [INFO ] [MAIN ] MNSO: Combined dataset has 20327 total records. [2025-09-05T18:37:44.080292] [WARN ] [VALIDATOR ] MNSO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:44.296108] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-05T18:37:44.314683] [WARN ] [VALIDATOR ] MNSO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:44.314934] [INFO ] [MAIN ] MNSO: Combined data validation passed. [2025-09-05T18:37:44.438682] [INFO ] [MAIN ] MNSO: Update completed successfully. [2025-09-05T18:37:44.441685] [INFO ] [MAIN ] Update Progress: 1375/2363 symbols completed. MNSO took 2.5s. Estimated remaining: 27m 4s. Rate: 36.5 symbols/min [2025-09-05T18:37:44.611254] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:44.611434] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-05T18:37:44.611557] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-05T18:37:44.611596] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-05T18:37:44.611659] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-05T18:37:44.674709] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-05T18:37:44.974016] [INFO ] [REMOTE ] MO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:37:45.071567] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:37:45.162251] [INFO ] [MAIN ] MNTN: Adding 0 new records, updating 0 existing records. [2025-09-05T18:37:45.163916] [INFO ] [MAIN ] MNTN: Combined dataset has 19034 total records. [2025-09-05T18:37:45.164342] [FATAL] [VALIDATOR ] MNTN: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:37:45.164424] [FATAL] [MAIN ] MNTN: Combined data validation failed. [2025-09-05T18:37:45.164466] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:37:45.164507] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-05T18:37:45.165015] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-05T18:37:45.167167] [INFO ] [MAIN ] Update Progress: 1376/2363 symbols completed. MNTN took 1.8s. Estimated remaining: 27m 2s. Rate: 36.5 symbols/min [2025-09-05T18:37:45.339569] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:45.373409] [INFO ] [MAIN ] MOD: Loaded 34083 existing records. [2025-09-05T18:37:45.468574] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-05T18:37:45.482200] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:37:45.613214] [INFO ] [MAIN ] MNR: Adding 205 new records, updating 0 existing records. [2025-09-05T18:37:45.646779] [INFO ] [MAIN ] MOD: Found 1 missing trading days. [2025-09-05T18:37:45.648902] [INFO ] [MAIN ] MOD: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:45.650957] [INFO ] [MAIN ] MNR: Combined dataset has 19393 total records. [2025-09-05T18:37:45.851705] [WARN ] [VALIDATOR ] MNR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:37:46.042899] [WARN ] [VALIDATOR ] MNR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:37:46.043114] [INFO ] [MAIN ] MNR: Combined data validation passed. [2025-09-05T18:37:46.165489] [INFO ] [MAIN ] MNR: Update completed successfully. [2025-09-05T18:37:46.167625] [INFO ] [MAIN ] Update Progress: 1377/2363 symbols completed. MNR took 4.4s. Estimated remaining: 26m 60s. Rate: 36.5 symbols/min [2025-09-05T18:37:46.267999] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-05T18:37:46.340170] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:46.379155] [INFO ] [MAIN ] MODG: Loaded 38990 existing records. [2025-09-05T18:37:46.565994] [INFO ] [MAIN ] MODG: Found 1 missing trading days. [2025-09-05T18:37:46.566130] [INFO ] [MAIN ] MODG: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:47.057442] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:37:47.069538] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-05T18:37:47.184492] [INFO ] [MAIN ] MOD: Adding 307 new records, updating 0 existing records. [2025-09-05T18:37:47.187950] [INFO ] [MAIN ] MOD: Combined dataset has 34390 total records. [2025-09-05T18:37:47.367744] [WARN ] [VALIDATOR ] MOD: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:37:47.563551] [WARN ] [VALIDATOR ] MOD: Missing data for 45 trading days: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:37:47.563773] [INFO ] [MAIN ] MOD: Combined data validation passed. [2025-09-05T18:37:47.696493] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:37:47.702916] [INFO ] [REMOTE ] MLI: Full fetch complete (47811 records). [2025-09-05T18:37:47.864277] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-05T18:37:48.129214] [INFO ] [MAIN ] MOD: Update completed successfully. [2025-09-05T18:37:48.179356] [INFO ] [MAIN ] Update Progress: 1378/2363 symbols completed. MOD took 3.0s. Estimated remaining: 26m 59s. Rate: 36.5 symbols/min [2025-09-05T18:37:48.253497] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-05T18:37:48.469428] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:48.533055] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-09-05T18:37:48.562879] [INFO ] [MAIN ] MOH: Loaded 21458 existing records. [2025-09-05T18:37:48.666762] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-05T18:37:48.752383] [INFO ] [MAIN ] MOH: Found 1 missing trading days. [2025-09-05T18:37:48.758490] [INFO ] [MAIN ] MOH: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:48.759694] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:37:48.921617] [INFO ] [MAIN ] MODG: Adding 365 new records, updating 0 existing records. [2025-09-05T18:37:49.005897] [INFO ] [MAIN ] MODG: Combined dataset has 39355 total records. [2025-09-05T18:37:49.207332] [WARN ] [VALIDATOR ] MODG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:37:49.424316] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-05T18:37:49.426826] [INFO ] [MAIN ] Update Progress: 1379/2363 symbols completed. MLI took 34.7s. Estimated remaining: 26m 57s. Rate: 36.5 symbols/min [2025-09-05T18:37:49.469452] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-05T18:37:49.600553] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:49.600971] [WARN ] [MAIN ] MOS: No existing data found, performing full refresh instead. [2025-09-05T18:37:49.601358] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-05T18:37:49.601567] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-05T18:37:49.601803] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-05T18:37:49.958694] [INFO ] [REMOTE ] MOS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:37:49.966282] [WARN ] [VALIDATOR ] MODG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:37:49.966520] [INFO ] [MAIN ] MODG: Combined data validation passed. [2025-09-05T18:37:50.207183] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:37:50.210238] [INFO ] [MAIN ] MODG: Update completed successfully. [2025-09-05T18:37:50.232199] [INFO ] [MAIN ] Update Progress: 1380/2363 symbols completed. MODG took 4.1s. Estimated remaining: 26m 54s. Rate: 36.5 symbols/min [2025-09-05T18:37:50.275229] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-05T18:37:50.547783] [INFO ] [MAIN ] MOH: Adding 362 new records, updating 0 existing records. [2025-09-05T18:37:50.567132] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:50.570596] [INFO ] [MAIN ] MOH: Combined dataset has 21820 total records. [2025-09-05T18:37:50.669313] [INFO ] [MAIN ] MOV: Loaded 9137 existing records. [2025-09-05T18:37:50.900278] [WARN ] [VALIDATOR ] MOH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:51.038722] [INFO ] [MAIN ] MOV: Found 1 missing trading days. [2025-09-05T18:37:51.049850] [INFO ] [MAIN ] MOV: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:51.086291] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-05T18:37:51.213600] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-05T18:37:51.231494] [WARN ] [VALIDATOR ] MOH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:51.231802] [INFO ] [MAIN ] MOH: Combined data validation passed. [2025-09-05T18:37:51.370339] [INFO ] [MAIN ] MOH: Update completed successfully. [2025-09-05T18:37:51.372622] [INFO ] [MAIN ] Update Progress: 1381/2363 symbols completed. MOH took 3.2s. Estimated remaining: 26m 52s. Rate: 36.5 symbols/min [2025-09-05T18:37:51.548121] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:51.568560] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:37:51.633790] [INFO ] [MAIN ] MP: Loaded 25747 existing records. [2025-09-05T18:37:51.640150] [INFO ] [MAIN ] MOV: Adding 0 new records, updating 0 existing records. [2025-09-05T18:37:51.715014] [INFO ] [MAIN ] MOV: Combined dataset has 9137 total records. [2025-09-05T18:37:51.747303] [FATAL] [VALIDATOR ] MOV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:37:51.751032] [FATAL] [MAIN ] MOV: Combined data validation failed. [2025-09-05T18:37:51.751588] [WARN ] [MAIN ] MOV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:37:51.777597] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-05T18:37:51.805483] [INFO ] [LOCAL ] MOV: Starting deletion of derivative data. [2025-09-05T18:37:51.845584] [INFO ] [MAIN ] MP: Found 1 missing trading days. [2025-09-05T18:37:51.845885] [INFO ] [MAIN ] MP: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:51.847461] [INFO ] [MAIN ] Update Progress: 1382/2363 symbols completed. MOV took 1.6s. Estimated remaining: 26m 50s. Rate: 36.6 symbols/min [2025-09-05T18:37:51.868507] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-05T18:37:52.044734] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:52.044936] [WARN ] [MAIN ] MPA: No existing data found, performing full refresh instead. [2025-09-05T18:37:52.045878] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-05T18:37:52.046259] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-05T18:37:52.076979] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-05T18:37:52.108353] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-05T18:37:52.478352] [INFO ] [REMOTE ] MPA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:37:52.655596] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:37:52.673751] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-05T18:37:52.802636] [INFO ] [MAIN ] MP: Adding 390 new records, updating 0 existing records. [2025-09-05T18:37:52.807023] [INFO ] [MAIN ] MP: Combined dataset has 26137 total records. [2025-09-05T18:37:52.984347] [WARN ] [VALIDATOR ] MP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:53.183437] [WARN ] [VALIDATOR ] MP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:53.183692] [INFO ] [MAIN ] MP: Combined data validation passed. [2025-09-05T18:37:53.344496] [INFO ] [MAIN ] MP: Update completed successfully. [2025-09-05T18:37:53.347379] [INFO ] [MAIN ] Update Progress: 1383/2363 symbols completed. MP took 2.0s. Estimated remaining: 26m 48s. Rate: 36.6 symbols/min [2025-09-05T18:37:53.468734] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-05T18:37:53.532404] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:53.560763] [INFO ] [MAIN ] MPC: Loaded 24670 existing records. [2025-09-05T18:37:53.777802] [INFO ] [MAIN ] MPC: Found 1 missing trading days. [2025-09-05T18:37:53.777972] [INFO ] [MAIN ] MPC: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:54.263514] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-05T18:37:54.463148] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-05T18:37:55.063485] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-05T18:37:55.115170] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:37:55.269526] [INFO ] [MAIN ] MPC: Adding 381 new records, updating 0 existing records. [2025-09-05T18:37:55.274136] [INFO ] [MAIN ] MPC: Combined dataset has 25051 total records. [2025-09-05T18:37:55.475077] [WARN ] [VALIDATOR ] MPC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:37:55.689485] [WARN ] [VALIDATOR ] MPC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:37:55.689740] [INFO ] [MAIN ] MPC: Combined data validation passed. [2025-09-05T18:37:55.867103] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-05T18:37:55.872346] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-05T18:37:55.920995] [INFO ] [MAIN ] MPC: Update completed successfully. [2025-09-05T18:37:55.926054] [INFO ] [MAIN ] Update Progress: 1384/2363 symbols completed. MPC took 2.6s. Estimated remaining: 26m 47s. Rate: 36.5 symbols/min [2025-09-05T18:37:56.113912] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:37:56.137487] [INFO ] [MAIN ] MPLX: Loaded 23823 existing records. [2025-09-05T18:37:56.251457] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-05T18:37:56.331404] [INFO ] [MAIN ] MPLX: Found 1 missing trading days. [2025-09-05T18:37:56.331547] [INFO ] [MAIN ] MPLX: Need to fetch 1 months: 2025-09 [2025-09-05T18:37:56.663525] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-05T18:37:57.463518] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-05T18:37:57.919015] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-05T18:37:58.194488] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-05T18:37:58.263509] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-05T18:37:58.804544] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-05T18:37:59.063447] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-05T18:37:59.532001] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-05T18:37:59.863487] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-05T18:38:00.663456] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-05T18:38:00.753540] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-05T18:38:01.158498] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-05T18:38:01.291807] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:38:01.459616] [INFO ] [MAIN ] MPLX: Adding 379 new records, updating 0 existing records. [2025-09-05T18:38:01.463832] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-05T18:38:01.468847] [INFO ] [MAIN ] MPLX: Combined dataset has 24202 total records. [2025-09-05T18:38:01.676306] [WARN ] [VALIDATOR ] MPLX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:01.880441] [WARN ] [VALIDATOR ] MPLX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:01.880682] [INFO ] [MAIN ] MPLX: Combined data validation passed. [2025-09-05T18:38:02.035545] [INFO ] [MAIN ] MPLX: Update completed successfully. [2025-09-05T18:38:02.038825] [INFO ] [MAIN ] Update Progress: 1385/2363 symbols completed. MPLX took 6.1s. Estimated remaining: 26m 49s. Rate: 36.5 symbols/min [2025-09-05T18:38:02.214103] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:02.219673] [INFO ] [MAIN ] MPV: Loaded 3449 existing records. [2025-09-05T18:38:02.273265] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-05T18:38:02.367974] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-05T18:38:02.403172] [INFO ] [MAIN ] MPV: Found 1 missing trading days. [2025-09-05T18:38:02.403407] [INFO ] [MAIN ] MPV: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:03.063468] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-05T18:38:03.863478] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-05T18:38:04.331812] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T18:38:04.343910] [INFO ] [MAIN ] MPV: Adding 18 new records, updating 0 existing records. [2025-09-05T18:38:04.363764] [INFO ] [MAIN ] MPV: Combined dataset has 3467 total records. [2025-09-05T18:38:04.460340] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-05T18:38:04.576406] [WARN ] [VALIDATOR ] MPV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:38:04.668516] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-05T18:38:04.767326] [WARN ] [VALIDATOR ] MPV: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:38:04.767552] [INFO ] [MAIN ] MPV: Combined data validation passed. [2025-09-05T18:38:04.789623] [INFO ] [MAIN ] MPV: Update completed successfully. [2025-09-05T18:38:04.790182] [INFO ] [MAIN ] Update Progress: 1386/2363 symbols completed. MPV took 2.8s. Estimated remaining: 26m 48s. Rate: 36.5 symbols/min [2025-09-05T18:38:04.960391] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:04.960594] [WARN ] [MAIN ] MPW: No existing data found, performing full refresh instead. [2025-09-05T18:38:04.960794] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-05T18:38:04.960847] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-05T18:38:04.960905] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-05T18:38:05.310801] [INFO ] [REMOTE ] MPW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:38:05.353935] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-05T18:38:05.463460] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-05T18:38:06.167991] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-05T18:38:06.263425] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-05T18:38:07.063485] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-05T18:38:07.736114] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-05T18:38:07.863481] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-05T18:38:08.663529] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-05T18:38:08.725186] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-05T18:38:08.779466] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-05T18:38:09.428478] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-05T18:38:09.463421] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-05T18:38:09.659444] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-05T18:38:10.263505] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-05T18:38:10.286297] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-05T18:38:11.063481] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-05T18:38:11.869124] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-05T18:38:11.875588] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-05T18:38:12.663513] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-05T18:38:13.328291] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-05T18:38:13.431728] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:38:13.432574] [INFO ] [REMOTE ] MPA: Full fetch complete (5771 records). [2025-09-05T18:38:13.468604] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-05T18:38:13.789698] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-05T18:38:13.817656] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-05T18:38:13.817789] [INFO ] [MAIN ] Update Progress: 1387/2363 symbols completed. MPA took 22.0s. Estimated remaining: 26m 51s. Rate: 36.3 symbols/min [2025-09-05T18:38:13.989738] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:13.993761] [INFO ] [MAIN ] MPX: Loaded 1939 existing records. [2025-09-05T18:38:14.180956] [INFO ] [MAIN ] MPX: Found 1 missing trading days. [2025-09-05T18:38:14.199407] [INFO ] [MAIN ] MPX: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:14.205181] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-05T18:38:14.263467] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-05T18:38:14.547436] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-05T18:38:14.558204] [INFO ] [MAIN ] MPX: Adding 0 new records, updating 0 existing records. [2025-09-05T18:38:14.559145] [INFO ] [MAIN ] MPX: Combined dataset has 1939 total records. [2025-09-05T18:38:14.559476] [FATAL] [VALIDATOR ] MPX: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:38:14.559555] [FATAL] [MAIN ] MPX: Combined data validation failed. [2025-09-05T18:38:14.559602] [WARN ] [MAIN ] MPX: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:38:14.559671] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-05T18:38:14.559898] [INFO ] [LOCAL ] MPX: Starting deletion of derivative data. [2025-09-05T18:38:14.560279] [INFO ] [MAIN ] Update Progress: 1388/2363 symbols completed. MPX took 0.7s. Estimated remaining: 26m 49s. Rate: 36.4 symbols/min [2025-09-05T18:38:14.733856] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:14.739151] [INFO ] [MAIN ] MQT: Loaded 3518 existing records. [2025-09-05T18:38:14.907714] [INFO ] [MAIN ] MQT: Found 1 missing trading days. [2025-09-05T18:38:14.907856] [INFO ] [MAIN ] MQT: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:15.063493] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-05T18:38:15.539704] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-05T18:38:15.863491] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-05T18:38:16.663475] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-05T18:38:17.115237] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-05T18:38:17.463492] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-05T18:38:18.108080] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-05T18:38:18.263489] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-05T18:38:18.340519] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:38:18.386576] [INFO ] [MAIN ] MQT: Adding 209 new records, updating 0 existing records. [2025-09-05T18:38:18.388577] [INFO ] [MAIN ] MQT: Combined dataset has 3727 total records. [2025-09-05T18:38:18.583701] [WARN ] [VALIDATOR ] MQT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:18.773454] [WARN ] [VALIDATOR ] MQT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:18.773684] [INFO ] [MAIN ] MQT: Combined data validation passed. [2025-09-05T18:38:18.797151] [INFO ] [MAIN ] MQT: Update completed successfully. [2025-09-05T18:38:18.797754] [INFO ] [MAIN ] Update Progress: 1389/2363 symbols completed. MQT took 4.2s. Estimated remaining: 26m 49s. Rate: 36.3 symbols/min [2025-09-05T18:38:18.919471] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:38:19.015926] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:19.011166] [INFO ] [REMOTE ] MOS: Full fetch complete (57800 records). [2025-09-05T18:38:19.019051] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-05T18:38:19.019879] [FATAL] [VALIDATOR ] MOS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:38:19.030454] [FATAL] [MAIN ] MOS: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:38:19.031074] [WARN ] [MAIN ] MOS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:38:19.031545] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-05T18:38:19.032009] [INFO ] [LOCAL ] MOS: Starting deletion of derivative data. [2025-09-05T18:38:19.032209] [INFO ] [MAIN ] Update Progress: 1390/2363 symbols completed. MOS took 29.6s. Estimated remaining: 26m 47s. Rate: 36.3 symbols/min [2025-09-05T18:38:19.064337] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-05T18:38:19.144051] [INFO ] [MAIN ] MQY: Loaded 7761 existing records. [2025-09-05T18:38:19.338719] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:19.368840] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-09-05T18:38:19.394996] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-05T18:38:19.401566] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-05T18:38:19.401677] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-05T18:38:19.401501] [INFO ] [MAIN ] MQY: Found 1 missing trading days. [2025-09-05T18:38:19.445063] [INFO ] [MAIN ] MQY: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:19.754166] [INFO ] [REMOTE ] MRC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:38:19.863441] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-05T18:38:20.663488] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-05T18:38:21.288432] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-05T18:38:21.421097] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-05T18:38:21.436844] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:38:21.440558] [INFO ] [REMOTE ] MO: Full fetch complete (58433 records). [2025-09-05T18:38:21.471309] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-05T18:38:21.820864] [INFO ] [MAIN ] MO: Fetched primary data is valid. [2025-09-05T18:38:22.079999] [INFO ] [MAIN ] MO: Full history saved. [2025-09-05T18:38:22.080146] [INFO ] [MAIN ] Update Progress: 1391/2363 symbols completed. MO took 37.6s. Estimated remaining: 26m 46s. Rate: 36.3 symbols/min [2025-09-05T18:38:22.249816] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:22.250004] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-09-05T18:38:22.250186] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-05T18:38:22.250225] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-05T18:38:22.250272] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-05T18:38:22.270706] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-05T18:38:22.616050] [INFO ] [REMOTE ] MRK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:38:22.964526] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-05T18:38:23.063453] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-05T18:38:23.863508] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-05T18:38:24.159921] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-05T18:38:24.242522] [INFO ] [MAIN ] MQY: Adding 158 new records, updating 0 existing records. [2025-09-05T18:38:24.244977] [INFO ] [MAIN ] MQY: Combined dataset has 7919 total records. [2025-09-05T18:38:24.445670] [WARN ] [VALIDATOR ] MQY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:24.665468] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-05T18:38:24.672486] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-05T18:38:24.692751] [WARN ] [VALIDATOR ] MQY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:24.692972] [INFO ] [MAIN ] MQY: Combined data validation passed. [2025-09-05T18:38:24.745697] [INFO ] [MAIN ] MQY: Update completed successfully. [2025-09-05T18:38:24.746736] [INFO ] [MAIN ] Update Progress: 1392/2363 symbols completed. MQY took 5.9s. Estimated remaining: 26m 45s. Rate: 36.3 symbols/min [2025-09-05T18:38:24.920073] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:24.961836] [INFO ] [MAIN ] MRP: Loaded 35080 existing records. [2025-09-05T18:38:25.146257] [INFO ] [MAIN ] MRP: Found 1 missing trading days. [2025-09-05T18:38:25.146425] [INFO ] [MAIN ] MRP: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:25.463525] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-05T18:38:26.264378] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-05T18:38:26.264449] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-05T18:38:26.652782] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-05T18:38:27.063535] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-05T18:38:27.197383] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-05T18:38:27.439385] [INFO ] [MAIN ] MRP: Adding 333 new records, updating 0 existing records. [2025-09-05T18:38:27.444349] [INFO ] [MAIN ] MRP: Combined dataset has 35413 total records. [2025-09-05T18:38:27.696853] [WARN ] [VALIDATOR ] MRP: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:38:27.872901] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-05T18:38:27.986777] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-05T18:38:28.011138] [WARN ] [VALIDATOR ] MRP: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:38:28.011455] [INFO ] [MAIN ] MRP: Combined data validation passed. [2025-09-05T18:38:28.269867] [INFO ] [MAIN ] MRP: Update completed successfully. [2025-09-05T18:38:28.275114] [INFO ] [MAIN ] Update Progress: 1393/2363 symbols completed. MRP took 3.5s. Estimated remaining: 26m 45s. Rate: 36.3 symbols/min [2025-09-05T18:38:28.469286] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:28.522831] [INFO ] [MAIN ] MS: Loaded 40437 existing records. [2025-09-05T18:38:28.673795] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-05T18:38:28.712166] [INFO ] [MAIN ] MS: Found 1 missing trading days. [2025-09-05T18:38:28.712349] [INFO ] [MAIN ] MS: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:29.078414] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-05T18:38:29.463464] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-05T18:38:29.781498] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:38:29.784382] [INFO ] [REMOTE ] MPW: Full fetch complete (58153 records). [2025-09-05T18:38:30.165998] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-05T18:38:30.189822] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-05T18:38:30.285332] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-05T18:38:30.331806] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-05T18:38:30.482484] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-05T18:38:30.482666] [INFO ] [MAIN ] Update Progress: 1394/2363 symbols completed. MPW took 25.7s. Estimated remaining: 26m 43s. Rate: 36.3 symbols/min [2025-09-05T18:38:30.663223] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:30.674200] [INFO ] [MAIN ] MSA: Loaded 8577 existing records. [2025-09-05T18:38:30.857610] [INFO ] [MAIN ] MSA: Found 1 missing trading days. [2025-09-05T18:38:30.857768] [INFO ] [MAIN ] MSA: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:30.951440] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:38:31.068604] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-05T18:38:31.167120] [INFO ] [MAIN ] MS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:38:31.171816] [INFO ] [MAIN ] MS: Combined dataset has 40827 total records. [2025-09-05T18:38:31.353330] [WARN ] [VALIDATOR ] MS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:38:31.551346] [WARN ] [VALIDATOR ] MS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:38:31.551560] [INFO ] [MAIN ] MS: Combined data validation passed. [2025-09-05T18:38:31.825044] [INFO ] [MAIN ] MS: Update completed successfully. [2025-09-05T18:38:31.829384] [INFO ] [MAIN ] Update Progress: 1395/2363 symbols completed. MS took 3.6s. Estimated remaining: 26m 42s. Rate: 36.3 symbols/min [2025-09-05T18:38:31.872613] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-05T18:38:32.004190] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:32.009595] [INFO ] [MAIN ] MSB: Loaded 4206 existing records. [2025-09-05T18:38:32.179176] [INFO ] [MAIN ] MSB: Found 1 missing trading days. [2025-09-05T18:38:32.179324] [INFO ] [MAIN ] MSB: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:32.410029] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:38:32.458579] [INFO ] [MAIN ] MSA: Adding 130 new records, updating 0 existing records. [2025-09-05T18:38:32.460683] [INFO ] [MAIN ] MSA: Combined dataset has 8707 total records. [2025-09-05T18:38:32.648041] [WARN ] [VALIDATOR ] MSA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:32.670997] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-05T18:38:32.866501] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-05T18:38:32.884468] [WARN ] [VALIDATOR ] MSA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:32.884760] [INFO ] [MAIN ] MSA: Combined data validation passed. [2025-09-05T18:38:32.942932] [INFO ] [MAIN ] MSA: Update completed successfully. [2025-09-05T18:38:32.944185] [INFO ] [MAIN ] Update Progress: 1396/2363 symbols completed. MSA took 2.5s. Estimated remaining: 26m 40s. Rate: 36.3 symbols/min [2025-09-05T18:38:33.119035] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:33.121318] [INFO ] [MAIN ] MSC: Loaded 669 existing records. [2025-09-05T18:38:33.290620] [INFO ] [MAIN ] MSC: Found 1 missing trading days. [2025-09-05T18:38:33.290798] [INFO ] [MAIN ] MSC: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:33.463448] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-05T18:38:34.111392] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:38:34.116829] [INFO ] [MAIN ] MSC: Adding 9 new records, updating 0 existing records. [2025-09-05T18:38:34.118074] [INFO ] [MAIN ] MSC: Combined dataset has 678 total records. [2025-09-05T18:38:34.278535] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-05T18:38:34.320914] [WARN ] [VALIDATOR ] MSC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:34.519562] [WARN ] [VALIDATOR ] MSC: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-07-23 [2025-09-05T18:38:34.519792] [INFO ] [MAIN ] MSC: Combined data validation passed. [2025-09-05T18:38:34.524894] [INFO ] [MAIN ] MSC: Update completed successfully. [2025-09-05T18:38:34.525117] [INFO ] [MAIN ] Update Progress: 1397/2363 symbols completed. MSC took 1.6s. Estimated remaining: 26m 38s. Rate: 36.3 symbols/min [2025-09-05T18:38:34.987252] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:38:35.012668] [INFO ] [MAIN ] MSB: Adding 26 new records, updating 0 existing records. [2025-09-05T18:38:35.014507] [INFO ] [MAIN ] MSB: Combined dataset has 4232 total records. [2025-09-05T18:38:35.070493] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-05T18:38:35.241548] [WARN ] [VALIDATOR ] MSB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:35.342027] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-05T18:38:35.451660] [WARN ] [VALIDATOR ] MSB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:35.451878] [INFO ] [MAIN ] MSB: Combined data validation passed. [2025-09-05T18:38:35.478438] [INFO ] [MAIN ] MSB: Update completed successfully. [2025-09-05T18:38:35.479085] [INFO ] [MAIN ] Update Progress: 1398/2363 symbols completed. MSB took 3.6s. Estimated remaining: 26m 36s. Rate: 36.3 symbols/min [2025-09-05T18:38:35.863534] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-05T18:38:36.912424] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-05T18:38:36.923039] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-05T18:38:38.243623] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-05T18:38:38.255564] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-05T18:38:38.277273] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-05T18:38:38.285253] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-05T18:38:38.757910] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:38:38.759985] [INFO ] [REMOTE ] MRC: Full fetch complete (41438 records). [2025-09-05T18:38:39.140039] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-05T18:38:39.317345] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-05T18:38:39.317497] [INFO ] [MAIN ] Update Progress: 1399/2363 symbols completed. MRC took 20.3s. Estimated remaining: 26m 36s. Rate: 36.3 symbols/min [2025-09-05T18:38:40.787052] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-05T18:38:40.798923] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-05T18:38:43.150395] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-05T18:38:43.161390] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-05T18:38:45.383213] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-05T18:38:45.395201] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-05T18:38:47.707738] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-05T18:38:47.720755] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-05T18:38:48.318008] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:38:48.321323] [INFO ] [REMOTE ] MRK: Full fetch complete (58469 records). [2025-09-05T18:38:48.754083] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-05T18:38:49.068177] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-05T18:38:49.068462] [INFO ] [MAIN ] Update Progress: 1400/2363 symbols completed. MRK took 27.0s. Estimated remaining: 26m 39s. Rate: 36.1 symbols/min [2025-09-05T18:38:49.713786] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:49.809003] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-09-05T18:38:49.814589] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:49.831705] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-05T18:38:49.855824] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-05T18:38:49.860512] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-05T18:38:49.928775] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:49.933110] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:49.994117] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-09-05T18:38:50.025434] [INFO ] [MAIN ] MSD: Loaded 8004 existing records. [2025-09-05T18:38:50.036577] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-05T18:38:50.076015] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-05T18:38:50.123618] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-05T18:38:50.447498] [INFO ] [MAIN ] MSDL: Loaded 18353 existing records. [2025-09-05T18:38:50.587820] [INFO ] [MAIN ] MSD: Found 1 missing trading days. [2025-09-05T18:38:50.707198] [INFO ] [MAIN ] MSD: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:50.747862] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-05T18:38:50.887493] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:38:50.922867] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-05T18:38:51.076464] [INFO ] [MAIN ] MSDL: Found 1 missing trading days. [2025-09-05T18:38:51.082663] [INFO ] [MAIN ] MSDL: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:51.082464] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:38:51.083170] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-05T18:38:51.083499] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-05T18:38:52.452381] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-05T18:38:52.516719] [INFO ] [MAIN ] MSD: Adding 186 new records, updating 0 existing records. [2025-09-05T18:38:52.536251] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-05T18:38:52.536465] [INFO ] [MAIN ] MSD: Combined dataset has 8190 total records. [2025-09-05T18:38:52.542662] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-05T18:38:52.726712] [WARN ] [VALIDATOR ] MSD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:52.875729] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-05T18:38:53.057353] [INFO ] [MAIN ] MSDL: Adding 245 new records, updating 0 existing records. [2025-09-05T18:38:53.062384] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-05T18:38:53.071528] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-05T18:38:53.078139] [INFO ] [MAIN ] MSDL: Combined dataset has 18598 total records. [2025-09-05T18:38:53.265154] [WARN ] [VALIDATOR ] MSDL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:53.470513] [WARN ] [VALIDATOR ] MSDL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:53.470600] [WARN ] [VALIDATOR ] MSD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:53.470977] [INFO ] [MAIN ] MSDL: Combined data validation passed. [2025-09-05T18:38:53.470894] [INFO ] [MAIN ] MSD: Combined data validation passed. [2025-09-05T18:38:53.631903] [INFO ] [MAIN ] MSDL: Update completed successfully. [2025-09-05T18:38:53.635563] [INFO ] [MAIN ] Update Progress: 1401/2363 symbols completed. MSDL took 4.6s. Estimated remaining: 26m 40s. Rate: 36.1 symbols/min [2025-09-05T18:38:53.744299] [INFO ] [MAIN ] MSD: Update completed successfully. [2025-09-05T18:38:53.771627] [INFO ] [MAIN ] Update Progress: 1402/2363 symbols completed. MSD took 4.7s. Estimated remaining: 26m 37s. Rate: 36.1 symbols/min [2025-09-05T18:38:53.830241] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:54.000021] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:54.003746] [INFO ] [MAIN ] MSGS: Loaded 8305 existing records. [2025-09-05T18:38:54.168241] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-05T18:38:54.227861] [INFO ] [MAIN ] MSGS: Found 1 missing trading days. [2025-09-05T18:38:54.223555] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-05T18:38:54.229084] [INFO ] [MAIN ] MSGS: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:54.235842] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-05T18:38:54.236399] [INFO ] [MAIN ] MSI: Loaded 19098 existing records. [2025-09-05T18:38:54.423899] [INFO ] [MAIN ] MSI: Found 1 missing trading days. [2025-09-05T18:38:54.424194] [INFO ] [MAIN ] MSI: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:54.424437] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-05T18:38:54.476168] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-05T18:38:54.483796] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-05T18:38:55.030618] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:38:55.077571] [INFO ] [MAIN ] MSGS: Adding 128 new records, updating 0 existing records. [2025-09-05T18:38:55.079927] [INFO ] [MAIN ] MSGS: Combined dataset has 8433 total records. [2025-09-05T18:38:55.262943] [WARN ] [VALIDATOR ] MSGS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:55.430094] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:38:55.576497] [INFO ] [MAIN ] MSI: Adding 262 new records, updating 0 existing records. [2025-09-05T18:38:55.581882] [INFO ] [MAIN ] MSI: Combined dataset has 19360 total records. [2025-09-05T18:38:55.731241] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-05T18:38:55.793876] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-05T18:38:55.824017] [WARN ] [VALIDATOR ] MSI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:55.920178] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-05T18:38:55.966039] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-05T18:38:56.090870] [WARN ] [VALIDATOR ] MSGS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:56.091666] [INFO ] [MAIN ] MSGS: Combined data validation passed. [2025-09-05T18:38:56.150707] [INFO ] [MAIN ] MSGS: Update completed successfully. [2025-09-05T18:38:56.152353] [INFO ] [MAIN ] Update Progress: 1403/2363 symbols completed. MSGS took 2.5s. Estimated remaining: 26m 36s. Rate: 36.1 symbols/min [2025-09-05T18:38:56.337164] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:56.341122] [WARN ] [VALIDATOR ] MSI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:56.341513] [INFO ] [MAIN ] MSI: Combined data validation passed. [2025-09-05T18:38:56.402244] [INFO ] [MAIN ] MSIF: Loaded 8346 existing records. [2025-09-05T18:38:56.653898] [INFO ] [MAIN ] MSIF: Found 1 missing trading days. [2025-09-05T18:38:56.662246] [INFO ] [MAIN ] MSIF: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:56.667482] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-05T18:38:56.667660] [INFO ] [MAIN ] MSI: Update completed successfully. [2025-09-05T18:38:56.670603] [INFO ] [MAIN ] Update Progress: 1404/2363 symbols completed. MSI took 2.9s. Estimated remaining: 26m 33s. Rate: 36.1 symbols/min [2025-09-05T18:38:56.843363] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:56.860035] [INFO ] [MAIN ] MSM: Loaded 16564 existing records. [2025-09-05T18:38:57.033572] [INFO ] [MAIN ] MSM: Found 1 missing trading days. [2025-09-05T18:38:57.033771] [INFO ] [MAIN ] MSM: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:57.033981] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-05T18:38:57.187227] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-05T18:38:57.194079] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-05T18:38:57.530690] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:38:57.590861] [INFO ] [MAIN ] MSIF: Adding 156 new records, updating 0 existing records. [2025-09-05T18:38:57.594421] [INFO ] [MAIN ] MSIF: Combined dataset has 8502 total records. [2025-09-05T18:38:57.733178] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:38:57.806772] [WARN ] [VALIDATOR ] MSIF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:58.016895] [INFO ] [MAIN ] MSM: Adding 281 new records, updating 0 existing records. [2025-09-05T18:38:58.133408] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-05T18:38:58.131241] [INFO ] [MAIN ] MSM: Combined dataset has 16845 total records. [2025-09-05T18:38:58.143090] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-05T18:38:58.328915] [WARN ] [VALIDATOR ] MSM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:38:58.533767] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-05T18:38:58.541097] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-05T18:38:58.554793] [WARN ] [VALIDATOR ] MSM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:58.554888] [WARN ] [VALIDATOR ] MSIF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:38:58.555307] [INFO ] [MAIN ] MSM: Combined data validation passed. [2025-09-05T18:38:58.555962] [INFO ] [MAIN ] MSIF: Combined data validation passed. [2025-09-05T18:38:58.707908] [INFO ] [MAIN ] MSIF: Update completed successfully. [2025-09-05T18:38:58.710676] [INFO ] [MAIN ] Update Progress: 1405/2363 symbols completed. MSIF took 2.6s. Estimated remaining: 26m 32s. Rate: 36.1 symbols/min [2025-09-05T18:38:58.757556] [INFO ] [MAIN ] MSM: Update completed successfully. [2025-09-05T18:38:58.792241] [INFO ] [MAIN ] Update Progress: 1406/2363 symbols completed. MSM took 2.1s. Estimated remaining: 26m 29s. Rate: 36.1 symbols/min [2025-09-05T18:38:59.001170] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:59.073180] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:38:59.092113] [INFO ] [MAIN ] MT: Loaded 24085 existing records. [2025-09-05T18:38:59.266279] [INFO ] [MAIN ] MTAL: Loaded 18627 existing records. [2025-09-05T18:38:59.443031] [INFO ] [MAIN ] MT: Found 1 missing trading days. [2025-09-05T18:38:59.443335] [INFO ] [MAIN ] MT: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:59.443699] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-05T18:38:59.523076] [INFO ] [MAIN ] MTAL: Found 1 missing trading days. [2025-09-05T18:38:59.523361] [INFO ] [MAIN ] MTAL: Need to fetch 1 months: 2025-09 [2025-09-05T18:38:59.523665] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-05T18:38:59.551775] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-05T18:38:59.558858] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-05T18:38:59.722947] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-05T18:38:59.732907] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-05T18:39:00.080506] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:39:00.220034] [INFO ] [MAIN ] MT: Adding 383 new records, updating 0 existing records. [2025-09-05T18:39:00.223250] [INFO ] [MAIN ] MT: Combined dataset has 24468 total records. [2025-09-05T18:39:00.398114] [WARN ] [VALIDATOR ] MT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:00.594119] [WARN ] [VALIDATOR ] MT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:00.594319] [INFO ] [MAIN ] MT: Combined data validation passed. [2025-09-05T18:39:00.745476] [INFO ] [MAIN ] MT: Update completed successfully. [2025-09-05T18:39:00.748451] [INFO ] [MAIN ] Update Progress: 1407/2363 symbols completed. MT took 2.0s. Estimated remaining: 26m 28s. Rate: 36.1 symbols/min [2025-09-05T18:39:00.915563] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:00.938606] [INFO ] [MAIN ] MTB: Loaded 22331 existing records. [2025-09-05T18:39:01.056913] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T18:39:01.190097] [INFO ] [MAIN ] MTB: Found 1 missing trading days. [2025-09-05T18:39:01.200706] [INFO ] [MAIN ] MTB: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:01.206356] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-05T18:39:01.243584] [INFO ] [MAIN ] MTAL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:39:01.260207] [INFO ] [MAIN ] MTAL: Combined dataset has 18627 total records. [2025-09-05T18:39:01.260962] [FATAL] [VALIDATOR ] MTAL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:39:01.261854] [FATAL] [MAIN ] MTAL: Combined data validation failed. [2025-09-05T18:39:01.262849] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-05T18:39:01.262962] [WARN ] [MAIN ] MTAL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:39:01.268935] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-05T18:39:01.269619] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-05T18:39:01.276446] [INFO ] [LOCAL ] MTAL: Starting deletion of derivative data. [2025-09-05T18:39:01.290100] [INFO ] [MAIN ] Update Progress: 1408/2363 symbols completed. MTAL took 2.5s. Estimated remaining: 26m 25s. Rate: 36.1 symbols/min [2025-09-05T18:39:01.290980] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-05T18:39:01.327798] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-05T18:39:01.472102] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:01.486324] [INFO ] [MAIN ] MTD: Loaded 12332 existing records. [2025-09-05T18:39:01.663338] [INFO ] [MAIN ] MTD: Found 1 missing trading days. [2025-09-05T18:39:01.663765] [INFO ] [MAIN ] MTD: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:01.664078] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-05T18:39:01.676939] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:39:01.825525] [INFO ] [MAIN ] MTB: Adding 343 new records, updating 0 existing records. [2025-09-05T18:39:01.830543] [INFO ] [MAIN ] MTB: Combined dataset has 22674 total records. [2025-09-05T18:39:02.040489] [WARN ] [VALIDATOR ] MTB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:02.185199] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:39:02.261881] [INFO ] [MAIN ] MTD: Adding 0 new records, updating 0 existing records. [2025-09-05T18:39:02.310774] [INFO ] [MAIN ] MTD: Combined dataset has 12332 total records. [2025-09-05T18:39:02.311263] [FATAL] [VALIDATOR ] MTD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:39:02.311349] [FATAL] [MAIN ] MTD: Combined data validation failed. [2025-09-05T18:39:02.311386] [WARN ] [MAIN ] MTD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:39:02.311427] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-05T18:39:02.312014] [INFO ] [LOCAL ] MTD: Starting deletion of derivative data. [2025-09-05T18:39:02.314495] [INFO ] [MAIN ] Update Progress: 1409/2363 symbols completed. MTD took 1.0s. Estimated remaining: 26m 23s. Rate: 36.2 symbols/min [2025-09-05T18:39:02.501122] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:02.512900] [WARN ] [VALIDATOR ] MTB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:02.513228] [INFO ] [MAIN ] MTB: Combined data validation passed. [2025-09-05T18:39:02.656910] [INFO ] [MAIN ] MTDR: Loaded 38989 existing records. [2025-09-05T18:39:02.872955] [INFO ] [MAIN ] MTDR: Found 1 missing trading days. [2025-09-05T18:39:02.875856] [INFO ] [MAIN ] MTDR: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:02.898295] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-05T18:39:02.916759] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-05T18:39:02.930013] [INFO ] [MAIN ] MTB: Update completed successfully. [2025-09-05T18:39:02.935046] [INFO ] [MAIN ] Update Progress: 1410/2363 symbols completed. MTB took 2.2s. Estimated remaining: 26m 21s. Rate: 36.2 symbols/min [2025-09-05T18:39:03.068637] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-05T18:39:03.127953] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:03.157780] [INFO ] [MAIN ] MTG: Loaded 24261 existing records. [2025-09-05T18:39:03.343449] [INFO ] [MAIN ] MTG: Found 1 missing trading days. [2025-09-05T18:39:03.343794] [INFO ] [MAIN ] MTG: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:03.392220] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-05T18:39:03.534036] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:39:03.666151] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:39:03.700203] [INFO ] [REMOTE ] MSGE: Full fetch complete (29024 records). [2025-09-05T18:39:03.719719] [INFO ] [MAIN ] MTDR: Adding 377 new records, updating 0 existing records. [2025-09-05T18:39:03.721253] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:39:03.721823] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:39:03.721881] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:39:03.721932] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-05T18:39:03.722014] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-09-05T18:39:03.722123] [INFO ] [MAIN ] Update Progress: 1411/2363 symbols completed. MSGE took 14.7s. Estimated remaining: 26m 19s. Rate: 36.2 symbols/min [2025-09-05T18:39:03.856765] [INFO ] [MAIN ] MTDR: Combined dataset has 39366 total records. [2025-09-05T18:39:03.906544] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-05T18:39:03.909409] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:04.135749] [INFO ] [MAIN ] MTH: Loaded 20982 existing records. [2025-09-05T18:39:04.141871] [WARN ] [VALIDATOR ] MTDR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:39:04.521279] [INFO ] [MAIN ] MTH: Found 1 missing trading days. [2025-09-05T18:39:04.527319] [INFO ] [MAIN ] MTH: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:04.546452] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:39:04.668393] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-05T18:39:04.690028] [INFO ] [MAIN ] MTG: Adding 368 new records, updating 0 existing records. [2025-09-05T18:39:04.700481] [INFO ] [MAIN ] MTG: Combined dataset has 24629 total records. [2025-09-05T18:39:04.889095] [WARN ] [VALIDATOR ] MTG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:05.091674] [WARN ] [VALIDATOR ] MTG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:05.092070] [INFO ] [MAIN ] MTG: Combined data validation passed. [2025-09-05T18:39:05.091805] [WARN ] [VALIDATOR ] MTDR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:39:05.092996] [INFO ] [MAIN ] MTDR: Combined data validation passed. [2025-09-05T18:39:05.369441] [INFO ] [MAIN ] MTG: Update completed successfully. [2025-09-05T18:39:05.373029] [INFO ] [MAIN ] Update Progress: 1412/2363 symbols completed. MTG took 2.4s. Estimated remaining: 26m 17s. Rate: 36.2 symbols/min [2025-09-05T18:39:05.466876] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-05T18:39:05.557732] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:05.676948] [INFO ] [MAIN ] MTN: Loaded 18620 existing records. [2025-09-05T18:39:05.868343] [INFO ] [MAIN ] MTN: Found 1 missing trading days. [2025-09-05T18:39:05.869283] [INFO ] [MAIN ] MTN: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:05.899284] [INFO ] [MAIN ] MTDR: Update completed successfully. [2025-09-05T18:39:05.906797] [INFO ] [MAIN ] Update Progress: 1413/2363 symbols completed. MTDR took 3.6s. Estimated remaining: 26m 15s. Rate: 36.2 symbols/min [2025-09-05T18:39:06.101178] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:06.110582] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:39:06.113587] [INFO ] [MAIN ] MTR: Loaded 1388 existing records. [2025-09-05T18:39:06.266039] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-05T18:39:06.377376] [INFO ] [MAIN ] MTH: Adding 374 new records, updating 0 existing records. [2025-09-05T18:39:06.455921] [INFO ] [MAIN ] MTR: Found 1 missing trading days. [2025-09-05T18:39:06.457057] [INFO ] [MAIN ] MTR: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:06.458407] [INFO ] [MAIN ] MTH: Combined dataset has 21356 total records. [2025-09-05T18:39:06.640603] [WARN ] [VALIDATOR ] MTH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:06.728346] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-05T18:39:06.876428] [WARN ] [VALIDATOR ] MTH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:06.876678] [INFO ] [MAIN ] MTH: Combined data validation passed. [2025-09-05T18:39:06.977506] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:39:07.068792] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-05T18:39:07.095898] [INFO ] [MAIN ] MTN: Adding 233 new records, updating 0 existing records. [2025-09-05T18:39:07.103004] [INFO ] [MAIN ] MTN: Combined dataset has 18853 total records. [2025-09-05T18:39:07.297336] [WARN ] [VALIDATOR ] MTN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:07.506685] [INFO ] [MAIN ] MTH: Update completed successfully. [2025-09-05T18:39:07.509463] [INFO ] [MAIN ] Update Progress: 1414/2363 symbols completed. MTH took 3.8s. Estimated remaining: 26m 13s. Rate: 36.2 symbols/min [2025-09-05T18:39:07.617406] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:39:07.627441] [INFO ] [MAIN ] MTR: Adding 4 new records, updating 0 existing records. [2025-09-05T18:39:07.650036] [INFO ] [MAIN ] MTR: Combined dataset has 1392 total records. [2025-09-05T18:39:07.719416] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:07.753956] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-09-05T18:39:07.775213] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-05T18:39:07.793468] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-05T18:39:07.806231] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-05T18:39:07.863805] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-05T18:39:07.957472] [WARN ] [VALIDATOR ] MTR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:08.445557] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:39:08.458877] [WARN ] [VALIDATOR ] MTN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:08.458945] [WARN ] [VALIDATOR ] MTR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:08.459165] [INFO ] [MAIN ] MTR: Combined data validation passed. [2025-09-05T18:39:08.460125] [INFO ] [MAIN ] MTN: Combined data validation passed. [2025-09-05T18:39:08.469594] [INFO ] [MAIN ] MTR: Update completed successfully. [2025-09-05T18:39:08.520912] [INFO ] [MAIN ] Update Progress: 1415/2363 symbols completed. MTR took 2.6s. Estimated remaining: 26m 11s. Rate: 36.2 symbols/min [2025-09-05T18:39:08.668016] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-05T18:39:08.738425] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:08.739582] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-09-05T18:39:08.741500] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-05T18:39:08.742312] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-05T18:39:08.743675] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-05T18:39:09.046544] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:39:09.071706] [INFO ] [REMOTE ] MSCI: Full fetch complete (38114 records). [2025-09-05T18:39:09.141212] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:39:09.269099] [INFO ] [MAIN ] MTN: Update completed successfully. [2025-09-05T18:39:09.298606] [INFO ] [MAIN ] Update Progress: 1416/2363 symbols completed. MTN took 3.9s. Estimated remaining: 26m 9s. Rate: 36.2 symbols/min [2025-09-05T18:39:09.469762] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-05T18:39:09.651966] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:09.726282] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-05T18:39:09.738957] [INFO ] [MAIN ] MTW: Loaded 12738 existing records. [2025-09-05T18:39:10.032584] [INFO ] [MAIN ] MTW: Found 1 missing trading days. [2025-09-05T18:39:10.033971] [INFO ] [MAIN ] MTW: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:10.043864] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-05T18:39:10.116192] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-05T18:39:10.116352] [INFO ] [MAIN ] Update Progress: 1417/2363 symbols completed. MSCI took 21.0s. Estimated remaining: 26m 6s. Rate: 36.2 symbols/min [2025-09-05T18:39:10.273456] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-05T18:39:10.308991] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:10.321979] [INFO ] [MAIN ] MTX: Loaded 11177 existing records. [2025-09-05T18:39:10.516500] [INFO ] [MAIN ] MTX: Found 1 missing trading days. [2025-09-05T18:39:10.516709] [INFO ] [MAIN ] MTX: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:11.032280] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-05T18:39:11.063475] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-05T18:39:11.100405] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-05T18:39:11.863490] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-05T18:39:12.134257] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-05T18:39:12.521279] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:39:12.593853] [INFO ] [MAIN ] MTX: Adding 161 new records, updating 0 existing records. [2025-09-05T18:39:12.596269] [INFO ] [MAIN ] MTX: Combined dataset has 11338 total records. [2025-09-05T18:39:12.668639] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-05T18:39:12.778602] [WARN ] [VALIDATOR ] MTX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:12.968360] [WARN ] [VALIDATOR ] MTX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:12.968571] [INFO ] [MAIN ] MTX: Combined data validation passed. [2025-09-05T18:39:13.039518] [INFO ] [MAIN ] MTX: Update completed successfully. [2025-09-05T18:39:13.040769] [INFO ] [MAIN ] Update Progress: 1418/2363 symbols completed. MTX took 2.9s. Estimated remaining: 26m 6s. Rate: 36.2 symbols/min [2025-09-05T18:39:13.217167] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:13.238281] [INFO ] [MAIN ] MTZ: Loaded 20275 existing records. [2025-09-05T18:39:13.413311] [INFO ] [MAIN ] MTZ: Found 1 missing trading days. [2025-09-05T18:39:13.413469] [INFO ] [MAIN ] MTZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:13.463433] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-05T18:39:13.707264] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-05T18:39:14.263541] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-05T18:39:14.293179] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:39:14.407325] [INFO ] [MAIN ] MTZ: Adding 302 new records, updating 0 existing records. [2025-09-05T18:39:14.410403] [INFO ] [MAIN ] MTZ: Combined dataset has 20577 total records. [2025-09-05T18:39:14.598667] [WARN ] [VALIDATOR ] MTZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:14.800133] [WARN ] [VALIDATOR ] MTZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:14.800359] [INFO ] [MAIN ] MTZ: Combined data validation passed. [2025-09-05T18:39:14.932065] [INFO ] [MAIN ] MTZ: Update completed successfully. [2025-09-05T18:39:14.934477] [INFO ] [MAIN ] Update Progress: 1419/2363 symbols completed. MTZ took 1.9s. Estimated remaining: 26m 4s. Rate: 36.2 symbols/min [2025-09-05T18:39:15.044458] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:39:15.074360] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-05T18:39:15.160674] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:15.192790] [INFO ] [MAIN ] MTW: Adding 171 new records, updating 0 existing records. [2025-09-05T18:39:15.196689] [INFO ] [MAIN ] MTW: Combined dataset has 12909 total records. [2025-09-05T18:39:15.308742] [INFO ] [MAIN ] MUA: Loaded 8819 existing records. [2025-09-05T18:39:15.511928] [WARN ] [VALIDATOR ] MTW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:15.666558] [INFO ] [MAIN ] MUA: Found 1 missing trading days. [2025-09-05T18:39:15.669087] [INFO ] [MAIN ] MUA: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:15.757513] [WARN ] [VALIDATOR ] MTW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:15.757788] [INFO ] [MAIN ] MTW: Combined data validation passed. [2025-09-05T18:39:15.839496] [INFO ] [MAIN ] MTW: Update completed successfully. [2025-09-05T18:39:15.841250] [INFO ] [MAIN ] Update Progress: 1420/2363 symbols completed. MTW took 6.5s. Estimated remaining: 26m 2s. Rate: 36.2 symbols/min [2025-09-05T18:39:15.870886] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-05T18:39:16.013782] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:16.013979] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-09-05T18:39:16.014111] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-05T18:39:16.014150] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-05T18:39:16.014195] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-05T18:39:16.365337] [INFO ] [REMOTE ] MUC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:39:16.587289] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-05T18:39:16.663456] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-05T18:39:16.776325] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:39:16.814436] [INFO ] [MAIN ] MUA: Adding 161 new records, updating 0 existing records. [2025-09-05T18:39:16.816937] [INFO ] [MAIN ] MUA: Combined dataset has 8980 total records. [2025-09-05T18:39:17.005411] [WARN ] [VALIDATOR ] MUA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:39:17.202167] [WARN ] [VALIDATOR ] MUA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:39:17.202392] [INFO ] [MAIN ] MUA: Combined data validation passed. [2025-09-05T18:39:17.261047] [INFO ] [MAIN ] MUA: Update completed successfully. [2025-09-05T18:39:17.262622] [INFO ] [MAIN ] Update Progress: 1421/2363 symbols completed. MUA took 2.3s. Estimated remaining: 26m 0s. Rate: 36.2 symbols/min [2025-09-05T18:39:17.436327] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:17.445899] [INFO ] [MAIN ] MUE: Loaded 6395 existing records. [2025-09-05T18:39:17.468687] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-05T18:39:17.639524] [INFO ] [MAIN ] MUE: Found 1 missing trading days. [2025-09-05T18:39:17.639774] [INFO ] [MAIN ] MUE: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:17.959817] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-05T18:39:18.263552] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-05T18:39:18.738879] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-05T18:39:19.063509] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-05T18:39:19.536414] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T18:39:19.589184] [INFO ] [MAIN ] MUE: Adding 125 new records, updating 0 existing records. [2025-09-05T18:39:19.591107] [INFO ] [MAIN ] MUE: Combined dataset has 6520 total records. [2025-09-05T18:39:19.767602] [WARN ] [VALIDATOR ] MUE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:19.868091] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-05T18:39:19.969955] [WARN ] [VALIDATOR ] MUE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:19.970180] [INFO ] [MAIN ] MUE: Combined data validation passed. [2025-09-05T18:39:20.016389] [INFO ] [MAIN ] MUE: Update completed successfully. [2025-09-05T18:39:20.017398] [INFO ] [MAIN ] Update Progress: 1422/2363 symbols completed. MUE took 2.8s. Estimated remaining: 25m 59s. Rate: 36.2 symbols/min [2025-09-05T18:39:20.210472] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:20.210743] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-09-05T18:39:20.210964] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-05T18:39:20.211029] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-05T18:39:20.211097] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-05T18:39:20.560110] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-05T18:39:20.668636] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-05T18:39:20.769628] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:39:21.343818] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-05T18:39:21.463554] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-05T18:39:21.683472] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-05T18:39:22.263497] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-05T18:39:22.865380] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-05T18:39:23.063479] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-05T18:39:23.863529] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-05T18:39:24.167521] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-05T18:39:24.410338] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-05T18:39:24.663492] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-05T18:39:24.963296] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-05T18:39:25.463488] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-05T18:39:26.263451] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-05T18:39:26.379460] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-05T18:39:26.554319] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-05T18:39:27.063485] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-05T18:39:27.654152] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-05T18:39:27.863496] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-05T18:39:28.663504] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-05T18:39:28.856520] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-05T18:39:29.102612] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-05T18:39:29.463499] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-05T18:39:29.767063] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-05T18:39:30.161999] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-05T18:39:30.263459] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-05T18:39:30.519971] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-05T18:39:30.521131] [INFO ] [REMOTE ] MTRN: Full fetch complete (18761 records). [2025-09-05T18:39:30.874911] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-05T18:39:30.971312] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-05T18:39:30.971471] [INFO ] [MAIN ] Update Progress: 1423/2363 symbols completed. MTRN took 23.5s. Estimated remaining: 26m 4s. Rate: 36.1 symbols/min [2025-09-05T18:39:31.069424] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-05T18:39:31.143420] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:31.143548] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-09-05T18:39:31.143685] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-05T18:39:31.143727] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-05T18:39:31.143771] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-05T18:39:31.496599] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:39:31.863472] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-05T18:39:32.558858] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-05T18:39:32.663480] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-05T18:39:33.098452] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-05T18:39:33.463509] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-05T18:39:34.062378] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-05T18:39:34.263481] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-05T18:39:34.656262] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-05T18:39:34.658030] [INFO ] [REMOTE ] MTUS: Full fetch complete (31991 records). [2025-09-05T18:39:35.021634] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-05T18:39:35.078703] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-05T18:39:35.156684] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-05T18:39:35.156843] [INFO ] [MAIN ] Update Progress: 1424/2363 symbols completed. MTUS took 26.6s. Estimated remaining: 26m 4s. Rate: 36.0 symbols/min [2025-09-05T18:39:35.329139] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:35.344871] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-05T18:39:35.372342] [INFO ] [MAIN ] MUR: Loaded 25200 existing records. [2025-09-05T18:39:35.550357] [INFO ] [MAIN ] MUR: Found 1 missing trading days. [2025-09-05T18:39:35.550596] [INFO ] [MAIN ] MUR: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:35.863434] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-05T18:39:36.068416] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-05T18:39:36.663483] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-05T18:39:36.902469] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-05T18:39:37.164189] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-05T18:39:37.463448] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-05T18:39:38.209967] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-05T18:39:38.263427] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-05T18:39:39.063468] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-05T18:39:39.405198] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-05T18:39:39.863462] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-05T18:39:39.913001] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-05T18:39:40.663444] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-05T18:39:40.843129] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:39:40.845494] [INFO ] [REMOTE ] MUC: Full fetch complete (21344 records). [2025-09-05T18:39:41.208340] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-05T18:39:41.309103] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-05T18:39:41.309271] [INFO ] [MAIN ] Update Progress: 1425/2363 symbols completed. MUC took 25.5s. Estimated remaining: 26m 5s. Rate: 36.0 symbols/min [2025-09-05T18:39:41.463485] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-05T18:39:41.481088] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:41.493512] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-05T18:39:41.507985] [INFO ] [MAIN ] MUSA: Loaded 11926 existing records. [2025-09-05T18:39:41.682050] [INFO ] [MAIN ] MUSA: Found 1 missing trading days. [2025-09-05T18:39:41.682189] [INFO ] [MAIN ] MUSA: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:42.263483] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-05T18:39:43.063497] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-05T18:39:43.261253] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-05T18:39:43.467326] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:39:43.622901] [INFO ] [MAIN ] MUR: Adding 388 new records, updating 0 existing records. [2025-09-05T18:39:43.642712] [INFO ] [MAIN ] MUR: Combined dataset has 25588 total records. [2025-09-05T18:39:43.730412] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-05T18:39:43.858556] [WARN ] [VALIDATOR ] MUR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:43.870025] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-05T18:39:44.072050] [WARN ] [VALIDATOR ] MUR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:44.072290] [INFO ] [MAIN ] MUR: Combined data validation passed. [2025-09-05T18:39:44.233416] [INFO ] [MAIN ] MUR: Update completed successfully. [2025-09-05T18:39:44.236615] [INFO ] [MAIN ] Update Progress: 1426/2363 symbols completed. MUR took 9.1s. Estimated remaining: 26m 4s. Rate: 35.9 symbols/min [2025-09-05T18:39:44.420754] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:44.441008] [INFO ] [MAIN ] MUX: Loaded 20628 existing records. [2025-09-05T18:39:44.640071] [INFO ] [MAIN ] MUX: Found 1 missing trading days. [2025-09-05T18:39:44.640245] [INFO ] [MAIN ] MUX: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:44.663416] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-05T18:39:44.701171] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:39:44.768499] [INFO ] [MAIN ] MUSA: Adding 173 new records, updating 0 existing records. [2025-09-05T18:39:44.770875] [INFO ] [MAIN ] MUSA: Combined dataset has 12099 total records. [2025-09-05T18:39:44.953502] [WARN ] [VALIDATOR ] MUSA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:45.143314] [WARN ] [VALIDATOR ] MUSA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:45.143557] [INFO ] [MAIN ] MUSA: Combined data validation passed. [2025-09-05T18:39:45.221580] [INFO ] [MAIN ] MUSA: Update completed successfully. [2025-09-05T18:39:45.223260] [INFO ] [MAIN ] Update Progress: 1427/2363 symbols completed. MUSA took 3.9s. Estimated remaining: 26m 2s. Rate: 36.0 symbols/min [2025-09-05T18:39:45.400360] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:45.401046] [WARN ] [MAIN ] MVF: No existing data found, performing full refresh instead. [2025-09-05T18:39:45.401279] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:39:45.418997] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-05T18:39:45.425138] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-05T18:39:45.425198] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-05T18:39:45.468421] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-05T18:39:45.718531] [INFO ] [MAIN ] MUX: Adding 375 new records, updating 0 existing records. [2025-09-05T18:39:45.882122] [INFO ] [MAIN ] MUX: Combined dataset has 21003 total records. [2025-09-05T18:39:45.904085] [INFO ] [REMOTE ] MVF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:39:46.081365] [WARN ] [VALIDATOR ] MUX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:46.263505] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-05T18:39:46.273908] [WARN ] [VALIDATOR ] MUX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:46.274159] [INFO ] [MAIN ] MUX: Combined data validation passed. [2025-09-05T18:39:46.399832] [INFO ] [MAIN ] MUX: Update completed successfully. [2025-09-05T18:39:46.402197] [INFO ] [MAIN ] Update Progress: 1428/2363 symbols completed. MUX took 2.2s. Estimated remaining: 26m 0s. Rate: 36.0 symbols/min [2025-09-05T18:39:46.572711] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:46.578083] [INFO ] [MAIN ] MVO: Loaded 4350 existing records. [2025-09-05T18:39:46.799047] [INFO ] [MAIN ] MVO: Found 1 missing trading days. [2025-09-05T18:39:46.799211] [INFO ] [MAIN ] MVO: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:47.063986] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-05T18:39:47.065926] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-05T18:39:47.311460] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-05T18:39:47.385909] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-05T18:39:47.404037] [INFO ] [MAIN ] MVO: Adding 56 new records, updating 0 existing records. [2025-09-05T18:39:47.405531] [INFO ] [MAIN ] MVO: Combined dataset has 4406 total records. [2025-09-05T18:39:47.582055] [WARN ] [VALIDATOR ] MVO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:47.765257] [WARN ] [VALIDATOR ] MVO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:47.765484] [INFO ] [MAIN ] MVO: Combined data validation passed. [2025-09-05T18:39:47.791514] [INFO ] [MAIN ] MVO: Update completed successfully. [2025-09-05T18:39:47.792152] [INFO ] [MAIN ] Update Progress: 1429/2363 symbols completed. MVO took 1.4s. Estimated remaining: 25m 58s. Rate: 36.0 symbols/min [2025-09-05T18:39:47.868580] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-05T18:39:47.964290] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:47.971190] [INFO ] [MAIN ] MVT: Loaded 4870 existing records. [2025-09-05T18:39:48.139639] [INFO ] [MAIN ] MVT: Found 1 missing trading days. [2025-09-05T18:39:48.139770] [INFO ] [MAIN ] MVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:48.663488] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-05T18:39:49.074712] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-05T18:39:49.463559] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-05T18:39:49.535199] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-05T18:39:50.256278] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-05T18:39:50.263411] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-05T18:39:51.063528] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-05T18:39:51.219458] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-05T18:39:51.708407] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:39:51.709691] [INFO ] [REMOTE ] MUJ: Full fetch complete (13822 records). [2025-09-05T18:39:51.885506] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-05T18:39:52.079490] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-05T18:39:52.142885] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-05T18:39:52.143044] [INFO ] [MAIN ] Update Progress: 1430/2363 symbols completed. MUJ took 21.2s. Estimated remaining: 25m 58s. Rate: 35.9 symbols/min [2025-09-05T18:39:52.312032] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:52.333364] [INFO ] [MAIN ] MWA: Loaded 21606 existing records. [2025-09-05T18:39:52.505634] [INFO ] [MAIN ] MWA: Found 1 missing trading days. [2025-09-05T18:39:52.505801] [INFO ] [MAIN ] MWA: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:52.663431] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-05T18:39:53.190271] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-05T18:39:53.463516] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-05T18:39:53.800419] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:39:53.840378] [INFO ] [MAIN ] MVT: Adding 116 new records, updating 0 existing records. [2025-09-05T18:39:53.843255] [INFO ] [MAIN ] MVT: Combined dataset has 4986 total records. [2025-09-05T18:39:54.040491] [WARN ] [VALIDATOR ] MVT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:54.251480] [WARN ] [VALIDATOR ] MVT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:54.252187] [INFO ] [MAIN ] MVT: Combined data validation passed. [2025-09-05T18:39:54.272751] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-05T18:39:54.295189] [INFO ] [MAIN ] MVT: Update completed successfully. [2025-09-05T18:39:54.296578] [INFO ] [MAIN ] Update Progress: 1431/2363 symbols completed. MVT took 6.5s. Estimated remaining: 25m 57s. Rate: 35.9 symbols/min [2025-09-05T18:39:54.473110] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:54.485302] [INFO ] [MAIN ] MX: Loaded 10870 existing records. [2025-09-05T18:39:54.663035] [INFO ] [MAIN ] MX: Found 1 missing trading days. [2025-09-05T18:39:54.663338] [INFO ] [MAIN ] MX: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:54.891028] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:39:54.999220] [INFO ] [MAIN ] MWA: Adding 256 new records, updating 0 existing records. [2025-09-05T18:39:55.002498] [INFO ] [MAIN ] MWA: Combined dataset has 21862 total records. [2025-09-05T18:39:55.068667] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-05T18:39:55.188811] [WARN ] [VALIDATOR ] MWA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:55.384467] [WARN ] [VALIDATOR ] MWA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:55.384747] [INFO ] [MAIN ] MWA: Combined data validation passed. [2025-09-05T18:39:55.531634] [INFO ] [MAIN ] MWA: Update completed successfully. [2025-09-05T18:39:55.534805] [INFO ] [MAIN ] Update Progress: 1432/2363 symbols completed. MWA took 3.4s. Estimated remaining: 25m 55s. Rate: 35.9 symbols/min [2025-09-05T18:39:55.716692] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:55.716896] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-05T18:39:55.717132] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-05T18:39:55.717214] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-05T18:39:55.717264] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-05T18:39:55.854229] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-05T18:39:55.861230] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:39:55.879505] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-05T18:39:56.028621] [INFO ] [MAIN ] MX: Adding 131 new records, updating 0 existing records. [2025-09-05T18:39:56.115287] [INFO ] [MAIN ] MX: Combined dataset has 11001 total records. [2025-09-05T18:39:56.277429] [INFO ] [REMOTE ] MXE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:39:56.363946] [WARN ] [VALIDATOR ] MX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:56.559269] [WARN ] [VALIDATOR ] MX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:56.559487] [INFO ] [MAIN ] MX: Combined data validation passed. [2025-09-05T18:39:56.622439] [INFO ] [MAIN ] MX: Update completed successfully. [2025-09-05T18:39:56.624066] [INFO ] [MAIN ] Update Progress: 1433/2363 symbols completed. MX took 2.3s. Estimated remaining: 25m 53s. Rate: 35.9 symbols/min [2025-09-05T18:39:56.668682] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-05T18:39:56.796759] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:56.804677] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-05T18:39:56.809172] [INFO ] [MAIN ] MXF: Loaded 2087 existing records. [2025-09-05T18:39:56.978098] [INFO ] [MAIN ] MXF: Found 1 missing trading days. [2025-09-05T18:39:56.978226] [INFO ] [MAIN ] MXF: Need to fetch 1 months: 2025-09 [2025-09-05T18:39:57.463539] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-05T18:39:58.030766] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-05T18:39:58.263574] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-05T18:39:58.446898] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-05T18:39:59.063470] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-05T18:39:59.225744] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:39:59.235408] [INFO ] [MAIN ] MXF: Adding 17 new records, updating 0 existing records. [2025-09-05T18:39:59.236840] [INFO ] [MAIN ] MXF: Combined dataset has 2104 total records. [2025-09-05T18:39:59.433175] [WARN ] [VALIDATOR ] MXF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:39:59.636811] [WARN ] [VALIDATOR ] MXF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:39:59.637042] [INFO ] [MAIN ] MXF: Combined data validation passed. [2025-09-05T18:39:59.650903] [INFO ] [MAIN ] MXF: Update completed successfully. [2025-09-05T18:39:59.651292] [INFO ] [MAIN ] Update Progress: 1434/2363 symbols completed. MXF took 3.0s. Estimated remaining: 25m 52s. Rate: 35.9 symbols/min [2025-09-05T18:39:59.841664] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:39:59.841845] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-09-05T18:39:59.841990] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-05T18:39:59.842064] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-05T18:39:59.842116] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-05T18:39:59.868585] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-05T18:39:59.960078] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-05T18:40:00.229039] [INFO ] [REMOTE ] MYD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:40:00.663473] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-05T18:40:00.862675] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:40:00.866541] [INFO ] [REMOTE ] MUFG: Full fetch complete (57167 records). [2025-09-05T18:40:01.267366] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-05T18:40:01.388079] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-05T18:40:01.482525] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-05T18:40:01.574463] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-05T18:40:01.574658] [INFO ] [MAIN ] Update Progress: 1435/2363 symbols completed. MUFG took 41.6s. Estimated remaining: 25m 51s. Rate: 35.9 symbols/min [2025-09-05T18:40:01.768018] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:01.768253] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-09-05T18:40:01.768412] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-05T18:40:01.768455] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-05T18:40:01.768501] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-05T18:40:01.880813] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-05T18:40:02.171177] [INFO ] [REMOTE ] MYE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:40:02.263522] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-05T18:40:03.063505] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-05T18:40:03.384491] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-05T18:40:03.863467] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-05T18:40:04.648141] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-05T18:40:04.663454] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-05T18:40:04.682725] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-05T18:40:05.463515] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-05T18:40:05.687672] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-05T18:40:06.116170] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-05T18:40:06.263508] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-05T18:40:07.063516] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-05T18:40:07.344295] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-05T18:40:07.863480] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-05T18:40:08.322715] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-05T18:40:08.417172] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-05T18:40:08.663551] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-05T18:40:09.036755] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-05T18:40:09.463582] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-05T18:40:09.859472] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-05T18:40:10.263577] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-05T18:40:11.009201] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:40:11.010605] [INFO ] [REMOTE ] MVF: Full fetch complete (13784 records). [2025-09-05T18:40:11.071368] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-05T18:40:11.370004] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-05T18:40:11.426471] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-05T18:40:11.426623] [INFO ] [MAIN ] Update Progress: 1436/2363 symbols completed. MVF took 26.2s. Estimated remaining: 25m 54s. Rate: 35.8 symbols/min [2025-09-05T18:40:11.596340] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:11.606701] [INFO ] [MAIN ] MYI: Loaded 8716 existing records. [2025-09-05T18:40:11.782913] [INFO ] [MAIN ] MYI: Found 1 missing trading days. [2025-09-05T18:40:11.783102] [INFO ] [MAIN ] MYI: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:11.863417] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-05T18:40:12.658282] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-05T18:40:12.664762] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-05T18:40:13.296188] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:40:13.400096] [INFO ] [MAIN ] MYI: Adding 250 new records, updating 0 existing records. [2025-09-05T18:40:13.404488] [INFO ] [MAIN ] MYI: Combined dataset has 8966 total records. [2025-09-05T18:40:13.468788] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-05T18:40:13.687478] [WARN ] [VALIDATOR ] MYI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:14.011147] [WARN ] [VALIDATOR ] MYI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:14.011459] [INFO ] [MAIN ] MYI: Combined data validation passed. [2025-09-05T18:40:14.093832] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-05T18:40:14.088236] [INFO ] [MAIN ] MYI: Update completed successfully. [2025-09-05T18:40:14.098085] [INFO ] [MAIN ] Update Progress: 1437/2363 symbols completed. MYI took 2.7s. Estimated remaining: 25m 53s. Rate: 35.8 symbols/min [2025-09-05T18:40:14.263559] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-05T18:40:14.842584] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-05T18:40:14.861859] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-05T18:40:15.063496] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-05T18:40:15.863454] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-05T18:40:16.248787] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-05T18:40:16.484111] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:40:16.485168] [INFO ] [REMOTE ] MXE: Full fetch complete (1809 records). [2025-09-05T18:40:16.485904] [FATAL] [VALIDATOR ] MXE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:40:16.485996] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:40:16.486047] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:40:16.486113] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-05T18:40:16.486211] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-05T18:40:16.486399] [INFO ] [MAIN ] Update Progress: 1438/2363 symbols completed. MXE took 21.0s. Estimated remaining: 25m 52s. Rate: 35.8 symbols/min [2025-09-05T18:40:16.663491] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-05T18:40:17.463533] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-05T18:40:17.819844] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-05T18:40:18.263486] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-05T18:40:18.815787] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-05T18:40:19.063476] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-05T18:40:20.152606] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-05T18:40:20.157186] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-05T18:40:20.790973] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-05T18:40:20.796775] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-05T18:40:21.095184] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-05T18:40:21.319882] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:40:21.321481] [INFO ] [REMOTE ] MYE: Full fetch complete (27736 records). [2025-09-05T18:40:21.473668] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-05T18:40:21.689534] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-05T18:40:21.818679] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-05T18:40:21.818859] [INFO ] [MAIN ] Update Progress: 1439/2363 symbols completed. MYE took 20.2s. Estimated remaining: 25m 53s. Rate: 35.7 symbols/min [2025-09-05T18:40:22.149411] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-05T18:40:22.263558] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-05T18:40:22.861134] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-05T18:40:23.063569] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-05T18:40:23.614694] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-05T18:40:23.863516] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-05T18:40:24.483885] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:40:24.484941] [INFO ] [REMOTE ] MYD: Full fetch complete (15192 records). [2025-09-05T18:40:24.485402] [FATAL] [VALIDATOR ] MYD: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:40:24.485481] [FATAL] [MAIN ] MYD: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:40:24.485518] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:40:24.485567] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-05T18:40:24.485627] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-09-05T18:40:24.485744] [INFO ] [MAIN ] Update Progress: 1440/2363 symbols completed. MYD took 24.8s. Estimated remaining: 25m 52s. Rate: 35.7 symbols/min [2025-09-05T18:40:25.150812] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:25.154429] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:25.155201] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:25.176721] [WARN ] [MAIN ] MYN: No existing data found, performing full refresh instead. [2025-09-05T18:40:25.178052] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:25.178924] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-05T18:40:25.179015] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-05T18:40:25.179506] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-05T18:40:25.426671] [INFO ] [MAIN ] NAC: Loaded 18274 existing records. [2025-09-05T18:40:25.527423] [INFO ] [MAIN ] NABL: Loaded 18008 existing records. [2025-09-05T18:40:25.543091] [INFO ] [MAIN ] NAD: Loaded 16101 existing records. [2025-09-05T18:40:25.921789] [INFO ] [REMOTE ] MYN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:40:26.002109] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-05T18:40:26.102601] [INFO ] [MAIN ] NAD: Found 1 missing trading days. [2025-09-05T18:40:26.108564] [INFO ] [MAIN ] NAC: Found 1 missing trading days. [2025-09-05T18:40:26.130133] [INFO ] [MAIN ] NAD: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:26.135278] [INFO ] [MAIN ] NABL: Found 1 missing trading days. [2025-09-05T18:40:26.135496] [INFO ] [MAIN ] NABL: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:26.130909] [INFO ] [MAIN ] NAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:26.135847] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-05T18:40:26.263480] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-05T18:40:27.038125] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:40:27.063588] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-05T18:40:27.157950] [INFO ] [MAIN ] NABL: Adding 292 new records, updating 0 existing records. [2025-09-05T18:40:27.162107] [INFO ] [MAIN ] NABL: Combined dataset has 18300 total records. [2025-09-05T18:40:27.343334] [WARN ] [VALIDATOR ] NABL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:27.553657] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-05T18:40:27.620426] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-05T18:40:27.726080] [INFO ] [MAIN ] NAC: Adding 240 new records, updating 0 existing records. [2025-09-05T18:40:27.732297] [INFO ] [MAIN ] NAC: Combined dataset has 18514 total records. [2025-09-05T18:40:27.874753] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-05T18:40:27.911055] [WARN ] [VALIDATOR ] NAC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:40:28.103017] [WARN ] [VALIDATOR ] NABL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:28.103783] [INFO ] [MAIN ] NABL: Combined data validation passed. [2025-09-05T18:40:28.108797] [WARN ] [VALIDATOR ] NAC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:40:28.109009] [INFO ] [MAIN ] NAC: Combined data validation passed. [2025-09-05T18:40:28.321854] [INFO ] [MAIN ] NAC: Update completed successfully. [2025-09-05T18:40:28.325717] [INFO ] [MAIN ] Update Progress: 1441/2363 symbols completed. NAC took 3.8s. Estimated remaining: 25m 51s. Rate: 35.7 symbols/min [2025-09-05T18:40:28.417092] [INFO ] [MAIN ] NABL: Update completed successfully. [2025-09-05T18:40:28.437477] [INFO ] [MAIN ] Update Progress: 1442/2363 symbols completed. NABL took 4.0s. Estimated remaining: 25m 49s. Rate: 35.7 symbols/min [2025-09-05T18:40:28.595888] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T18:40:28.627425] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:28.792016] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:28.820767] [INFO ] [MAIN ] NAN: Loaded 3861 existing records. [2025-09-05T18:40:28.829336] [INFO ] [MAIN ] NAD: Adding 300 new records, updating 0 existing records. [2025-09-05T18:40:28.994202] [INFO ] [MAIN ] NAD: Combined dataset has 16401 total records. [2025-09-05T18:40:29.019712] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-05T18:40:29.021587] [INFO ] [MAIN ] NAN: Found 1 missing trading days. [2025-09-05T18:40:29.035765] [INFO ] [MAIN ] NAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:29.061959] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-05T18:40:29.068215] [INFO ] [MAIN ] NAT: Loaded 23082 existing records. [2025-09-05T18:40:29.370130] [WARN ] [VALIDATOR ] NAD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:29.480830] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-05T18:40:29.533659] [INFO ] [MAIN ] NAT: Found 1 missing trading days. [2025-09-05T18:40:29.558143] [INFO ] [MAIN ] NAT: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:29.652324] [WARN ] [VALIDATOR ] NAD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:29.652536] [INFO ] [MAIN ] NAD: Combined data validation passed. [2025-09-05T18:40:29.773746] [INFO ] [MAIN ] NAD: Update completed successfully. [2025-09-05T18:40:29.775993] [INFO ] [MAIN ] Update Progress: 1443/2363 symbols completed. NAD took 5.3s. Estimated remaining: 25m 47s. Rate: 35.7 symbols/min [2025-09-05T18:40:29.947662] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:29.970893] [INFO ] [MAIN ] NATL: Loaded 24513 existing records. [2025-09-05T18:40:30.146993] [INFO ] [MAIN ] NATL: Found 1 missing trading days. [2025-09-05T18:40:30.147134] [INFO ] [MAIN ] NATL: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:30.149810] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:40:30.174918] [INFO ] [MAIN ] NAN: Adding 64 new records, updating 0 existing records. [2025-09-05T18:40:30.176956] [INFO ] [MAIN ] NAN: Combined dataset has 3925 total records. [2025-09-05T18:40:30.265779] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-05T18:40:30.285548] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-05T18:40:30.370880] [WARN ] [VALIDATOR ] NAN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:30.556720] [WARN ] [VALIDATOR ] NAN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:30.556947] [INFO ] [MAIN ] NAN: Combined data validation passed. [2025-09-05T18:40:30.582776] [INFO ] [MAIN ] NAN: Update completed successfully. [2025-09-05T18:40:30.583403] [INFO ] [MAIN ] Update Progress: 1444/2363 symbols completed. NAN took 2.3s. Estimated remaining: 25m 44s. Rate: 35.7 symbols/min [2025-09-05T18:40:30.755517] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:30.759253] [INFO ] [MAIN ] NAZ: Loaded 1898 existing records. [2025-09-05T18:40:30.879212] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:40:30.997260] [INFO ] [MAIN ] NAZ: Found 1 missing trading days. [2025-09-05T18:40:31.007693] [INFO ] [MAIN ] NAZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:31.031058] [INFO ] [MAIN ] NATL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:40:31.032915] [INFO ] [MAIN ] NATL: Combined dataset has 24513 total records. [2025-09-05T18:40:31.033399] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:40:31.033490] [FATAL] [MAIN ] NATL: Combined data validation failed. [2025-09-05T18:40:31.033527] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:40:31.033566] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-05T18:40:31.034250] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-09-05T18:40:31.037353] [INFO ] [MAIN ] Update Progress: 1445/2363 symbols completed. NATL took 1.3s. Estimated remaining: 25m 42s. Rate: 35.7 symbols/min [2025-09-05T18:40:31.068716] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-05T18:40:31.217226] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:31.226498] [INFO ] [MAIN ] NBB: Loaded 6825 existing records. [2025-09-05T18:40:31.402564] [INFO ] [MAIN ] NBB: Found 1 missing trading days. [2025-09-05T18:40:31.402725] [INFO ] [MAIN ] NBB: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:31.863474] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-05T18:40:31.998099] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-05T18:40:32.663495] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-05T18:40:32.909380] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:40:32.944703] [INFO ] [MAIN ] NBB: Adding 81 new records, updating 0 existing records. [2025-09-05T18:40:32.946586] [INFO ] [MAIN ] NBB: Combined dataset has 6906 total records. [2025-09-05T18:40:33.125631] [WARN ] [VALIDATOR ] NBB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:40:33.315595] [WARN ] [VALIDATOR ] NBB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:40:33.315873] [INFO ] [MAIN ] NBB: Combined data validation passed. [2025-09-05T18:40:33.360036] [INFO ] [MAIN ] NBB: Update completed successfully. [2025-09-05T18:40:33.361189] [INFO ] [MAIN ] Update Progress: 1446/2363 symbols completed. NBB took 2.3s. Estimated remaining: 25m 41s. Rate: 35.7 symbols/min [2025-09-05T18:40:33.463532] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-05T18:40:33.508337] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:40:33.548363] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:33.552975] [INFO ] [MAIN ] NAZ: Adding 35 new records, updating 0 existing records. [2025-09-05T18:40:33.555056] [INFO ] [MAIN ] NAZ: Combined dataset has 1933 total records. [2025-09-05T18:40:33.724315] [INFO ] [MAIN ] NBHC: Loaded 10835 existing records. [2025-09-05T18:40:33.745719] [WARN ] [VALIDATOR ] NAZ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:40:34.102094] [INFO ] [MAIN ] NBHC: Found 1 missing trading days. [2025-09-05T18:40:34.102378] [INFO ] [MAIN ] NBHC: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:34.112842] [WARN ] [VALIDATOR ] NAZ: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:40:34.113077] [INFO ] [MAIN ] NAZ: Combined data validation passed. [2025-09-05T18:40:34.126177] [INFO ] [MAIN ] NAZ: Update completed successfully. [2025-09-05T18:40:34.126634] [INFO ] [MAIN ] Update Progress: 1447/2363 symbols completed. NAZ took 3.5s. Estimated remaining: 25m 38s. Rate: 35.7 symbols/min [2025-09-05T18:40:34.268410] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-05T18:40:34.299522] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:34.326558] [INFO ] [MAIN ] NBR: Loaded 26382 existing records. [2025-09-05T18:40:34.502764] [INFO ] [MAIN ] NBR: Found 1 missing trading days. [2025-09-05T18:40:34.503028] [INFO ] [MAIN ] NBR: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:34.509124] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-05T18:40:34.875120] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:40:34.927729] [INFO ] [MAIN ] NBHC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:40:34.929175] [INFO ] [MAIN ] NBHC: Combined dataset has 10835 total records. [2025-09-05T18:40:34.929591] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:40:34.929697] [FATAL] [MAIN ] NBHC: Combined data validation failed. [2025-09-05T18:40:34.929737] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:40:34.929779] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-05T18:40:34.930232] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-09-05T18:40:34.931891] [INFO ] [MAIN ] Update Progress: 1448/2363 symbols completed. NBHC took 1.6s. Estimated remaining: 25m 36s. Rate: 35.7 symbols/min [2025-09-05T18:40:35.068609] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-05T18:40:35.128308] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:35.146867] [INFO ] [MAIN ] NBXG: Loaded 16893 existing records. [2025-09-05T18:40:35.327102] [INFO ] [MAIN ] NBXG: Found 1 missing trading days. [2025-09-05T18:40:35.327361] [INFO ] [MAIN ] NBXG: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:35.863517] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-05T18:40:36.151391] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-05T18:40:36.663510] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-05T18:40:36.912035] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:40:36.971467] [INFO ] [MAIN ] NBXG: Adding 108 new records, updating 0 existing records. [2025-09-05T18:40:36.974897] [INFO ] [MAIN ] NBXG: Combined dataset has 17001 total records. [2025-09-05T18:40:37.162001] [WARN ] [VALIDATOR ] NBXG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:40:37.353592] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:40:37.463775] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-05T18:40:37.512005] [INFO ] [MAIN ] NAT: Adding 370 new records, updating 0 existing records. [2025-09-05T18:40:37.517413] [INFO ] [MAIN ] NAT: Combined dataset has 23452 total records. [2025-09-05T18:40:37.715192] [WARN ] [VALIDATOR ] NAT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:37.909934] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:40:37.999153] [INFO ] [MAIN ] NBR: Adding 0 new records, updating 0 existing records. [2025-09-05T18:40:38.002986] [INFO ] [MAIN ] NBR: Combined dataset has 26382 total records. [2025-09-05T18:40:38.003948] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:40:38.004242] [FATAL] [MAIN ] NBR: Combined data validation failed. [2025-09-05T18:40:38.004738] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:40:38.005177] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-05T18:40:38.005964] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-09-05T18:40:38.008764] [INFO ] [MAIN ] Update Progress: 1449/2363 symbols completed. NBR took 3.9s. Estimated remaining: 25m 35s. Rate: 35.7 symbols/min [2025-09-05T18:40:38.129520] [WARN ] [VALIDATOR ] NBXG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:40:38.161195] [INFO ] [MAIN ] NBXG: Combined data validation passed. [2025-09-05T18:40:38.186853] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:38.195429] [INFO ] [MAIN ] NC: Loaded 1487 existing records. [2025-09-05T18:40:38.195594] [WARN ] [VALIDATOR ] NAT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:38.195819] [INFO ] [MAIN ] NAT: Combined data validation passed. [2025-09-05T18:40:38.284206] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-05T18:40:38.557319] [INFO ] [MAIN ] NC: Found 1 missing trading days. [2025-09-05T18:40:38.558884] [INFO ] [MAIN ] NC: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:38.585813] [INFO ] [MAIN ] NBXG: Update completed successfully. [2025-09-05T18:40:38.588280] [INFO ] [MAIN ] Update Progress: 1450/2363 symbols completed. NBXG took 3.7s. Estimated remaining: 25m 33s. Rate: 35.7 symbols/min [2025-09-05T18:40:38.768999] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:38.769921] [WARN ] [MAIN ] NCA: No existing data found, performing full refresh instead. [2025-09-05T18:40:38.772087] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-05T18:40:38.772901] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-05T18:40:38.773243] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-05T18:40:39.070079] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-05T18:40:39.097500] [INFO ] [MAIN ] NAT: Update completed successfully. [2025-09-05T18:40:39.157504] [INFO ] [REMOTE ] NCA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:40:39.153402] [INFO ] [MAIN ] Update Progress: 1451/2363 symbols completed. NAT took 10.7s. Estimated remaining: 25m 31s. Rate: 35.7 symbols/min [2025-09-05T18:40:39.325802] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:39.342018] [INFO ] [MAIN ] NCDL: Loaded 15881 existing records. [2025-09-05T18:40:39.517461] [INFO ] [MAIN ] NCDL: Found 1 missing trading days. [2025-09-05T18:40:39.517632] [INFO ] [MAIN ] NCDL: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:39.525089] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-05T18:40:39.645045] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:40:39.651137] [INFO ] [MAIN ] NC: Adding 16 new records, updating 0 existing records. [2025-09-05T18:40:39.652492] [INFO ] [MAIN ] NC: Combined dataset has 1503 total records. [2025-09-05T18:40:39.840230] [WARN ] [VALIDATOR ] NC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:40:39.869203] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-05T18:40:40.028829] [WARN ] [VALIDATOR ] NC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:40:40.029052] [INFO ] [MAIN ] NC: Combined data validation passed. [2025-09-05T18:40:40.040295] [INFO ] [MAIN ] NC: Update completed successfully. [2025-09-05T18:40:40.040666] [INFO ] [MAIN ] Update Progress: 1452/2363 symbols completed. NC took 2.0s. Estimated remaining: 25m 29s. Rate: 35.8 symbols/min [2025-09-05T18:40:40.209629] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:40.209830] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-09-05T18:40:40.209950] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-05T18:40:40.209989] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-05T18:40:40.210034] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-05T18:40:40.578892] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:40:40.663483] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-05T18:40:41.081409] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-05T18:40:41.463480] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-05T18:40:42.040995] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-05T18:40:42.263468] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-05T18:40:42.920329] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-05T18:40:43.063452] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-05T18:40:43.190702] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:40:43.243302] [INFO ] [MAIN ] NCDL: Adding 76 new records, updating 0 existing records. [2025-09-05T18:40:43.245967] [INFO ] [MAIN ] NCDL: Combined dataset has 15957 total records. [2025-09-05T18:40:43.426176] [WARN ] [VALIDATOR ] NCDL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:40:43.618473] [WARN ] [VALIDATOR ] NCDL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:40:43.618704] [INFO ] [MAIN ] NCDL: Combined data validation passed. [2025-09-05T18:40:43.718404] [INFO ] [MAIN ] NCDL: Update completed successfully. [2025-09-05T18:40:43.720294] [INFO ] [MAIN ] Update Progress: 1453/2363 symbols completed. NCDL took 4.6s. Estimated remaining: 25m 28s. Rate: 35.7 symbols/min [2025-09-05T18:40:43.872867] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-05T18:40:43.893273] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:43.900991] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-05T18:40:43.910759] [INFO ] [MAIN ] NCV: Loaded 6197 existing records. [2025-09-05T18:40:44.081635] [INFO ] [MAIN ] NCV: Found 1 missing trading days. [2025-09-05T18:40:44.081806] [INFO ] [MAIN ] NCV: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:44.434038] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-05T18:40:44.663475] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-05T18:40:45.463467] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-05T18:40:45.694105] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:40:45.730931] [INFO ] [MAIN ] NCV: Adding 108 new records, updating 0 existing records. [2025-09-05T18:40:45.732966] [INFO ] [MAIN ] NCV: Combined dataset has 6305 total records. [2025-09-05T18:40:45.917373] [WARN ] [VALIDATOR ] NCV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:46.133083] [WARN ] [VALIDATOR ] NCV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:46.133302] [INFO ] [MAIN ] NCV: Combined data validation passed. [2025-09-05T18:40:46.176763] [INFO ] [MAIN ] NCV: Update completed successfully. [2025-09-05T18:40:46.177788] [INFO ] [MAIN ] Update Progress: 1454/2363 symbols completed. NCV took 2.5s. Estimated remaining: 25m 27s. Rate: 35.7 symbols/min [2025-09-05T18:40:46.268608] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-05T18:40:46.392995] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:46.401175] [INFO ] [MAIN ] NCZ: Loaded 5215 existing records. [2025-09-05T18:40:46.579722] [INFO ] [MAIN ] NCZ: Found 1 missing trading days. [2025-09-05T18:40:46.579890] [INFO ] [MAIN ] NCZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:46.589501] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-05T18:40:47.063470] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-05T18:40:47.863450] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-05T18:40:48.004515] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-05T18:40:48.480952] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-05T18:40:48.663512] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-05T18:40:49.022260] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:40:49.054113] [INFO ] [MAIN ] NCZ: Adding 82 new records, updating 0 existing records. [2025-09-05T18:40:49.056221] [INFO ] [MAIN ] NCZ: Combined dataset has 5297 total records. [2025-09-05T18:40:49.254960] [WARN ] [VALIDATOR ] NCZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:49.441536] [WARN ] [VALIDATOR ] NCZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:49.441774] [INFO ] [MAIN ] NCZ: Combined data validation passed. [2025-09-05T18:40:49.467198] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-05T18:40:49.477559] [INFO ] [MAIN ] NCZ: Update completed successfully. [2025-09-05T18:40:49.478417] [INFO ] [MAIN ] Update Progress: 1455/2363 symbols completed. NCZ took 3.3s. Estimated remaining: 25m 26s. Rate: 35.7 symbols/min [2025-09-05T18:40:49.647945] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:49.656732] [INFO ] [MAIN ] NDMO: Loaded 8047 existing records. [2025-09-05T18:40:49.827668] [INFO ] [MAIN ] NDMO: Found 1 missing trading days. [2025-09-05T18:40:49.827825] [INFO ] [MAIN ] NDMO: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:50.263495] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-05T18:40:50.374589] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:40:50.376164] [INFO ] [REMOTE ] MYN: Full fetch complete (11411 records). [2025-09-05T18:40:50.741464] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-05T18:40:50.817835] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-05T18:40:50.836800] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-05T18:40:50.836909] [INFO ] [MAIN ] Update Progress: 1456/2363 symbols completed. MYN took 26.4s. Estimated remaining: 25m 24s. Rate: 35.7 symbols/min [2025-09-05T18:40:51.007367] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:51.033263] [INFO ] [MAIN ] NE: Loaded 24909 existing records. [2025-09-05T18:40:51.064711] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-05T18:40:51.183271] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-05T18:40:51.221689] [INFO ] [MAIN ] NE: Found 1 missing trading days. [2025-09-05T18:40:51.221785] [INFO ] [MAIN ] NE: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:51.863465] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-05T18:40:52.490762] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:40:52.668525] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-05T18:40:52.731497] [INFO ] [MAIN ] NE: Adding 387 new records, updating 764 existing records. [2025-09-05T18:40:52.737136] [INFO ] [MAIN ] NE: Combined dataset has 25296 total records. [2025-09-05T18:40:52.915122] [WARN ] [VALIDATOR ] NE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:53.106811] [WARN ] [VALIDATOR ] NE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:53.107072] [INFO ] [MAIN ] NE: Combined data validation passed. [2025-09-05T18:40:53.266976] [INFO ] [MAIN ] NE: Update completed successfully. [2025-09-05T18:40:53.270137] [INFO ] [MAIN ] Update Progress: 1457/2363 symbols completed. NE took 2.4s. Estimated remaining: 25m 23s. Rate: 35.7 symbols/min [2025-09-05T18:40:53.447682] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:53.465394] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-05T18:40:53.501060] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-05T18:40:53.520766] [INFO ] [MAIN ] NEA: Loaded 16681 existing records. [2025-09-05T18:40:53.696982] [INFO ] [MAIN ] NEA: Found 1 missing trading days. [2025-09-05T18:40:53.697137] [INFO ] [MAIN ] NEA: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:53.817572] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:40:53.867192] [INFO ] [MAIN ] NDMO: Adding 143 new records, updating 0 existing records. [2025-09-05T18:40:53.869235] [INFO ] [MAIN ] NDMO: Combined dataset has 8190 total records. [2025-09-05T18:40:54.045906] [WARN ] [VALIDATOR ] NDMO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:54.245986] [WARN ] [VALIDATOR ] NDMO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:54.246238] [INFO ] [MAIN ] NDMO: Combined data validation passed. [2025-09-05T18:40:54.269534] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-05T18:40:54.304798] [INFO ] [MAIN ] NDMO: Update completed successfully. [2025-09-05T18:40:54.306350] [INFO ] [MAIN ] Update Progress: 1458/2363 symbols completed. NDMO took 4.8s. Estimated remaining: 25m 21s. Rate: 35.7 symbols/min [2025-09-05T18:40:54.451235] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-05T18:40:54.508325] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:54.508544] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-09-05T18:40:54.508700] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-05T18:40:54.508742] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-05T18:40:54.508811] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-05T18:40:54.886545] [INFO ] [REMOTE ] NEE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:40:55.063484] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-05T18:40:55.863563] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-05T18:40:56.206454] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-05T18:40:56.663502] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-05T18:40:56.803378] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-05T18:40:57.105983] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-05T18:40:57.463481] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-05T18:40:58.122005] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:40:58.123025] [INFO ] [REMOTE ] NCA: Full fetch complete (10956 records). [2025-09-05T18:40:58.279150] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-05T18:40:58.510713] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-05T18:40:58.517838] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-05T18:40:58.670106] [INFO ] [MAIN ] NEA: Adding 339 new records, updating 0 existing records. [2025-09-05T18:40:58.679478] [INFO ] [MAIN ] NEA: Combined dataset has 17020 total records. [2025-09-05T18:40:58.784735] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-05T18:40:58.787402] [INFO ] [MAIN ] Update Progress: 1459/2363 symbols completed. NCA took 20.2s. Estimated remaining: 25m 21s. Rate: 35.7 symbols/min [2025-09-05T18:40:58.967937] [WARN ] [VALIDATOR ] NEA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:40:59.070364] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-05T18:40:59.166260] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:59.270769] [INFO ] [MAIN ] NEM: Loaded 25689 existing records. [2025-09-05T18:40:59.449098] [INFO ] [MAIN ] NEM: Found 1 missing trading days. [2025-09-05T18:40:59.449353] [INFO ] [MAIN ] NEM: Need to fetch 1 months: 2025-09 [2025-09-05T18:40:59.452785] [WARN ] [VALIDATOR ] NEA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:40:59.452929] [INFO ] [MAIN ] NEA: Combined data validation passed. [2025-09-05T18:40:59.558005] [INFO ] [MAIN ] NEA: Update completed successfully. [2025-09-05T18:40:59.559982] [INFO ] [MAIN ] Update Progress: 1460/2363 symbols completed. NEA took 6.3s. Estimated remaining: 25m 19s. Rate: 35.7 symbols/min [2025-09-05T18:40:59.728376] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:40:59.756323] [INFO ] [MAIN ] NET: Loaded 25336 existing records. [2025-09-05T18:40:59.868612] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-05T18:40:59.932264] [INFO ] [MAIN ] NET: Found 1 missing trading days. [2025-09-05T18:40:59.932378] [INFO ] [MAIN ] NET: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:00.272796] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:41:00.520881] [INFO ] [MAIN ] NEM: Adding 390 new records, updating 780 existing records. [2025-09-05T18:41:00.527537] [INFO ] [MAIN ] NEM: Combined dataset has 26079 total records. [2025-09-05T18:41:00.675935] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-05T18:41:00.722993] [WARN ] [VALIDATOR ] NEM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:00.954758] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-05T18:41:00.975742] [WARN ] [VALIDATOR ] NEM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:00.976070] [INFO ] [MAIN ] NEM: Combined data validation passed. [2025-09-05T18:41:01.015154] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-05T18:41:01.184495] [INFO ] [MAIN ] NEM: Update completed successfully. [2025-09-05T18:41:01.187708] [INFO ] [MAIN ] Update Progress: 1461/2363 symbols completed. NEM took 2.4s. Estimated remaining: 25m 17s. Rate: 35.7 symbols/min [2025-09-05T18:41:01.358213] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:01.366494] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:41:01.412259] [INFO ] [MAIN ] NEU: Loaded 6776 existing records. [2025-09-05T18:41:01.467748] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-05T18:41:01.662552] [INFO ] [MAIN ] NET: Adding 356 new records, updating 0 existing records. [2025-09-05T18:41:01.709888] [INFO ] [MAIN ] NEU: Found 1 missing trading days. [2025-09-05T18:41:01.710826] [INFO ] [MAIN ] NEU: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:01.712404] [INFO ] [MAIN ] NET: Combined dataset has 25692 total records. [2025-09-05T18:41:01.886722] [WARN ] [VALIDATOR ] NET: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:02.085008] [WARN ] [VALIDATOR ] NET: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:02.085243] [INFO ] [MAIN ] NET: Combined data validation passed. [2025-09-05T18:41:02.246609] [INFO ] [MAIN ] NET: Update completed successfully. [2025-09-05T18:41:02.250188] [INFO ] [MAIN ] Update Progress: 1462/2363 symbols completed. NET took 2.7s. Estimated remaining: 25m 15s. Rate: 35.7 symbols/min [2025-09-05T18:41:02.271596] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-05T18:41:02.437685] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:02.441009] [INFO ] [MAIN ] NEUE: Loaded 1250 existing records. [2025-09-05T18:41:02.614126] [INFO ] [MAIN ] NEUE: Found 1 missing trading days. [2025-09-05T18:41:02.614282] [INFO ] [MAIN ] NEUE: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:03.063518] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-05T18:41:03.324255] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-05T18:41:03.356638] [INFO ] [MAIN ] NEU: Adding 58 new records, updating 0 existing records. [2025-09-05T18:41:03.358757] [INFO ] [MAIN ] NEU: Combined dataset has 6834 total records. [2025-09-05T18:41:03.535114] [WARN ] [VALIDATOR ] NEU: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:03.675262] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-05T18:41:03.782518] [WARN ] [VALIDATOR ] NEU: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:03.782748] [INFO ] [MAIN ] NEU: Combined data validation passed. [2025-09-05T18:41:03.831445] [INFO ] [MAIN ] NEU: Update completed successfully. [2025-09-05T18:41:03.832543] [INFO ] [MAIN ] Update Progress: 1463/2363 symbols completed. NEU took 2.6s. Estimated remaining: 25m 13s. Rate: 35.7 symbols/min [2025-09-05T18:41:03.868555] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-05T18:41:04.005698] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:04.009519] [INFO ] [MAIN ] NEXA: Loaded 2070 existing records. [2025-09-05T18:41:04.180697] [INFO ] [MAIN ] NEXA: Found 1 missing trading days. [2025-09-05T18:41:04.180849] [INFO ] [MAIN ] NEXA: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:04.663518] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-05T18:41:04.713884] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-05T18:41:04.923162] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-05T18:41:04.934997] [INFO ] [MAIN ] NEXA: Adding 41 new records, updating 0 existing records. [2025-09-05T18:41:04.936674] [INFO ] [MAIN ] NEXA: Combined dataset has 2111 total records. [2025-09-05T18:41:05.117106] [WARN ] [VALIDATOR ] NEXA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:05.303175] [WARN ] [VALIDATOR ] NEXA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:05.303413] [INFO ] [MAIN ] NEXA: Combined data validation passed. [2025-09-05T18:41:05.316707] [INFO ] [MAIN ] NEXA: Update completed successfully. [2025-09-05T18:41:05.317111] [INFO ] [MAIN ] Update Progress: 1464/2363 symbols completed. NEXA took 1.5s. Estimated remaining: 25m 12s. Rate: 35.7 symbols/min [2025-09-05T18:41:05.471679] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-05T18:41:05.489163] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:05.521958] [INFO ] [MAIN ] NFG: Loaded 29008 existing records. [2025-09-05T18:41:05.699712] [INFO ] [MAIN ] NFG: Found 1 missing trading days. [2025-09-05T18:41:05.699852] [INFO ] [MAIN ] NFG: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:06.098993] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-05T18:41:06.263455] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-05T18:41:07.063439] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-05T18:41:07.654810] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-05T18:41:07.768682] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:41:07.772498] [INFO ] [MAIN ] NEUE: Adding 1 new records, updating 0 existing records. [2025-09-05T18:41:07.773916] [INFO ] [MAIN ] NEUE: Combined dataset has 1251 total records. [2025-09-05T18:41:07.873160] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-05T18:41:07.956118] [WARN ] [VALIDATOR ] NEUE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:08.199511] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-05T18:41:08.197816] [WARN ] [VALIDATOR ] NEUE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:08.199837] [INFO ] [MAIN ] NEUE: Combined data validation passed. [2025-09-05T18:41:08.218981] [INFO ] [MAIN ] NEUE: Update completed successfully. [2025-09-05T18:41:08.219307] [INFO ] [MAIN ] Update Progress: 1465/2363 symbols completed. NEUE took 6.0s. Estimated remaining: 25m 11s. Rate: 35.7 symbols/min [2025-09-05T18:41:08.391271] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:08.406672] [INFO ] [MAIN ] NFJ: Loaded 9627 existing records. [2025-09-05T18:41:08.578488] [INFO ] [MAIN ] NFJ: Found 1 missing trading days. [2025-09-05T18:41:08.578672] [INFO ] [MAIN ] NFJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:08.586738] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:41:08.591036] [INFO ] [REMOTE ] NCLH: Full fetch complete (58433 records). [2025-09-05T18:41:08.668577] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-05T18:41:09.016570] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-05T18:41:09.127633] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:41:09.267165] [INFO ] [MAIN ] NFG: Adding 276 new records, updating 0 existing records. [2025-09-05T18:41:09.281162] [INFO ] [MAIN ] NFG: Combined dataset has 29284 total records. [2025-09-05T18:41:09.469068] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-05T18:41:09.475637] [WARN ] [VALIDATOR ] NFG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:09.800980] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-05T18:41:09.801369] [INFO ] [MAIN ] Update Progress: 1466/2363 symbols completed. NCLH took 29.8s. Estimated remaining: 25m 9s. Rate: 35.7 symbols/min [2025-09-05T18:41:09.978751] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:09.984229] [WARN ] [VALIDATOR ] NFG: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:09.984483] [INFO ] [MAIN ] NFG: Combined data validation passed. [2025-09-05T18:41:10.068769] [INFO ] [MAIN ] NGG: Loaded 22172 existing records. [2025-09-05T18:41:10.288024] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-05T18:41:10.294945] [INFO ] [MAIN ] NGG: Found 1 missing trading days. [2025-09-05T18:41:10.300686] [INFO ] [MAIN ] NGG: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:10.374623] [INFO ] [MAIN ] NFG: Update completed successfully. [2025-09-05T18:41:10.378146] [INFO ] [MAIN ] Update Progress: 1467/2363 symbols completed. NFG took 5.1s. Estimated remaining: 25m 6s. Rate: 35.7 symbols/min [2025-09-05T18:41:10.564047] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:10.580409] [INFO ] [MAIN ] NGL: Loaded 16430 existing records. [2025-09-05T18:41:10.759169] [INFO ] [MAIN ] NGL: Found 1 missing trading days. [2025-09-05T18:41:10.759383] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:41:10.759614] [INFO ] [MAIN ] NGL: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:10.807824] [INFO ] [MAIN ] NFJ: Adding 64 new records, updating 0 existing records. [2025-09-05T18:41:10.810170] [INFO ] [MAIN ] NFJ: Combined dataset has 9691 total records. [2025-09-05T18:41:10.985980] [WARN ] [VALIDATOR ] NFJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:11.068575] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-05T18:41:11.175779] [WARN ] [VALIDATOR ] NFJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:11.176016] [INFO ] [MAIN ] NFJ: Combined data validation passed. [2025-09-05T18:41:11.238409] [INFO ] [MAIN ] NFJ: Update completed successfully. [2025-09-05T18:41:11.239597] [INFO ] [MAIN ] Update Progress: 1468/2363 symbols completed. NFJ took 3.0s. Estimated remaining: 25m 4s. Rate: 35.7 symbols/min [2025-09-05T18:41:11.415425] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:11.426253] [INFO ] [MAIN ] NGS: Loaded 8649 existing records. [2025-09-05T18:41:11.606938] [INFO ] [MAIN ] NGS: Found 1 missing trading days. [2025-09-05T18:41:11.607123] [INFO ] [MAIN ] NGS: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:11.863481] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-05T18:41:11.997515] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:41:12.148593] [INFO ] [MAIN ] NGG: Adding 327 new records, updating 0 existing records. [2025-09-05T18:41:12.152214] [INFO ] [MAIN ] NGG: Combined dataset has 22499 total records. [2025-09-05T18:41:12.347703] [WARN ] [VALIDATOR ] NGG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:12.567631] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:41:12.696093] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-05T18:41:12.716989] [INFO ] [MAIN ] NGL: Adding 350 new records, updating 0 existing records. [2025-09-05T18:41:12.720579] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-05T18:41:12.738332] [INFO ] [MAIN ] NGL: Combined dataset has 16780 total records. [2025-09-05T18:41:12.922314] [WARN ] [VALIDATOR ] NGL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:13.126428] [WARN ] [VALIDATOR ] NGG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:13.126816] [INFO ] [MAIN ] NGG: Combined data validation passed. [2025-09-05T18:41:13.131835] [WARN ] [VALIDATOR ] NGL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:13.131995] [INFO ] [MAIN ] NGL: Combined data validation passed. [2025-09-05T18:41:13.292322] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:41:13.335892] [INFO ] [MAIN ] NGS: Adding 0 new records, updating 0 existing records. [2025-09-05T18:41:13.347273] [INFO ] [MAIN ] NGS: Combined dataset has 8649 total records. [2025-09-05T18:41:13.350622] [FATAL] [VALIDATOR ] NGS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:41:13.353748] [FATAL] [MAIN ] NGS: Combined data validation failed. [2025-09-05T18:41:13.355722] [WARN ] [MAIN ] NGS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:41:13.357792] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-05T18:41:13.362099] [INFO ] [LOCAL ] NGS: Starting deletion of derivative data. [2025-09-05T18:41:13.364957] [INFO ] [MAIN ] Update Progress: 1469/2363 symbols completed. NGS took 2.1s. Estimated remaining: 25m 3s. Rate: 35.7 symbols/min [2025-09-05T18:41:13.479962] [INFO ] [MAIN ] NGL: Update completed successfully. [2025-09-05T18:41:13.479855] [INFO ] [MAIN ] NGG: Update completed successfully. [2025-09-05T18:41:13.479902] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-05T18:41:13.486921] [INFO ] [MAIN ] Update Progress: 1470/2363 symbols completed. NGL took 3.1s. Estimated remaining: 25m 0s. Rate: 35.7 symbols/min [2025-09-05T18:41:13.521912] [INFO ] [MAIN ] Update Progress: 1471/2363 symbols completed. NGG took 3.7s. Estimated remaining: 24m 58s. Rate: 35.7 symbols/min [2025-09-05T18:41:13.811502] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:13.947462] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:13.966736] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:13.967022] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-09-05T18:41:13.972145] [INFO ] [MAIN ] NGVC: Loaded 11520 existing records. [2025-09-05T18:41:13.971792] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-05T18:41:13.983843] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-05T18:41:14.022731] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-05T18:41:14.200942] [INFO ] [MAIN ] NGVT: Loaded 11243 existing records. [2025-09-05T18:41:14.301169] [INFO ] [MAIN ] NGVC: Found 1 missing trading days. [2025-09-05T18:41:14.354423] [INFO ] [MAIN ] NGVC: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:14.420263] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-05T18:41:14.605256] [INFO ] [MAIN ] NGVT: Found 1 missing trading days. [2025-09-05T18:41:14.636235] [INFO ] [MAIN ] NGVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:14.718359] [INFO ] [REMOTE ] NHI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:41:15.008724] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:41:15.066865] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-05T18:41:15.066811] [INFO ] [MAIN ] NGVC: Adding 158 new records, updating 0 existing records. [2025-09-05T18:41:15.069990] [INFO ] [MAIN ] NGVC: Combined dataset has 11678 total records. [2025-09-05T18:41:15.251930] [WARN ] [VALIDATOR ] NGVC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:15.441382] [WARN ] [VALIDATOR ] NGVC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:15.441579] [INFO ] [MAIN ] NGVC: Combined data validation passed. [2025-09-05T18:41:15.511578] [INFO ] [MAIN ] NGVC: Update completed successfully. [2025-09-05T18:41:15.513099] [INFO ] [MAIN ] Update Progress: 1472/2363 symbols completed. NGVC took 2.1s. Estimated remaining: 24m 56s. Rate: 35.7 symbols/min [2025-09-05T18:41:15.682432] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:15.726763] [INFO ] [MAIN ] NI: Loaded 40196 existing records. [2025-09-05T18:41:15.871033] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-05T18:41:15.912879] [INFO ] [MAIN ] NI: Found 1 missing trading days. [2025-09-05T18:41:15.913076] [INFO ] [MAIN ] NI: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:15.998829] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-05T18:41:16.023567] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-05T18:41:16.404955] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:41:16.468547] [INFO ] [MAIN ] NGVT: Adding 168 new records, updating 0 existing records. [2025-09-05T18:41:16.470826] [INFO ] [MAIN ] NGVT: Combined dataset has 11411 total records. [2025-09-05T18:41:16.649133] [WARN ] [VALIDATOR ] NGVT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:16.669366] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-05T18:41:16.842108] [WARN ] [VALIDATOR ] NGVT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:16.842457] [INFO ] [MAIN ] NGVT: Combined data validation passed. [2025-09-05T18:41:16.911013] [INFO ] [MAIN ] NGVT: Update completed successfully. [2025-09-05T18:41:16.912405] [INFO ] [MAIN ] Update Progress: 1473/2363 symbols completed. NGVT took 3.4s. Estimated remaining: 24m 54s. Rate: 35.7 symbols/min [2025-09-05T18:41:17.085407] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:17.091415] [INFO ] [MAIN ] NIC: Loaded 4637 existing records. [2025-09-05T18:41:17.264516] [INFO ] [MAIN ] NIC: Found 1 missing trading days. [2025-09-05T18:41:17.264737] [INFO ] [MAIN ] NIC: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:17.463488] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-05T18:41:17.946235] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-05T18:41:18.210889] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:41:18.228704] [INFO ] [MAIN ] NIC: Adding 47 new records, updating 0 existing records. [2025-09-05T18:41:18.230141] [INFO ] [MAIN ] NIC: Combined dataset has 4684 total records. [2025-09-05T18:41:18.268636] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-05T18:41:18.429266] [WARN ] [VALIDATOR ] NIC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:18.632625] [WARN ] [VALIDATOR ] NIC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:18.632852] [INFO ] [MAIN ] NIC: Combined data validation passed. [2025-09-05T18:41:18.662962] [INFO ] [MAIN ] NIC: Update completed successfully. [2025-09-05T18:41:18.663694] [INFO ] [MAIN ] Update Progress: 1474/2363 symbols completed. NIC took 1.8s. Estimated remaining: 24m 53s. Rate: 35.7 symbols/min [2025-09-05T18:41:18.835718] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:18.842904] [INFO ] [MAIN ] NIE: Loaded 5626 existing records. [2025-09-05T18:41:19.016422] [INFO ] [MAIN ] NIE: Found 1 missing trading days. [2025-09-05T18:41:19.016611] [INFO ] [MAIN ] NIE: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:19.063521] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-05T18:41:19.863552] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-05T18:41:20.222328] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-05T18:41:20.419855] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:41:20.446823] [INFO ] [MAIN ] NIE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:41:20.448557] [INFO ] [MAIN ] NIE: Combined dataset has 5626 total records. [2025-09-05T18:41:20.449066] [FATAL] [VALIDATOR ] NIE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:41:20.449191] [FATAL] [MAIN ] NIE: Combined data validation failed. [2025-09-05T18:41:20.449240] [WARN ] [MAIN ] NIE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:41:20.449289] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-05T18:41:20.449766] [INFO ] [LOCAL ] NIE: Starting deletion of derivative data. [2025-09-05T18:41:20.450802] [INFO ] [MAIN ] Update Progress: 1475/2363 symbols completed. NIE took 1.8s. Estimated remaining: 24m 51s. Rate: 35.7 symbols/min [2025-09-05T18:41:20.631053] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:20.635334] [INFO ] [MAIN ] NIM: Loaded 1718 existing records. [2025-09-05T18:41:20.668571] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-05T18:41:20.828466] [INFO ] [MAIN ] NIM: Found 1 missing trading days. [2025-09-05T18:41:20.828822] [INFO ] [MAIN ] NIM: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:20.876579] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-05T18:41:21.463494] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-05T18:41:21.961206] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-05T18:41:22.263490] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-05T18:41:22.889418] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:41:22.892453] [INFO ] [REMOTE ] NEE: Full fetch complete (58387 records). [2025-09-05T18:41:22.973360] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-05T18:41:23.009042] [INFO ] [MAIN ] NIM: Adding 12 new records, updating 0 existing records. [2025-09-05T18:41:23.021686] [INFO ] [MAIN ] NIM: Combined dataset has 1730 total records. [2025-09-05T18:41:23.064023] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-05T18:41:23.423705] [WARN ] [VALIDATOR ] NIM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:23.628420] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-05T18:41:23.908524] [WARN ] [VALIDATOR ] NIM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:23.908364] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-05T18:41:23.918109] [INFO ] [MAIN ] NIM: Combined data validation passed. [2025-09-05T18:41:23.963882] [INFO ] [MAIN ] NIM: Update completed successfully. [2025-09-05T18:41:23.973692] [INFO ] [MAIN ] Update Progress: 1476/2363 symbols completed. NIM took 3.5s. Estimated remaining: 24m 50s. Rate: 35.7 symbols/min [2025-09-05T18:41:24.179500] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:24.186061] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-05T18:41:24.186678] [INFO ] [MAIN ] Update Progress: 1477/2363 symbols completed. NEE took 29.9s. Estimated remaining: 24m 48s. Rate: 35.7 symbols/min [2025-09-05T18:41:24.202723] [INFO ] [MAIN ] NINE: Loaded 14475 existing records. [2025-09-05T18:41:24.380081] [INFO ] [MAIN ] NINE: Found 1 missing trading days. [2025-09-05T18:41:24.380287] [INFO ] [MAIN ] NINE: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:24.387986] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:41:24.556513] [INFO ] [MAIN ] NI: Adding 390 new records, updating 0 existing records. [2025-09-05T18:41:24.575354] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-05T18:41:24.586759] [INFO ] [MAIN ] NI: Combined dataset has 40586 total records. [2025-09-05T18:41:24.668561] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-05T18:41:24.774524] [WARN ] [VALIDATOR ] NI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:24.974956] [WARN ] [VALIDATOR ] NI: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:24.975174] [INFO ] [MAIN ] NI: Combined data validation passed. [2025-09-05T18:41:25.245855] [INFO ] [MAIN ] NI: Update completed successfully. [2025-09-05T18:41:25.250662] [INFO ] [MAIN ] Update Progress: 1478/2363 symbols completed. NI took 9.7s. Estimated remaining: 24m 46s. Rate: 35.7 symbols/min [2025-09-05T18:41:25.463899] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-05T18:41:25.637551] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-05T18:41:25.949598] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:41:26.012488] [INFO ] [MAIN ] NINE: Adding 172 new records, updating 0 existing records. [2025-09-05T18:41:26.014974] [INFO ] [MAIN ] NINE: Combined dataset has 14647 total records. [2025-09-05T18:41:26.200456] [WARN ] [VALIDATOR ] NINE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:26.270747] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-05T18:41:26.400456] [WARN ] [VALIDATOR ] NINE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:26.400721] [INFO ] [MAIN ] NINE: Combined data validation passed. [2025-09-05T18:41:26.489912] [INFO ] [MAIN ] NINE: Update completed successfully. [2025-09-05T18:41:26.491808] [INFO ] [MAIN ] Update Progress: 1479/2363 symbols completed. NINE took 2.5s. Estimated remaining: 24m 44s. Rate: 35.7 symbols/min [2025-09-05T18:41:27.732355] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-05T18:41:27.738001] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-05T18:41:28.734873] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-05T18:41:28.740551] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-05T18:41:29.487678] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:41:29.489840] [INFO ] [REMOTE ] NHI: Full fetch complete (23901 records). [2025-09-05T18:41:30.023597] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-05T18:41:30.149223] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-05T18:41:30.149377] [INFO ] [MAIN ] Update Progress: 1480/2363 symbols completed. NHI took 16.6s. Estimated remaining: 24m 43s. Rate: 35.7 symbols/min [2025-09-05T18:41:30.766235] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:30.808465] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:30.906928] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:30.911272] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:30.930443] [INFO ] [MAIN ] NJR: Loaded 18091 existing records. [2025-09-05T18:41:31.016850] [INFO ] [MAIN ] NIQ: Loaded 10901 existing records. [2025-09-05T18:41:31.051382] [INFO ] [MAIN ] NIO: Loaded 25782 existing records. [2025-09-05T18:41:31.286267] [INFO ] [MAIN ] NKE: Loaded 25407 existing records. [2025-09-05T18:41:31.372392] [INFO ] [MAIN ] NJR: Found 1 missing trading days. [2025-09-05T18:41:31.428396] [INFO ] [MAIN ] NJR: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:31.580370] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-05T18:41:31.599284] [INFO ] [MAIN ] NIQ: Found 1 missing trading days. [2025-09-05T18:41:31.635187] [INFO ] [MAIN ] NIQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:31.677242] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-05T18:41:31.740632] [INFO ] [MAIN ] NIO: Found 1 missing trading days. [2025-09-05T18:41:31.749661] [INFO ] [MAIN ] NKE: Found 1 missing trading days. [2025-09-05T18:41:31.743172] [INFO ] [MAIN ] NIO: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:31.749953] [INFO ] [MAIN ] NKE: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:31.750309] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-05T18:41:31.750522] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-05T18:41:32.078841] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-05T18:41:32.228039] [INFO ] [MAIN ] NIO: Adding 390 new records, updating 0 existing records. [2025-09-05T18:41:32.231488] [INFO ] [MAIN ] NIO: Combined dataset has 26172 total records. [2025-09-05T18:41:32.348236] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:41:32.491590] [WARN ] [VALIDATOR ] NIO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:32.589551] [INFO ] [MAIN ] NJR: Adding 271 new records, updating 0 existing records. [2025-09-05T18:41:32.705578] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:41:32.793789] [INFO ] [MAIN ] NJR: Combined dataset has 18362 total records. [2025-09-05T18:41:33.116290] [INFO ] [MAIN ] NKE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:41:33.115552] [WARN ] [VALIDATOR ] NJR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:33.241744] [INFO ] [MAIN ] NKE: Combined dataset has 25797 total records. [2025-09-05T18:41:33.510208] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-05T18:41:33.531736] [WARN ] [VALIDATOR ] NKE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:33.754077] [INFO ] [MAIN ] NIQ: Adding 248 new records, updating 0 existing records. [2025-09-05T18:41:33.837311] [WARN ] [VALIDATOR ] NIO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:33.844521] [WARN ] [VALIDATOR ] NJR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:33.844830] [INFO ] [MAIN ] NJR: Combined data validation passed. [2025-09-05T18:41:33.845148] [INFO ] [MAIN ] NIO: Combined data validation passed. [2025-09-05T18:41:33.847003] [INFO ] [MAIN ] NIQ: Combined dataset has 11149 total records. [2025-09-05T18:41:34.215062] [WARN ] [VALIDATOR ] NIQ: Not fatal, but first date in data (2025-07-23) does not match expected start date (2025-01-31) [2025-09-05T18:41:34.501079] [INFO ] [MAIN ] NJR: Update completed successfully. [2025-09-05T18:41:34.504007] [INFO ] [MAIN ] Update Progress: 1481/2363 symbols completed. NJR took 4.4s. Estimated remaining: 24m 43s. Rate: 35.7 symbols/min [2025-09-05T18:41:34.657840] [INFO ] [MAIN ] NIO: Update completed successfully. [2025-09-05T18:41:34.688931] [INFO ] [MAIN ] Update Progress: 1482/2363 symbols completed. NIO took 4.5s. Estimated remaining: 24m 41s. Rate: 35.7 symbols/min [2025-09-05T18:41:34.708125] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:34.730113] [WARN ] [VALIDATOR ] NKE: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-08-21 [2025-09-05T18:41:34.744470] [INFO ] [MAIN ] NKE: Combined data validation passed. [2025-09-05T18:41:34.739198] [WARN ] [VALIDATOR ] NIQ: Missing days changed. Total missing: 118 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22 [2025-09-05T18:41:34.744845] [INFO ] [MAIN ] NIQ: Combined data validation passed. [2025-09-05T18:41:34.981213] [INFO ] [MAIN ] NKX: Loaded 10350 existing records. [2025-09-05T18:41:35.082257] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:35.170404] [INFO ] [MAIN ] NL: Loaded 2609 existing records. [2025-09-05T18:41:35.293857] [INFO ] [MAIN ] NKX: Found 1 missing trading days. [2025-09-05T18:41:35.316418] [INFO ] [MAIN ] NKX: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:35.329078] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-05T18:41:35.450356] [INFO ] [MAIN ] NL: Found 1 missing trading days. [2025-09-05T18:41:35.451299] [INFO ] [MAIN ] NL: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:35.452431] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-05T18:41:35.461377] [INFO ] [MAIN ] NIQ: Update completed successfully. [2025-09-05T18:41:35.463629] [INFO ] [MAIN ] Update Progress: 1483/2363 symbols completed. NIQ took 5.3s. Estimated remaining: 24m 39s. Rate: 35.7 symbols/min [2025-09-05T18:41:35.649420] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:35.703125] [INFO ] [MAIN ] NLOP: Loaded 8727 existing records. [2025-09-05T18:41:35.795628] [INFO ] [MAIN ] NKE: Update completed successfully. [2025-09-05T18:41:35.808529] [INFO ] [MAIN ] Update Progress: 1484/2363 symbols completed. NKE took 5.7s. Estimated remaining: 24m 36s. Rate: 35.7 symbols/min [2025-09-05T18:41:35.997179] [INFO ] [MAIN ] NLOP: Found 1 missing trading days. [2025-09-05T18:41:35.999311] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:41:36.009751] [INFO ] [MAIN ] NLOP: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:36.080920] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:36.055984] [INFO ] [MAIN ] NL: Adding 17 new records, updating 0 existing records. [2025-09-05T18:41:36.081277] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-05T18:41:36.081768] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-09-05T18:41:36.082717] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-05T18:41:36.082778] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-05T18:41:36.083835] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-05T18:41:36.095153] [INFO ] [MAIN ] NL: Combined dataset has 2626 total records. [2025-09-05T18:41:36.527318] [WARN ] [VALIDATOR ] NL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:36.625491] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:41:36.795240] [INFO ] [REMOTE ] NLY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:41:36.823517] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-05T18:41:36.823108] [INFO ] [MAIN ] NKX: Adding 75 new records, updating 0 existing records. [2025-09-05T18:41:36.906013] [INFO ] [MAIN ] NKX: Combined dataset has 10425 total records. [2025-09-05T18:41:37.101402] [WARN ] [VALIDATOR ] NKX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:37.101618] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:41:37.225664] [INFO ] [MAIN ] NLOP: Adding 71 new records, updating 0 existing records. [2025-09-05T18:41:37.295962] [INFO ] [MAIN ] NLOP: Combined dataset has 8798 total records. [2025-09-05T18:41:37.535499] [WARN ] [VALIDATOR ] NLOP: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:37.744462] [WARN ] [VALIDATOR ] NL: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-08-21 [2025-09-05T18:41:37.743688] [WARN ] [VALIDATOR ] NKX: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:37.744877] [INFO ] [MAIN ] NL: Combined data validation passed. [2025-09-05T18:41:37.744993] [INFO ] [MAIN ] NKX: Combined data validation passed. [2025-09-05T18:41:37.814742] [INFO ] [MAIN ] NL: Update completed successfully. [2025-09-05T18:41:37.820311] [INFO ] [MAIN ] Update Progress: 1485/2363 symbols completed. NL took 3.1s. Estimated remaining: 24m 35s. Rate: 35.7 symbols/min [2025-09-05T18:41:37.941681] [INFO ] [MAIN ] NKX: Update completed successfully. [2025-09-05T18:41:37.953867] [INFO ] [MAIN ] Update Progress: 1486/2363 symbols completed. NKX took 3.4s. Estimated remaining: 24m 32s. Rate: 35.7 symbols/min [2025-09-05T18:41:38.072395] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:38.163367] [INFO ] [MAIN ] NMAI: Loaded 6590 existing records. [2025-09-05T18:41:38.222132] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:38.328934] [WARN ] [VALIDATOR ] NLOP: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:38.329151] [INFO ] [MAIN ] NLOP: Combined data validation passed. [2025-09-05T18:41:38.412187] [INFO ] [MAIN ] NMAI: Found 1 missing trading days. [2025-09-05T18:41:38.412604] [INFO ] [MAIN ] NMAI: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:38.412940] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-05T18:41:38.475037] [INFO ] [MAIN ] NMAX: Loaded 21168 existing records. [2025-09-05T18:41:38.599472] [INFO ] [MAIN ] NLOP: Update completed successfully. [2025-09-05T18:41:38.621811] [INFO ] [MAIN ] Update Progress: 1487/2363 symbols completed. NLOP took 3.2s. Estimated remaining: 24m 30s. Rate: 35.8 symbols/min [2025-09-05T18:41:38.679729] [INFO ] [MAIN ] NMAX: Found 1 missing trading days. [2025-09-05T18:41:38.725203] [INFO ] [MAIN ] NMAX: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:38.760858] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-05T18:41:38.863360] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:38.904196] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-05T18:41:38.915148] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-05T18:41:38.921259] [INFO ] [MAIN ] NMCO: Loaded 13065 existing records. [2025-09-05T18:41:39.097184] [INFO ] [MAIN ] NMCO: Found 1 missing trading days. [2025-09-05T18:41:39.097332] [INFO ] [MAIN ] NMCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:39.097554] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-05T18:41:39.389514] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:41:39.432083] [INFO ] [MAIN ] NMAI: Adding 102 new records, updating 0 existing records. [2025-09-05T18:41:39.435211] [INFO ] [MAIN ] NMAI: Combined dataset has 6692 total records. [2025-09-05T18:41:39.631797] [WARN ] [VALIDATOR ] NMAI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:39.827111] [WARN ] [VALIDATOR ] NMAI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:39.827348] [INFO ] [MAIN ] NMAI: Combined data validation passed. [2025-09-05T18:41:39.872256] [INFO ] [MAIN ] NMAI: Update completed successfully. [2025-09-05T18:41:39.873464] [INFO ] [MAIN ] Update Progress: 1488/2363 symbols completed. NMAI took 2.1s. Estimated remaining: 24m 28s. Rate: 35.8 symbols/min [2025-09-05T18:41:40.051368] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:40.058882] [INFO ] [MAIN ] NMG: Loaded 3971 existing records. [2025-09-05T18:41:40.251401] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:41:40.278073] [INFO ] [MAIN ] NMG: Found 1 missing trading days. [2025-09-05T18:41:40.303379] [INFO ] [MAIN ] NMG: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:40.303926] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-05T18:41:40.362815] [INFO ] [MAIN ] NMCO: Adding 130 new records, updating 0 existing records. [2025-09-05T18:41:40.367095] [INFO ] [MAIN ] NMCO: Combined dataset has 13195 total records. [2025-09-05T18:41:40.582624] [WARN ] [VALIDATOR ] NMCO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:40.684990] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:41:40.730178] [INFO ] [MAIN ] NMG: Adding 0 new records, updating 0 existing records. [2025-09-05T18:41:40.747875] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-05T18:41:40.747984] [INFO ] [MAIN ] NMG: Combined dataset has 3971 total records. [2025-09-05T18:41:40.763745] [FATAL] [VALIDATOR ] NMG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:41:40.798005] [FATAL] [MAIN ] NMG: Combined data validation failed. [2025-09-05T18:41:40.851210] [WARN ] [MAIN ] NMG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:41:40.890427] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-05T18:41:40.972832] [INFO ] [LOCAL ] NMG: Starting deletion of derivative data. [2025-09-05T18:41:40.972400] [INFO ] [MAIN ] NMAX: Adding 282 new records, updating 0 existing records. [2025-09-05T18:41:40.974890] [INFO ] [MAIN ] Update Progress: 1489/2363 symbols completed. NMG took 1.1s. Estimated remaining: 24m 26s. Rate: 35.8 symbols/min [2025-09-05T18:41:41.072357] [INFO ] [MAIN ] NMAX: Combined dataset has 21450 total records. [2025-09-05T18:41:41.301297] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:41.307659] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-05T18:41:41.307817] [WARN ] [MAIN ] NMI: No existing data found, performing full refresh instead. [2025-09-05T18:41:41.344545] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-05T18:41:41.359740] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-05T18:41:41.360090] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-05T18:41:41.360293] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-05T18:41:41.419374] [WARN ] [VALIDATOR ] NMAX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:41.987375] [INFO ] [REMOTE ] NMI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:41:41.987986] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-05T18:41:41.997439] [WARN ] [VALIDATOR ] NMCO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:41.997849] [INFO ] [MAIN ] NMCO: Combined data validation passed. [2025-09-05T18:41:42.062776] [WARN ] [VALIDATOR ] NMAX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:42.066905] [INFO ] [MAIN ] NMAX: Combined data validation passed. [2025-09-05T18:41:42.176980] [INFO ] [MAIN ] NMCO: Update completed successfully. [2025-09-05T18:41:42.184245] [INFO ] [MAIN ] Update Progress: 1490/2363 symbols completed. NMCO took 3.5s. Estimated remaining: 24m 24s. Rate: 35.8 symbols/min [2025-09-05T18:41:42.391003] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:42.392405] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-09-05T18:41:42.395338] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-05T18:41:42.397413] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-05T18:41:42.402817] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-05T18:41:42.523310] [INFO ] [MAIN ] NMAX: Update completed successfully. [2025-09-05T18:41:42.541423] [INFO ] [MAIN ] Update Progress: 1491/2363 symbols completed. NMAX took 4.6s. Estimated remaining: 24m 21s. Rate: 35.8 symbols/min [2025-09-05T18:41:42.949449] [INFO ] [REMOTE ] NMM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:41:42.968511] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-05T18:41:42.968090] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:42.987979] [INFO ] [MAIN ] NMR: Loaded 15914 existing records. [2025-09-05T18:41:43.116232] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-05T18:41:43.117816] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-05T18:41:43.195791] [INFO ] [MAIN ] NMR: Found 1 missing trading days. [2025-09-05T18:41:43.195980] [INFO ] [MAIN ] NMR: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:43.196432] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-05T18:41:43.319945] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-05T18:41:43.332247] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-05T18:41:43.582486] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-05T18:41:43.781527] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:41:43.868564] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-05T18:41:43.934968] [INFO ] [MAIN ] NMR: Adding 241 new records, updating 0 existing records. [2025-09-05T18:41:43.949299] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-05T18:41:43.953665] [INFO ] [MAIN ] NMR: Combined dataset has 16155 total records. [2025-09-05T18:41:44.131743] [WARN ] [VALIDATOR ] NMR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:44.322917] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-05T18:41:44.335510] [WARN ] [VALIDATOR ] NMR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:44.335779] [INFO ] [MAIN ] NMR: Combined data validation passed. [2025-09-05T18:41:44.430666] [INFO ] [MAIN ] NMR: Update completed successfully. [2025-09-05T18:41:44.432511] [INFO ] [MAIN ] Update Progress: 1492/2363 symbols completed. NMR took 1.9s. Estimated remaining: 24m 20s. Rate: 35.8 symbols/min [2025-09-05T18:41:44.604426] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:44.608322] [INFO ] [MAIN ] NMS: Loaded 2209 existing records. [2025-09-05T18:41:44.671217] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-05T18:41:44.786375] [INFO ] [MAIN ] NMS: Found 1 missing trading days. [2025-09-05T18:41:44.786517] [INFO ] [MAIN ] NMS: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:45.086636] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-05T18:41:45.445885] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-05T18:41:45.463471] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-05T18:41:46.263480] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-05T18:41:47.063473] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-05T18:41:47.199142] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:41:47.211456] [INFO ] [MAIN ] NMS: Adding 29 new records, updating 0 existing records. [2025-09-05T18:41:47.213047] [INFO ] [MAIN ] NMS: Combined dataset has 2238 total records. [2025-09-05T18:41:47.397254] [WARN ] [VALIDATOR ] NMS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:41:47.597478] [WARN ] [VALIDATOR ] NMS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:41:47.597723] [INFO ] [MAIN ] NMS: Combined data validation passed. [2025-09-05T18:41:47.613259] [INFO ] [MAIN ] NMS: Update completed successfully. [2025-09-05T18:41:47.613747] [INFO ] [MAIN ] Update Progress: 1493/2363 symbols completed. NMS took 3.2s. Estimated remaining: 24m 19s. Rate: 35.8 symbols/min [2025-09-05T18:41:47.796699] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:47.799873] [INFO ] [MAIN ] NMT: Loaded 1425 existing records. [2025-09-05T18:41:47.865165] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-05T18:41:47.974912] [INFO ] [MAIN ] NMT: Found 1 missing trading days. [2025-09-05T18:41:47.975091] [INFO ] [MAIN ] NMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:48.009919] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-05T18:41:48.030931] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-05T18:41:48.596160] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-05T18:41:48.663447] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-05T18:41:49.463493] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-05T18:41:50.263484] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-05T18:41:50.307593] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-05T18:41:50.774918] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-05T18:41:51.063513] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-05T18:41:51.229787] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:41:51.242301] [INFO ] [MAIN ] NMT: Adding 11 new records, updating 0 existing records. [2025-09-05T18:41:51.243857] [INFO ] [MAIN ] NMT: Combined dataset has 1436 total records. [2025-09-05T18:41:51.424830] [WARN ] [VALIDATOR ] NMT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:51.610308] [WARN ] [VALIDATOR ] NMT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:51.610544] [INFO ] [MAIN ] NMT: Combined data validation passed. [2025-09-05T18:41:51.621243] [INFO ] [MAIN ] NMT: Update completed successfully. [2025-09-05T18:41:51.621727] [INFO ] [MAIN ] Update Progress: 1494/2363 symbols completed. NMT took 4.0s. Estimated remaining: 24m 19s. Rate: 35.7 symbols/min [2025-09-05T18:41:51.800461] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:51.812368] [INFO ] [MAIN ] NMZ: Loaded 10017 existing records. [2025-09-05T18:41:51.874874] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-05T18:41:51.994826] [INFO ] [MAIN ] NMZ: Found 1 missing trading days. [2025-09-05T18:41:51.994982] [INFO ] [MAIN ] NMZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:52.413012] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-05T18:41:52.663539] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-05T18:41:53.245012] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-05T18:41:53.463496] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-05T18:41:53.929120] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-05T18:41:54.263483] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-05T18:41:54.509773] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:41:54.571102] [INFO ] [MAIN ] NMZ: Adding 0 new records, updating 0 existing records. [2025-09-05T18:41:54.572518] [INFO ] [MAIN ] NMZ: Combined dataset has 10017 total records. [2025-09-05T18:41:54.573002] [FATAL] [VALIDATOR ] NMZ: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:41:54.573086] [FATAL] [MAIN ] NMZ: Combined data validation failed. [2025-09-05T18:41:54.573129] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:41:54.573177] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-05T18:41:54.573580] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-09-05T18:41:54.575146] [INFO ] [MAIN ] Update Progress: 1495/2363 symbols completed. NMZ took 3.0s. Estimated remaining: 24m 18s. Rate: 35.7 symbols/min [2025-09-05T18:41:54.761742] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:54.768984] [INFO ] [MAIN ] NNI: Loaded 5306 existing records. [2025-09-05T18:41:54.944181] [INFO ] [MAIN ] NNI: Found 1 missing trading days. [2025-09-05T18:41:54.944325] [INFO ] [MAIN ] NNI: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:54.975086] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-05T18:41:55.063513] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-05T18:41:55.299617] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-05T18:41:55.329094] [INFO ] [MAIN ] NNI: Adding 75 new records, updating 0 existing records. [2025-09-05T18:41:55.330799] [INFO ] [MAIN ] NNI: Combined dataset has 5381 total records. [2025-09-05T18:41:55.509509] [WARN ] [VALIDATOR ] NNI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:55.700287] [WARN ] [VALIDATOR ] NNI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:55.700492] [INFO ] [MAIN ] NNI: Combined data validation passed. [2025-09-05T18:41:55.735498] [INFO ] [MAIN ] NNI: Update completed successfully. [2025-09-05T18:41:55.736404] [INFO ] [MAIN ] Update Progress: 1496/2363 symbols completed. NNI took 1.2s. Estimated remaining: 24m 16s. Rate: 35.7 symbols/min [2025-09-05T18:41:55.868664] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-05T18:41:55.917108] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:55.939266] [INFO ] [MAIN ] NNN: Loaded 22978 existing records. [2025-09-05T18:41:56.114731] [INFO ] [MAIN ] NNN: Found 1 missing trading days. [2025-09-05T18:41:56.114944] [INFO ] [MAIN ] NNN: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:56.663502] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-05T18:41:56.933390] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-05T18:41:57.314837] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:41:57.447613] [INFO ] [MAIN ] NNN: Adding 370 new records, updating 0 existing records. [2025-09-05T18:41:57.450830] [INFO ] [MAIN ] NNN: Combined dataset has 23348 total records. [2025-09-05T18:41:57.471365] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-05T18:41:57.640303] [WARN ] [VALIDATOR ] NNN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:41:57.833740] [WARN ] [VALIDATOR ] NNN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:41:57.833979] [INFO ] [MAIN ] NNN: Combined data validation passed. [2025-09-05T18:41:57.979016] [INFO ] [MAIN ] NNN: Update completed successfully. [2025-09-05T18:41:57.981618] [INFO ] [MAIN ] Update Progress: 1497/2363 symbols completed. NNN took 2.2s. Estimated remaining: 24m 14s. Rate: 35.7 symbols/min [2025-09-05T18:41:58.154594] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:41:58.158941] [INFO ] [MAIN ] NNY: Loaded 2761 existing records. [2025-09-05T18:41:58.268723] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-05T18:41:58.329863] [INFO ] [MAIN ] NNY: Found 1 missing trading days. [2025-09-05T18:41:58.330233] [INFO ] [MAIN ] NNY: Need to fetch 1 months: 2025-09 [2025-09-05T18:41:58.335733] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-05T18:41:59.063489] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-05T18:41:59.227939] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-05T18:41:59.863502] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-05T18:41:59.937597] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-05T18:42:00.663483] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-05T18:42:01.004631] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-05T18:42:01.237820] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:42:01.239140] [INFO ] [REMOTE ] NMI: Full fetch complete (4620 records). [2025-09-05T18:42:01.472100] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-05T18:42:01.598506] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-05T18:42:01.620096] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-05T18:42:01.620198] [INFO ] [MAIN ] Update Progress: 1498/2363 symbols completed. NMI took 20.6s. Estimated remaining: 24m 14s. Rate: 35.7 symbols/min [2025-09-05T18:42:01.792385] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:01.804138] [INFO ] [MAIN ] NOA: Loaded 7468 existing records. [2025-09-05T18:42:01.992859] [INFO ] [MAIN ] NOA: Found 1 missing trading days. [2025-09-05T18:42:01.993085] [INFO ] [MAIN ] NOA: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:01.996985] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:42:01.998439] [INFO ] [REMOTE ] NMM: Full fetch complete (16056 records). [2025-09-05T18:42:02.268607] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-05T18:42:02.364844] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-05T18:42:02.436702] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-05T18:42:02.436897] [INFO ] [MAIN ] Update Progress: 1499/2363 symbols completed. NMM took 20.2s. Estimated remaining: 24m 12s. Rate: 35.7 symbols/min [2025-09-05T18:42:02.607195] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:02.607356] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-09-05T18:42:02.607524] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-05T18:42:02.607564] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-05T18:42:02.607610] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-05T18:42:02.959805] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:42:03.063442] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-05T18:42:03.413492] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:42:03.430591] [INFO ] [MAIN ] NNY: Adding 36 new records, updating 0 existing records. [2025-09-05T18:42:03.432072] [INFO ] [MAIN ] NNY: Combined dataset has 2797 total records. [2025-09-05T18:42:03.616872] [WARN ] [VALIDATOR ] NNY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:03.819948] [WARN ] [VALIDATOR ] NNY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:03.820184] [INFO ] [MAIN ] NNY: Combined data validation passed. [2025-09-05T18:42:03.838757] [INFO ] [MAIN ] NNY: Update completed successfully. [2025-09-05T18:42:03.839349] [INFO ] [MAIN ] Update Progress: 1500/2363 symbols completed. NNY took 5.9s. Estimated remaining: 24m 10s. Rate: 35.7 symbols/min [2025-09-05T18:42:03.871515] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-05T18:42:04.029952] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:04.031127] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-05T18:42:04.073253] [INFO ] [MAIN ] NOC: Loaded 32431 existing records. [2025-09-05T18:42:04.258795] [INFO ] [MAIN ] NOC: Found 1 missing trading days. [2025-09-05T18:42:04.258937] [INFO ] [MAIN ] NOC: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:04.663521] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-05T18:42:04.965428] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-05T18:42:05.066234] [INFO ] [MAIN ] NOC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:42:05.068504] [INFO ] [MAIN ] NOC: Combined dataset has 32431 total records. [2025-09-05T18:42:05.069073] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:42:05.069164] [FATAL] [MAIN ] NOC: Combined data validation failed. [2025-09-05T18:42:05.069201] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:42:05.069249] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-05T18:42:05.070108] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-09-05T18:42:05.075715] [INFO ] [MAIN ] Update Progress: 1501/2363 symbols completed. NOC took 1.2s. Estimated remaining: 24m 8s. Rate: 35.7 symbols/min [2025-09-05T18:42:05.255661] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:05.283050] [INFO ] [MAIN ] NOG: Loaded 24323 existing records. [2025-09-05T18:42:05.455526] [INFO ] [MAIN ] NOG: Found 1 missing trading days. [2025-09-05T18:42:05.455674] [INFO ] [MAIN ] NOG: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:05.463417] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-05T18:42:05.945461] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-05T18:42:05.981739] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:42:06.115159] [INFO ] [MAIN ] NOG: Adding 369 new records, updating 0 existing records. [2025-09-05T18:42:06.118465] [INFO ] [MAIN ] NOG: Combined dataset has 24692 total records. [2025-09-05T18:42:06.264925] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-05T18:42:06.299236] [WARN ] [VALIDATOR ] NOG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:06.494374] [WARN ] [VALIDATOR ] NOG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:06.494583] [INFO ] [MAIN ] NOG: Combined data validation passed. [2025-09-05T18:42:06.656437] [INFO ] [MAIN ] NOG: Update completed successfully. [2025-09-05T18:42:06.656726] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:42:06.660216] [INFO ] [MAIN ] Update Progress: 1502/2363 symbols completed. NOG took 1.6s. Estimated remaining: 24m 6s. Rate: 35.7 symbols/min [2025-09-05T18:42:06.705991] [INFO ] [REMOTE ] NLY: Full fetch complete (58240 records). [2025-09-05T18:42:06.969620] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:07.068534] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-05T18:42:07.240810] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-05T18:42:07.241498] [INFO ] [MAIN ] NOK: Loaded 25639 existing records. [2025-09-05T18:42:07.516384] [INFO ] [MAIN ] NOK: Found 1 missing trading days. [2025-09-05T18:42:07.531194] [INFO ] [MAIN ] NOK: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:07.647877] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:42:07.697034] [INFO ] [MAIN ] NOA: Adding 111 new records, updating 0 existing records. [2025-09-05T18:42:07.703977] [INFO ] [MAIN ] NOA: Combined dataset has 7579 total records. [2025-09-05T18:42:07.866300] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-05T18:42:07.898735] [WARN ] [VALIDATOR ] NOA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:08.133180] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-05T18:42:08.133709] [INFO ] [MAIN ] Update Progress: 1503/2363 symbols completed. NLY took 32.3s. Estimated remaining: 24m 4s. Rate: 35.7 symbols/min [2025-09-05T18:42:08.300457] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:42:08.327787] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:08.374505] [INFO ] [MAIN ] NOM: Loaded 589 existing records. [2025-09-05T18:42:08.584825] [INFO ] [MAIN ] NOK: Adding 390 new records, updating 0 existing records. [2025-09-05T18:42:08.658325] [INFO ] [MAIN ] NOM: Found 1 missing trading days. [2025-09-05T18:42:08.658946] [INFO ] [MAIN ] NOM: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:08.659697] [INFO ] [MAIN ] NOK: Combined dataset has 26029 total records. [2025-09-05T18:42:08.671437] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-05T18:42:08.854302] [WARN ] [VALIDATOR ] NOK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:08.929015] [WARN ] [VALIDATOR ] NOA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:08.956328] [INFO ] [MAIN ] NOA: Combined data validation passed. [2025-09-05T18:42:09.132227] [INFO ] [MAIN ] NOA: Update completed successfully. [2025-09-05T18:42:09.133280] [INFO ] [MAIN ] Update Progress: 1504/2363 symbols completed. NOA took 7.5s. Estimated remaining: 24m 2s. Rate: 35.7 symbols/min [2025-09-05T18:42:09.306284] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:09.319323] [WARN ] [VALIDATOR ] NOK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:09.319621] [INFO ] [MAIN ] NOK: Combined data validation passed. [2025-09-05T18:42:09.327984] [INFO ] [MAIN ] NOMD: Loaded 19024 existing records. [2025-09-05T18:42:09.476822] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-05T18:42:09.602497] [INFO ] [MAIN ] NOMD: Found 1 missing trading days. [2025-09-05T18:42:09.602673] [INFO ] [MAIN ] NOMD: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:09.614635] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-05T18:42:09.681690] [INFO ] [MAIN ] NOK: Update completed successfully. [2025-09-05T18:42:09.684556] [INFO ] [MAIN ] Update Progress: 1505/2363 symbols completed. NOK took 3.0s. Estimated remaining: 23m 60s. Rate: 35.8 symbols/min [2025-09-05T18:42:09.861351] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:09.883107] [INFO ] [MAIN ] NOTE: Loaded 21625 existing records. [2025-09-05T18:42:10.056844] [INFO ] [MAIN ] NOTE: Found 1 missing trading days. [2025-09-05T18:42:10.057011] [INFO ] [MAIN ] NOTE: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:10.263527] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-05T18:42:10.441285] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:42:10.445734] [INFO ] [MAIN ] NOM: Adding 13 new records, updating 0 existing records. [2025-09-05T18:42:10.447007] [INFO ] [MAIN ] NOM: Combined dataset has 602 total records. [2025-09-05T18:42:10.572094] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:42:10.664407] [WARN ] [VALIDATOR ] NOM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:10.867024] [INFO ] [MAIN ] NOMD: Adding 371 new records, updating 0 existing records. [2025-09-05T18:42:10.931020] [INFO ] [MAIN ] NOMD: Combined dataset has 19395 total records. [2025-09-05T18:42:11.076313] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-05T18:42:11.116298] [WARN ] [VALIDATOR ] NOMD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:11.318974] [WARN ] [VALIDATOR ] NOMD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:11.319069] [WARN ] [VALIDATOR ] NOM: Missing days changed. Total missing: 87 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-04, 2025-06-11, 2025-06-16, 2025-06-27 [2025-09-05T18:42:11.319393] [INFO ] [MAIN ] NOMD: Combined data validation passed. [2025-09-05T18:42:11.319524] [INFO ] [MAIN ] NOM: Combined data validation passed. [2025-09-05T18:42:11.325735] [INFO ] [MAIN ] NOM: Update completed successfully. [2025-09-05T18:42:11.325967] [INFO ] [MAIN ] Update Progress: 1506/2363 symbols completed. NOM took 3.2s. Estimated remaining: 23m 58s. Rate: 35.8 symbols/min [2025-09-05T18:42:11.595270] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:11.631229] [INFO ] [MAIN ] NOV: Loaded 25437 existing records. [2025-09-05T18:42:11.747932] [INFO ] [MAIN ] NOMD: Update completed successfully. [2025-09-05T18:42:11.752725] [INFO ] [MAIN ] Update Progress: 1507/2363 symbols completed. NOMD took 2.6s. Estimated remaining: 23m 56s. Rate: 35.8 symbols/min [2025-09-05T18:42:11.866058] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-05T18:42:11.949723] [INFO ] [MAIN ] NOV: Found 1 missing trading days. [2025-09-05T18:42:12.016387] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:12.016517] [INFO ] [MAIN ] NOV: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:12.017062] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-05T18:42:12.017324] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-05T18:42:12.017397] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-05T18:42:12.017461] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-05T18:42:12.155256] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-05T18:42:12.390324] [INFO ] [REMOTE ] NOW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:42:12.663465] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-05T18:42:13.463522] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-05T18:42:13.600307] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-05T18:42:13.692841] [INFO ] [MAIN ] NOTE: Adding 0 new records, updating 0 existing records. [2025-09-05T18:42:13.694669] [INFO ] [MAIN ] NOTE: Combined dataset has 21625 total records. [2025-09-05T18:42:13.695145] [FATAL] [VALIDATOR ] NOTE: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:42:13.695232] [FATAL] [MAIN ] NOTE: Combined data validation failed. [2025-09-05T18:42:13.695271] [WARN ] [MAIN ] NOTE: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:42:13.695311] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-05T18:42:13.695982] [INFO ] [LOCAL ] NOTE: Starting deletion of derivative data. [2025-09-05T18:42:13.698935] [INFO ] [MAIN ] Update Progress: 1508/2363 symbols completed. NOTE took 4.0s. Estimated remaining: 23m 54s. Rate: 35.8 symbols/min [2025-09-05T18:42:13.881443] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:13.891071] [INFO ] [MAIN ] NPB: Loaded 7531 existing records. [2025-09-05T18:42:14.065319] [INFO ] [MAIN ] NPB: Found 1 missing trading days. [2025-09-05T18:42:14.065470] [INFO ] [MAIN ] NPB: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:14.263517] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-05T18:42:14.479331] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-05T18:42:14.518328] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-05T18:42:15.063505] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-05T18:42:15.174852] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:42:15.231462] [INFO ] [MAIN ] NPB: Adding 135 new records, updating 0 existing records. [2025-09-05T18:42:15.233616] [INFO ] [MAIN ] NPB: Combined dataset has 7666 total records. [2025-09-05T18:42:15.412481] [WARN ] [VALIDATOR ] NPB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:15.606139] [WARN ] [VALIDATOR ] NPB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:15.606364] [INFO ] [MAIN ] NPB: Combined data validation passed. [2025-09-05T18:42:15.652932] [INFO ] [MAIN ] NPB: Update completed successfully. [2025-09-05T18:42:15.653931] [INFO ] [MAIN ] Update Progress: 1509/2363 symbols completed. NPB took 2.0s. Estimated remaining: 23m 53s. Rate: 35.8 symbols/min [2025-09-05T18:42:15.823478] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:15.833086] [INFO ] [MAIN ] NPCT: Loaded 8235 existing records. [2025-09-05T18:42:15.868613] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-05T18:42:16.006817] [INFO ] [MAIN ] NPCT: Found 1 missing trading days. [2025-09-05T18:42:16.006952] [INFO ] [MAIN ] NPCT: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:16.526799] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:42:16.651095] [INFO ] [MAIN ] NOV: Adding 0 new records, updating 0 existing records. [2025-09-05T18:42:16.652859] [INFO ] [MAIN ] NOV: Combined dataset has 25437 total records. [2025-09-05T18:42:16.653301] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:42:16.653388] [FATAL] [MAIN ] NOV: Combined data validation failed. [2025-09-05T18:42:16.653427] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:42:16.653468] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-05T18:42:16.654178] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-09-05T18:42:16.657270] [INFO ] [MAIN ] Update Progress: 1510/2363 symbols completed. NOV took 5.3s. Estimated remaining: 23m 51s. Rate: 35.8 symbols/min [2025-09-05T18:42:16.668797] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-05T18:42:16.831110] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:16.838034] [INFO ] [MAIN ] NPFD: Loaded 4811 existing records. [2025-09-05T18:42:17.013288] [INFO ] [MAIN ] NPFD: Found 1 missing trading days. [2025-09-05T18:42:17.013496] [INFO ] [MAIN ] NPFD: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:17.099975] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-05T18:42:17.463484] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-05T18:42:17.593455] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-05T18:42:18.263474] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-05T18:42:19.063541] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-05T18:42:19.482082] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T18:42:19.525050] [INFO ] [MAIN ] NPCT: Adding 129 new records, updating 0 existing records. [2025-09-05T18:42:19.527450] [INFO ] [MAIN ] NPCT: Combined dataset has 8364 total records. [2025-09-05T18:42:19.711433] [WARN ] [VALIDATOR ] NPCT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:19.864658] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-05T18:42:19.945390] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-05T18:42:19.953809] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-05T18:42:19.975669] [WARN ] [VALIDATOR ] NPCT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:19.975899] [INFO ] [MAIN ] NPCT: Combined data validation passed. [2025-09-05T18:42:20.028871] [INFO ] [MAIN ] NPCT: Update completed successfully. [2025-09-05T18:42:20.029972] [INFO ] [MAIN ] Update Progress: 1511/2363 symbols completed. NPCT took 4.4s. Estimated remaining: 23m 50s. Rate: 35.7 symbols/min [2025-09-05T18:42:20.199036] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:20.205768] [INFO ] [MAIN ] NPK: Loaded 5131 existing records. [2025-09-05T18:42:20.377149] [INFO ] [MAIN ] NPK: Found 1 missing trading days. [2025-09-05T18:42:20.377271] [INFO ] [MAIN ] NPK: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:20.663526] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-05T18:42:20.946574] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:42:20.976481] [INFO ] [MAIN ] NPFD: Adding 69 new records, updating 0 existing records. [2025-09-05T18:42:20.978095] [INFO ] [MAIN ] NPFD: Combined dataset has 4880 total records. [2025-09-05T18:42:21.155612] [WARN ] [VALIDATOR ] NPFD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:21.343609] [WARN ] [VALIDATOR ] NPFD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:21.343854] [INFO ] [MAIN ] NPFD: Combined data validation passed. [2025-09-05T18:42:21.374873] [INFO ] [MAIN ] NPFD: Update completed successfully. [2025-09-05T18:42:21.375540] [INFO ] [MAIN ] Update Progress: 1512/2363 symbols completed. NPFD took 4.7s. Estimated remaining: 23m 48s. Rate: 35.8 symbols/min [2025-09-05T18:42:21.471392] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-05T18:42:21.557364] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:21.559860] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:42:21.578120] [INFO ] [MAIN ] NPK: Adding 35 new records, updating 0 existing records. [2025-09-05T18:42:21.579961] [INFO ] [MAIN ] NPK: Combined dataset has 5166 total records. [2025-09-05T18:42:21.785048] [WARN ] [VALIDATOR ] NPK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:21.786398] [INFO ] [MAIN ] NPKI: Loaded 31391 existing records. [2025-09-05T18:42:22.164689] [INFO ] [MAIN ] NPKI: Found 1 missing trading days. [2025-09-05T18:42:22.183985] [INFO ] [MAIN ] NPKI: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:22.207571] [WARN ] [VALIDATOR ] NPK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:22.207885] [INFO ] [MAIN ] NPK: Combined data validation passed. [2025-09-05T18:42:22.243959] [INFO ] [MAIN ] NPK: Update completed successfully. [2025-09-05T18:42:22.244969] [INFO ] [MAIN ] Update Progress: 1513/2363 symbols completed. NPK took 2.2s. Estimated remaining: 23m 46s. Rate: 35.8 symbols/min [2025-09-05T18:42:22.268749] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-05T18:42:22.471593] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:22.483790] [INFO ] [MAIN ] NPO: Loaded 5883 existing records. [2025-09-05T18:42:22.627129] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-05T18:42:22.775411] [INFO ] [MAIN ] NPO: Found 1 missing trading days. [2025-09-05T18:42:22.775617] [INFO ] [MAIN ] NPO: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:23.063543] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-05T18:42:23.863481] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-05T18:42:24.455428] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-05T18:42:24.597711] [INFO ] [MAIN ] NPKI: Adding 296 new records, updating 0 existing records. [2025-09-05T18:42:24.643789] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-05T18:42:24.656045] [INFO ] [MAIN ] NPKI: Combined dataset has 31687 total records. [2025-09-05T18:42:24.668659] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-05T18:42:24.844547] [WARN ] [VALIDATOR ] NPKI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:42:25.045078] [WARN ] [VALIDATOR ] NPKI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:42:25.045313] [INFO ] [MAIN ] NPKI: Combined data validation passed. [2025-09-05T18:42:25.241033] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-05T18:42:25.251346] [INFO ] [MAIN ] NPKI: Update completed successfully. [2025-09-05T18:42:25.256202] [INFO ] [MAIN ] Update Progress: 1514/2363 symbols completed. NPKI took 3.9s. Estimated remaining: 23m 45s. Rate: 35.7 symbols/min [2025-09-05T18:42:25.430345] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:25.435146] [INFO ] [MAIN ] NPV: Loaded 2377 existing records. [2025-09-05T18:42:25.468562] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-05T18:42:25.609866] [INFO ] [MAIN ] NPV: Found 1 missing trading days. [2025-09-05T18:42:25.610034] [INFO ] [MAIN ] NPV: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:25.954764] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:42:25.984904] [INFO ] [MAIN ] NPO: Adding 67 new records, updating 0 existing records. [2025-09-05T18:42:25.987539] [INFO ] [MAIN ] NPO: Combined dataset has 5950 total records. [2025-09-05T18:42:26.166606] [WARN ] [VALIDATOR ] NPO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:26.267684] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-05T18:42:26.363428] [WARN ] [VALIDATOR ] NPO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:26.363666] [INFO ] [MAIN ] NPO: Combined data validation passed. [2025-09-05T18:42:26.402248] [INFO ] [MAIN ] NPO: Update completed successfully. [2025-09-05T18:42:26.403278] [INFO ] [MAIN ] Update Progress: 1515/2363 symbols completed. NPO took 4.2s. Estimated remaining: 23m 43s. Rate: 35.8 symbols/min [2025-09-05T18:42:26.575090] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:26.597763] [INFO ] [MAIN ] NPWR: Loaded 21346 existing records. [2025-09-05T18:42:26.773798] [INFO ] [MAIN ] NPWR: Found 1 missing trading days. [2025-09-05T18:42:26.774014] [INFO ] [MAIN ] NPWR: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:27.070070] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-05T18:42:27.086737] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-05T18:42:27.141912] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:42:27.160250] [INFO ] [MAIN ] NPV: Adding 76 new records, updating 0 existing records. [2025-09-05T18:42:27.161990] [INFO ] [MAIN ] NPV: Combined dataset has 2453 total records. [2025-09-05T18:42:27.363587] [WARN ] [VALIDATOR ] NPV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:27.576596] [WARN ] [VALIDATOR ] NPV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:27.576901] [INFO ] [MAIN ] NPV: Combined data validation passed. [2025-09-05T18:42:27.597213] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:42:27.601101] [INFO ] [MAIN ] NPV: Update completed successfully. [2025-09-05T18:42:27.601166] [INFO ] [REMOTE ] NOAH: Full fetch complete (20945 records). [2025-09-05T18:42:27.601722] [INFO ] [MAIN ] Update Progress: 1516/2363 symbols completed. NPV took 2.3s. Estimated remaining: 23m 41s. Rate: 35.8 symbols/min [2025-09-05T18:42:27.865075] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-05T18:42:28.001098] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:28.177531] [INFO ] [MAIN ] NQP: Loaded 4519 existing records. [2025-09-05T18:42:28.228576] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-05T18:42:28.428505] [INFO ] [MAIN ] NQP: Found 1 missing trading days. [2025-09-05T18:42:28.430635] [INFO ] [MAIN ] NQP: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:28.455818] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-05T18:42:28.455996] [INFO ] [MAIN ] Update Progress: 1517/2363 symbols completed. NOAH took 26.0s. Estimated remaining: 23m 39s. Rate: 35.8 symbols/min [2025-09-05T18:42:28.663485] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-05T18:42:29.309449] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-05T18:42:29.479513] [INFO ] [MAIN ] NPWR: Adding 263 new records, updating 0 existing records. [2025-09-05T18:42:29.474478] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-05T18:42:29.483579] [INFO ] [MAIN ] NPWR: Combined dataset has 21609 total records. [2025-09-05T18:42:29.657790] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:42:29.677446] [WARN ] [VALIDATOR ] NPWR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:29.769551] [INFO ] [MAIN ] NQP: Adding 106 new records, updating 0 existing records. [2025-09-05T18:42:29.831986] [INFO ] [MAIN ] NQP: Combined dataset has 4625 total records. [2025-09-05T18:42:30.109663] [WARN ] [VALIDATOR ] NQP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:30.322781] [WARN ] [VALIDATOR ] NQP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:30.322898] [WARN ] [VALIDATOR ] NPWR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:30.323214] [INFO ] [MAIN ] NQP: Combined data validation passed. [2025-09-05T18:42:30.323337] [INFO ] [MAIN ] NPWR: Combined data validation passed. [2025-09-05T18:42:30.435266] [INFO ] [MAIN ] NQP: Update completed successfully. [2025-09-05T18:42:30.440408] [INFO ] [MAIN ] Update Progress: 1518/2363 symbols completed. NQP took 2.8s. Estimated remaining: 23m 38s. Rate: 35.8 symbols/min [2025-09-05T18:42:30.477460] [INFO ] [MAIN ] NPWR: Update completed successfully. [2025-09-05T18:42:30.480014] [INFO ] [MAIN ] Update Progress: 1519/2363 symbols completed. NPWR took 4.1s. Estimated remaining: 23m 35s. Rate: 35.8 symbols/min [2025-09-05T18:42:31.328258] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-05T18:42:31.337478] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-05T18:42:33.242169] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-05T18:42:33.253162] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-05T18:42:35.088839] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-05T18:42:35.100136] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-05T18:42:35.678776] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:42:35.681456] [INFO ] [REMOTE ] NOW: Full fetch complete (53686 records). [2025-09-05T18:42:36.048517] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-05T18:42:36.284199] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-05T18:42:36.284344] [INFO ] [MAIN ] Update Progress: 1520/2363 symbols completed. NOW took 24.5s. Estimated remaining: 23m 36s. Rate: 35.7 symbols/min [2025-09-05T18:42:36.804907] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:36.908525] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:36.956218] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:36.980730] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:36.987607] [INFO ] [MAIN ] NREF: Loaded 3984 existing records. [2025-09-05T18:42:37.078034] [INFO ] [MAIN ] NRDY: Loaded 15581 existing records. [2025-09-05T18:42:37.197239] [INFO ] [MAIN ] NRGV: Loaded 19710 existing records. [2025-09-05T18:42:37.346219] [INFO ] [MAIN ] NRG: Loaded 39830 existing records. [2025-09-05T18:42:37.469522] [INFO ] [MAIN ] NREF: Found 1 missing trading days. [2025-09-05T18:42:37.489748] [INFO ] [MAIN ] NREF: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:37.535275] [INFO ] [MAIN ] NRDY: Found 1 missing trading days. [2025-09-05T18:42:37.545855] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-05T18:42:37.571338] [INFO ] [MAIN ] NRDY: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:37.587881] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-05T18:42:37.683363] [INFO ] [MAIN ] NRGV: Found 1 missing trading days. [2025-09-05T18:42:37.683713] [INFO ] [MAIN ] NRGV: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:37.683969] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-05T18:42:37.770929] [INFO ] [MAIN ] NRG: Found 1 missing trading days. [2025-09-05T18:42:37.771092] [INFO ] [MAIN ] NRG: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:37.771354] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-05T18:42:38.191777] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:42:38.347981] [INFO ] [MAIN ] NRG: Adding 378 new records, updating 0 existing records. [2025-09-05T18:42:38.357770] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:42:38.403542] [INFO ] [MAIN ] NRG: Combined dataset has 40208 total records. [2025-09-05T18:42:38.442014] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:42:38.663484] [INFO ] [MAIN ] NRGV: Adding 278 new records, updating 0 existing records. [2025-09-05T18:42:38.687025] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T18:42:38.750924] [INFO ] [MAIN ] NREF: Adding 46 new records, updating 0 existing records. [2025-09-05T18:42:38.753842] [INFO ] [MAIN ] NRDY: Adding 261 new records, updating 0 existing records. [2025-09-05T18:42:38.772882] [INFO ] [MAIN ] NRGV: Combined dataset has 19988 total records. [2025-09-05T18:42:38.857300] [INFO ] [MAIN ] NRDY: Combined dataset has 15842 total records. [2025-09-05T18:42:38.841785] [INFO ] [MAIN ] NREF: Combined dataset has 4030 total records. [2025-09-05T18:42:38.900823] [WARN ] [VALIDATOR ] NRG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:42:39.568254] [WARN ] [VALIDATOR ] NRGV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:39.541170] [WARN ] [VALIDATOR ] NRDY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:39.594755] [WARN ] [VALIDATOR ] NREF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:40.274796] [WARN ] [VALIDATOR ] NRG: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:42:40.274939] [WARN ] [VALIDATOR ] NRGV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:40.275016] [WARN ] [VALIDATOR ] NREF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:40.275688] [INFO ] [MAIN ] NRG: Combined data validation passed. [2025-09-05T18:42:40.275870] [INFO ] [MAIN ] NRGV: Combined data validation passed. [2025-09-05T18:42:40.277762] [INFO ] [MAIN ] NREF: Combined data validation passed. [2025-09-05T18:42:40.362833] [WARN ] [VALIDATOR ] NRDY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:40.391901] [INFO ] [MAIN ] NRDY: Combined data validation passed. [2025-09-05T18:42:40.470426] [INFO ] [MAIN ] NREF: Update completed successfully. [2025-09-05T18:42:40.544825] [INFO ] [MAIN ] Update Progress: 1521/2363 symbols completed. NREF took 4.3s. Estimated remaining: 23m 35s. Rate: 35.7 symbols/min [2025-09-05T18:42:40.796600] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:40.810174] [INFO ] [MAIN ] NRGV: Update completed successfully. [2025-09-05T18:42:40.814377] [INFO ] [MAIN ] Update Progress: 1522/2363 symbols completed. NRGV took 4.5s. Estimated remaining: 23m 33s. Rate: 35.7 symbols/min [2025-09-05T18:42:40.922082] [INFO ] [MAIN ] NRK: Loaded 10051 existing records. [2025-09-05T18:42:41.244876] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:41.313793] [INFO ] [MAIN ] NRK: Found 1 missing trading days. [2025-09-05T18:42:41.316786] [INFO ] [MAIN ] NRK: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:41.317331] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-05T18:42:41.324499] [INFO ] [MAIN ] NRDY: Update completed successfully. [2025-09-05T18:42:41.327328] [INFO ] [MAIN ] Update Progress: 1523/2363 symbols completed. NRDY took 5.0s. Estimated remaining: 23m 31s. Rate: 35.7 symbols/min [2025-09-05T18:42:41.325590] [INFO ] [MAIN ] NRP: Loaded 1976 existing records. [2025-09-05T18:42:41.684247] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:41.687581] [INFO ] [MAIN ] NRP: Found 1 missing trading days. [2025-09-05T18:42:41.688610] [INFO ] [MAIN ] NRP: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:41.692523] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-05T18:42:41.699980] [INFO ] [MAIN ] NRT: Loaded 2449 existing records. [2025-09-05T18:42:41.818012] [INFO ] [MAIN ] NRG: Update completed successfully. [2025-09-05T18:42:41.822765] [INFO ] [MAIN ] Update Progress: 1524/2363 symbols completed. NRG took 5.5s. Estimated remaining: 23m 28s. Rate: 35.7 symbols/min [2025-09-05T18:42:41.942854] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-05T18:42:42.005035] [INFO ] [MAIN ] NRT: Found 1 missing trading days. [2025-09-05T18:42:41.994982] [INFO ] [MAIN ] NRP: Adding 19 new records, updating 0 existing records. [2025-09-05T18:42:42.008471] [INFO ] [MAIN ] NRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:42.009116] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-05T18:42:42.051785] [INFO ] [MAIN ] NRP: Combined dataset has 1995 total records. [2025-09-05T18:42:42.089980] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:42.191109] [INFO ] [MAIN ] NRUC: Loaded 1345 existing records. [2025-09-05T18:42:42.377483] [WARN ] [VALIDATOR ] NRP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:42.548704] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:42:42.548486] [INFO ] [MAIN ] NRUC: Found 1 missing trading days. [2025-09-05T18:42:42.560388] [INFO ] [MAIN ] NRUC: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:42.565860] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-05T18:42:42.584660] [INFO ] [MAIN ] NRT: Adding 28 new records, updating 0 existing records. [2025-09-05T18:42:42.586637] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T18:42:42.686596] [INFO ] [MAIN ] NRT: Combined dataset has 2477 total records. [2025-09-05T18:42:42.715570] [INFO ] [MAIN ] NRK: Adding 197 new records, updating 0 existing records. [2025-09-05T18:42:42.822367] [INFO ] [MAIN ] NRK: Combined dataset has 10248 total records. [2025-09-05T18:42:42.936076] [WARN ] [VALIDATOR ] NRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:43.267727] [WARN ] [VALIDATOR ] NRK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:43.413132] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:42:43.479637] [INFO ] [MAIN ] NRUC: Adding 21 new records, updating 0 existing records. [2025-09-05T18:42:43.483851] [INFO ] [MAIN ] NRUC: Combined dataset has 1366 total records. [2025-09-05T18:42:43.689421] [WARN ] [VALIDATOR ] NRUC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:43.859266] [WARN ] [VALIDATOR ] NRP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:43.859399] [WARN ] [VALIDATOR ] NRK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:43.859346] [WARN ] [VALIDATOR ] NRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:43.881098] [INFO ] [MAIN ] NRP: Combined data validation passed. [2025-09-05T18:42:43.881701] [INFO ] [MAIN ] NRK: Combined data validation passed. [2025-09-05T18:42:43.882518] [INFO ] [MAIN ] NRT: Combined data validation passed. [2025-09-05T18:42:43.904169] [INFO ] [MAIN ] NRP: Update completed successfully. [2025-09-05T18:42:43.906061] [INFO ] [MAIN ] Update Progress: 1525/2363 symbols completed. NRP took 3.1s. Estimated remaining: 23m 27s. Rate: 35.7 symbols/min [2025-09-05T18:42:44.047197] [INFO ] [MAIN ] NRT: Update completed successfully. [2025-09-05T18:42:44.068724] [INFO ] [MAIN ] Update Progress: 1526/2363 symbols completed. NRT took 2.7s. Estimated remaining: 23m 24s. Rate: 35.8 symbols/min [2025-09-05T18:42:44.182430] [INFO ] [MAIN ] NRK: Update completed successfully. [2025-09-05T18:42:44.258353] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:44.260115] [INFO ] [MAIN ] Update Progress: 1527/2363 symbols completed. NRK took 3.7s. Estimated remaining: 23m 22s. Rate: 35.8 symbols/min [2025-09-05T18:42:44.424798] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:44.435621] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-05T18:42:44.461881] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-05T18:42:44.473194] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-05T18:42:44.509953] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-05T18:42:44.560628] [INFO ] [MAIN ] NSA: Loaded 33861 existing records. [2025-09-05T18:42:44.597738] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:45.003133] [INFO ] [MAIN ] NSP: Loaded 16677 existing records. [2025-09-05T18:42:45.035754] [INFO ] [MAIN ] NSA: Found 1 missing trading days. [2025-09-05T18:42:45.081319] [INFO ] [MAIN ] NSA: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:45.086917] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-05T18:42:45.231007] [INFO ] [REMOTE ] NSC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:42:45.231728] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-05T18:42:45.307843] [INFO ] [MAIN ] NSP: Found 1 missing trading days. [2025-09-05T18:42:45.308181] [INFO ] [MAIN ] NSP: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:45.308476] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-05T18:42:45.310517] [WARN ] [VALIDATOR ] NRUC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:45.310775] [INFO ] [MAIN ] NRUC: Combined data validation passed. [2025-09-05T18:42:45.320571] [INFO ] [MAIN ] NRUC: Update completed successfully. [2025-09-05T18:42:45.320983] [INFO ] [MAIN ] Update Progress: 1528/2363 symbols completed. NRUC took 3.5s. Estimated remaining: 23m 20s. Rate: 35.8 symbols/min [2025-09-05T18:42:45.492127] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:45.502581] [INFO ] [MAIN ] NTB: Loaded 9146 existing records. [2025-09-05T18:42:45.675387] [INFO ] [MAIN ] NTB: Found 2 missing trading days. [2025-09-05T18:42:45.675570] [INFO ] [MAIN ] NTB: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:45.675839] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-05T18:42:45.682789] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:42:45.843335] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:42:45.843061] [INFO ] [MAIN ] NSP: Adding 296 new records, updating 451 existing records. [2025-09-05T18:42:45.949204] [INFO ] [MAIN ] NSP: Combined dataset has 16973 total records. [2025-09-05T18:42:46.009757] [INFO ] [MAIN ] NSA: Adding 357 new records, updating 0 existing records. [2025-09-05T18:42:45.989451] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:42:46.186407] [INFO ] [MAIN ] NTB: Adding 283 new records, updating 0 existing records. [2025-09-05T18:42:46.223869] [WARN ] [VALIDATOR ] NSP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:46.224177] [INFO ] [MAIN ] NSA: Combined dataset has 34218 total records. [2025-09-05T18:42:46.353372] [INFO ] [MAIN ] NTB: Combined dataset has 9429 total records. [2025-09-05T18:42:46.845952] [WARN ] [VALIDATOR ] NSA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:42:46.906972] [WARN ] [VALIDATOR ] NTB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:47.304093] [WARN ] [VALIDATOR ] NSA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:42:47.304210] [WARN ] [VALIDATOR ] NSP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:47.307683] [INFO ] [MAIN ] NSP: Combined data validation passed. [2025-09-05T18:42:47.306043] [INFO ] [MAIN ] NSA: Combined data validation passed. [2025-09-05T18:42:47.307463] [WARN ] [VALIDATOR ] NTB: Missing days changed. Total missing: 83 No longer missing: 2025-01-29, 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:47.309199] [INFO ] [MAIN ] NTB: Combined data validation passed. [2025-09-05T18:42:47.518967] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-05T18:42:47.542353] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-05T18:42:47.689699] [INFO ] [MAIN ] NTB: Update completed successfully. [2025-09-05T18:42:47.691657] [INFO ] [MAIN ] Update Progress: 1529/2363 symbols completed. NTB took 2.4s. Estimated remaining: 23m 18s. Rate: 35.8 symbols/min [2025-09-05T18:42:47.807454] [INFO ] [MAIN ] NSA: Update completed successfully. [2025-09-05T18:42:47.819228] [INFO ] [MAIN ] Update Progress: 1530/2363 symbols completed. NSA took 3.9s. Estimated remaining: 23m 16s. Rate: 35.8 symbols/min [2025-09-05T18:42:48.026682] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:48.031021] [INFO ] [MAIN ] NSP: Update completed successfully. [2025-09-05T18:42:48.057789] [INFO ] [MAIN ] Update Progress: 1531/2363 symbols completed. NSP took 3.8s. Estimated remaining: 23m 13s. Rate: 35.8 symbols/min [2025-09-05T18:42:48.116040] [INFO ] [MAIN ] NTEST: Loaded 1494 existing records. [2025-09-05T18:42:48.124172] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:48.510167] [INFO ] [MAIN ] NTEST: Found 1 missing trading days. [2025-09-05T18:42:48.524723] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:48.526375] [INFO ] [MAIN ] NTEST: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:48.527007] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-05T18:42:48.527839] [INFO ] [MAIN ] NTR: Loaded 24993 existing records. [2025-09-05T18:42:48.735336] [INFO ] [MAIN ] NTST: Loaded 21216 existing records. [2025-09-05T18:42:48.770875] [INFO ] [MAIN ] NTR: Found 1 missing trading days. [2025-09-05T18:42:48.811716] [INFO ] [MAIN ] NTR: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:48.835046] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-05T18:42:48.971955] [INFO ] [MAIN ] NTST: Found 1 missing trading days. [2025-09-05T18:42:48.972331] [INFO ] [MAIN ] NTST: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:48.972832] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-05T18:42:49.039545] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-05T18:42:49.050153] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-05T18:42:49.368190] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:42:49.370922] [INFO ] [MAIN ] NTEST: Adding 1 new records, updating 0 existing records. [2025-09-05T18:42:49.372128] [INFO ] [MAIN ] NTEST: Combined dataset has 1495 total records. [2025-09-05T18:42:49.564175] [WARN ] [VALIDATOR ] NTEST: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:42:49.593566] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:42:49.760093] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:42:49.931725] [INFO ] [MAIN ] NTR: Adding 385 new records, updating 0 existing records. [2025-09-05T18:42:50.052588] [INFO ] [MAIN ] NTR: Combined dataset has 25378 total records. [2025-09-05T18:42:50.064579] [INFO ] [MAIN ] NTST: Adding 346 new records, updating 0 existing records. [2025-09-05T18:42:50.191174] [INFO ] [MAIN ] NTST: Combined dataset has 21562 total records. [2025-09-05T18:42:50.270679] [WARN ] [VALIDATOR ] NTR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:50.648242] [WARN ] [VALIDATOR ] NTST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:50.882812] [WARN ] [VALIDATOR ] NTR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:50.883280] [INFO ] [MAIN ] NTR: Combined data validation passed. [2025-09-05T18:42:50.883083] [WARN ] [VALIDATOR ] NTST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:50.882912] [WARN ] [VALIDATOR ] NTEST: Missing days changed. Total missing: 53 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-24, 2025-04-25, 2025-04-29, 2025-05-20, 2025-08-18 [2025-09-05T18:42:50.883869] [INFO ] [MAIN ] NTST: Combined data validation passed. [2025-09-05T18:42:50.883773] [INFO ] [MAIN ] NTEST: Combined data validation passed. [2025-09-05T18:42:51.067334] [INFO ] [MAIN ] NTEST: Update completed successfully. [2025-09-05T18:42:51.070115] [INFO ] [MAIN ] Update Progress: 1532/2363 symbols completed. NTEST took 3.4s. Estimated remaining: 23m 13s. Rate: 35.8 symbols/min [2025-09-05T18:42:51.268045] [INFO ] [MAIN ] NTST: Update completed successfully. [2025-09-05T18:42:51.288489] [INFO ] [MAIN ] Update Progress: 1533/2363 symbols completed. NTST took 3.2s. Estimated remaining: 23m 10s. Rate: 35.8 symbols/min [2025-09-05T18:42:51.306971] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:51.467935] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-05T18:42:51.553104] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-05T18:42:51.557243] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:51.571072] [INFO ] [MAIN ] NU: Loaded 25727 existing records. [2025-09-05T18:42:51.817911] [INFO ] [MAIN ] NU: Found 1 missing trading days. [2025-09-05T18:42:51.820001] [INFO ] [MAIN ] NU: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:51.820319] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-05T18:42:51.824915] [INFO ] [MAIN ] NUE: Loaded 24336 existing records. [2025-09-05T18:42:51.899911] [INFO ] [MAIN ] NTR: Update completed successfully. [2025-09-05T18:42:51.915624] [INFO ] [MAIN ] Update Progress: 1534/2363 symbols completed. NTR took 4.1s. Estimated remaining: 23m 8s. Rate: 35.8 symbols/min [2025-09-05T18:42:52.137535] [INFO ] [MAIN ] NUE: Found 1 missing trading days. [2025-09-05T18:42:52.160690] [INFO ] [MAIN ] NUE: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:52.160981] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-05T18:42:52.234213] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:52.234376] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-09-05T18:42:52.234510] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-05T18:42:52.234554] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-05T18:42:52.234602] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-05T18:42:52.608881] [INFO ] [REMOTE ] NUS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:42:52.609799] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:42:52.610051] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-05T18:42:52.658447] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:42:52.880874] [INFO ] [MAIN ] NU: Adding 390 new records, updating 0 existing records. [2025-09-05T18:42:52.931208] [INFO ] [MAIN ] NUE: Adding 354 new records, updating 0 existing records. [2025-09-05T18:42:52.934935] [INFO ] [MAIN ] NU: Combined dataset has 26117 total records. [2025-09-05T18:42:52.935014] [INFO ] [MAIN ] NUE: Combined dataset has 24690 total records. [2025-09-05T18:42:53.289739] [WARN ] [VALIDATOR ] NUE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:53.311127] [WARN ] [VALIDATOR ] NU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:42:53.726318] [WARN ] [VALIDATOR ] NUE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:53.726386] [WARN ] [VALIDATOR ] NU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:42:53.726835] [INFO ] [MAIN ] NU: Combined data validation passed. [2025-09-05T18:42:53.726612] [INFO ] [MAIN ] NUE: Combined data validation passed. [2025-09-05T18:42:53.937709] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-05T18:42:53.963239] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-05T18:42:54.048107] [INFO ] [MAIN ] NU: Update completed successfully. [2025-09-05T18:42:54.054362] [INFO ] [MAIN ] Update Progress: 1535/2363 symbols completed. NU took 3.0s. Estimated remaining: 23m 6s. Rate: 35.8 symbols/min [2025-09-05T18:42:54.260499] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:54.272268] [WARN ] [MAIN ] NUV: No existing data found, performing full refresh instead. [2025-09-05T18:42:54.272834] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-05T18:42:54.273669] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-05T18:42:54.274454] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-05T18:42:54.458189] [INFO ] [MAIN ] NUE: Update completed successfully. [2025-09-05T18:42:54.494951] [INFO ] [MAIN ] Update Progress: 1536/2363 symbols completed. NUE took 3.2s. Estimated remaining: 23m 4s. Rate: 35.9 symbols/min [2025-09-05T18:42:54.756624] [INFO ] [REMOTE ] NUV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:42:54.786975] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-05T18:42:54.818418] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:54.843673] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-05T18:42:54.851887] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-05T18:42:54.887503] [INFO ] [MAIN ] NUVB: Loaded 38658 existing records. [2025-09-05T18:42:55.077551] [INFO ] [MAIN ] NUVB: Found 1 missing trading days. [2025-09-05T18:42:55.077836] [INFO ] [MAIN ] NUVB: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:55.078074] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-05T18:42:55.689371] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:42:55.852174] [INFO ] [MAIN ] NUVB: Adding 390 new records, updating 0 existing records. [2025-09-05T18:42:55.859513] [INFO ] [MAIN ] NUVB: Combined dataset has 39048 total records. [2025-09-05T18:42:56.040003] [WARN ] [VALIDATOR ] NUVB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:42:56.317904] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-05T18:42:56.352451] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-05T18:42:56.361541] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-05T18:42:56.364000] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-05T18:42:56.379721] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-05T18:42:56.385062] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-05T18:42:56.403272] [WARN ] [VALIDATOR ] NUVB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:42:56.403558] [INFO ] [MAIN ] NUVB: Combined data validation passed. [2025-09-05T18:42:56.640679] [INFO ] [MAIN ] NUVB: Update completed successfully. [2025-09-05T18:42:56.647087] [INFO ] [MAIN ] Update Progress: 1537/2363 symbols completed. NUVB took 2.1s. Estimated remaining: 23m 3s. Rate: 35.8 symbols/min [2025-09-05T18:42:56.820436] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:56.825457] [INFO ] [MAIN ] NUW: Loaded 2927 existing records. [2025-09-05T18:42:56.993443] [INFO ] [MAIN ] NUW: Found 1 missing trading days. [2025-09-05T18:42:56.993599] [INFO ] [MAIN ] NUW: Need to fetch 1 months: 2025-09 [2025-09-05T18:42:56.993855] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-05T18:42:57.701246] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-05T18:42:57.706165] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-05T18:42:57.791895] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:42:57.809539] [INFO ] [MAIN ] NUW: Adding 0 new records, updating 0 existing records. [2025-09-05T18:42:57.810631] [INFO ] [MAIN ] NUW: Combined dataset has 2927 total records. [2025-09-05T18:42:57.811038] [FATAL] [VALIDATOR ] NUW: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:42:57.811112] [FATAL] [MAIN ] NUW: Combined data validation failed. [2025-09-05T18:42:57.811156] [WARN ] [MAIN ] NUW: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:42:57.811197] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-05T18:42:57.811492] [INFO ] [LOCAL ] NUW: Starting deletion of derivative data. [2025-09-05T18:42:57.812037] [INFO ] [MAIN ] Update Progress: 1538/2363 symbols completed. NUW took 1.2s. Estimated remaining: 23m 1s. Rate: 35.9 symbols/min [2025-09-05T18:42:57.986771] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:42:57.987216] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-09-05T18:42:57.987689] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-05T18:42:57.987999] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-05T18:42:57.988090] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-05T18:42:58.214729] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-05T18:42:58.303888] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-05T18:42:58.394565] [INFO ] [REMOTE ] NVG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:42:58.394917] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-05T18:42:58.425308] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-05T18:42:58.435577] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-05T18:42:58.965138] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-05T18:42:59.063484] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-05T18:42:59.475324] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-05T18:42:59.863691] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-05T18:42:59.925428] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-05T18:43:00.274018] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-05T18:43:00.475972] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-05T18:43:00.663480] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-05T18:43:01.000746] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-05T18:43:01.463492] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-05T18:43:01.883863] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-05T18:43:02.263515] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-05T18:43:02.690626] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-05T18:43:03.063493] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-05T18:43:03.863477] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-05T18:43:04.018542] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-05T18:43:04.343516] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-05T18:43:04.663470] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-05T18:43:04.782509] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-05T18:43:05.246939] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:43:05.250243] [INFO ] [REMOTE ] NSC: Full fetch complete (53494 records). [2025-09-05T18:43:05.468674] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-05T18:43:05.621142] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-09-05T18:43:05.868864] [INFO ] [MAIN ] NSC: Full history saved. [2025-09-05T18:43:05.869014] [INFO ] [MAIN ] Update Progress: 1539/2363 symbols completed. NSC took 21.8s. Estimated remaining: 23m 2s. Rate: 35.8 symbols/min [2025-09-05T18:43:06.043252] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:06.060729] [INFO ] [MAIN ] NVGS: Loaded 16047 existing records. [2025-09-05T18:43:06.239879] [INFO ] [MAIN ] NVGS: Found 1 missing trading days. [2025-09-05T18:43:06.240030] [INFO ] [MAIN ] NVGS: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:06.263438] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-05T18:43:06.751698] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:43:06.846991] [INFO ] [MAIN ] NVGS: Adding 207 new records, updating 0 existing records. [2025-09-05T18:43:06.849723] [INFO ] [MAIN ] NVGS: Combined dataset has 16254 total records. [2025-09-05T18:43:07.082841] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-05T18:43:07.087475] [WARN ] [VALIDATOR ] NVGS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:07.293721] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-05T18:43:07.309662] [WARN ] [VALIDATOR ] NVGS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:07.309873] [INFO ] [MAIN ] NVGS: Combined data validation passed. [2025-09-05T18:43:07.410552] [INFO ] [MAIN ] NVGS: Update completed successfully. [2025-09-05T18:43:07.412174] [INFO ] [MAIN ] Update Progress: 1540/2363 symbols completed. NVGS took 1.5s. Estimated remaining: 23m 1s. Rate: 35.8 symbols/min [2025-09-05T18:43:07.583458] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:07.583669] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-09-05T18:43:07.583797] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-05T18:43:07.583837] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-05T18:43:07.583884] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-05T18:43:07.868743] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-05T18:43:07.939358] [INFO ] [REMOTE ] NVO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:43:08.658033] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-05T18:43:08.663407] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-05T18:43:09.382565] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-05T18:43:09.463457] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-05T18:43:09.912533] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-05T18:43:10.263503] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-05T18:43:10.635736] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-05T18:43:11.063490] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-05T18:43:11.566033] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-05T18:43:11.650360] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:43:11.653458] [INFO ] [REMOTE ] NUS: Full fetch complete (40620 records). [2025-09-05T18:43:11.871567] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-05T18:43:12.057917] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-05T18:43:12.252799] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-05T18:43:12.253036] [INFO ] [MAIN ] Update Progress: 1541/2363 symbols completed. NUS took 20.3s. Estimated remaining: 23m 1s. Rate: 35.7 symbols/min [2025-09-05T18:43:12.431703] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:12.431999] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-09-05T18:43:12.432146] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-05T18:43:12.432190] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-05T18:43:12.432237] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-05T18:43:12.668717] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-05T18:43:12.809790] [INFO ] [REMOTE ] NVR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:43:13.463497] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-05T18:43:13.793408] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-05T18:43:14.263559] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-05T18:43:14.615912] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-05T18:43:14.693512] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-09-05T18:43:15.063487] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-05T18:43:15.693478] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-05T18:43:15.863544] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-05T18:43:16.663536] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-05T18:43:16.776838] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-05T18:43:17.463503] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-05T18:43:17.563392] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-05T18:43:17.931636] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-05T18:43:18.263529] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-05T18:43:18.499226] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-05T18:43:19.063548] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-05T18:43:19.757260] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-05T18:43:19.863495] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-05T18:43:19.945690] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:43:19.947842] [INFO ] [REMOTE ] NVG: Full fetch complete (29413 records). [2025-09-05T18:43:20.314547] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-05T18:43:20.440618] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-05T18:43:20.440780] [INFO ] [MAIN ] Update Progress: 1542/2363 symbols completed. NVG took 22.6s. Estimated remaining: 23m 3s. Rate: 35.6 symbols/min [2025-09-05T18:43:20.614083] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:20.633000] [INFO ] [MAIN ] NVRI: Loaded 18098 existing records. [2025-09-05T18:43:20.668810] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-05T18:43:20.808907] [INFO ] [MAIN ] NVRI: Found 1 missing trading days. [2025-09-05T18:43:20.809032] [INFO ] [MAIN ] NVRI: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:21.069188] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:43:21.070849] [INFO ] [REMOTE ] NUV: Full fetch complete (25135 records). [2025-09-05T18:43:21.426102] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-05T18:43:21.475878] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-05T18:43:21.539747] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-05T18:43:21.539907] [INFO ] [MAIN ] Update Progress: 1543/2363 symbols completed. NUV took 27.5s. Estimated remaining: 23m 1s. Rate: 35.6 symbols/min [2025-09-05T18:43:21.710532] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:21.735659] [INFO ] [MAIN ] NVS: Loaded 24436 existing records. [2025-09-05T18:43:21.928705] [INFO ] [MAIN ] NVS: Found 1 missing trading days. [2025-09-05T18:43:21.929034] [INFO ] [MAIN ] NVS: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:22.257328] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:43:22.273387] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-05T18:43:22.378488] [INFO ] [MAIN ] NVRI: Adding 327 new records, updating 0 existing records. [2025-09-05T18:43:22.381354] [INFO ] [MAIN ] NVRI: Combined dataset has 18425 total records. [2025-09-05T18:43:22.561201] [WARN ] [VALIDATOR ] NVRI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:22.755339] [WARN ] [VALIDATOR ] NVRI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:22.755551] [INFO ] [MAIN ] NVRI: Combined data validation passed. [2025-09-05T18:43:22.862904] [INFO ] [MAIN ] NVRI: Update completed successfully. [2025-09-05T18:43:22.864774] [INFO ] [MAIN ] Update Progress: 1544/2363 symbols completed. NVRI took 2.4s. Estimated remaining: 22m 59s. Rate: 35.6 symbols/min [2025-09-05T18:43:23.044498] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:23.051990] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:43:23.077024] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-05T18:43:23.203604] [INFO ] [MAIN ] NVS: Adding 374 new records, updating 0 existing records. [2025-09-05T18:43:23.212374] [INFO ] [MAIN ] NVST: Loaded 24425 existing records. [2025-09-05T18:43:23.330244] [INFO ] [MAIN ] NVS: Combined dataset has 24810 total records. [2025-09-05T18:43:23.408715] [INFO ] [MAIN ] NVST: Found 1 missing trading days. [2025-09-05T18:43:23.473189] [INFO ] [MAIN ] NVST: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:23.554487] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-09-05T18:43:23.621285] [WARN ] [VALIDATOR ] NVS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:23.816747] [WARN ] [VALIDATOR ] NVS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:23.816995] [INFO ] [MAIN ] NVS: Combined data validation passed. [2025-09-05T18:43:23.873630] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-05T18:43:23.975667] [INFO ] [MAIN ] NVS: Update completed successfully. [2025-09-05T18:43:23.978677] [INFO ] [MAIN ] Update Progress: 1545/2363 symbols completed. NVS took 2.4s. Estimated remaining: 22m 57s. Rate: 35.7 symbols/min [2025-09-05T18:43:24.150687] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:24.174159] [INFO ] [MAIN ] NVT: Loaded 24381 existing records. [2025-09-05T18:43:24.360572] [INFO ] [MAIN ] NVT: Found 1 missing trading days. [2025-09-05T18:43:24.360927] [INFO ] [MAIN ] NVT: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:24.380285] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-05T18:43:24.663475] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-05T18:43:24.720000] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:43:24.869216] [INFO ] [MAIN ] NVST: Adding 374 new records, updating 0 existing records. [2025-09-05T18:43:24.873877] [INFO ] [MAIN ] NVST: Combined dataset has 24799 total records. [2025-09-05T18:43:25.062519] [WARN ] [VALIDATOR ] NVST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:25.282807] [WARN ] [VALIDATOR ] NVST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:25.283045] [INFO ] [MAIN ] NVST: Combined data validation passed. [2025-09-05T18:43:25.436161] [INFO ] [MAIN ] NVST: Update completed successfully. [2025-09-05T18:43:25.439485] [INFO ] [MAIN ] Update Progress: 1546/2363 symbols completed. NVST took 2.6s. Estimated remaining: 22m 55s. Rate: 35.7 symbols/min [2025-09-05T18:43:25.470296] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-05T18:43:25.618638] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:25.619410] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:43:25.771622] [INFO ] [MAIN ] NVT: Adding 387 new records, updating 0 existing records. [2025-09-05T18:43:25.781593] [INFO ] [MAIN ] NWG: Loaded 24552 existing records. [2025-09-05T18:43:25.927223] [INFO ] [MAIN ] NVT: Combined dataset has 24768 total records. [2025-09-05T18:43:26.006971] [INFO ] [MAIN ] NWG: Found 1 missing trading days. [2025-09-05T18:43:26.033949] [INFO ] [MAIN ] NWG: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:26.143818] [WARN ] [VALIDATOR ] NVT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:26.268533] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-05T18:43:26.339793] [WARN ] [VALIDATOR ] NVT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:26.340002] [INFO ] [MAIN ] NVT: Combined data validation passed. [2025-09-05T18:43:26.495701] [INFO ] [MAIN ] NVT: Update completed successfully. [2025-09-05T18:43:26.498915] [INFO ] [MAIN ] Update Progress: 1547/2363 symbols completed. NVT took 2.5s. Estimated remaining: 22m 53s. Rate: 35.7 symbols/min [2025-09-05T18:43:26.680130] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:26.694452] [INFO ] [MAIN ] NWN: Loaded 13004 existing records. [2025-09-05T18:43:26.875317] [INFO ] [MAIN ] NWN: Found 1 missing trading days. [2025-09-05T18:43:26.875469] [INFO ] [MAIN ] NWN: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:27.063468] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-05T18:43:27.257770] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-05T18:43:27.347383] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-05T18:43:27.408072] [INFO ] [MAIN ] NWN: Adding 167 new records, updating 0 existing records. [2025-09-05T18:43:27.410474] [INFO ] [MAIN ] NWN: Combined dataset has 13171 total records. [2025-09-05T18:43:27.598959] [WARN ] [VALIDATOR ] NWN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:27.797903] [WARN ] [VALIDATOR ] NWN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:27.798112] [INFO ] [MAIN ] NWN: Combined data validation passed. [2025-09-05T18:43:27.865688] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-05T18:43:27.886598] [INFO ] [MAIN ] NWN: Update completed successfully. [2025-09-05T18:43:27.888427] [INFO ] [MAIN ] Update Progress: 1548/2363 symbols completed. NWN took 1.4s. Estimated remaining: 22m 51s. Rate: 35.7 symbols/min [2025-09-05T18:43:28.060378] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:28.076481] [INFO ] [MAIN ] NX: Loaded 15361 existing records. [2025-09-05T18:43:28.263511] [INFO ] [MAIN ] NX: Found 1 missing trading days. [2025-09-05T18:43:28.263721] [INFO ] [MAIN ] NX: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:28.503059] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-05T18:43:28.663437] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-05T18:43:28.990456] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-05T18:43:29.269333] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:43:29.374725] [INFO ] [MAIN ] NX: Adding 360 new records, updating 0 existing records. [2025-09-05T18:43:29.377541] [INFO ] [MAIN ] NX: Combined dataset has 15721 total records. [2025-09-05T18:43:29.468729] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-05T18:43:29.560386] [WARN ] [VALIDATOR ] NX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:29.754234] [WARN ] [VALIDATOR ] NX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:29.754460] [INFO ] [MAIN ] NX: Combined data validation passed. [2025-09-05T18:43:29.849921] [INFO ] [MAIN ] NX: Update completed successfully. [2025-09-05T18:43:29.851922] [INFO ] [MAIN ] Update Progress: 1549/2363 symbols completed. NX took 2.0s. Estimated remaining: 22m 49s. Rate: 35.7 symbols/min [2025-09-05T18:43:30.020827] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:30.024107] [INFO ] [MAIN ] NXC: Loaded 1758 existing records. [2025-09-05T18:43:30.195012] [INFO ] [MAIN ] NXC: Found 1 missing trading days. [2025-09-05T18:43:30.195141] [INFO ] [MAIN ] NXC: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:30.263454] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-05T18:43:30.844709] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:43:30.982390] [INFO ] [MAIN ] NWG: Adding 378 new records, updating 0 existing records. [2025-09-05T18:43:30.986064] [INFO ] [MAIN ] NWG: Combined dataset has 24930 total records. [2025-09-05T18:43:31.068686] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-05T18:43:31.167885] [WARN ] [VALIDATOR ] NWG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:31.357778] [WARN ] [VALIDATOR ] NWG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:31.358014] [INFO ] [MAIN ] NWG: Combined data validation passed. [2025-09-05T18:43:31.515948] [INFO ] [MAIN ] NWG: Update completed successfully. [2025-09-05T18:43:31.519023] [INFO ] [MAIN ] Update Progress: 1550/2363 symbols completed. NWG took 6.1s. Estimated remaining: 22m 48s. Rate: 35.7 symbols/min [2025-09-05T18:43:31.723202] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:31.735758] [INFO ] [MAIN ] NXDR: Loaded 11928 existing records. [2025-09-05T18:43:31.879966] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-05T18:43:31.912517] [INFO ] [MAIN ] NXDR: Found 1 missing trading days. [2025-09-05T18:43:31.912607] [INFO ] [MAIN ] NXDR: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:32.170956] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-05T18:43:32.393620] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-05T18:43:32.412070] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:43:32.421848] [INFO ] [MAIN ] NXC: Adding 31 new records, updating 0 existing records. [2025-09-05T18:43:32.423086] [INFO ] [MAIN ] NXC: Combined dataset has 1789 total records. [2025-09-05T18:43:32.598334] [WARN ] [VALIDATOR ] NXC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:32.668723] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-05T18:43:32.786707] [WARN ] [VALIDATOR ] NXC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:32.786904] [INFO ] [MAIN ] NXC: Combined data validation passed. [2025-09-05T18:43:32.798909] [INFO ] [MAIN ] NXC: Update completed successfully. [2025-09-05T18:43:32.799244] [INFO ] [MAIN ] Update Progress: 1551/2363 symbols completed. NXC took 2.9s. Estimated remaining: 22m 46s. Rate: 35.7 symbols/min [2025-09-05T18:43:32.967108] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:32.975234] [INFO ] [MAIN ] NXDT: Loaded 6593 existing records. [2025-09-05T18:43:33.149266] [INFO ] [MAIN ] NXDT: Found 1 missing trading days. [2025-09-05T18:43:33.149445] [INFO ] [MAIN ] NXDT: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:33.463568] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-05T18:43:33.918481] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-05T18:43:34.263501] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-05T18:43:35.030420] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-05T18:43:35.068583] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-05T18:43:35.151464] [INFO ] [MAIN ] NXDR: Adding 369 new records, updating 0 existing records. [2025-09-05T18:43:35.157240] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:43:35.161058] [INFO ] [REMOTE ] NVR: Full fetch complete (21600 records). [2025-09-05T18:43:35.228014] [INFO ] [MAIN ] NXDR: Combined dataset has 12297 total records. [2025-09-05T18:43:35.612088] [WARN ] [VALIDATOR ] NXDR: Not fatal, but first date in data (2025-07-21) does not match expected start date (2025-01-31) [2025-09-05T18:43:35.866458] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-05T18:43:35.910895] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-05T18:43:36.013250] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-05T18:43:36.013837] [INFO ] [MAIN ] Update Progress: 1552/2363 symbols completed. NVR took 23.8s. Estimated remaining: 22m 45s. Rate: 35.6 symbols/min [2025-09-05T18:43:36.191399] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:36.193819] [WARN ] [VALIDATOR ] NXDR: Missing days changed. Total missing: 116 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18 [2025-09-05T18:43:36.194130] [INFO ] [MAIN ] NXDR: Combined data validation passed. [2025-09-05T18:43:36.275528] [INFO ] [MAIN ] NXDR: Update completed successfully. [2025-09-05T18:43:36.277265] [INFO ] [MAIN ] Update Progress: 1553/2363 symbols completed. NXDR took 4.8s. Estimated remaining: 22m 43s. Rate: 35.7 symbols/min [2025-09-05T18:43:36.394538] [INFO ] [MAIN ] NXE: Loaded 25325 existing records. [2025-09-05T18:43:36.580971] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:36.663477] [INFO ] [MAIN ] NXG: Loaded 5287 existing records. [2025-09-05T18:43:36.663373] [INFO ] [MAIN ] NXE: Found 1 missing trading days. [2025-09-05T18:43:36.707725] [INFO ] [MAIN ] NXE: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:36.734818] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-05T18:43:36.839479] [INFO ] [MAIN ] NXG: Found 1 missing trading days. [2025-09-05T18:43:36.839624] [INFO ] [MAIN ] NXG: Need to fetch 1 months: 2025-09 [2025-09-05T18:43:36.999514] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:43:37.036230] [INFO ] [MAIN ] NXDT: Adding 89 new records, updating 0 existing records. [2025-09-05T18:43:37.038147] [INFO ] [MAIN ] NXDT: Combined dataset has 6682 total records. [2025-09-05T18:43:37.222239] [WARN ] [VALIDATOR ] NXDT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:37.430966] [WARN ] [VALIDATOR ] NXDT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:37.431208] [INFO ] [MAIN ] NXDT: Combined data validation passed. [2025-09-05T18:43:37.463916] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-05T18:43:37.473931] [INFO ] [MAIN ] NXDT: Update completed successfully. [2025-09-05T18:43:37.475407] [INFO ] [MAIN ] Update Progress: 1554/2363 symbols completed. NXDT took 4.7s. Estimated remaining: 22m 41s. Rate: 35.7 symbols/min [2025-09-05T18:43:37.689187] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-05T18:43:37.701990] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:43:37.690610] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:37.727253] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-09-05T18:43:37.730916] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-05T18:43:37.731108] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-05T18:43:37.751767] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-05T18:43:37.973322] [INFO ] [MAIN ] NXE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:43:38.143066] [INFO ] [MAIN ] NXE: Combined dataset has 25715 total records. [2025-09-05T18:43:38.273086] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-05T18:43:38.344870] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:43:38.348864] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:43:38.427850] [INFO ] [MAIN ] NXG: Adding 109 new records, updating 0 existing records. [2025-09-05T18:43:38.465006] [WARN ] [VALIDATOR ] NXE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:38.566487] [INFO ] [MAIN ] NXG: Combined dataset has 5396 total records. [2025-09-05T18:43:38.835214] [WARN ] [VALIDATOR ] NXG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:43:39.048515] [WARN ] [VALIDATOR ] NXG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:39.048437] [WARN ] [VALIDATOR ] NXE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:43:39.048801] [INFO ] [MAIN ] NXG: Combined data validation passed. [2025-09-05T18:43:39.049502] [INFO ] [MAIN ] NXE: Combined data validation passed. [2025-09-05T18:43:39.066859] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-05T18:43:39.212439] [INFO ] [MAIN ] NXG: Update completed successfully. [2025-09-05T18:43:39.215129] [INFO ] [MAIN ] Update Progress: 1555/2363 symbols completed. NXG took 2.9s. Estimated remaining: 22m 39s. Rate: 35.7 symbols/min [2025-09-05T18:43:39.400794] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:39.402078] [WARN ] [MAIN ] NXN: No existing data found, performing full refresh instead. [2025-09-05T18:43:39.408021] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-05T18:43:39.411999] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-05T18:43:39.412082] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-05T18:43:39.571697] [INFO ] [MAIN ] NXE: Update completed successfully. [2025-09-05T18:43:39.581724] [INFO ] [MAIN ] Update Progress: 1556/2363 symbols completed. NXE took 3.6s. Estimated remaining: 22m 37s. Rate: 35.7 symbols/min [2025-09-05T18:43:39.985677] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:43:40.005866] [INFO ] [REMOTE ] NXN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:43:40.005944] [WARN ] [MAIN ] NXP: No existing data found, performing full refresh instead. [2025-09-05T18:43:40.006305] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-05T18:43:40.006433] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-05T18:43:40.006535] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-05T18:43:40.007369] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-05T18:43:40.370772] [INFO ] [REMOTE ] NXP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:43:40.375332] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-05T18:43:40.615861] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-05T18:43:40.663429] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-05T18:43:41.033441] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-05T18:43:41.138662] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-05T18:43:41.463506] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-05T18:43:41.907579] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-05T18:43:42.263511] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-05T18:43:43.063474] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-05T18:43:43.110535] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-05T18:43:43.366727] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-05T18:43:43.863484] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-05T18:43:44.663484] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-05T18:43:45.463532] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-05T18:43:45.556053] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-05T18:43:45.939930] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-05T18:43:46.263469] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-05T18:43:46.837307] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-09-05T18:43:47.063483] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-05T18:43:47.228724] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-05T18:43:47.625943] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:43:47.628793] [INFO ] [REMOTE ] NVO: Full fetch complete (58074 records). [2025-09-05T18:43:47.629627] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:43:47.629745] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:43:47.629793] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:43:47.629835] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-05T18:43:47.629919] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-09-05T18:43:47.630039] [INFO ] [MAIN ] Update Progress: 1557/2363 symbols completed. NVO took 40.2s. Estimated remaining: 22m 38s. Rate: 35.6 symbols/min [2025-09-05T18:43:47.863465] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-05T18:43:48.663560] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-05T18:43:48.813558] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-05T18:43:49.094910] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-05T18:43:49.463521] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-05T18:43:49.922539] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-05T18:43:50.263479] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-05T18:43:50.996009] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-05T18:43:51.063512] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-05T18:43:51.863517] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-05T18:43:52.122085] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-05T18:43:52.284363] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:43:52.285070] [INFO ] [REMOTE ] NXN: Full fetch complete (2637 records). [2025-09-05T18:43:52.647392] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-05T18:43:52.659670] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-05T18:43:52.659753] [INFO ] [MAIN ] Update Progress: 1558/2363 symbols completed. NXN took 13.4s. Estimated remaining: 22m 38s. Rate: 35.6 symbols/min [2025-09-05T18:43:52.663420] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-05T18:43:53.463490] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-05T18:43:53.523149] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-05T18:43:54.263580] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-05T18:43:54.387889] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-05T18:43:55.063514] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-05T18:43:55.458178] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-05T18:43:55.863495] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-05T18:43:55.948339] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-05T18:43:56.663564] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-05T18:43:56.735960] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-05T18:43:57.463529] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-05T18:43:57.816385] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-05T18:43:58.263522] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-05T18:43:58.284472] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-05T18:43:59.063521] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-05T18:43:59.224484] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-05T18:43:59.863522] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-05T18:44:00.120545] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-05T18:44:00.663466] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-05T18:44:00.700487] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:44:00.701522] [INFO ] [REMOTE ] NXJ: Full fetch complete (15622 records). [2025-09-05T18:44:00.702001] [FATAL] [VALIDATOR ] NXJ: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:44:00.702077] [FATAL] [MAIN ] NXJ: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:44:00.702115] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:44:00.702151] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-05T18:44:00.702212] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-09-05T18:44:00.702314] [INFO ] [MAIN ] Update Progress: 1559/2363 symbols completed. NXJ took 23.2s. Estimated remaining: 22m 40s. Rate: 35.5 symbols/min [2025-09-05T18:44:01.731577] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-05T18:44:01.736527] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-05T18:44:02.601210] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:44:02.602582] [INFO ] [REMOTE ] NXP: Full fetch complete (12931 records). [2025-09-05T18:44:02.960020] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-05T18:44:03.020956] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-05T18:44:03.021118] [INFO ] [MAIN ] Update Progress: 1560/2363 symbols completed. NXP took 23.4s. Estimated remaining: 22m 39s. Rate: 35.5 symbols/min [2025-09-05T18:44:03.533864] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:03.569405] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-05T18:44:03.590738] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-05T18:44:03.636989] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-05T18:44:03.734245] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-05T18:44:03.740990] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:03.746154] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:03.774376] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:03.907305] [INFO ] [MAIN ] NXRT: Loaded 8960 existing records. [2025-09-05T18:44:04.014817] [INFO ] [MAIN ] NZF: Loaded 21776 existing records. [2025-09-05T18:44:04.095853] [INFO ] [MAIN ] NYT: Loaded 23803 existing records. [2025-09-05T18:44:04.610137] [INFO ] [MAIN ] NZF: Found 1 missing trading days. [2025-09-05T18:44:04.679117] [INFO ] [MAIN ] NZF: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:04.649526] [INFO ] [REMOTE ] NYC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:44:04.692413] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-05T18:44:04.686832] [INFO ] [MAIN ] NXRT: Found 1 missing trading days. [2025-09-05T18:44:04.723572] [INFO ] [MAIN ] NYT: Found 1 missing trading days. [2025-09-05T18:44:04.724054] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-05T18:44:04.725402] [INFO ] [MAIN ] NXRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:04.727171] [INFO ] [MAIN ] NYT: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:04.727012] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-05T18:44:04.728690] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-05T18:44:05.007268] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-05T18:44:05.053591] [INFO ] [MAIN ] NXRT: Adding 151 new records, updating 0 existing records. [2025-09-05T18:44:05.055774] [INFO ] [MAIN ] NXRT: Combined dataset has 9111 total records. [2025-09-05T18:44:05.193077] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-05T18:44:05.244687] [WARN ] [VALIDATOR ] NXRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:05.412980] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:44:05.463827] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-05T18:44:05.584261] [INFO ] [MAIN ] NYT: Adding 333 new records, updating 0 existing records. [2025-09-05T18:44:05.589782] [INFO ] [MAIN ] NYT: Combined dataset has 24136 total records. [2025-09-05T18:44:05.777005] [WARN ] [VALIDATOR ] NYT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:05.973772] [WARN ] [VALIDATOR ] NXRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:05.974345] [INFO ] [MAIN ] NXRT: Combined data validation passed. [2025-09-05T18:44:06.034057] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-05T18:44:06.033906] [INFO ] [MAIN ] NXRT: Update completed successfully. [2025-09-05T18:44:06.036612] [INFO ] [MAIN ] Update Progress: 1561/2363 symbols completed. NXRT took 3.0s. Estimated remaining: 22m 37s. Rate: 35.4 symbols/min [2025-09-05T18:44:06.212924] [WARN ] [VALIDATOR ] NYT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:06.215709] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:06.216001] [INFO ] [MAIN ] NYT: Combined data validation passed. [2025-09-05T18:44:06.220579] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-05T18:44:06.221807] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T18:44:06.247285] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-05T18:44:06.257884] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-05T18:44:06.320421] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-05T18:44:06.320553] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-05T18:44:06.443266] [INFO ] [MAIN ] NZF: Adding 271 new records, updating 0 existing records. [2025-09-05T18:44:06.524743] [INFO ] [MAIN ] NZF: Combined dataset has 22047 total records. [2025-09-05T18:44:06.946426] [WARN ] [VALIDATOR ] NZF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:44:06.953560] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-05T18:44:06.953702] [INFO ] [MAIN ] NYT: Update completed successfully. [2025-09-05T18:44:07.052840] [INFO ] [MAIN ] Update Progress: 1562/2363 symbols completed. NYT took 4.0s. Estimated remaining: 22m 35s. Rate: 35.5 symbols/min [2025-09-05T18:44:07.081976] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-05T18:44:07.087975] [INFO ] [REMOTE ] O: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:44:07.453740] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:07.464582] [WARN ] [VALIDATOR ] NZF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:44:07.464883] [INFO ] [MAIN ] NZF: Combined data validation passed. [2025-09-05T18:44:07.590700] [INFO ] [MAIN ] OBDC: Loaded 38664 existing records. [2025-09-05T18:44:07.678394] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-05T18:44:07.804725] [INFO ] [MAIN ] OBDC: Found 1 missing trading days. [2025-09-05T18:44:07.813834] [INFO ] [MAIN ] OBDC: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:07.815334] [INFO ] [MAIN ] NZF: Update completed successfully. [2025-09-05T18:44:07.817798] [INFO ] [MAIN ] Update Progress: 1563/2363 symbols completed. NZF took 4.8s. Estimated remaining: 22m 33s. Rate: 35.5 symbols/min [2025-09-05T18:44:07.870727] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-05T18:44:07.991614] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:08.003690] [INFO ] [MAIN ] OBK: Loaded 11975 existing records. [2025-09-05T18:44:08.180126] [INFO ] [MAIN ] OBK: Found 1 missing trading days. [2025-09-05T18:44:08.180301] [INFO ] [MAIN ] OBK: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:08.436354] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-05T18:44:08.663550] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-05T18:44:09.425534] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:44:09.468669] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-05T18:44:09.484491] [INFO ] [MAIN ] OBK: Adding 96 new records, updating 0 existing records. [2025-09-05T18:44:09.487827] [INFO ] [MAIN ] OBK: Combined dataset has 12071 total records. [2025-09-05T18:44:09.723258] [WARN ] [VALIDATOR ] OBK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:44:09.955667] [WARN ] [VALIDATOR ] OBK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:44:09.955938] [INFO ] [MAIN ] OBK: Combined data validation passed. [2025-09-05T18:44:10.037710] [INFO ] [MAIN ] OBK: Update completed successfully. [2025-09-05T18:44:10.039222] [INFO ] [MAIN ] Update Progress: 1564/2363 symbols completed. OBK took 2.2s. Estimated remaining: 22m 32s. Rate: 35.5 symbols/min [2025-09-05T18:44:10.216330] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:10.216533] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-09-05T18:44:10.216682] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-05T18:44:10.216724] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-05T18:44:10.216769] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-05T18:44:10.270498] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-05T18:44:10.349603] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:44:10.735831] [INFO ] [MAIN ] OBDC: Adding 363 new records, updating 0 existing records. [2025-09-05T18:44:10.768091] [INFO ] [REMOTE ] OC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:44:10.772093] [INFO ] [MAIN ] OBDC: Combined dataset has 39027 total records. [2025-09-05T18:44:10.959282] [WARN ] [VALIDATOR ] OBDC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:44:11.068788] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-05T18:44:11.163435] [WARN ] [VALIDATOR ] OBDC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:44:11.163678] [INFO ] [MAIN ] OBDC: Combined data validation passed. [2025-09-05T18:44:11.414978] [INFO ] [MAIN ] OBDC: Update completed successfully. [2025-09-05T18:44:11.419085] [INFO ] [MAIN ] Update Progress: 1565/2363 symbols completed. OBDC took 4.3s. Estimated remaining: 22m 30s. Rate: 35.5 symbols/min [2025-09-05T18:44:11.595005] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:11.598106] [WARN ] [MAIN ] OCFT: No existing data found, performing full refresh instead. [2025-09-05T18:44:11.598441] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-05T18:44:11.598271] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-05T18:44:11.599762] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-05T18:44:11.599832] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-05T18:44:11.868697] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-05T18:44:11.968960] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:44:12.433945] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-05T18:44:12.663461] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-05T18:44:12.781987] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-05T18:44:13.463497] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-05T18:44:14.263550] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-05T18:44:14.444296] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-05T18:44:14.741207] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-05T18:44:15.063519] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-05T18:44:15.628369] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-05T18:44:15.863506] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-05T18:44:15.869949] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-05T18:44:16.412352] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:44:16.413086] [INFO ] [REMOTE ] NYC: Full fetch complete (1352 records). [2025-09-05T18:44:16.668702] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-05T18:44:16.801219] [WARN ] [VALIDATOR ] NYC: Missing days changed. Total missing: 4 New missing: 2025-08-13, 2025-08-14, 2025-08-18, 2025-08-26 No longer missing: 2025-01-29, 2025-01-30, 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-08-13, 2025-08-14, 2025-08-18, 2025-08-26 [2025-09-05T18:44:16.801439] [INFO ] [MAIN ] NYC: Fetched primary data is valid. [2025-09-05T18:44:16.807440] [INFO ] [MAIN ] NYC: Full history saved. [2025-09-05T18:44:16.807532] [INFO ] [MAIN ] Update Progress: 1566/2363 symbols completed. NYC took 13.8s. Estimated remaining: 22m 30s. Rate: 35.4 symbols/min [2025-09-05T18:44:16.983498] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:16.992722] [INFO ] [MAIN ] ODC: Loaded 4724 existing records. [2025-09-05T18:44:17.167679] [INFO ] [MAIN ] ODC: Found 1 missing trading days. [2025-09-05T18:44:17.167821] [INFO ] [MAIN ] ODC: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:17.463490] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-05T18:44:18.263456] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-05T18:44:18.447947] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-05T18:44:18.921816] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:44:18.951808] [INFO ] [MAIN ] ODC: Adding 0 new records, updating 0 existing records. [2025-09-05T18:44:18.953185] [INFO ] [MAIN ] ODC: Combined dataset has 4724 total records. [2025-09-05T18:44:18.953598] [FATAL] [VALIDATOR ] ODC: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:44:18.953698] [FATAL] [MAIN ] ODC: Combined data validation failed. [2025-09-05T18:44:18.953742] [WARN ] [MAIN ] ODC: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:44:18.953794] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-05T18:44:18.954148] [INFO ] [LOCAL ] ODC: Starting deletion of derivative data. [2025-09-05T18:44:18.954924] [INFO ] [MAIN ] Update Progress: 1567/2363 symbols completed. ODC took 2.1s. Estimated remaining: 22m 29s. Rate: 35.4 symbols/min [2025-09-05T18:44:19.068697] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-05T18:44:19.135928] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:19.158085] [INFO ] [MAIN ] ODV: Loaded 19175 existing records. [2025-09-05T18:44:19.337806] [INFO ] [MAIN ] ODV: Found 1 missing trading days. [2025-09-05T18:44:19.337960] [INFO ] [MAIN ] ODV: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:19.421360] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-05T18:44:19.863474] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-05T18:44:20.672966] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-05T18:44:20.678565] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-05T18:44:21.463478] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-05T18:44:21.835129] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-05T18:44:22.263486] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-05T18:44:22.628505] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T18:44:22.753585] [INFO ] [MAIN ] ODV: Adding 331 new records, updating 0 existing records. [2025-09-05T18:44:22.756997] [INFO ] [MAIN ] ODV: Combined dataset has 19506 total records. [2025-09-05T18:44:22.862381] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-09-05T18:44:22.999335] [WARN ] [VALIDATOR ] ODV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:44:23.073395] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-05T18:44:23.227132] [WARN ] [VALIDATOR ] ODV: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:44:23.227382] [INFO ] [MAIN ] ODV: Combined data validation passed. [2025-09-05T18:44:23.356831] [INFO ] [MAIN ] ODV: Update completed successfully. [2025-09-05T18:44:23.359385] [INFO ] [MAIN ] Update Progress: 1568/2363 symbols completed. ODV took 4.4s. Estimated remaining: 22m 28s. Rate: 35.4 symbols/min [2025-09-05T18:44:23.541911] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:23.561118] [INFO ] [MAIN ] OEC: Loaded 17374 existing records. [2025-09-05T18:44:23.742432] [INFO ] [MAIN ] OEC: Found 1 missing trading days. [2025-09-05T18:44:23.742748] [INFO ] [MAIN ] OEC: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:23.839588] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-05T18:44:23.863423] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-05T18:44:24.663505] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-05T18:44:25.463477] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-05T18:44:25.644756] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-05T18:44:25.726884] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-05T18:44:25.815697] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-05T18:44:25.829980] [INFO ] [MAIN ] OEC: Adding 277 new records, updating 0 existing records. [2025-09-05T18:44:25.867769] [INFO ] [MAIN ] OEC: Combined dataset has 17651 total records. [2025-09-05T18:44:25.910210] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-05T18:44:26.089560] [WARN ] [VALIDATOR ] OEC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:26.273399] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-05T18:44:26.296048] [WARN ] [VALIDATOR ] OEC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:26.296311] [INFO ] [MAIN ] OEC: Combined data validation passed. [2025-09-05T18:44:26.420252] [INFO ] [MAIN ] OEC: Update completed successfully. [2025-09-05T18:44:26.423525] [INFO ] [MAIN ] Update Progress: 1569/2363 symbols completed. OEC took 3.1s. Estimated remaining: 22m 27s. Rate: 35.4 symbols/min [2025-09-05T18:44:26.612403] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:26.623122] [INFO ] [MAIN ] OFG: Loaded 9513 existing records. [2025-09-05T18:44:26.812265] [INFO ] [MAIN ] OFG: Found 1 missing trading days. [2025-09-05T18:44:26.812477] [INFO ] [MAIN ] OFG: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:27.063529] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-05T18:44:27.717115] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:44:27.767031] [INFO ] [MAIN ] OFG: Adding 121 new records, updating 0 existing records. [2025-09-05T18:44:27.769213] [INFO ] [MAIN ] OFG: Combined dataset has 9634 total records. [2025-09-05T18:44:27.869328] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-05T18:44:27.955751] [WARN ] [VALIDATOR ] OFG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:28.155114] [WARN ] [VALIDATOR ] OFG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:28.155366] [INFO ] [MAIN ] OFG: Combined data validation passed. [2025-09-05T18:44:28.217388] [INFO ] [MAIN ] OFG: Update completed successfully. [2025-09-05T18:44:28.218715] [INFO ] [MAIN ] Update Progress: 1570/2363 symbols completed. OFG took 1.8s. Estimated remaining: 22m 26s. Rate: 35.4 symbols/min [2025-09-05T18:44:28.389165] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:28.411368] [INFO ] [MAIN ] OGE: Loaded 22094 existing records. [2025-09-05T18:44:28.586722] [INFO ] [MAIN ] OGE: Found 1 missing trading days. [2025-09-05T18:44:28.586897] [INFO ] [MAIN ] OGE: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:28.663477] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-05T18:44:28.759306] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-05T18:44:28.949535] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-05T18:44:29.232152] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:44:29.369015] [INFO ] [MAIN ] OGE: Adding 365 new records, updating 0 existing records. [2025-09-05T18:44:29.372369] [INFO ] [MAIN ] OGE: Combined dataset has 22459 total records. [2025-09-05T18:44:29.468688] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-05T18:44:29.563663] [WARN ] [VALIDATOR ] OGE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:29.763840] [WARN ] [VALIDATOR ] OGE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:29.764130] [INFO ] [MAIN ] OGE: Combined data validation passed. [2025-09-05T18:44:29.901551] [INFO ] [MAIN ] OGE: Update completed successfully. [2025-09-05T18:44:29.904621] [INFO ] [MAIN ] Update Progress: 1571/2363 symbols completed. OGE took 1.7s. Estimated remaining: 22m 24s. Rate: 35.4 symbols/min [2025-09-05T18:44:30.083680] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:30.109351] [INFO ] [MAIN ] OGN: Loaded 25294 existing records. [2025-09-05T18:44:30.276120] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-05T18:44:30.286951] [INFO ] [MAIN ] OGN: Found 1 missing trading days. [2025-09-05T18:44:30.287377] [INFO ] [MAIN ] OGN: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:30.295460] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-05T18:44:31.063531] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-05T18:44:31.863488] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-05T18:44:32.059801] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-05T18:44:32.663469] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-05T18:44:33.077590] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-05T18:44:33.368481] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-05T18:44:33.409991] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-05T18:44:33.463476] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-05T18:44:34.263476] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-05T18:44:35.063522] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-05T18:44:35.182948] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-05T18:44:35.679326] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:44:35.833432] [INFO ] [MAIN ] OGN: Adding 387 new records, updating 0 existing records. [2025-09-05T18:44:35.836907] [INFO ] [MAIN ] OGN: Combined dataset has 25681 total records. [2025-09-05T18:44:35.868683] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-05T18:44:36.029146] [WARN ] [VALIDATOR ] OGN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:36.229256] [WARN ] [VALIDATOR ] OGN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:36.229474] [INFO ] [MAIN ] OGN: Combined data validation passed. [2025-09-05T18:44:36.393896] [INFO ] [MAIN ] OGN: Update completed successfully. [2025-09-05T18:44:36.397458] [INFO ] [MAIN ] Update Progress: 1572/2363 symbols completed. OGN took 6.5s. Estimated remaining: 22m 25s. Rate: 35.3 symbols/min [2025-09-05T18:44:36.582173] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:36.600177] [INFO ] [MAIN ] OGS: Loaded 16383 existing records. [2025-09-05T18:44:36.665144] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-05T18:44:36.797637] [INFO ] [MAIN ] OGS: Found 1 missing trading days. [2025-09-05T18:44:36.797903] [INFO ] [MAIN ] OGS: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:36.833906] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-05T18:44:36.998619] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-05T18:44:36.999757] [INFO ] [REMOTE ] OCFT: Full fetch complete (10388 records). [2025-09-05T18:44:37.364531] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-05T18:44:37.403711] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-05T18:44:37.403924] [INFO ] [MAIN ] Update Progress: 1573/2363 symbols completed. OCFT took 26.0s. Estimated remaining: 22m 23s. Rate: 35.3 symbols/min [2025-09-05T18:44:37.469824] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-05T18:44:37.583838] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:37.622525] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-05T18:44:37.650842] [INFO ] [MAIN ] OHI: Loaded 24890 existing records. [2025-09-05T18:44:37.826063] [INFO ] [MAIN ] OHI: Found 1 missing trading days. [2025-09-05T18:44:37.826235] [INFO ] [MAIN ] OHI: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:38.063864] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:44:38.163111] [INFO ] [MAIN ] OGS: Adding 255 new records, updating 0 existing records. [2025-09-05T18:44:38.167698] [INFO ] [MAIN ] OGS: Combined dataset has 16638 total records. [2025-09-05T18:44:38.269370] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-05T18:44:38.426285] [WARN ] [VALIDATOR ] OGS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:38.623369] [WARN ] [VALIDATOR ] OGS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:38.623607] [INFO ] [MAIN ] OGS: Combined data validation passed. [2025-09-05T18:44:38.738531] [INFO ] [MAIN ] OGS: Update completed successfully. [2025-09-05T18:44:38.740480] [INFO ] [MAIN ] Update Progress: 1574/2363 symbols completed. OGS took 2.3s. Estimated remaining: 22m 21s. Rate: 35.3 symbols/min [2025-09-05T18:44:38.912063] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:38.912317] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-09-05T18:44:38.912447] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-05T18:44:38.912487] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-05T18:44:38.912535] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-05T18:44:39.087225] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-05T18:44:39.272804] [INFO ] [REMOTE ] OI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:44:39.863474] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-05T18:44:40.004975] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-05T18:44:40.056932] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:44:40.211471] [INFO ] [MAIN ] OHI: Adding 375 new records, updating 0 existing records. [2025-09-05T18:44:40.215669] [INFO ] [MAIN ] OHI: Combined dataset has 25265 total records. [2025-09-05T18:44:40.395267] [WARN ] [VALIDATOR ] OHI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:40.592138] [WARN ] [VALIDATOR ] OHI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:40.592341] [INFO ] [MAIN ] OHI: Combined data validation passed. [2025-09-05T18:44:40.665930] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-05T18:44:40.766607] [INFO ] [MAIN ] OHI: Update completed successfully. [2025-09-05T18:44:40.769780] [INFO ] [MAIN ] Update Progress: 1575/2363 symbols completed. OHI took 3.4s. Estimated remaining: 22m 19s. Rate: 35.3 symbols/min [2025-09-05T18:44:40.951321] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:40.960137] [INFO ] [MAIN ] OIA: Loaded 6839 existing records. [2025-09-05T18:44:41.142993] [INFO ] [MAIN ] OIA: Found 1 missing trading days. [2025-09-05T18:44:41.143297] [INFO ] [MAIN ] OIA: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:41.213093] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-05T18:44:41.463473] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-05T18:44:41.500783] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:44:41.504620] [INFO ] [REMOTE ] O: Full fetch complete (58465 records). [2025-09-05T18:44:41.923203] [INFO ] [MAIN ] O: Fetched primary data is valid. [2025-09-05T18:44:42.188562] [INFO ] [MAIN ] O: Full history saved. [2025-09-05T18:44:42.188715] [INFO ] [MAIN ] Update Progress: 1576/2363 symbols completed. O took 36.2s. Estimated remaining: 22m 17s. Rate: 35.3 symbols/min [2025-09-05T18:44:42.268713] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-05T18:44:42.359417] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:42.379109] [INFO ] [MAIN ] OII: Loaded 20444 existing records. [2025-09-05T18:44:42.555563] [INFO ] [MAIN ] OII: Found 1 missing trading days. [2025-09-05T18:44:42.555709] [INFO ] [MAIN ] OII: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:42.785484] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-05T18:44:42.932026] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:44:42.935042] [INFO ] [REMOTE ] OC: Full fetch complete (48597 records). [2025-09-05T18:44:43.074881] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-05T18:44:43.304564] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-05T18:44:43.527708] [INFO ] [MAIN ] OC: Full history saved. [2025-09-05T18:44:43.527868] [INFO ] [MAIN ] Update Progress: 1577/2363 symbols completed. OC took 33.5s. Estimated remaining: 22m 16s. Rate: 35.3 symbols/min [2025-09-05T18:44:43.697041] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:43.715870] [INFO ] [MAIN ] OIS: Loaded 19403 existing records. [2025-09-05T18:44:43.866456] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-05T18:44:43.889491] [INFO ] [MAIN ] OIS: Found 1 missing trading days. [2025-09-05T18:44:43.890844] [INFO ] [MAIN ] OIS: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:44.134219] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:44:44.177430] [INFO ] [MAIN ] OIA: Adding 173 new records, updating 0 existing records. [2025-09-05T18:44:44.179458] [INFO ] [MAIN ] OIA: Combined dataset has 7012 total records. [2025-09-05T18:44:44.371057] [WARN ] [VALIDATOR ] OIA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:44.549579] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:44:44.668094] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-05T18:44:44.719834] [INFO ] [MAIN ] OII: Adding 306 new records, updating 0 existing records. [2025-09-05T18:44:44.725143] [INFO ] [MAIN ] OII: Combined dataset has 20750 total records. [2025-09-05T18:44:44.912188] [WARN ] [VALIDATOR ] OII: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:45.038871] [WARN ] [VALIDATOR ] OIA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:45.071308] [INFO ] [MAIN ] OIA: Combined data validation passed. [2025-09-05T18:44:45.139697] [INFO ] [MAIN ] OIA: Update completed successfully. [2025-09-05T18:44:45.140815] [INFO ] [MAIN ] Update Progress: 1578/2363 symbols completed. OIA took 4.4s. Estimated remaining: 22m 14s. Rate: 35.3 symbols/min [2025-09-05T18:44:45.319290] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:45.334490] [WARN ] [VALIDATOR ] OII: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:45.334757] [INFO ] [MAIN ] OII: Combined data validation passed. [2025-09-05T18:44:45.430683] [INFO ] [MAIN ] OKE: Loaded 25606 existing records. [2025-09-05T18:44:45.466203] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-05T18:44:45.632472] [INFO ] [MAIN ] OKE: Found 1 missing trading days. [2025-09-05T18:44:45.634763] [INFO ] [MAIN ] OKE: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:45.647944] [INFO ] [MAIN ] OII: Update completed successfully. [2025-09-05T18:44:45.650102] [INFO ] [MAIN ] Update Progress: 1579/2363 symbols completed. OII took 3.5s. Estimated remaining: 22m 12s. Rate: 35.3 symbols/min [2025-09-05T18:44:45.819835] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:45.845272] [INFO ] [MAIN ] OKLO: Loaded 25800 existing records. [2025-09-05T18:44:46.019402] [INFO ] [MAIN ] OKLO: Found 1 missing trading days. [2025-09-05T18:44:46.019588] [INFO ] [MAIN ] OKLO: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:46.071881] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:44:46.168380] [INFO ] [MAIN ] OIS: Adding 226 new records, updating 0 existing records. [2025-09-05T18:44:46.171095] [INFO ] [MAIN ] OIS: Combined dataset has 19629 total records. [2025-09-05T18:44:46.268598] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-05T18:44:46.348806] [WARN ] [VALIDATOR ] OIS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:46.563563] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-05T18:44:46.582455] [WARN ] [VALIDATOR ] OIS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:46.582677] [INFO ] [MAIN ] OIS: Combined data validation passed. [2025-09-05T18:44:46.699034] [INFO ] [MAIN ] OIS: Update completed successfully. [2025-09-05T18:44:46.701184] [INFO ] [MAIN ] Update Progress: 1580/2363 symbols completed. OIS took 3.2s. Estimated remaining: 22m 10s. Rate: 35.3 symbols/min [2025-09-05T18:44:46.872750] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:46.914626] [INFO ] [MAIN ] OLN: Loaded 38996 existing records. [2025-09-05T18:44:47.069115] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-05T18:44:47.103362] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:44:47.105122] [INFO ] [MAIN ] OLN: Found 1 missing trading days. [2025-09-05T18:44:47.107706] [INFO ] [MAIN ] OLN: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:47.256767] [INFO ] [MAIN ] OKE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:44:47.260406] [INFO ] [MAIN ] OKE: Combined dataset has 25996 total records. [2025-09-05T18:44:47.444042] [WARN ] [VALIDATOR ] OKE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:47.651851] [WARN ] [VALIDATOR ] OKE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:47.652104] [INFO ] [MAIN ] OKE: Combined data validation passed. [2025-09-05T18:44:47.821242] [INFO ] [MAIN ] OKE: Update completed successfully. [2025-09-05T18:44:47.824938] [INFO ] [MAIN ] Update Progress: 1581/2363 symbols completed. OKE took 2.7s. Estimated remaining: 22m 8s. Rate: 35.3 symbols/min [2025-09-05T18:44:47.868659] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-05T18:44:47.998779] [INFO ] [MAIN ] OLO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:47.999029] [WARN ] [MAIN ] OLO: No existing data found, performing full refresh instead. [2025-09-05T18:44:47.999224] [INFO ] [MAIN ] OLO: Wiping existing primary data before full refresh. [2025-09-05T18:44:47.999352] [INFO ] [LOCAL ] OLO: Starting deletion of primary data. [2025-09-05T18:44:47.999445] [INFO ] [MAIN ] OLO: Starting full primary refresh. [2025-09-05T18:44:48.075537] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:44:48.461922] [INFO ] [MAIN ] OKLO: Adding 390 new records, updating 0 existing records. [2025-09-05T18:44:48.519845] [INFO ] [REMOTE ] OLO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:44:48.521104] [INFO ] [MAIN ] OKLO: Combined dataset has 26190 total records. [2025-09-05T18:44:48.671711] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-01. [2025-09-05T18:44:48.700784] [WARN ] [VALIDATOR ] OKLO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:48.901454] [WARN ] [VALIDATOR ] OKLO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:48.901727] [INFO ] [MAIN ] OKLO: Combined data validation passed. [2025-09-05T18:44:49.063104] [INFO ] [MAIN ] OKLO: Update completed successfully. [2025-09-05T18:44:49.066449] [INFO ] [MAIN ] Update Progress: 1582/2363 symbols completed. OKLO took 3.4s. Estimated remaining: 22m 6s. Rate: 35.3 symbols/min [2025-09-05T18:44:49.236549] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:49.243331] [INFO ] [MAIN ] OLP: Loaded 4727 existing records. [2025-09-05T18:44:49.413993] [INFO ] [MAIN ] OLP: Found 1 missing trading days. [2025-09-05T18:44:49.414150] [INFO ] [MAIN ] OLP: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:49.463420] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-05T18:44:49.627472] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-05T18:44:49.702255] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-09-05T18:44:49.729888] [INFO ] [MAIN ] OLP: Adding 85 new records, updating 0 existing records. [2025-09-05T18:44:49.731481] [INFO ] [MAIN ] OLP: Combined dataset has 4812 total records. [2025-09-05T18:44:49.919756] [WARN ] [VALIDATOR ] OLP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:50.121346] [WARN ] [VALIDATOR ] OLP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:50.121560] [INFO ] [MAIN ] OLP: Combined data validation passed. [2025-09-05T18:44:50.152127] [INFO ] [MAIN ] OLP: Update completed successfully. [2025-09-05T18:44:50.152914] [INFO ] [MAIN ] Update Progress: 1583/2363 symbols completed. OLP took 1.1s. Estimated remaining: 22m 4s. Rate: 35.4 symbols/min [2025-09-05T18:44:50.268561] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-05T18:44:50.328906] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:50.354482] [INFO ] [MAIN ] OMC: Loaded 25526 existing records. [2025-09-05T18:44:50.536511] [INFO ] [MAIN ] OMC: Found 1 missing trading days. [2025-09-05T18:44:50.536822] [INFO ] [MAIN ] OMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:50.571133] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-05T18:44:51.063521] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-02. [2025-09-05T18:44:51.863469] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-05T18:44:51.912812] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-05T18:44:52.448396] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:44:52.620628] [INFO ] [MAIN ] OLN: Adding 387 new records, updating 0 existing records. [2025-09-05T18:44:52.625536] [INFO ] [MAIN ] OLN: Combined dataset has 39383 total records. [2025-09-05T18:44:52.668735] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-05T18:44:52.835240] [WARN ] [VALIDATOR ] OLN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:44:53.086750] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-05T18:44:53.107576] [WARN ] [VALIDATOR ] OLN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:44:53.107850] [INFO ] [MAIN ] OLN: Combined data validation passed. [2025-09-05T18:44:53.361689] [INFO ] [MAIN ] OLN: Update completed successfully. [2025-09-05T18:44:53.362478] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:44:53.368533] [INFO ] [MAIN ] Update Progress: 1584/2363 symbols completed. OLN took 6.7s. Estimated remaining: 22m 3s. Rate: 35.3 symbols/min [2025-09-05T18:44:53.463617] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-03. [2025-09-05T18:44:53.682575] [INFO ] [MAIN ] OMC: Adding 389 new records, updating 0 existing records. [2025-09-05T18:44:53.700693] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:53.704190] [INFO ] [MAIN ] OMC: Combined dataset has 25915 total records. [2025-09-05T18:44:53.896853] [INFO ] [MAIN ] OMF: Loaded 21463 existing records. [2025-09-05T18:44:53.901205] [WARN ] [VALIDATOR ] OMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:54.293796] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-05T18:44:54.326675] [INFO ] [MAIN ] OMF: Found 1 missing trading days. [2025-09-05T18:44:54.339213] [INFO ] [MAIN ] OMF: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:54.349878] [WARN ] [VALIDATOR ] OMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:54.350457] [INFO ] [MAIN ] OMC: Combined data validation passed. [2025-09-05T18:44:54.516813] [INFO ] [MAIN ] OMC: Update completed successfully. [2025-09-05T18:44:54.520191] [INFO ] [MAIN ] Update Progress: 1585/2363 symbols completed. OMC took 4.4s. Estimated remaining: 22m 1s. Rate: 35.3 symbols/min [2025-09-05T18:44:54.691601] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:54.691816] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-09-05T18:44:54.691943] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-05T18:44:54.691982] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-05T18:44:54.692029] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-05T18:44:55.049214] [INFO ] [REMOTE ] OMI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:44:55.063485] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-05T18:44:55.399724] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-05T18:44:55.640418] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:44:55.761937] [INFO ] [MAIN ] OMF: Adding 312 new records, updating 0 existing records. [2025-09-05T18:44:55.765014] [INFO ] [MAIN ] OMF: Combined dataset has 21775 total records. [2025-09-05T18:44:55.865095] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-05T18:44:55.954267] [WARN ] [VALIDATOR ] OMF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:56.164137] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-05T18:44:56.183495] [WARN ] [VALIDATOR ] OMF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:56.183724] [INFO ] [MAIN ] OMF: Combined data validation passed. [2025-09-05T18:44:56.324487] [INFO ] [MAIN ] OMF: Update completed successfully. [2025-09-05T18:44:56.327210] [INFO ] [MAIN ] Update Progress: 1586/2363 symbols completed. OMF took 2.9s. Estimated remaining: 21m 59s. Rate: 35.3 symbols/min [2025-09-05T18:44:56.498064] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:56.503089] [INFO ] [MAIN ] ONIT: Loaded 3810 existing records. [2025-09-05T18:44:56.669186] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-05T18:44:56.672484] [INFO ] [MAIN ] ONIT: Found 1 missing trading days. [2025-09-05T18:44:56.673358] [INFO ] [MAIN ] ONIT: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:57.243526] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-05T18:44:57.463475] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-04. [2025-09-05T18:44:58.263524] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-05T18:44:58.513372] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-05T18:44:58.953210] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:44:58.980466] [INFO ] [MAIN ] ONIT: Adding 61 new records, updating 0 existing records. [2025-09-05T18:44:58.982618] [INFO ] [MAIN ] ONIT: Combined dataset has 3871 total records. [2025-09-05T18:44:59.067707] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-05T18:44:59.172984] [WARN ] [VALIDATOR ] ONIT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:44:59.302807] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-05T18:44:59.419527] [WARN ] [VALIDATOR ] ONIT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:44:59.419783] [INFO ] [MAIN ] ONIT: Combined data validation passed. [2025-09-05T18:44:59.443680] [INFO ] [MAIN ] ONIT: Update completed successfully. [2025-09-05T18:44:59.444259] [INFO ] [MAIN ] Update Progress: 1587/2363 symbols completed. ONIT took 3.1s. Estimated remaining: 21m 58s. Rate: 35.3 symbols/min [2025-09-05T18:44:59.627055] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:44:59.640962] [INFO ] [MAIN ] ONL: Loaded 13935 existing records. [2025-09-05T18:44:59.818461] [INFO ] [MAIN ] ONL: Found 1 missing trading days. [2025-09-05T18:44:59.818596] [INFO ] [MAIN ] ONL: Need to fetch 1 months: 2025-09 [2025-09-05T18:44:59.863437] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-05T18:45:00.348172] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:45:00.423741] [INFO ] [MAIN ] ONL: Adding 187 new records, updating 0 existing records. [2025-09-05T18:45:00.426293] [INFO ] [MAIN ] ONL: Combined dataset has 14122 total records. [2025-09-05T18:45:00.616080] [WARN ] [VALIDATOR ] ONL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:00.673480] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-05. [2025-09-05T18:45:00.824861] [WARN ] [VALIDATOR ] ONL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:00.825133] [INFO ] [MAIN ] ONL: Combined data validation passed. [2025-09-05T18:45:00.927117] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-05T18:45:00.949355] [INFO ] [MAIN ] ONL: Update completed successfully. [2025-09-05T18:45:00.951677] [INFO ] [MAIN ] Update Progress: 1588/2363 symbols completed. ONL took 1.5s. Estimated remaining: 21m 56s. Rate: 35.3 symbols/min [2025-09-05T18:45:01.119585] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:01.119768] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-09-05T18:45:01.119902] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-05T18:45:01.119943] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-05T18:45:01.120023] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-05T18:45:01.468182] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-05T18:45:01.491512] [INFO ] [REMOTE ] ONON: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:45:02.035914] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:45:02.039114] [INFO ] [REMOTE ] OI: Full fetch complete (51664 records). [2025-09-05T18:45:02.270999] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-05T18:45:02.482586] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-05T18:45:02.611732] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-05T18:45:02.751844] [INFO ] [MAIN ] OI: Full history saved. [2025-09-05T18:45:02.752022] [INFO ] [MAIN ] Update Progress: 1589/2363 symbols completed. OI took 24.0s. Estimated remaining: 21m 55s. Rate: 35.3 symbols/min [2025-09-05T18:45:02.936807] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:02.966462] [INFO ] [MAIN ] ONTF: Loaded 17075 existing records. [2025-09-05T18:45:03.069102] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-06. [2025-09-05T18:45:03.168925] [INFO ] [MAIN ] ONTF: Found 1 missing trading days. [2025-09-05T18:45:03.169100] [INFO ] [MAIN ] ONTF: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:03.863484] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-05T18:45:04.364374] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-05T18:45:04.401382] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:45:04.482552] [INFO ] [MAIN ] ONTF: Adding 213 new records, updating 0 existing records. [2025-09-05T18:45:04.486304] [INFO ] [MAIN ] ONTF: Combined dataset has 17288 total records. [2025-09-05T18:45:04.669270] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-05T18:45:04.674690] [WARN ] [VALIDATOR ] ONTF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:45:04.873378] [WARN ] [VALIDATOR ] ONTF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:45:04.873589] [INFO ] [MAIN ] ONTF: Combined data validation passed. [2025-09-05T18:45:04.976618] [INFO ] [MAIN ] ONTF: Update completed successfully. [2025-09-05T18:45:04.978421] [INFO ] [MAIN ] Update Progress: 1590/2363 symbols completed. ONTF took 2.2s. Estimated remaining: 21m 53s. Rate: 35.3 symbols/min [2025-09-05T18:45:05.189976] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:05.197262] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-05T18:45:05.226891] [INFO ] [MAIN ] ONTO: Loaded 22324 existing records. [2025-09-05T18:45:05.403026] [INFO ] [MAIN ] ONTO: Found 1 missing trading days. [2025-09-05T18:45:05.403175] [INFO ] [MAIN ] ONTO: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:05.463427] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-05T18:45:06.080070] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-05T18:45:06.094931] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:45:06.219219] [INFO ] [MAIN ] ONTO: Adding 343 new records, updating 0 existing records. [2025-09-05T18:45:06.222506] [INFO ] [MAIN ] ONTO: Combined dataset has 22667 total records. [2025-09-05T18:45:06.268638] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-05T18:45:06.402379] [WARN ] [VALIDATOR ] ONTO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:06.610555] [WARN ] [VALIDATOR ] ONTO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:06.610841] [INFO ] [MAIN ] ONTO: Combined data validation passed. [2025-09-05T18:45:06.760254] [INFO ] [MAIN ] ONTO: Update completed successfully. [2025-09-05T18:45:06.763456] [INFO ] [MAIN ] Update Progress: 1591/2363 symbols completed. ONTO took 1.8s. Estimated remaining: 21m 52s. Rate: 35.3 symbols/min [2025-09-05T18:45:06.933588] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:06.944908] [INFO ] [MAIN ] OOMA: Loaded 9494 existing records. [2025-09-05T18:45:07.068534] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-05T18:45:07.120070] [INFO ] [MAIN ] OOMA: Found 1 missing trading days. [2025-09-05T18:45:07.120200] [INFO ] [MAIN ] OOMA: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:07.863479] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-07. [2025-09-05T18:45:08.267782] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-05T18:45:08.663452] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-05T18:45:08.772519] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-05T18:45:09.354777] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:45:09.416982] [INFO ] [MAIN ] OOMA: Adding 125 new records, updating 0 existing records. [2025-09-05T18:45:09.419255] [INFO ] [MAIN ] OOMA: Combined dataset has 9619 total records. [2025-09-05T18:45:09.474744] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-05T18:45:09.610402] [WARN ] [VALIDATOR ] OOMA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:09.804707] [WARN ] [VALIDATOR ] OOMA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:09.804964] [INFO ] [MAIN ] OOMA: Combined data validation passed. [2025-09-05T18:45:09.866105] [INFO ] [MAIN ] OOMA: Update completed successfully. [2025-09-05T18:45:09.867445] [INFO ] [MAIN ] Update Progress: 1592/2363 symbols completed. OOMA took 3.1s. Estimated remaining: 21m 51s. Rate: 35.3 symbols/min [2025-09-05T18:45:10.046770] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:10.089234] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-05T18:45:10.106543] [INFO ] [MAIN ] OPAD: Loaded 12384 existing records. [2025-09-05T18:45:10.266048] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-08. [2025-09-05T18:45:10.290224] [INFO ] [MAIN ] OPAD: Found 1 missing trading days. [2025-09-05T18:45:10.290381] [INFO ] [MAIN ] OPAD: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:11.063489] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-05T18:45:11.688215] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-05T18:45:11.863471] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-05T18:45:11.983921] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-05T18:45:12.663483] [INFO ] [REMOTE ] OLO: Fetching primary data for 2025-09. [2025-09-05T18:45:12.764485] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-05T18:45:13.420377] [INFO ] [REMOTE ] OLO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:45:13.423582] [INFO ] [REMOTE ] OLO: Full fetch complete (51300 records). [2025-09-05T18:45:13.469538] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-05T18:45:13.815392] [INFO ] [MAIN ] OLO: Fetched primary data is valid. [2025-09-05T18:45:14.063806] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-05T18:45:14.095270] [INFO ] [MAIN ] OLO: Full history saved. [2025-09-05T18:45:14.095412] [INFO ] [MAIN ] Update Progress: 1593/2363 symbols completed. OLO took 26.3s. Estimated remaining: 21m 50s. Rate: 35.3 symbols/min [2025-09-05T18:45:14.268697] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-05T18:45:14.287371] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:14.297198] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:45:14.469212] [INFO ] [MAIN ] OPAD: Adding 390 new records, updating 0 existing records. [2025-09-05T18:45:14.471805] [INFO ] [MAIN ] OPFI: Loaded 34965 existing records. [2025-09-05T18:45:14.590176] [INFO ] [MAIN ] OPAD: Combined dataset has 12774 total records. [2025-09-05T18:45:14.725703] [INFO ] [MAIN ] OPFI: Found 1 missing trading days. [2025-09-05T18:45:14.737605] [INFO ] [MAIN ] OPFI: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:14.842594] [WARN ] [VALIDATOR ] OPAD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:15.043351] [WARN ] [VALIDATOR ] OPAD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:15.043618] [INFO ] [MAIN ] OPAD: Combined data validation passed. [2025-09-05T18:45:15.074450] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-05T18:45:15.122176] [INFO ] [MAIN ] OPAD: Update completed successfully. [2025-09-05T18:45:15.123613] [INFO ] [MAIN ] Update Progress: 1594/2363 symbols completed. OPAD took 5.3s. Estimated remaining: 21m 48s. Rate: 35.3 symbols/min [2025-09-05T18:45:15.294179] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:15.301404] [INFO ] [MAIN ] OPP: Loaded 5553 existing records. [2025-09-05T18:45:15.474276] [INFO ] [MAIN ] OPP: Found 1 missing trading days. [2025-09-05T18:45:15.474411] [INFO ] [MAIN ] OPP: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:15.818116] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:45:15.868580] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-05T18:45:15.953298] [INFO ] [MAIN ] OPFI: Adding 302 new records, updating 0 existing records. [2025-09-05T18:45:15.957072] [INFO ] [MAIN ] OPFI: Combined dataset has 35267 total records. [2025-09-05T18:45:16.139287] [WARN ] [VALIDATOR ] OPFI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:45:16.335322] [WARN ] [VALIDATOR ] OPFI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:45:16.335559] [INFO ] [MAIN ] OPFI: Combined data validation passed. [2025-09-05T18:45:16.550348] [INFO ] [MAIN ] OPFI: Update completed successfully. [2025-09-05T18:45:16.554217] [INFO ] [MAIN ] Update Progress: 1595/2363 symbols completed. OPFI took 2.5s. Estimated remaining: 21m 46s. Rate: 35.3 symbols/min [2025-09-05T18:45:16.668928] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-05T18:45:16.729602] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:16.736197] [INFO ] [MAIN ] OPY: Loaded 4068 existing records. [2025-09-05T18:45:16.921613] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-05T18:45:16.939699] [INFO ] [MAIN ] OPY: Found 1 missing trading days. [2025-09-05T18:45:16.950121] [INFO ] [MAIN ] OPY: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:17.463439] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-05T18:45:17.626197] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:45:17.628168] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-05T18:45:17.716716] [INFO ] [MAIN ] OPP: Adding 0 new records, updating 0 existing records. [2025-09-05T18:45:17.718146] [INFO ] [MAIN ] OPP: Combined dataset has 5553 total records. [2025-09-05T18:45:17.718486] [FATAL] [VALIDATOR ] OPP: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:45:17.718561] [FATAL] [MAIN ] OPP: Combined data validation failed. [2025-09-05T18:45:17.718597] [WARN ] [MAIN ] OPP: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:45:17.718634] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-05T18:45:17.719016] [INFO ] [LOCAL ] OPP: Starting deletion of derivative data. [2025-09-05T18:45:17.719888] [INFO ] [MAIN ] Update Progress: 1596/2363 symbols completed. OPP took 2.6s. Estimated remaining: 21m 44s. Rate: 35.3 symbols/min [2025-09-05T18:45:17.813769] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-05T18:45:17.852300] [INFO ] [MAIN ] OPY: Adding 0 new records, updating 0 existing records. [2025-09-05T18:45:17.899833] [INFO ] [MAIN ] OPY: Combined dataset has 4068 total records. [2025-09-05T18:45:17.919050] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:17.919412] [FATAL] [VALIDATOR ] OPY: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:45:17.919570] [FATAL] [MAIN ] OPY: Combined data validation failed. [2025-09-05T18:45:17.919913] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:45:17.919962] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-05T18:45:17.920265] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-05T18:45:17.920991] [INFO ] [MAIN ] Update Progress: 1597/2363 symbols completed. OPY took 1.4s. Estimated remaining: 21m 42s. Rate: 35.3 symbols/min [2025-09-05T18:45:17.939745] [INFO ] [MAIN ] OR: Loaded 21650 existing records. [2025-09-05T18:45:18.112788] [INFO ] [MAIN ] OR: Found 1 missing trading days. [2025-09-05T18:45:18.112911] [INFO ] [MAIN ] OR: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:18.263506] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-05T18:45:19.063504] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-05T18:45:19.776036] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-05T18:45:19.813009] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:45:19.868691] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-05T18:45:19.955832] [INFO ] [MAIN ] OR: Adding 377 new records, updating 0 existing records. [2025-09-05T18:45:19.959088] [INFO ] [MAIN ] OR: Combined dataset has 22027 total records. [2025-09-05T18:45:20.136972] [WARN ] [VALIDATOR ] OR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:20.334214] [WARN ] [VALIDATOR ] OR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:20.334482] [INFO ] [MAIN ] OR: Combined data validation passed. [2025-09-05T18:45:20.469127] [INFO ] [MAIN ] OR: Update completed successfully. [2025-09-05T18:45:20.472363] [INFO ] [MAIN ] Update Progress: 1598/2363 symbols completed. OR took 2.8s. Estimated remaining: 21m 41s. Rate: 35.3 symbols/min [2025-09-05T18:45:20.663544] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-05T18:45:22.034589] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-05T18:45:22.049901] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-05T18:45:22.213090] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-05T18:45:22.263468] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-05T18:45:24.087625] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-05T18:45:24.102773] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-05T18:45:24.149891] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-05T18:45:24.162635] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-05T18:45:24.374060] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-05T18:45:24.379150] [INFO ] [REMOTE ] OMI: Full fetch complete (49960 records). [2025-09-05T18:45:24.918962] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-05T18:45:25.234127] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-05T18:45:25.234320] [INFO ] [MAIN ] Update Progress: 1599/2363 symbols completed. OMI took 30.7s. Estimated remaining: 21m 40s. Rate: 35.3 symbols/min [2025-09-05T18:45:26.443404] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-05T18:45:26.455554] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-05T18:45:27.276153] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:45:27.280581] [INFO ] [REMOTE ] ONON: Full fetch complete (58291 records). [2025-09-05T18:45:27.719242] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-05T18:45:27.980446] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-05T18:45:27.980606] [INFO ] [MAIN ] Update Progress: 1600/2363 symbols completed. ONON took 27.0s. Estimated remaining: 21m 39s. Rate: 35.2 symbols/min [2025-09-05T18:45:28.614889] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:28.677620] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:28.705807] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:28.737566] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:28.800115] [INFO ] [MAIN ] ORA: Loaded 15989 existing records. [2025-09-05T18:45:28.807078] [INFO ] [MAIN ] ORI: Loaded 23300 existing records. [2025-09-05T18:45:28.823096] [INFO ] [MAIN ] ORCL: Loaded 25796 existing records. [2025-09-05T18:45:28.883180] [INFO ] [MAIN ] ORC: Loaded 25056 existing records. [2025-09-05T18:45:29.321871] [INFO ] [MAIN ] ORA: Found 1 missing trading days. [2025-09-05T18:45:29.410001] [INFO ] [MAIN ] ORA: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:29.458301] [INFO ] [MAIN ] ORI: Found 1 missing trading days. [2025-09-05T18:45:29.479573] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-05T18:45:29.532895] [INFO ] [MAIN ] ORC: Found 1 missing trading days. [2025-09-05T18:45:29.534434] [INFO ] [MAIN ] ORC: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:29.534302] [INFO ] [MAIN ] ORCL: Found 1 missing trading days. [2025-09-05T18:45:29.525873] [INFO ] [MAIN ] ORI: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:29.534837] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-05T18:45:29.535072] [INFO ] [MAIN ] ORCL: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:29.535412] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-05T18:45:29.536242] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-05T18:45:29.927782] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:45:29.975487] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:45:30.193439] [INFO ] [MAIN ] ORI: Adding 356 new records, updating 0 existing records. [2025-09-05T18:45:30.245327] [INFO ] [MAIN ] ORCL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:45:30.249408] [INFO ] [MAIN ] ORI: Combined dataset has 23656 total records. [2025-09-05T18:45:30.298003] [INFO ] [MAIN ] ORCL: Combined dataset has 26186 total records. [2025-09-05T18:45:30.391343] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:45:30.522221] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:45:30.581684] [WARN ] [VALIDATOR ] ORI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:30.682020] [INFO ] [MAIN ] ORA: Adding 248 new records, updating 0 existing records. [2025-09-05T18:45:30.818805] [WARN ] [VALIDATOR ] ORCL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:31.142948] [INFO ] [MAIN ] ORC: Adding 389 new records, updating 0 existing records. [2025-09-05T18:45:31.191387] [INFO ] [MAIN ] ORA: Combined dataset has 16237 total records. [2025-09-05T18:45:31.401379] [INFO ] [MAIN ] ORC: Combined dataset has 25445 total records. [2025-09-05T18:45:31.537888] [WARN ] [VALIDATOR ] ORA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:31.775303] [WARN ] [VALIDATOR ] ORC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:32.065473] [WARN ] [VALIDATOR ] ORCL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:32.065260] [WARN ] [VALIDATOR ] ORI: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-08-21 [2025-09-05T18:45:32.069113] [INFO ] [MAIN ] ORCL: Combined data validation passed. [2025-09-05T18:45:32.069612] [INFO ] [MAIN ] ORI: Combined data validation passed. [2025-09-05T18:45:32.076603] [WARN ] [VALIDATOR ] ORC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:32.076539] [WARN ] [VALIDATOR ] ORA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:32.077395] [INFO ] [MAIN ] ORC: Combined data validation passed. [2025-09-05T18:45:32.077798] [INFO ] [MAIN ] ORA: Combined data validation passed. [2025-09-05T18:45:32.520736] [INFO ] [MAIN ] ORA: Update completed successfully. [2025-09-05T18:45:32.525089] [INFO ] [MAIN ] Update Progress: 1601/2363 symbols completed. ORA took 4.5s. Estimated remaining: 21m 39s. Rate: 35.2 symbols/min [2025-09-05T18:45:32.743732] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:32.756621] [INFO ] [MAIN ] ORI: Update completed successfully. [2025-09-05T18:45:32.764760] [INFO ] [MAIN ] Update Progress: 1602/2363 symbols completed. ORI took 4.8s. Estimated remaining: 21m 36s. Rate: 35.2 symbols/min [2025-09-05T18:45:32.857421] [INFO ] [MAIN ] ORN: Loaded 14655 existing records. [2025-09-05T18:45:33.121254] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:33.145226] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-09-05T18:45:33.140025] [INFO ] [MAIN ] ORCL: Update completed successfully. [2025-09-05T18:45:33.180763] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-05T18:45:33.200076] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-05T18:45:33.176548] [INFO ] [MAIN ] Update Progress: 1603/2363 symbols completed. ORCL took 5.2s. Estimated remaining: 21m 34s. Rate: 35.2 symbols/min [2025-09-05T18:45:33.204596] [INFO ] [MAIN ] ORN: Found 1 missing trading days. [2025-09-05T18:45:33.205415] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-05T18:45:33.205472] [INFO ] [MAIN ] ORN: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:33.248084] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-05T18:45:33.353927] [INFO ] [MAIN ] ORC: Update completed successfully. [2025-09-05T18:45:33.382768] [INFO ] [MAIN ] Update Progress: 1604/2363 symbols completed. ORC took 5.4s. Estimated remaining: 21m 32s. Rate: 35.3 symbols/min [2025-09-05T18:45:33.623866] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:33.823030] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:33.944244] [INFO ] [MAIN ] OTF: Loaded 4995 existing records. [2025-09-05T18:45:33.941247] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:45:33.974885] [INFO ] [MAIN ] OSK: Loaded 31832 existing records. [2025-09-05T18:45:33.973985] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-05T18:45:34.163255] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:45:34.318022] [INFO ] [MAIN ] OTF: Found 1 missing trading days. [2025-09-05T18:45:34.375446] [INFO ] [MAIN ] OTF: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:34.382733] [INFO ] [MAIN ] OSK: Found 1 missing trading days. [2025-09-05T18:45:34.393293] [INFO ] [MAIN ] OSK: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:34.399569] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-05T18:45:34.399080] [INFO ] [MAIN ] ORN: Adding 179 new records, updating 0 existing records. [2025-09-05T18:45:34.400093] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-05T18:45:34.404308] [INFO ] [MAIN ] ORN: Combined dataset has 14834 total records. [2025-09-05T18:45:34.586548] [WARN ] [VALIDATOR ] ORN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:34.778061] [WARN ] [VALIDATOR ] ORN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:34.778274] [INFO ] [MAIN ] ORN: Combined data validation passed. [2025-09-05T18:45:34.865398] [INFO ] [MAIN ] ORN: Update completed successfully. [2025-09-05T18:45:34.867183] [INFO ] [MAIN ] Update Progress: 1605/2363 symbols completed. ORN took 2.3s. Estimated remaining: 21m 30s. Rate: 35.3 symbols/min [2025-09-05T18:45:34.999566] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:45:35.100181] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:35.221016] [INFO ] [MAIN ] OSK: Adding 291 new records, updating 0 existing records. [2025-09-05T18:45:35.225696] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:45:35.284768] [INFO ] [MAIN ] OTF: Adding 136 new records, updating 0 existing records. [2025-09-05T18:45:35.286007] [INFO ] [MAIN ] OTIS: Loaded 25181 existing records. [2025-09-05T18:45:35.356090] [INFO ] [MAIN ] OSK: Combined dataset has 32123 total records. [2025-09-05T18:45:35.402397] [INFO ] [MAIN ] OTF: Combined dataset has 5131 total records. [2025-09-05T18:45:35.637493] [INFO ] [MAIN ] OTIS: Found 1 missing trading days. [2025-09-05T18:45:35.674098] [INFO ] [MAIN ] OTIS: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:35.679480] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-05T18:45:35.798584] [WARN ] [VALIDATOR ] OSK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:45:35.857691] [WARN ] [VALIDATOR ] OTF: Not fatal, but first date in data (2025-06-12) does not match expected start date (2025-01-31) [2025-09-05T18:45:36.275996] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-05T18:45:36.287476] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-05T18:45:36.305809] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:45:36.332944] [WARN ] [VALIDATOR ] OTF: Missing days changed. Total missing: 91 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11 [2025-09-05T18:45:36.336095] [INFO ] [MAIN ] OTF: Combined data validation passed. [2025-09-05T18:45:36.335979] [WARN ] [VALIDATOR ] OSK: Missing days changed. Total missing: 46 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-08-21 [2025-09-05T18:45:36.341967] [INFO ] [MAIN ] OSK: Combined data validation passed. [2025-09-05T18:45:36.551864] [INFO ] [MAIN ] OTF: Update completed successfully. [2025-09-05T18:45:36.593940] [INFO ] [MAIN ] OTIS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:45:36.595312] [INFO ] [MAIN ] Update Progress: 1606/2363 symbols completed. OTF took 3.2s. Estimated remaining: 21m 28s. Rate: 35.3 symbols/min [2025-09-05T18:45:36.715938] [INFO ] [MAIN ] OTIS: Combined dataset has 25571 total records. [2025-09-05T18:45:36.825148] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:36.992913] [WARN ] [VALIDATOR ] OTIS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:37.073457] [INFO ] [MAIN ] OUT: Loaded 22984 existing records. [2025-09-05T18:45:37.446683] [INFO ] [MAIN ] OUT: Found 1 missing trading days. [2025-09-05T18:45:37.447686] [INFO ] [MAIN ] OUT: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:37.448589] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-05T18:45:37.468748] [INFO ] [MAIN ] OSK: Update completed successfully. [2025-09-05T18:45:37.473682] [INFO ] [MAIN ] Update Progress: 1607/2363 symbols completed. OSK took 4.3s. Estimated remaining: 21m 26s. Rate: 35.3 symbols/min [2025-09-05T18:45:37.649216] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:37.650715] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-09-05T18:45:37.651560] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-05T18:45:37.651798] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-05T18:45:37.652002] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-05T18:45:38.085194] [INFO ] [REMOTE ] OVV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:45:38.085549] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-05T18:45:38.088443] [WARN ] [VALIDATOR ] OTIS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:38.088596] [INFO ] [MAIN ] OTIS: Combined data validation passed. [2025-09-05T18:45:38.204107] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:45:38.397755] [INFO ] [MAIN ] OUT: Adding 378 new records, updating 0 existing records. [2025-09-05T18:45:38.415006] [INFO ] [MAIN ] OTIS: Update completed successfully. [2025-09-05T18:45:38.418700] [INFO ] [MAIN ] Update Progress: 1608/2363 symbols completed. OTIS took 3.6s. Estimated remaining: 21m 24s. Rate: 35.3 symbols/min [2025-09-05T18:45:38.554721] [INFO ] [MAIN ] OUT: Combined dataset has 23362 total records. [2025-09-05T18:45:38.620201] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:38.636290] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-09-05T18:45:38.660537] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-05T18:45:38.687753] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-05T18:45:38.736732] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-05T18:45:38.837543] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-05T18:45:38.978910] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-05T18:45:38.988132] [WARN ] [VALIDATOR ] OUT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:39.412744] [INFO ] [REMOTE ] OWL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:45:39.429732] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-05T18:45:39.458911] [WARN ] [VALIDATOR ] OUT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:39.459176] [INFO ] [MAIN ] OUT: Combined data validation passed. [2025-09-05T18:45:39.610369] [INFO ] [MAIN ] OUT: Update completed successfully. [2025-09-05T18:45:39.613051] [INFO ] [MAIN ] Update Progress: 1609/2363 symbols completed. OUT took 3.0s. Estimated remaining: 21m 22s. Rate: 35.3 symbols/min [2025-09-05T18:45:39.792266] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:39.792694] [WARN ] [MAIN ] OWLT: No existing data found, performing full refresh instead. [2025-09-05T18:45:39.792991] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-05T18:45:39.793297] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-05T18:45:39.793395] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-05T18:45:40.202746] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-05T18:45:40.206162] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:45:40.206531] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-05T18:45:40.216627] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-05T18:45:40.932370] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-05T18:45:40.934710] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-05T18:45:41.216816] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-05T18:45:41.228966] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-05T18:45:41.433000] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-05T18:45:41.445192] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-05T18:45:41.528752] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-05T18:45:41.530573] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-05T18:45:42.070811] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-05T18:45:42.080913] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-05T18:45:42.267148] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-05T18:45:42.270333] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-05T18:45:42.965201] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-05T18:45:43.063462] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-05T18:45:43.115409] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-05T18:45:43.168691] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-05T18:45:43.480492] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-05T18:45:43.863476] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-05T18:45:44.360627] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-05T18:45:44.486986] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-05T18:45:44.663483] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-05T18:45:45.463468] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-05T18:45:46.263466] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-05T18:45:47.063486] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-05T18:45:47.260443] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-05T18:45:47.362839] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-05T18:45:47.869134] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-05T18:45:47.891677] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-05T18:45:47.958671] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-05T18:45:48.663472] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-05T18:45:49.463569] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-05T18:45:49.560972] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-05T18:45:50.263511] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-05T18:45:50.634738] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-09-05T18:45:51.063472] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-05T18:45:51.257597] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-05T18:45:51.403435] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-05T18:45:51.863495] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-05T18:45:52.663518] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-05T18:45:53.463531] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-05T18:45:53.768871] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-05T18:45:53.866122] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-05T18:45:54.121071] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:45:54.122071] [INFO ] [REMOTE ] OWLT: Full fetch complete (8992 records). [2025-09-05T18:45:54.264250] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-05T18:45:54.554216] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-05T18:45:54.554493] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-05T18:45:54.603814] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-05T18:45:54.603987] [INFO ] [MAIN ] Update Progress: 1610/2363 symbols completed. OWLT took 15.0s. Estimated remaining: 21m 27s. Rate: 35.1 symbols/min [2025-09-05T18:45:54.780075] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:54.798995] [INFO ] [MAIN ] OXM: Loaded 15537 existing records. [2025-09-05T18:45:54.974972] [INFO ] [MAIN ] OXM: Found 1 missing trading days. [2025-09-05T18:45:54.975164] [INFO ] [MAIN ] OXM: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:55.063469] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-05T18:45:55.863470] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-05T18:45:56.366464] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:45:56.444985] [INFO ] [MAIN ] OXM: Adding 0 new records, updating 0 existing records. [2025-09-05T18:45:56.446908] [INFO ] [MAIN ] OXM: Combined dataset has 15537 total records. [2025-09-05T18:45:56.447559] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:45:56.447678] [FATAL] [MAIN ] OXM: Combined data validation failed. [2025-09-05T18:45:56.447828] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:45:56.447886] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-05T18:45:56.448493] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-09-05T18:45:56.450466] [INFO ] [MAIN ] Update Progress: 1611/2363 symbols completed. OXM took 1.8s. Estimated remaining: 21m 25s. Rate: 35.1 symbols/min [2025-09-05T18:45:56.650889] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:56.665890] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-05T18:45:56.691308] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-05T18:45:56.724199] [INFO ] [MAIN ] OXY: Loaded 25777 existing records. [2025-09-05T18:45:56.920080] [INFO ] [MAIN ] OXY: Found 1 missing trading days. [2025-09-05T18:45:56.920322] [INFO ] [MAIN ] OXY: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:56.960583] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-05T18:45:57.463517] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-05T18:45:57.795790] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-05T18:45:57.951481] [INFO ] [MAIN ] OXY: Adding 390 new records, updating 0 existing records. [2025-09-05T18:45:57.954921] [INFO ] [MAIN ] OXY: Combined dataset has 26167 total records. [2025-09-05T18:45:58.143499] [WARN ] [VALIDATOR ] OXY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:45:58.265869] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-05T18:45:58.383907] [WARN ] [VALIDATOR ] OXY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:45:58.384490] [INFO ] [MAIN ] OXY: Combined data validation passed. [2025-09-05T18:45:58.387227] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-05T18:45:58.564438] [INFO ] [MAIN ] OXY: Update completed successfully. [2025-09-05T18:45:58.567870] [INFO ] [MAIN ] Update Progress: 1612/2363 symbols completed. OXY took 2.1s. Estimated remaining: 21m 23s. Rate: 35.1 symbols/min [2025-09-05T18:45:58.740233] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:58.762592] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:45:58.765718] [INFO ] [REMOTE ] OSCR: Full fetch complete (58349 records). [2025-09-05T18:45:58.851573] [INFO ] [MAIN ] PAAS: Loaded 25632 existing records. [2025-09-05T18:45:59.094792] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-05T18:45:59.252946] [INFO ] [MAIN ] PAAS: Found 1 missing trading days. [2025-09-05T18:45:59.263492] [INFO ] [MAIN ] PAAS: Need to fetch 1 months: 2025-09 [2025-09-05T18:45:59.354518] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-05T18:45:59.610307] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-05T18:45:59.610453] [INFO ] [MAIN ] Update Progress: 1613/2363 symbols completed. OSCR took 26.8s. Estimated remaining: 21m 21s. Rate: 35.1 symbols/min [2025-09-05T18:45:59.782881] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:45:59.790184] [INFO ] [MAIN ] PAC: Loaded 5604 existing records. [2025-09-05T18:45:59.868537] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-05T18:45:59.964334] [INFO ] [MAIN ] PAC: Found 1 missing trading days. [2025-09-05T18:45:59.964504] [INFO ] [MAIN ] PAC: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:00.571158] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:46:00.668569] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-05T18:46:00.720608] [INFO ] [MAIN ] PAAS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:46:00.724025] [INFO ] [MAIN ] PAAS: Combined dataset has 26022 total records. [2025-09-05T18:46:00.904113] [WARN ] [VALIDATOR ] PAAS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:01.136145] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-05T18:46:01.150510] [WARN ] [VALIDATOR ] PAAS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:01.150773] [INFO ] [MAIN ] PAAS: Combined data validation passed. [2025-09-05T18:46:01.312269] [INFO ] [MAIN ] PAAS: Update completed successfully. [2025-09-05T18:46:01.315108] [INFO ] [MAIN ] Update Progress: 1614/2363 symbols completed. PAAS took 2.7s. Estimated remaining: 21m 20s. Rate: 35.1 symbols/min [2025-09-05T18:46:01.468135] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-05T18:46:01.485925] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:01.486524] [WARN ] [MAIN ] PACK: No existing data found, performing full refresh instead. [2025-09-05T18:46:01.487425] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-05T18:46:01.487472] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-05T18:46:01.487520] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-05T18:46:01.847874] [INFO ] [REMOTE ] PACK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:46:01.856968] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-05T18:46:01.861113] [INFO ] [REMOTE ] OVV: Full fetch complete (58140 records). [2025-09-05T18:46:02.238777] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-05T18:46:02.308827] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-05T18:46:02.516934] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-05T18:46:02.517076] [INFO ] [MAIN ] Update Progress: 1615/2363 symbols completed. OVV took 25.0s. Estimated remaining: 21m 18s. Rate: 35.1 symbols/min [2025-09-05T18:46:02.652700] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-05T18:46:02.714917] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:02.729905] [INFO ] [MAIN ] PAC: Adding 50 new records, updating 0 existing records. [2025-09-05T18:46:02.732940] [INFO ] [MAIN ] PAC: Combined dataset has 5654 total records. [2025-09-05T18:46:02.887363] [INFO ] [MAIN ] PACS: Loaded 16004 existing records. [2025-09-05T18:46:02.941998] [WARN ] [VALIDATOR ] PAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:03.078987] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-05T18:46:03.200494] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-05T18:46:03.334937] [INFO ] [MAIN ] PACS: Found 1 missing trading days. [2025-09-05T18:46:03.367402] [INFO ] [MAIN ] PACS: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:03.378893] [WARN ] [VALIDATOR ] PAC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:03.379123] [INFO ] [MAIN ] PAC: Combined data validation passed. [2025-09-05T18:46:03.418814] [INFO ] [MAIN ] PAC: Update completed successfully. [2025-09-05T18:46:03.419626] [INFO ] [MAIN ] Update Progress: 1616/2363 symbols completed. PAC took 3.8s. Estimated remaining: 21m 16s. Rate: 35.1 symbols/min [2025-09-05T18:46:03.593633] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:03.605170] [INFO ] [MAIN ] PAG: Loaded 10286 existing records. [2025-09-05T18:46:03.786070] [INFO ] [MAIN ] PAG: Found 1 missing trading days. [2025-09-05T18:46:03.786358] [INFO ] [MAIN ] PAG: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:03.863485] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-05T18:46:04.219561] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-05T18:46:04.264710] [INFO ] [MAIN ] PAG: Adding 121 new records, updating 0 existing records. [2025-09-05T18:46:04.267158] [INFO ] [MAIN ] PAG: Combined dataset has 10407 total records. [2025-09-05T18:46:04.457863] [WARN ] [VALIDATOR ] PAG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:04.623570] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-05T18:46:04.664358] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-05T18:46:04.685323] [WARN ] [VALIDATOR ] PAG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:04.685565] [INFO ] [MAIN ] PAG: Combined data validation passed. [2025-09-05T18:46:04.759733] [INFO ] [MAIN ] PAG: Update completed successfully. [2025-09-05T18:46:04.761206] [INFO ] [MAIN ] Update Progress: 1617/2363 symbols completed. PAG took 1.3s. Estimated remaining: 21m 14s. Rate: 35.1 symbols/min [2025-09-05T18:46:04.942856] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:04.943112] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-09-05T18:46:04.943252] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-05T18:46:04.943292] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-05T18:46:04.943340] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-05T18:46:05.324151] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:46:05.463484] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-05T18:46:06.263631] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-05T18:46:06.644331] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-05T18:46:06.747742] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:46:06.829281] [INFO ] [MAIN ] PACS: Adding 173 new records, updating 0 existing records. [2025-09-05T18:46:06.848534] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-05T18:46:06.855147] [INFO ] [MAIN ] PACS: Combined dataset has 16177 total records. [2025-09-05T18:46:07.034431] [WARN ] [VALIDATOR ] PACS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:07.068569] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-05T18:46:07.245808] [WARN ] [VALIDATOR ] PACS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:07.246044] [INFO ] [MAIN ] PACS: Combined data validation passed. [2025-09-05T18:46:07.341782] [INFO ] [MAIN ] PACS: Update completed successfully. [2025-09-05T18:46:07.343492] [INFO ] [MAIN ] Update Progress: 1618/2363 symbols completed. PACS took 4.8s. Estimated remaining: 21m 12s. Rate: 35.1 symbols/min [2025-09-05T18:46:07.513187] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:07.516404] [INFO ] [MAIN ] PAI: Loaded 1217 existing records. [2025-09-05T18:46:07.685598] [INFO ] [MAIN ] PAI: Found 1 missing trading days. [2025-09-05T18:46:07.685759] [INFO ] [MAIN ] PAI: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:07.863430] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-05T18:46:08.663469] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-05T18:46:08.733963] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:46:08.755139] [INFO ] [MAIN ] PAI: Adding 70 new records, updating 0 existing records. [2025-09-05T18:46:08.756996] [INFO ] [MAIN ] PAI: Combined dataset has 1287 total records. [2025-09-05T18:46:08.995826] [WARN ] [VALIDATOR ] PAI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:09.159163] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-05T18:46:09.188844] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:46:09.221517] [INFO ] [REMOTE ] OWL: Full fetch complete (58226 records). [2025-09-05T18:46:09.471770] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-05T18:46:09.656249] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-05T18:46:09.849751] [WARN ] [VALIDATOR ] PAI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:09.859139] [INFO ] [MAIN ] PAI: Combined data validation passed. [2025-09-05T18:46:09.896243] [INFO ] [MAIN ] PAI: Update completed successfully. [2025-09-05T18:46:09.898259] [INFO ] [MAIN ] Update Progress: 1619/2363 symbols completed. PAI took 2.6s. Estimated remaining: 21m 11s. Rate: 35.1 symbols/min [2025-09-05T18:46:10.089956] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:10.115356] [INFO ] [MAIN ] PAM: Loaded 12830 existing records. [2025-09-05T18:46:10.231578] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-05T18:46:10.237357] [INFO ] [MAIN ] Update Progress: 1620/2363 symbols completed. OWL took 31.8s. Estimated remaining: 21m 9s. Rate: 35.1 symbols/min [2025-09-05T18:46:10.273698] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-05T18:46:10.384613] [INFO ] [MAIN ] PAM: Found 1 missing trading days. [2025-09-05T18:46:10.391167] [INFO ] [MAIN ] PAM: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:10.491947] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:10.508010] [INFO ] [MAIN ] PAR: Loaded 15291 existing records. [2025-09-05T18:46:10.700018] [INFO ] [MAIN ] PAR: Found 1 missing trading days. [2025-09-05T18:46:10.700192] [INFO ] [MAIN ] PAR: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:11.063508] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-05T18:46:11.395792] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-05T18:46:11.596514] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:46:11.710944] [INFO ] [MAIN ] PAR: Adding 320 new records, updating 0 existing records. [2025-09-05T18:46:11.713788] [INFO ] [MAIN ] PAR: Combined dataset has 15611 total records. [2025-09-05T18:46:11.868745] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-05T18:46:11.898444] [WARN ] [VALIDATOR ] PAR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:12.115527] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-05T18:46:12.133290] [WARN ] [VALIDATOR ] PAR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:12.133533] [INFO ] [MAIN ] PAR: Combined data validation passed. [2025-09-05T18:46:12.233203] [INFO ] [MAIN ] PAR: Update completed successfully. [2025-09-05T18:46:12.234897] [INFO ] [MAIN ] Update Progress: 1621/2363 symbols completed. PAR took 2.0s. Estimated remaining: 21m 7s. Rate: 35.1 symbols/min [2025-09-05T18:46:12.405495] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:12.443211] [INFO ] [MAIN ] PARR: Loaded 36361 existing records. [2025-09-05T18:46:12.619433] [INFO ] [MAIN ] PARR: Found 1 missing trading days. [2025-09-05T18:46:12.619589] [INFO ] [MAIN ] PARR: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:12.663430] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-05T18:46:13.077756] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-05T18:46:13.233422] [INFO ] [MAIN ] PARR: Adding 358 new records, updating 0 existing records. [2025-09-05T18:46:13.237752] [INFO ] [MAIN ] PARR: Combined dataset has 36719 total records. [2025-09-05T18:46:13.423954] [WARN ] [VALIDATOR ] PARR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:46:13.471800] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-05T18:46:13.639167] [WARN ] [VALIDATOR ] PARR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:46:13.639411] [INFO ] [MAIN ] PARR: Combined data validation passed. [2025-09-05T18:46:13.766762] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-05T18:46:13.895697] [INFO ] [MAIN ] PARR: Update completed successfully. [2025-09-05T18:46:13.899511] [INFO ] [MAIN ] Update Progress: 1622/2363 symbols completed. PARR took 1.7s. Estimated remaining: 21m 5s. Rate: 35.1 symbols/min [2025-09-05T18:46:14.070497] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:14.097332] [INFO ] [MAIN ] PATH: Loaded 25682 existing records. [2025-09-05T18:46:14.274270] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-05T18:46:14.275558] [INFO ] [MAIN ] PATH: Found 1 missing trading days. [2025-09-05T18:46:14.277265] [INFO ] [MAIN ] PATH: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:14.433151] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-05T18:46:15.063518] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-05T18:46:15.707577] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:46:15.797602] [INFO ] [MAIN ] PAM: Adding 264 new records, updating 0 existing records. [2025-09-05T18:46:15.800284] [INFO ] [MAIN ] PAM: Combined dataset has 13094 total records. [2025-09-05T18:46:15.868676] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-05T18:46:15.986718] [WARN ] [VALIDATOR ] PAM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:16.178887] [WARN ] [VALIDATOR ] PAM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:16.179089] [INFO ] [MAIN ] PAM: Combined data validation passed. [2025-09-05T18:46:16.276171] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-05T18:46:16.303709] [INFO ] [MAIN ] PAM: Update completed successfully. [2025-09-05T18:46:16.305359] [INFO ] [MAIN ] Update Progress: 1623/2363 symbols completed. PAM took 6.4s. Estimated remaining: 21m 4s. Rate: 35.1 symbols/min [2025-09-05T18:46:16.477333] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:16.489052] [INFO ] [MAIN ] PAXS: Loaded 10419 existing records. [2025-09-05T18:46:16.674140] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-05T18:46:16.681430] [INFO ] [MAIN ] PAXS: Found 1 missing trading days. [2025-09-05T18:46:16.683189] [INFO ] [MAIN ] PAXS: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:16.683031] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:46:16.904010] [INFO ] [MAIN ] PATH: Adding 390 new records, updating 0 existing records. [2025-09-05T18:46:16.908061] [INFO ] [MAIN ] PATH: Combined dataset has 26072 total records. [2025-09-05T18:46:17.157947] [WARN ] [VALIDATOR ] PATH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:17.417241] [WARN ] [VALIDATOR ] PATH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:17.417541] [INFO ] [MAIN ] PATH: Combined data validation passed. [2025-09-05T18:46:17.482283] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-05T18:46:17.622310] [INFO ] [MAIN ] PATH: Update completed successfully. [2025-09-05T18:46:17.626480] [INFO ] [MAIN ] Update Progress: 1624/2363 symbols completed. PATH took 3.7s. Estimated remaining: 21m 2s. Rate: 35.1 symbols/min [2025-09-05T18:46:17.858107] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:17.879447] [INFO ] [MAIN ] PAY: Loaded 18684 existing records. [2025-09-05T18:46:18.082068] [INFO ] [MAIN ] PAY: Found 1 missing trading days. [2025-09-05T18:46:18.082262] [INFO ] [MAIN ] PAY: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:18.263500] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-05T18:46:18.537259] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-05T18:46:18.817581] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-05T18:46:19.063440] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-05T18:46:19.070302] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:46:19.186106] [INFO ] [MAIN ] PAY: Adding 318 new records, updating 0 existing records. [2025-09-05T18:46:19.189029] [INFO ] [MAIN ] PAY: Combined dataset has 19002 total records. [2025-09-05T18:46:19.371527] [WARN ] [VALIDATOR ] PAY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:19.569516] [WARN ] [VALIDATOR ] PAY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:19.569862] [INFO ] [MAIN ] PAY: Combined data validation passed. [2025-09-05T18:46:19.686819] [INFO ] [MAIN ] PAY: Update completed successfully. [2025-09-05T18:46:19.688903] [INFO ] [MAIN ] Update Progress: 1625/2363 symbols completed. PAY took 2.1s. Estimated remaining: 21m 1s. Rate: 35.1 symbols/min [2025-09-05T18:46:19.866059] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:19.866183] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-05T18:46:19.895400] [INFO ] [MAIN ] PAYC: Loaded 26893 existing records. [2025-09-05T18:46:20.071448] [INFO ] [MAIN ] PAYC: Found 1 missing trading days. [2025-09-05T18:46:20.071614] [INFO ] [MAIN ] PAYC: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:20.604478] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-05T18:46:20.663491] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-05T18:46:21.315284] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:46:21.434157] [INFO ] [MAIN ] PAYC: Adding 256 new records, updating 0 existing records. [2025-09-05T18:46:21.437583] [INFO ] [MAIN ] PAYC: Combined dataset has 27149 total records. [2025-09-05T18:46:21.469187] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-05T18:46:21.641349] [WARN ] [VALIDATOR ] PAYC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:46:21.895112] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-05T18:46:21.913951] [WARN ] [VALIDATOR ] PAYC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:46:21.914172] [INFO ] [MAIN ] PAYC: Combined data validation passed. [2025-09-05T18:46:22.091354] [INFO ] [MAIN ] PAYC: Update completed successfully. [2025-09-05T18:46:22.094775] [INFO ] [MAIN ] Update Progress: 1626/2363 symbols completed. PAYC took 2.4s. Estimated remaining: 20m 59s. Rate: 35.1 symbols/min [2025-09-05T18:46:22.268809] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-05T18:46:22.270899] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:22.291861] [INFO ] [MAIN ] PB: Loaded 20285 existing records. [2025-09-05T18:46:22.465853] [INFO ] [MAIN ] PB: Found 1 missing trading days. [2025-09-05T18:46:22.466018] [INFO ] [MAIN ] PB: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:22.975447] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-05T18:46:23.063446] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-05T18:46:23.692357] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:46:23.817764] [INFO ] [MAIN ] PB: Adding 343 new records, updating 0 existing records. [2025-09-05T18:46:23.821234] [INFO ] [MAIN ] PB: Combined dataset has 20628 total records. [2025-09-05T18:46:23.868566] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-05T18:46:24.015815] [WARN ] [VALIDATOR ] PB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:24.188367] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-05T18:46:24.274700] [WARN ] [VALIDATOR ] PB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:24.274911] [INFO ] [MAIN ] PB: Combined data validation passed. [2025-09-05T18:46:24.408219] [INFO ] [MAIN ] PB: Update completed successfully. [2025-09-05T18:46:24.411113] [INFO ] [MAIN ] Update Progress: 1627/2363 symbols completed. PB took 2.3s. Estimated remaining: 20m 58s. Rate: 35.1 symbols/min [2025-09-05T18:46:24.580364] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:24.603534] [INFO ] [MAIN ] PBA: Loaded 23652 existing records. [2025-09-05T18:46:24.668658] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-05T18:46:24.780836] [INFO ] [MAIN ] PBA: Found 1 missing trading days. [2025-09-05T18:46:24.780981] [INFO ] [MAIN ] PBA: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:25.184949] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T18:46:25.240666] [INFO ] [MAIN ] PAXS: Adding 109 new records, updating 0 existing records. [2025-09-05T18:46:25.244223] [INFO ] [MAIN ] PAXS: Combined dataset has 10528 total records. [2025-09-05T18:46:25.413404] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:46:25.433797] [WARN ] [VALIDATOR ] PAXS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:25.473033] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-05T18:46:25.491915] [INFO ] [REMOTE ] PACK: Full fetch complete (34499 records). [2025-09-05T18:46:25.986675] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-05T18:46:26.104846] [WARN ] [VALIDATOR ] PAXS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:26.109960] [INFO ] [MAIN ] PAXS: Combined data validation passed. [2025-09-05T18:46:26.173381] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-05T18:46:26.173529] [INFO ] [MAIN ] Update Progress: 1628/2363 symbols completed. PACK took 24.9s. Estimated remaining: 20m 56s. Rate: 35.1 symbols/min [2025-09-05T18:46:26.275795] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-05T18:46:26.408521] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:26.417813] [INFO ] [MAIN ] PAXS: Update completed successfully. [2025-09-05T18:46:26.419463] [INFO ] [MAIN ] Update Progress: 1629/2363 symbols completed. PAXS took 10.1s. Estimated remaining: 20m 54s. Rate: 35.1 symbols/min [2025-09-05T18:46:26.604534] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:26.621003] [INFO ] [MAIN ] PBF: Loaded 40015 existing records. [2025-09-05T18:46:26.807932] [INFO ] [MAIN ] PBH: Loaded 15576 existing records. [2025-09-05T18:46:26.827528] [INFO ] [MAIN ] PBF: Found 1 missing trading days. [2025-09-05T18:46:26.895751] [INFO ] [MAIN ] PBF: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:27.021168] [INFO ] [MAIN ] PBH: Found 1 missing trading days. [2025-09-05T18:46:27.027386] [INFO ] [MAIN ] PBH: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:27.028088] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:46:27.068578] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-05T18:46:27.167291] [INFO ] [MAIN ] PBA: Adding 362 new records, updating 0 existing records. [2025-09-05T18:46:27.170858] [INFO ] [MAIN ] PBA: Combined dataset has 24014 total records. [2025-09-05T18:46:27.356973] [WARN ] [VALIDATOR ] PBA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:27.669504] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-05T18:46:27.691670] [WARN ] [VALIDATOR ] PBA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:27.691921] [INFO ] [MAIN ] PBA: Combined data validation passed. [2025-09-05T18:46:27.852469] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:46:27.869205] [INFO ] [MAIN ] PBA: Update completed successfully. [2025-09-05T18:46:27.869294] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-05T18:46:27.901187] [INFO ] [MAIN ] Update Progress: 1630/2363 symbols completed. PBA took 3.5s. Estimated remaining: 20m 52s. Rate: 35.1 symbols/min [2025-09-05T18:46:28.221350] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:28.229130] [INFO ] [MAIN ] PBF: Adding 386 new records, updating 0 existing records. [2025-09-05T18:46:28.236354] [INFO ] [MAIN ] PBF: Combined dataset has 40401 total records. [2025-09-05T18:46:28.437800] [INFO ] [MAIN ] PBI: Loaded 23923 existing records. [2025-09-05T18:46:28.441540] [WARN ] [VALIDATOR ] PBF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:46:28.663699] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-05T18:46:28.808059] [INFO ] [MAIN ] PBI: Found 1 missing trading days. [2025-09-05T18:46:28.818465] [INFO ] [MAIN ] PBI: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:28.834404] [WARN ] [VALIDATOR ] PBF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:46:28.834617] [INFO ] [MAIN ] PBF: Combined data validation passed. [2025-09-05T18:46:29.094050] [INFO ] [MAIN ] PBF: Update completed successfully. [2025-09-05T18:46:29.098260] [INFO ] [MAIN ] Update Progress: 1631/2363 symbols completed. PBF took 2.9s. Estimated remaining: 20m 50s. Rate: 35.1 symbols/min [2025-09-05T18:46:29.275000] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:29.304298] [INFO ] [MAIN ] PBR: Loaded 25704 existing records. [2025-09-05T18:46:29.475963] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-05T18:46:29.489859] [INFO ] [MAIN ] PBR: Found 1 missing trading days. [2025-09-05T18:46:29.490838] [INFO ] [MAIN ] PBR: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:29.946490] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-05T18:46:30.263528] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-05T18:46:30.277720] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:46:30.434663] [INFO ] [MAIN ] PBI: Adding 362 new records, updating 0 existing records. [2025-09-05T18:46:30.438414] [INFO ] [MAIN ] PBI: Combined dataset has 24285 total records. [2025-09-05T18:46:30.623756] [WARN ] [VALIDATOR ] PBI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:30.711791] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:46:30.735467] [INFO ] [REMOTE ] PAGS: Full fetch complete (57247 records). [2025-09-05T18:46:31.072929] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-05T18:46:31.220439] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-05T18:46:31.229211] [WARN ] [VALIDATOR ] PBI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:31.229425] [INFO ] [MAIN ] PBI: Combined data validation passed. [2025-09-05T18:46:31.440942] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-09-05T18:46:31.579716] [INFO ] [MAIN ] PBH: Adding 0 new records, updating 0 existing records. [2025-09-05T18:46:31.590470] [INFO ] [MAIN ] PBI: Update completed successfully. [2025-09-05T18:46:31.593090] [INFO ] [MAIN ] Update Progress: 1632/2363 symbols completed. PBI took 3.7s. Estimated remaining: 20m 49s. Rate: 35.1 symbols/min [2025-09-05T18:46:31.590386] [INFO ] [MAIN ] PBH: Combined dataset has 15576 total records. [2025-09-05T18:46:31.594288] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:46:31.606810] [FATAL] [MAIN ] PBH: Combined data validation failed. [2025-09-05T18:46:31.607380] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:46:31.617737] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-05T18:46:31.641131] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-09-05T18:46:31.687312] [INFO ] [MAIN ] Update Progress: 1633/2363 symbols completed. PBH took 5.3s. Estimated remaining: 20m 46s. Rate: 35.1 symbols/min [2025-09-05T18:46:31.857062] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:31.955963] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:46:31.968830] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:32.030575] [INFO ] [MAIN ] PBT: Loaded 9419 existing records. [2025-09-05T18:46:32.050379] [INFO ] [MAIN ] PCF: Loaded 4128 existing records. [2025-09-05T18:46:32.409938] [INFO ] [MAIN ] PBR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:46:32.575130] [INFO ] [MAIN ] PBT: Found 1 missing trading days. [2025-09-05T18:46:32.584456] [INFO ] [MAIN ] PBT: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:32.608597] [INFO ] [MAIN ] PCF: Found 1 missing trading days. [2025-09-05T18:46:32.609897] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-05T18:46:32.610555] [INFO ] [MAIN ] PCF: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:32.613278] [INFO ] [MAIN ] PBR: Combined dataset has 26094 total records. [2025-09-05T18:46:32.672347] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-05T18:46:32.819997] [WARN ] [VALIDATOR ] PBR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:32.989877] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-05T18:46:33.004989] [INFO ] [MAIN ] Update Progress: 1634/2363 symbols completed. PAGS took 28.2s. Estimated remaining: 20m 44s. Rate: 35.2 symbols/min [2025-09-05T18:46:33.190690] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:33.200968] [WARN ] [VALIDATOR ] PBR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:33.201229] [INFO ] [MAIN ] PBR: Combined data validation passed. [2025-09-05T18:46:33.318176] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:46:33.410892] [INFO ] [MAIN ] PBT: Adding 138 new records, updating 0 existing records. [2025-09-05T18:46:33.416683] [INFO ] [MAIN ] PCG: Loaded 40459 existing records. [2025-09-05T18:46:33.488364] [INFO ] [MAIN ] PBT: Combined dataset has 9557 total records. [2025-09-05T18:46:33.737351] [INFO ] [MAIN ] PCG: Found 1 missing trading days. [2025-09-05T18:46:33.785773] [INFO ] [MAIN ] PCG: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:33.806628] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-05T18:46:33.806331] [WARN ] [VALIDATOR ] PBT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:34.042303] [INFO ] [MAIN ] PBR: Update completed successfully. [2025-09-05T18:46:34.045961] [INFO ] [MAIN ] Update Progress: 1635/2363 symbols completed. PBR took 4.9s. Estimated remaining: 20m 42s. Rate: 35.2 symbols/min [2025-09-05T18:46:34.155928] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-05T18:46:34.252759] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:34.263620] [INFO ] [MAIN ] PCF: Adding 144 new records, updating 0 existing records. [2025-09-05T18:46:34.271122] [INFO ] [MAIN ] PCF: Combined dataset has 4272 total records. [2025-09-05T18:46:34.270889] [INFO ] [MAIN ] PCM: Loaded 3100 existing records. [2025-09-05T18:46:34.607594] [WARN ] [VALIDATOR ] PCF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:34.774254] [INFO ] [MAIN ] PCM: Found 1 missing trading days. [2025-09-05T18:46:34.779696] [INFO ] [MAIN ] PCM: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:34.804280] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-05T18:46:34.895425] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:46:35.074666] [WARN ] [VALIDATOR ] PBT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:35.080913] [INFO ] [MAIN ] PCG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:46:35.081257] [INFO ] [MAIN ] PBT: Combined data validation passed. [2025-09-05T18:46:35.153576] [INFO ] [MAIN ] PBT: Update completed successfully. [2025-09-05T18:46:35.155422] [INFO ] [MAIN ] Update Progress: 1636/2363 symbols completed. PBT took 3.6s. Estimated remaining: 20m 40s. Rate: 35.2 symbols/min [2025-09-05T18:46:35.157153] [INFO ] [MAIN ] PCG: Combined dataset has 40849 total records. [2025-09-05T18:46:35.156956] [WARN ] [VALIDATOR ] PCF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:35.202171] [INFO ] [MAIN ] PCF: Combined data validation passed. [2025-09-05T18:46:35.482509] [INFO ] [MAIN ] PCF: Update completed successfully. [2025-09-05T18:46:35.485456] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:35.486364] [INFO ] [MAIN ] Update Progress: 1637/2363 symbols completed. PCF took 3.8s. Estimated remaining: 20m 38s. Rate: 35.2 symbols/min [2025-09-05T18:46:35.569416] [WARN ] [VALIDATOR ] PCG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:46:35.689935] [INFO ] [MAIN ] PCN: Loaded 11691 existing records. [2025-09-05T18:46:35.704569] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T18:46:35.809427] [INFO ] [MAIN ] PCM: Adding 64 new records, updating 0 existing records. [2025-09-05T18:46:35.942510] [INFO ] [MAIN ] PCM: Combined dataset has 3164 total records. [2025-09-05T18:46:36.021206] [INFO ] [MAIN ] PCN: Found 1 missing trading days. [2025-09-05T18:46:36.042378] [INFO ] [MAIN ] PCN: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:36.079338] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-05T18:46:36.213752] [WARN ] [VALIDATOR ] PCM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:36.404518] [WARN ] [VALIDATOR ] PCG: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:46:36.405020] [INFO ] [MAIN ] PCG: Combined data validation passed. [2025-09-05T18:46:36.670762] [INFO ] [MAIN ] PCG: Update completed successfully. [2025-09-05T18:46:36.676625] [INFO ] [MAIN ] Update Progress: 1638/2363 symbols completed. PCG took 3.7s. Estimated remaining: 20m 36s. Rate: 35.2 symbols/min [2025-09-05T18:46:36.677843] [WARN ] [VALIDATOR ] PCM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:36.678097] [INFO ] [MAIN ] PCM: Combined data validation passed. [2025-09-05T18:46:36.698457] [INFO ] [MAIN ] PCM: Update completed successfully. [2025-09-05T18:46:36.699077] [INFO ] [MAIN ] Update Progress: 1639/2363 symbols completed. PCM took 2.7s. Estimated remaining: 20m 34s. Rate: 35.2 symbols/min [2025-09-05T18:46:37.346257] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T18:46:37.431126] [INFO ] [MAIN ] PCN: Adding 199 new records, updating 0 existing records. [2025-09-05T18:46:37.434503] [INFO ] [MAIN ] PCN: Combined dataset has 11890 total records. [2025-09-05T18:46:37.642289] [WARN ] [VALIDATOR ] PCN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:37.840394] [WARN ] [VALIDATOR ] PCN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:37.840602] [INFO ] [MAIN ] PCN: Combined data validation passed. [2025-09-05T18:46:37.919389] [INFO ] [MAIN ] PCN: Update completed successfully. [2025-09-05T18:46:37.920890] [INFO ] [MAIN ] Update Progress: 1640/2363 symbols completed. PCN took 2.8s. Estimated remaining: 20m 32s. Rate: 35.2 symbols/min [2025-09-05T18:46:38.594172] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:38.593273] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:38.626164] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:38.649495] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:38.653185] [INFO ] [MAIN ] PDCC: Loaded 411 existing records. [2025-09-05T18:46:38.793494] [INFO ] [MAIN ] PCQ: Loaded 5398 existing records. [2025-09-05T18:46:38.794498] [INFO ] [MAIN ] PD: Loaded 23185 existing records. [2025-09-05T18:46:38.856587] [INFO ] [MAIN ] PCOR: Loaded 22901 existing records. [2025-09-05T18:46:39.039793] [INFO ] [MAIN ] PDCC: Found 1 missing trading days. [2025-09-05T18:46:39.064709] [INFO ] [MAIN ] PDCC: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:39.180373] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-05T18:46:39.402462] [INFO ] [MAIN ] PCQ: Found 1 missing trading days. [2025-09-05T18:46:39.431589] [INFO ] [MAIN ] PCOR: Found 1 missing trading days. [2025-09-05T18:46:39.439591] [INFO ] [MAIN ] PD: Found 1 missing trading days. [2025-09-05T18:46:39.439806] [INFO ] [MAIN ] PCQ: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:39.439953] [INFO ] [MAIN ] PCOR: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:39.439903] [INFO ] [MAIN ] PD: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:39.440280] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-05T18:46:39.440587] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-05T18:46:39.441664] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-05T18:46:39.710053] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:46:39.712920] [INFO ] [MAIN ] PDCC: Adding 5 new records, updating 0 existing records. [2025-09-05T18:46:39.714267] [INFO ] [MAIN ] PDCC: Combined dataset has 416 total records. [2025-09-05T18:46:39.911049] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:46:39.916678] [WARN ] [VALIDATOR ] PDCC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:40.202859] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:46:40.208407] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:46:40.315677] [INFO ] [MAIN ] PD: Adding 376 new records, updating 0 existing records. [2025-09-05T18:46:40.404452] [INFO ] [MAIN ] PCQ: Adding 164 new records, updating 0 existing records. [2025-09-05T18:46:40.447920] [INFO ] [MAIN ] PD: Combined dataset has 23561 total records. [2025-09-05T18:46:40.466367] [INFO ] [MAIN ] PCOR: Adding 359 new records, updating 0 existing records. [2025-09-05T18:46:40.486049] [INFO ] [MAIN ] PCQ: Combined dataset has 5562 total records. [2025-09-05T18:46:40.657299] [INFO ] [MAIN ] PCOR: Combined dataset has 23260 total records. [2025-09-05T18:46:40.952614] [WARN ] [VALIDATOR ] PD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:40.969038] [WARN ] [VALIDATOR ] PCQ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:41.284553] [WARN ] [VALIDATOR ] PCOR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:41.700470] [WARN ] [VALIDATOR ] PDCC: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-08-07 [2025-09-05T18:46:41.701320] [INFO ] [MAIN ] PDCC: Combined data validation passed. [2025-09-05T18:46:41.706548] [INFO ] [MAIN ] PDCC: Update completed successfully. [2025-09-05T18:46:41.706831] [INFO ] [MAIN ] Update Progress: 1641/2363 symbols completed. PDCC took 3.8s. Estimated remaining: 20m 31s. Rate: 35.2 symbols/min [2025-09-05T18:46:41.904040] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:41.914926] [WARN ] [VALIDATOR ] PD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:41.915734] [WARN ] [VALIDATOR ] PCQ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:41.915778] [WARN ] [VALIDATOR ] PCOR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:41.916132] [INFO ] [MAIN ] PCOR: Combined data validation passed. [2025-09-05T18:46:41.916509] [INFO ] [MAIN ] PCQ: Combined data validation passed. [2025-09-05T18:46:41.917075] [INFO ] [MAIN ] PD: Combined data validation passed. [2025-09-05T18:46:42.202149] [INFO ] [MAIN ] PDI: Loaded 23768 existing records. [2025-09-05T18:46:42.205332] [INFO ] [MAIN ] PCQ: Update completed successfully. [2025-09-05T18:46:42.245178] [INFO ] [MAIN ] Update Progress: 1642/2363 symbols completed. PCQ took 4.3s. Estimated remaining: 20m 29s. Rate: 35.2 symbols/min [2025-09-05T18:46:42.304127] [INFO ] [MAIN ] PD: Update completed successfully. [2025-09-05T18:46:42.362757] [INFO ] [MAIN ] Update Progress: 1643/2363 symbols completed. PD took 4.4s. Estimated remaining: 20m 26s. Rate: 35.2 symbols/min [2025-09-05T18:46:42.591965] [INFO ] [MAIN ] PDI: Found 1 missing trading days. [2025-09-05T18:46:42.657950] [INFO ] [MAIN ] PDI: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:42.722349] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-05T18:46:42.734660] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:42.746753] [INFO ] [MAIN ] PCOR: Update completed successfully. [2025-09-05T18:46:42.809356] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:42.807451] [INFO ] [MAIN ] Update Progress: 1644/2363 symbols completed. PCOR took 4.9s. Estimated remaining: 20m 24s. Rate: 35.2 symbols/min [2025-09-05T18:46:43.011957] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:43.013741] [INFO ] [MAIN ] PDO: Loaded 14468 existing records. [2025-09-05T18:46:43.012929] [INFO ] [MAIN ] PDM: Loaded 18156 existing records. [2025-09-05T18:46:43.201976] [INFO ] [MAIN ] PDS: Loaded 7813 existing records. [2025-09-05T18:46:43.446801] [INFO ] [MAIN ] PDM: Found 1 missing trading days. [2025-09-05T18:46:43.497017] [INFO ] [MAIN ] PDM: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:43.505705] [INFO ] [MAIN ] PDO: Found 1 missing trading days. [2025-09-05T18:46:43.511391] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-05T18:46:43.512328] [INFO ] [MAIN ] PDO: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:43.549086] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-05T18:46:43.576292] [INFO ] [MAIN ] PDS: Found 1 missing trading days. [2025-09-05T18:46:43.576432] [INFO ] [MAIN ] PDS: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:43.576669] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-05T18:46:43.934632] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-05T18:46:43.967026] [INFO ] [MAIN ] PDS: Adding 82 new records, updating 0 existing records. [2025-09-05T18:46:43.968976] [INFO ] [MAIN ] PDS: Combined dataset has 7895 total records. [2025-09-05T18:46:44.146521] [WARN ] [VALIDATOR ] PDS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:44.348461] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T18:46:44.453322] [INFO ] [MAIN ] PDM: Adding 285 new records, updating 0 existing records. [2025-09-05T18:46:44.457030] [WARN ] [VALIDATOR ] PDS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:44.457278] [INFO ] [MAIN ] PDM: Combined dataset has 18441 total records. [2025-09-05T18:46:44.457602] [INFO ] [MAIN ] PDS: Combined data validation passed. [2025-09-05T18:46:44.685744] [WARN ] [VALIDATOR ] PDM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:44.781461] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-05T18:46:44.978356] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:46:44.981476] [INFO ] [MAIN ] PDS: Update completed successfully. [2025-09-05T18:46:45.021877] [INFO ] [MAIN ] Update Progress: 1645/2363 symbols completed. PDS took 2.2s. Estimated remaining: 20m 23s. Rate: 35.2 symbols/min [2025-09-05T18:46:45.118001] [INFO ] [MAIN ] PDI: Adding 374 new records, updating 0 existing records. [2025-09-05T18:46:45.311245] [INFO ] [MAIN ] PDO: Adding 274 new records, updating 0 existing records. [2025-09-05T18:46:45.312118] [INFO ] [MAIN ] PDI: Combined dataset has 24142 total records. [2025-09-05T18:46:45.360062] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:45.444783] [INFO ] [MAIN ] PDO: Combined dataset has 14742 total records. [2025-09-05T18:46:45.481374] [INFO ] [MAIN ] PDT: Loaded 8739 existing records. [2025-09-05T18:46:45.723625] [WARN ] [VALIDATOR ] PDI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:45.981139] [WARN ] [VALIDATOR ] PDO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:46.034811] [INFO ] [MAIN ] PDT: Found 1 missing trading days. [2025-09-05T18:46:46.072468] [INFO ] [MAIN ] PDT: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:46.107247] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-05T18:46:46.177659] [WARN ] [VALIDATOR ] PDM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:46.224936] [INFO ] [MAIN ] PDM: Combined data validation passed. [2025-09-05T18:46:46.442455] [INFO ] [MAIN ] PDM: Update completed successfully. [2025-09-05T18:46:46.445369] [INFO ] [MAIN ] Update Progress: 1646/2363 symbols completed. PDM took 4.2s. Estimated remaining: 20m 21s. Rate: 35.2 symbols/min [2025-09-05T18:46:46.442748] [WARN ] [VALIDATOR ] PDO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:46.445899] [INFO ] [MAIN ] PDO: Combined data validation passed. [2025-09-05T18:46:46.446008] [WARN ] [VALIDATOR ] PDI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:46.467716] [INFO ] [MAIN ] PDI: Combined data validation passed. [2025-09-05T18:46:46.797124] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:46.804955] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-09-05T18:46:46.805670] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-05T18:46:46.806897] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-05T18:46:46.807941] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-05T18:46:46.940673] [INFO ] [MAIN ] PDO: Update completed successfully. [2025-09-05T18:46:46.950508] [INFO ] [MAIN ] Update Progress: 1647/2363 symbols completed. PDO took 4.6s. Estimated remaining: 20m 19s. Rate: 35.3 symbols/min [2025-09-05T18:46:47.188022] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:46:47.341251] [INFO ] [MAIN ] PDT: Adding 97 new records, updating 0 existing records. [2025-09-05T18:46:47.382413] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:47.480870] [INFO ] [REMOTE ] PDX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:46:47.475604] [INFO ] [MAIN ] PDT: Combined dataset has 8836 total records. [2025-09-05T18:46:47.482055] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-05T18:46:47.641055] [INFO ] [MAIN ] PDI: Update completed successfully. [2025-09-05T18:46:47.640977] [INFO ] [MAIN ] PEB: Loaded 24095 existing records. [2025-09-05T18:46:47.654175] [INFO ] [MAIN ] Update Progress: 1648/2363 symbols completed. PDI took 5.9s. Estimated remaining: 20m 16s. Rate: 35.3 symbols/min [2025-09-05T18:46:47.758917] [WARN ] [VALIDATOR ] PDT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:48.178625] [INFO ] [MAIN ] PEB: Found 1 missing trading days. [2025-09-05T18:46:48.206088] [INFO ] [MAIN ] PEB: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:48.211722] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-05T18:46:48.255919] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:48.284090] [INFO ] [MAIN ] PEG: Loaded 25393 existing records. [2025-09-05T18:46:48.364244] [WARN ] [VALIDATOR ] PDT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:48.384974] [INFO ] [MAIN ] PDT: Combined data validation passed. [2025-09-05T18:46:48.513074] [INFO ] [MAIN ] PEG: Found 1 missing trading days. [2025-09-05T18:46:48.514331] [INFO ] [MAIN ] PEG: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:48.514934] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-05T18:46:48.532943] [INFO ] [MAIN ] PDT: Update completed successfully. [2025-09-05T18:46:48.534252] [INFO ] [MAIN ] Update Progress: 1649/2363 symbols completed. PDT took 3.5s. Estimated remaining: 20m 14s. Rate: 35.3 symbols/min [2025-09-05T18:46:48.705439] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:48.705582] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-09-05T18:46:48.705732] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-05T18:46:48.705778] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-05T18:46:48.705825] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-05T18:46:49.058355] [INFO ] [REMOTE ] PEN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:46:49.058761] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-05T18:46:49.066052] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-05T18:46:49.204064] [INFO ] [MAIN ] PEB: Adding 359 new records, updating 0 existing records. [2025-09-05T18:46:49.207473] [INFO ] [MAIN ] PEB: Combined dataset has 24454 total records. [2025-09-05T18:46:49.386779] [WARN ] [VALIDATOR ] PEB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:49.559369] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T18:46:49.607583] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-05T18:46:49.617915] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-05T18:46:49.773323] [INFO ] [MAIN ] PEG: Adding 386 new records, updating 0 existing records. [2025-09-05T18:46:49.779135] [INFO ] [MAIN ] PEG: Combined dataset has 25779 total records. [2025-09-05T18:46:49.965616] [WARN ] [VALIDATOR ] PEG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:50.163632] [WARN ] [VALIDATOR ] PEB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:50.164063] [INFO ] [MAIN ] PEB: Combined data validation passed. [2025-09-05T18:46:50.323835] [WARN ] [VALIDATOR ] PEG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:50.325910] [INFO ] [MAIN ] PEG: Combined data validation passed. [2025-09-05T18:46:50.326264] [INFO ] [MAIN ] PEB: Update completed successfully. [2025-09-05T18:46:50.329577] [INFO ] [MAIN ] Update Progress: 1650/2363 symbols completed. PEB took 3.4s. Estimated remaining: 20m 13s. Rate: 35.3 symbols/min [2025-09-05T18:46:50.598813] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:50.627116] [INFO ] [MAIN ] PEO: Loaded 5615 existing records. [2025-09-05T18:46:50.774940] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-05T18:46:50.805049] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-05T18:46:50.874306] [INFO ] [MAIN ] PEO: Found 1 missing trading days. [2025-09-05T18:46:50.877950] [INFO ] [MAIN ] PEO: Need to fetch 1 months: 2025-09 [2025-09-05T18:46:50.886708] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-05T18:46:50.910549] [INFO ] [MAIN ] PEG: Update completed successfully. [2025-09-05T18:46:50.911594] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-05T18:46:50.920253] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-05T18:46:50.919607] [INFO ] [MAIN ] Update Progress: 1651/2363 symbols completed. PEG took 3.2s. Estimated remaining: 20m 11s. Rate: 35.3 symbols/min [2025-09-05T18:46:51.094306] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:51.094498] [WARN ] [MAIN ] PERF: No existing data found, performing full refresh instead. [2025-09-05T18:46:51.094677] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-05T18:46:51.094721] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-05T18:46:51.094766] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-05T18:46:51.269892] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:46:51.412050] [INFO ] [MAIN ] PEO: Adding 110 new records, updating 0 existing records. [2025-09-05T18:46:51.459777] [INFO ] [MAIN ] PEO: Combined dataset has 5725 total records. [2025-09-05T18:46:51.578359] [INFO ] [REMOTE ] PERF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:46:51.627979] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-05T18:46:51.718371] [WARN ] [VALIDATOR ] PEO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:46:51.914021] [WARN ] [VALIDATOR ] PEO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:46:51.914316] [INFO ] [MAIN ] PEO: Combined data validation passed. [2025-09-05T18:46:51.952672] [INFO ] [MAIN ] PEO: Update completed successfully. [2025-09-05T18:46:51.953629] [INFO ] [MAIN ] Update Progress: 1652/2363 symbols completed. PEO took 1.6s. Estimated remaining: 20m 9s. Rate: 35.3 symbols/min [2025-09-05T18:46:52.157021] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-05T18:46:52.180586] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-05T18:46:52.185633] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:46:52.196243] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-05T18:46:52.195666] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-05T18:46:52.197870] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-05T18:46:52.198776] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-05T18:46:52.198943] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-05T18:46:52.199023] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-05T18:46:52.554004] [INFO ] [REMOTE ] PEW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:46:52.554334] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-05T18:46:52.728263] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-05T18:46:52.732352] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-05T18:46:52.744171] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-05T18:46:53.231779] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-05T18:46:53.463461] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-05T18:46:53.857875] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-05T18:46:53.876667] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-05T18:46:54.263498] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-05T18:46:54.482333] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-05T18:46:54.682937] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-05T18:46:55.063488] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-05T18:46:55.443892] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-05T18:46:55.863460] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-05T18:46:56.663503] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-05T18:46:57.425497] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-05T18:46:57.463423] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-05T18:46:57.740278] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-05T18:46:58.263516] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-05T18:46:58.860700] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-05T18:46:58.992693] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-05T18:46:59.063455] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-05T18:46:59.863489] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-05T18:47:00.370046] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-05T18:47:00.663517] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-05T18:47:00.714854] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-05T18:47:01.463519] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-05T18:47:01.923836] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-05T18:47:02.263565] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-05T18:47:02.275633] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-05T18:47:03.063498] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-05T18:47:03.265194] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-05T18:47:03.639283] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-05T18:47:03.863558] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-05T18:47:04.663516] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-05T18:47:04.866611] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-05T18:47:05.189537] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:47:05.192780] [INFO ] [REMOTE ] PEN: Full fetch complete (34071 records). [2025-09-05T18:47:05.468818] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-05T18:47:05.631807] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-05T18:47:05.731770] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-05T18:47:05.790146] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-05T18:47:05.790296] [INFO ] [MAIN ] Update Progress: 1653/2363 symbols completed. PEN took 17.3s. Estimated remaining: 20m 12s. Rate: 35.1 symbols/min [2025-09-05T18:47:05.968155] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:05.972797] [INFO ] [MAIN ] PFD: Loaded 2854 existing records. [2025-09-05T18:47:06.141674] [INFO ] [MAIN ] PFD: Found 1 missing trading days. [2025-09-05T18:47:06.141822] [INFO ] [MAIN ] PFD: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:06.263471] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-05T18:47:07.063493] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-05T18:47:07.355033] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:47:07.380355] [INFO ] [MAIN ] PFD: Adding 76 new records, updating 0 existing records. [2025-09-05T18:47:07.382829] [INFO ] [MAIN ] PFD: Combined dataset has 2930 total records. [2025-09-05T18:47:07.566735] [WARN ] [VALIDATOR ] PFD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:07.767410] [WARN ] [VALIDATOR ] PFD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:07.767668] [INFO ] [MAIN ] PFD: Combined data validation passed. [2025-09-05T18:47:07.787513] [INFO ] [MAIN ] PFD: Update completed successfully. [2025-09-05T18:47:07.788202] [INFO ] [MAIN ] Update Progress: 1654/2363 symbols completed. PFD took 2.0s. Estimated remaining: 20m 11s. Rate: 35.1 symbols/min [2025-09-05T18:47:07.868718] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-05T18:47:07.969115] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:07.997692] [INFO ] [MAIN ] PFE: Loaded 25795 existing records. [2025-09-05T18:47:08.187203] [INFO ] [MAIN ] PFE: Found 1 missing trading days. [2025-09-05T18:47:08.187408] [INFO ] [MAIN ] PFE: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:08.266250] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-05T18:47:08.663481] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-05T18:47:08.896614] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-05T18:47:09.463485] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-05T18:47:10.016045] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-05T18:47:10.263519] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-05T18:47:10.375552] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:47:10.377636] [INFO ] [REMOTE ] PDX: Full fetch complete (16811 records). [2025-09-05T18:47:10.874699] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-05T18:47:10.926187] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:47:11.074499] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-05T18:47:11.229489] [INFO ] [MAIN ] PFE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:47:11.234714] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-05T18:47:11.235878] [INFO ] [MAIN ] Update Progress: 1655/2363 symbols completed. PDX took 24.8s. Estimated remaining: 20m 10s. Rate: 35.1 symbols/min [2025-09-05T18:47:11.390005] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-05T18:47:11.412467] [INFO ] [MAIN ] PFE: Combined dataset has 26185 total records. [2025-09-05T18:47:11.587810] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:11.820278] [INFO ] [MAIN ] PFGC: Loaded 22484 existing records. [2025-09-05T18:47:11.818941] [WARN ] [VALIDATOR ] PFE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:11.875863] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-05T18:47:12.216302] [INFO ] [MAIN ] PFGC: Found 1 missing trading days. [2025-09-05T18:47:12.216715] [INFO ] [MAIN ] PFGC: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:12.228953] [WARN ] [VALIDATOR ] PFE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:12.229180] [INFO ] [MAIN ] PFE: Combined data validation passed. [2025-09-05T18:47:12.404124] [INFO ] [MAIN ] PFE: Update completed successfully. [2025-09-05T18:47:12.407081] [INFO ] [MAIN ] Update Progress: 1656/2363 symbols completed. PFE took 4.6s. Estimated remaining: 20m 8s. Rate: 35.1 symbols/min [2025-09-05T18:47:12.581103] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:12.586240] [INFO ] [MAIN ] PFH: Loaded 3286 existing records. [2025-09-05T18:47:12.668691] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-05T18:47:12.763658] [INFO ] [MAIN ] PFH: Found 1 missing trading days. [2025-09-05T18:47:12.764014] [INFO ] [MAIN ] PFH: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:12.780982] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-05T18:47:13.429278] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:47:13.468582] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-05T18:47:13.571947] [INFO ] [MAIN ] PFGC: Adding 352 new records, updating 0 existing records. [2025-09-05T18:47:13.575060] [INFO ] [MAIN ] PFGC: Combined dataset has 22836 total records. [2025-09-05T18:47:13.753684] [WARN ] [VALIDATOR ] PFGC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:13.946894] [WARN ] [VALIDATOR ] PFGC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:13.947105] [INFO ] [MAIN ] PFGC: Combined data validation passed. [2025-09-05T18:47:14.097569] [INFO ] [MAIN ] PFGC: Update completed successfully. [2025-09-05T18:47:14.100361] [INFO ] [MAIN ] Update Progress: 1657/2363 symbols completed. PFGC took 2.9s. Estimated remaining: 20m 6s. Rate: 35.1 symbols/min [2025-09-05T18:47:14.183896] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:47:14.219904] [INFO ] [MAIN ] PFH: Adding 43 new records, updating 0 existing records. [2025-09-05T18:47:14.264214] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-05T18:47:14.264062] [INFO ] [MAIN ] PFH: Combined dataset has 3329 total records. [2025-09-05T18:47:14.294530] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:14.314351] [WARN ] [MAIN ] PFL: No existing data found, performing full refresh instead. [2025-09-05T18:47:14.351853] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-05T18:47:14.377076] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-05T18:47:14.377191] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-05T18:47:14.620066] [WARN ] [VALIDATOR ] PFH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:15.036931] [INFO ] [REMOTE ] PFL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:47:15.047215] [WARN ] [VALIDATOR ] PFH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:15.047427] [INFO ] [MAIN ] PFH: Combined data validation passed. [2025-09-05T18:47:15.063987] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-05T18:47:15.070059] [INFO ] [MAIN ] PFH: Update completed successfully. [2025-09-05T18:47:15.070655] [INFO ] [MAIN ] Update Progress: 1658/2363 symbols completed. PFH took 2.7s. Estimated remaining: 20m 4s. Rate: 35.1 symbols/min [2025-09-05T18:47:15.247951] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:15.250492] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:47:15.251854] [INFO ] [REMOTE ] PERF: Full fetch complete (16136 records). [2025-09-05T18:47:15.551121] [INFO ] [MAIN ] PFLT: Loaded 32495 existing records. [2025-09-05T18:47:15.763018] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-05T18:47:15.828369] [INFO ] [MAIN ] PFLT: Found 1 missing trading days. [2025-09-05T18:47:15.828513] [INFO ] [MAIN ] PFLT: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:15.878151] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-05T18:47:15.898692] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-05T18:47:15.898817] [INFO ] [MAIN ] Update Progress: 1659/2363 symbols completed. PERF took 25.0s. Estimated remaining: 20m 2s. Rate: 35.1 symbols/min [2025-09-05T18:47:16.036238] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-05T18:47:16.100022] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:16.100246] [WARN ] [MAIN ] PFN: No existing data found, performing full refresh instead. [2025-09-05T18:47:16.100380] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-05T18:47:16.100419] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-05T18:47:16.100466] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-05T18:47:16.455600] [INFO ] [REMOTE ] PFN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:47:16.461953] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:47:16.594736] [INFO ] [MAIN ] PFLT: Adding 264 new records, updating 0 existing records. [2025-09-05T18:47:16.598386] [INFO ] [MAIN ] PFLT: Combined dataset has 32759 total records. [2025-09-05T18:47:16.668727] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-05T18:47:16.781999] [WARN ] [VALIDATOR ] PFLT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:47:16.980561] [WARN ] [VALIDATOR ] PFLT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:47:16.980802] [INFO ] [MAIN ] PFLT: Combined data validation passed. [2025-09-05T18:47:17.198871] [INFO ] [MAIN ] PFLT: Update completed successfully. [2025-09-05T18:47:17.203018] [INFO ] [MAIN ] Update Progress: 1660/2363 symbols completed. PFLT took 2.1s. Estimated remaining: 19m 60s. Rate: 35.2 symbols/min [2025-09-05T18:47:17.372894] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:17.379043] [INFO ] [MAIN ] PFO: Loaded 4237 existing records. [2025-09-05T18:47:17.468558] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-05T18:47:17.549724] [INFO ] [MAIN ] PFO: Found 1 missing trading days. [2025-09-05T18:47:17.549895] [INFO ] [MAIN ] PFO: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:18.263474] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-05T18:47:18.404234] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-05T18:47:18.491939] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-05T18:47:19.063476] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-05T18:47:19.077478] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:47:19.098507] [INFO ] [MAIN ] PFO: Adding 90 new records, updating 0 existing records. [2025-09-05T18:47:19.100398] [INFO ] [MAIN ] PFO: Combined dataset has 4327 total records. [2025-09-05T18:47:19.281153] [WARN ] [VALIDATOR ] PFO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:47:19.474552] [WARN ] [VALIDATOR ] PFO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:47:19.474848] [INFO ] [MAIN ] PFO: Combined data validation passed. [2025-09-05T18:47:19.502160] [INFO ] [MAIN ] PFO: Update completed successfully. [2025-09-05T18:47:19.503014] [INFO ] [MAIN ] Update Progress: 1661/2363 symbols completed. PFO took 2.3s. Estimated remaining: 19m 58s. Rate: 35.1 symbols/min [2025-09-05T18:47:19.712824] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:19.713040] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-09-05T18:47:19.713216] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-05T18:47:19.713265] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-05T18:47:19.713314] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-05T18:47:19.869247] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-05T18:47:20.087908] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-05T18:47:20.093525] [INFO ] [REMOTE ] PFS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:47:20.663473] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-05T18:47:21.447447] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-05T18:47:21.463434] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-05T18:47:21.649711] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-05T18:47:22.263533] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-05T18:47:23.063498] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-05T18:47:23.205097] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-05T18:47:23.207068] [INFO ] [REMOTE ] PEW: Full fetch complete (12057 records). [2025-09-05T18:47:23.387869] [WARN ] [VALIDATOR ] PEW: Not fatal, but first date in data (2025-07-16) does not match expected start date (2025-01-31) [2025-09-05T18:47:23.618836] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-05T18:47:23.636730] [WARN ] [VALIDATOR ] PEW: Missing days changed. Total missing: 113 No longer missing: 2025-01-29, 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15 [2025-09-05T18:47:23.636941] [INFO ] [MAIN ] PEW: Fetched primary data is valid. [2025-09-05T18:47:23.713241] [INFO ] [MAIN ] PEW: Full history saved. [2025-09-05T18:47:23.713388] [INFO ] [MAIN ] Update Progress: 1662/2363 symbols completed. PEW took 31.8s. Estimated remaining: 19m 58s. Rate: 35.1 symbols/min [2025-09-05T18:47:23.864487] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-05T18:47:23.892040] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:23.917175] [INFO ] [MAIN ] PFSI: Loaded 21333 existing records. [2025-09-05T18:47:24.110007] [INFO ] [MAIN ] PFSI: Found 1 missing trading days. [2025-09-05T18:47:24.110325] [INFO ] [MAIN ] PFSI: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:24.258849] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-05T18:47:24.663471] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-05T18:47:25.165267] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-05T18:47:25.304874] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:47:25.398859] [INFO ] [MAIN ] PFSI: Adding 275 new records, updating 0 existing records. [2025-09-05T18:47:25.402211] [INFO ] [MAIN ] PFSI: Combined dataset has 21608 total records. [2025-09-05T18:47:25.468628] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-05T18:47:25.588631] [WARN ] [VALIDATOR ] PFSI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:47:25.792520] [WARN ] [VALIDATOR ] PFSI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:47:25.792747] [INFO ] [MAIN ] PFSI: Combined data validation passed. [2025-09-05T18:47:25.937727] [INFO ] [MAIN ] PFSI: Update completed successfully. [2025-09-05T18:47:25.940487] [INFO ] [MAIN ] Update Progress: 1663/2363 symbols completed. PFSI took 2.2s. Estimated remaining: 19m 56s. Rate: 35.1 symbols/min [2025-09-05T18:47:26.112141] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:26.139635] [INFO ] [MAIN ] PG: Loaded 25738 existing records. [2025-09-05T18:47:26.268680] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-05T18:47:26.319787] [INFO ] [MAIN ] PG: Found 1 missing trading days. [2025-09-05T18:47:26.319892] [INFO ] [MAIN ] PG: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:26.903099] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-05T18:47:26.930520] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-05T18:47:27.063479] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-05T18:47:27.863488] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-05T18:47:28.480126] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-05T18:47:28.497587] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-05T18:47:28.663474] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-05T18:47:29.463507] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-05T18:47:29.520461] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-05T18:47:30.263535] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-05T18:47:30.330288] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:47:30.489407] [INFO ] [MAIN ] PG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:47:30.492824] [INFO ] [MAIN ] PG: Combined dataset has 26128 total records. [2025-09-05T18:47:30.695032] [WARN ] [VALIDATOR ] PG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:30.900238] [WARN ] [VALIDATOR ] PG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:30.900478] [INFO ] [MAIN ] PG: Combined data validation passed. [2025-09-05T18:47:31.063683] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-05T18:47:31.071109] [INFO ] [MAIN ] PG: Update completed successfully. [2025-09-05T18:47:31.074561] [INFO ] [MAIN ] Update Progress: 1664/2363 symbols completed. PG took 5.1s. Estimated remaining: 19m 56s. Rate: 35.1 symbols/min [2025-09-05T18:47:31.266798] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:31.271442] [INFO ] [MAIN ] PGP: Loaded 2675 existing records. [2025-09-05T18:47:31.504687] [INFO ] [MAIN ] PGP: Found 1 missing trading days. [2025-09-05T18:47:31.504904] [INFO ] [MAIN ] PGP: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:31.516873] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-05T18:47:31.863462] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-05T18:47:32.403053] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:47:32.417681] [INFO ] [MAIN ] PGP: Adding 25 new records, updating 0 existing records. [2025-09-05T18:47:32.419199] [INFO ] [MAIN ] PGP: Combined dataset has 2700 total records. [2025-09-05T18:47:32.600446] [WARN ] [VALIDATOR ] PGP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:32.665907] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-05T18:47:32.815397] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-05T18:47:32.830693] [WARN ] [VALIDATOR ] PGP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:32.830920] [INFO ] [MAIN ] PGP: Combined data validation passed. [2025-09-05T18:47:32.851713] [INFO ] [MAIN ] PGP: Update completed successfully. [2025-09-05T18:47:32.852280] [INFO ] [MAIN ] Update Progress: 1665/2363 symbols completed. PGP took 1.8s. Estimated remaining: 19m 54s. Rate: 35.1 symbols/min [2025-09-05T18:47:33.025252] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:33.066965] [INFO ] [MAIN ] PGR: Loaded 39886 existing records. [2025-09-05T18:47:33.245803] [INFO ] [MAIN ] PGR: Found 1 missing trading days. [2025-09-05T18:47:33.245974] [INFO ] [MAIN ] PGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:33.463491] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-05T18:47:33.970005] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-05T18:47:34.263515] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-05T18:47:34.846103] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-05T18:47:35.063531] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-05T18:47:35.348845] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-05T18:47:35.829959] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:47:35.871443] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-05T18:47:36.012849] [INFO ] [MAIN ] PGR: Adding 374 new records, updating 0 existing records. [2025-09-05T18:47:36.018047] [INFO ] [MAIN ] PGR: Combined dataset has 40260 total records. [2025-09-05T18:47:36.212398] [WARN ] [VALIDATOR ] PGR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:47:36.428286] [WARN ] [VALIDATOR ] PGR: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:47:36.428669] [INFO ] [MAIN ] PGR: Combined data validation passed. [2025-09-05T18:47:36.685321] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-05T18:47:36.736054] [INFO ] [MAIN ] PGR: Update completed successfully. [2025-09-05T18:47:36.742714] [INFO ] [MAIN ] Update Progress: 1666/2363 symbols completed. PGR took 3.9s. Estimated remaining: 19m 54s. Rate: 35.0 symbols/min [2025-09-05T18:47:36.930220] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:36.957158] [INFO ] [MAIN ] PGRE: Loaded 22657 existing records. [2025-09-05T18:47:37.137721] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-05T18:47:37.165978] [INFO ] [MAIN ] PGRE: Found 1 missing trading days. [2025-09-05T18:47:37.171522] [INFO ] [MAIN ] PGRE: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:37.463506] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-05T18:47:38.195724] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-05T18:47:38.263441] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-05T18:47:38.507902] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-05T18:47:39.063478] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-05T18:47:39.612037] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-05T18:47:39.863501] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-05T18:47:40.146772] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-05T18:47:40.663440] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-05T18:47:41.018699] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-05T18:47:41.137812] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:47:41.139827] [INFO ] [REMOTE ] PFS: Full fetch complete (38880 records). [2025-09-05T18:47:41.473161] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-05T18:47:41.521921] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-05T18:47:41.698618] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-05T18:47:41.698816] [INFO ] [MAIN ] Update Progress: 1667/2363 symbols completed. PFS took 22.2s. Estimated remaining: 19m 53s. Rate: 35.0 symbols/min [2025-09-05T18:47:41.884378] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:41.889888] [INFO ] [MAIN ] PGZ: Loaded 2741 existing records. [2025-09-05T18:47:42.074304] [INFO ] [MAIN ] PGZ: Found 1 missing trading days. [2025-09-05T18:47:42.074531] [INFO ] [MAIN ] PGZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:42.263491] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-05T18:47:42.554516] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:47:42.556225] [INFO ] [REMOTE ] PFL: Full fetch complete (15090 records). [2025-09-05T18:47:42.932496] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-05T18:47:42.994698] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-05T18:47:42.994845] [INFO ] [MAIN ] Update Progress: 1668/2363 symbols completed. PFL took 28.9s. Estimated remaining: 19m 51s. Rate: 35.0 symbols/min [2025-09-05T18:47:43.064515] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-05T18:47:43.089716] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:47:43.121303] [INFO ] [MAIN ] PGZ: Adding 41 new records, updating 0 existing records. [2025-09-05T18:47:43.169766] [INFO ] [MAIN ] PGZ: Combined dataset has 2782 total records. [2025-09-05T18:47:43.193124] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:43.378188] [WARN ] [VALIDATOR ] PGZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:43.464633] [INFO ] [MAIN ] PH: Loaded 17295 existing records. [2025-09-05T18:47:43.738433] [INFO ] [MAIN ] PH: Found 1 missing trading days. [2025-09-05T18:47:43.738832] [INFO ] [MAIN ] PH: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:43.749667] [WARN ] [VALIDATOR ] PGZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:43.749880] [INFO ] [MAIN ] PGZ: Combined data validation passed. [2025-09-05T18:47:43.768172] [INFO ] [MAIN ] PGZ: Update completed successfully. [2025-09-05T18:47:43.768738] [INFO ] [MAIN ] Update Progress: 1669/2363 symbols completed. PGZ took 2.1s. Estimated remaining: 19m 49s. Rate: 35.0 symbols/min [2025-09-05T18:47:43.868516] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-05T18:47:43.944384] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:43.950887] [INFO ] [MAIN ] PHD: Loaded 4813 existing records. [2025-09-05T18:47:44.119300] [INFO ] [MAIN ] PHD: Found 1 missing trading days. [2025-09-05T18:47:44.119419] [INFO ] [MAIN ] PHD: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:44.158991] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-05T18:47:44.663478] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-05T18:47:44.673413] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:47:44.805877] [INFO ] [MAIN ] PGRE: Adding 316 new records, updating 0 existing records. [2025-09-05T18:47:44.808982] [INFO ] [MAIN ] PGRE: Combined dataset has 22973 total records. [2025-09-05T18:47:44.990113] [WARN ] [VALIDATOR ] PGRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:45.184303] [WARN ] [VALIDATOR ] PGRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:45.184515] [INFO ] [MAIN ] PGRE: Combined data validation passed. [2025-09-05T18:47:45.316541] [INFO ] [MAIN ] PGRE: Update completed successfully. [2025-09-05T18:47:45.319077] [INFO ] [MAIN ] Update Progress: 1670/2363 symbols completed. PGRE took 8.6s. Estimated remaining: 19m 47s. Rate: 35.0 symbols/min [2025-09-05T18:47:45.468709] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-05T18:47:45.492859] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:45.515985] [INFO ] [MAIN ] PHG: Loaded 22061 existing records. [2025-09-05T18:47:45.618722] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:47:45.699405] [INFO ] [MAIN ] PHD: Adding 47 new records, updating 0 existing records. [2025-09-05T18:47:45.733087] [INFO ] [MAIN ] PHD: Combined dataset has 4860 total records. [2025-09-05T18:47:45.739736] [INFO ] [MAIN ] PHG: Found 1 missing trading days. [2025-09-05T18:47:45.783179] [INFO ] [MAIN ] PHG: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:45.918976] [WARN ] [VALIDATOR ] PHD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:46.106719] [WARN ] [VALIDATOR ] PHD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:46.106995] [INFO ] [MAIN ] PHD: Combined data validation passed. [2025-09-05T18:47:46.137930] [INFO ] [MAIN ] PHD: Update completed successfully. [2025-09-05T18:47:46.138793] [INFO ] [MAIN ] Update Progress: 1671/2363 symbols completed. PHD took 2.4s. Estimated remaining: 19m 45s. Rate: 35.0 symbols/min [2025-09-05T18:47:46.177045] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:47:46.268701] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-05T18:47:46.413235] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:46.413457] [INFO ] [MAIN ] PH: Adding 232 new records, updating 0 existing records. [2025-09-05T18:47:46.417263] [INFO ] [MAIN ] PH: Combined dataset has 17527 total records. [2025-09-05T18:47:46.521281] [INFO ] [MAIN ] PHI: Loaded 6884 existing records. [2025-09-05T18:47:46.771321] [WARN ] [VALIDATOR ] PH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:46.832543] [INFO ] [MAIN ] PHI: Found 1 missing trading days. [2025-09-05T18:47:46.872955] [INFO ] [MAIN ] PHI: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:46.991697] [WARN ] [VALIDATOR ] PH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:46.991915] [INFO ] [MAIN ] PH: Combined data validation passed. [2025-09-05T18:47:47.073899] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-05T18:47:47.106341] [INFO ] [MAIN ] PH: Update completed successfully. [2025-09-05T18:47:47.108411] [INFO ] [MAIN ] Update Progress: 1672/2363 symbols completed. PH took 4.1s. Estimated remaining: 19m 43s. Rate: 35.0 symbols/min [2025-09-05T18:47:47.264938] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:47:47.326322] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:47.341859] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-09-05T18:47:47.357405] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-05T18:47:47.367802] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-05T18:47:47.383219] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-05T18:47:47.489383] [INFO ] [MAIN ] PHG: Adding 327 new records, updating 0 existing records. [2025-09-05T18:47:47.612428] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:47:47.612526] [INFO ] [MAIN ] PHG: Combined dataset has 22388 total records. [2025-09-05T18:47:47.857100] [INFO ] [MAIN ] PHI: Adding 141 new records, updating 0 existing records. [2025-09-05T18:47:47.867511] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-05T18:47:48.024626] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:47:47.998519] [INFO ] [MAIN ] PHI: Combined dataset has 7025 total records. [2025-09-05T18:47:48.054710] [WARN ] [VALIDATOR ] PHG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:48.400147] [WARN ] [VALIDATOR ] PHI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:48.644612] [WARN ] [VALIDATOR ] PHG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:48.644772] [WARN ] [VALIDATOR ] PHI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:48.645075] [INFO ] [MAIN ] PHI: Combined data validation passed. [2025-09-05T18:47:48.645232] [INFO ] [MAIN ] PHG: Combined data validation passed. [2025-09-05T18:47:48.667691] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-05T18:47:48.808186] [INFO ] [MAIN ] PHI: Update completed successfully. [2025-09-05T18:47:48.823195] [INFO ] [MAIN ] Update Progress: 1673/2363 symbols completed. PHI took 2.7s. Estimated remaining: 19m 42s. Rate: 35.0 symbols/min [2025-09-05T18:47:48.897970] [INFO ] [MAIN ] PHG: Update completed successfully. [2025-09-05T18:47:48.914104] [INFO ] [MAIN ] Update Progress: 1674/2363 symbols completed. PHG took 3.6s. Estimated remaining: 19m 39s. Rate: 35.1 symbols/min [2025-09-05T18:47:48.993363] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T18:47:49.114243] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:49.110854] [INFO ] [REMOTE ] PFN: Full fetch complete (23278 records). [2025-09-05T18:47:49.270070] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:49.453475] [INFO ] [MAIN ] PHK: Loaded 19706 existing records. [2025-09-05T18:47:49.598953] [INFO ] [MAIN ] PHM: Loaded 24686 existing records. [2025-09-05T18:47:49.933423] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-05T18:47:49.933253] [INFO ] [MAIN ] PHK: Found 1 missing trading days. [2025-09-05T18:47:49.971480] [INFO ] [MAIN ] PHK: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:49.983112] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-05T18:47:50.012829] [INFO ] [MAIN ] PHM: Found 1 missing trading days. [2025-09-05T18:47:50.013575] [INFO ] [MAIN ] PHM: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:50.112371] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-05T18:47:50.143503] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-05T18:47:50.143743] [INFO ] [MAIN ] Update Progress: 1675/2363 symbols completed. PFN took 34.2s. Estimated remaining: 19m 37s. Rate: 35.1 symbols/min [2025-09-05T18:47:50.268589] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-05T18:47:50.318727] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:50.318920] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-09-05T18:47:50.319042] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-05T18:47:50.319090] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-05T18:47:50.319139] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-05T18:47:50.683543] [INFO ] [REMOTE ] PHR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:47:51.026009] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:47:51.068597] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-05T18:47:51.168987] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-05T18:47:51.196219] [INFO ] [MAIN ] PHM: Adding 388 new records, updating 0 existing records. [2025-09-05T18:47:51.280598] [INFO ] [MAIN ] PHK: Adding 257 new records, updating 0 existing records. [2025-09-05T18:47:51.282592] [INFO ] [MAIN ] PHM: Combined dataset has 25074 total records. [2025-09-05T18:47:51.390593] [INFO ] [MAIN ] PHK: Combined dataset has 19963 total records. [2025-09-05T18:47:51.559993] [WARN ] [VALIDATOR ] PHM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:47:51.834410] [WARN ] [VALIDATOR ] PHK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:47:51.875261] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-05T18:47:52.112453] [WARN ] [VALIDATOR ] PHM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:47:52.112371] [WARN ] [VALIDATOR ] PHK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:47:52.112747] [INFO ] [MAIN ] PHM: Combined data validation passed. [2025-09-05T18:47:52.112883] [INFO ] [MAIN ] PHK: Combined data validation passed. [2025-09-05T18:47:52.399376] [INFO ] [MAIN ] PHK: Update completed successfully. [2025-09-05T18:47:52.402788] [INFO ] [MAIN ] PHM: Update completed successfully. [2025-09-05T18:47:52.402623] [INFO ] [MAIN ] Update Progress: 1676/2363 symbols completed. PHK took 3.6s. Estimated remaining: 19m 36s. Rate: 35.1 symbols/min [2025-09-05T18:47:52.426684] [INFO ] [MAIN ] Update Progress: 1677/2363 symbols completed. PHM took 3.5s. Estimated remaining: 19m 33s. Rate: 35.1 symbols/min [2025-09-05T18:47:52.603213] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-05T18:47:52.606232] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:47:52.626690] [INFO ] [MAIN ] PHT: Loaded 12284 existing records. [2025-09-05T18:47:52.669777] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-05T18:47:52.803961] [INFO ] [MAIN ] PHT: Found 1 missing trading days. [2025-09-05T18:47:52.804177] [INFO ] [MAIN ] PHT: Need to fetch 1 months: 2025-09 [2025-09-05T18:47:53.316678] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-05T18:47:53.463478] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-05T18:47:54.032323] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-05T18:47:54.082145] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:47:54.141253] [INFO ] [MAIN ] PHT: Adding 89 new records, updating 0 existing records. [2025-09-05T18:47:54.143553] [INFO ] [MAIN ] PHT: Combined dataset has 12373 total records. [2025-09-05T18:47:54.268570] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-05T18:47:54.329463] [WARN ] [VALIDATOR ] PHT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:47:54.519592] [WARN ] [VALIDATOR ] PHT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:47:54.519831] [INFO ] [MAIN ] PHT: Combined data validation passed. [2025-09-05T18:47:54.594068] [INFO ] [MAIN ] PHT: Update completed successfully. [2025-09-05T18:47:54.595661] [INFO ] [MAIN ] Update Progress: 1678/2363 symbols completed. PHT took 2.2s. Estimated remaining: 19m 32s. Rate: 35.1 symbols/min [2025-09-05T18:47:55.063535] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-05T18:47:55.927781] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-05T18:47:55.936439] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-05T18:47:56.482375] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-05T18:47:56.663470] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-05T18:47:56.945256] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-05T18:47:57.463492] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-05T18:47:58.055162] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-05T18:47:58.263510] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-05T18:47:59.004869] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-05T18:47:59.063437] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-05T18:47:59.595920] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-05T18:47:59.863519] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-05T18:48:00.363123] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-05T18:48:00.663525] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-05T18:48:01.052501] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-05T18:48:01.463517] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-05T18:48:01.981353] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-05T18:48:02.263476] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-05T18:48:02.871569] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-05T18:48:03.063434] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-05T18:48:03.532490] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-05T18:48:03.863496] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-05T18:48:04.358570] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T18:48:04.360936] [INFO ] [REMOTE ] PHIN: Full fetch complete (36659 records). [2025-09-05T18:48:04.866675] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-05T18:48:04.904063] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-05T18:48:04.979560] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-05T18:48:05.077855] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-05T18:48:05.078014] [INFO ] [MAIN ] Update Progress: 1679/2363 symbols completed. PHIN took 18.0s. Estimated remaining: 19m 34s. Rate: 35.0 symbols/min [2025-09-05T18:48:05.622976] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:48:05.625541] [INFO ] [REMOTE ] PHR: Full fetch complete (38785 records). [2025-09-05T18:48:05.986897] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-05T18:48:06.158835] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-05T18:48:06.158984] [INFO ] [MAIN ] Update Progress: 1680/2363 symbols completed. PHR took 16.0s. Estimated remaining: 19m 32s. Rate: 35.0 symbols/min [2025-09-05T18:48:06.872840] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:06.821190] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:06.895619] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:06.901231] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:06.902114] [WARN ] [MAIN ] PINE: No existing data found, performing full refresh instead. [2025-09-05T18:48:06.902767] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-05T18:48:06.903249] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-05T18:48:06.903613] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-05T18:48:06.973660] [INFO ] [MAIN ] PIM: Loaded 2109 existing records. [2025-09-05T18:48:07.173621] [INFO ] [MAIN ] PII: Loaded 23090 existing records. [2025-09-05T18:48:07.309040] [INFO ] [MAIN ] PINS: Loaded 25674 existing records. [2025-09-05T18:48:07.581907] [INFO ] [MAIN ] PIM: Found 1 missing trading days. [2025-09-05T18:48:07.667721] [INFO ] [REMOTE ] PINE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:07.626661] [INFO ] [MAIN ] PIM: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:07.682833] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-05T18:48:07.683052] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-05T18:48:07.808838] [INFO ] [MAIN ] PII: Found 1 missing trading days. [2025-09-05T18:48:07.829363] [INFO ] [MAIN ] PII: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:07.856328] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-05T18:48:07.882694] [INFO ] [MAIN ] PINS: Found 1 missing trading days. [2025-09-05T18:48:07.883350] [INFO ] [MAIN ] PINS: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:07.883589] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-05T18:48:08.373939] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:48:08.392966] [INFO ] [MAIN ] PIM: Adding 51 new records, updating 0 existing records. [2025-09-05T18:48:08.396085] [INFO ] [MAIN ] PIM: Combined dataset has 2160 total records. [2025-09-05T18:48:08.582194] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:48:08.607734] [WARN ] [VALIDATOR ] PIM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:08.811980] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:48:08.991951] [INFO ] [MAIN ] PII: Adding 327 new records, updating 0 existing records. [2025-09-05T18:48:09.104630] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-05T18:48:09.135822] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-05T18:48:09.156320] [INFO ] [MAIN ] PINS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:48:09.160118] [INFO ] [MAIN ] PII: Combined dataset has 23417 total records. [2025-09-05T18:48:09.265731] [INFO ] [MAIN ] PINS: Combined dataset has 26064 total records. [2025-09-05T18:48:09.426061] [WARN ] [VALIDATOR ] PII: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:09.660603] [WARN ] [VALIDATOR ] PINS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:09.955516] [WARN ] [VALIDATOR ] PIM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:09.955740] [INFO ] [MAIN ] PIM: Combined data validation passed. [2025-09-05T18:48:09.971062] [INFO ] [MAIN ] PIM: Update completed successfully. [2025-09-05T18:48:09.971743] [INFO ] [MAIN ] Update Progress: 1681/2363 symbols completed. PIM took 3.8s. Estimated remaining: 19m 31s. Rate: 34.9 symbols/min [2025-09-05T18:48:10.158261] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:10.174354] [WARN ] [VALIDATOR ] PINS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:10.174677] [INFO ] [MAIN ] PINS: Combined data validation passed. [2025-09-05T18:48:10.174249] [WARN ] [VALIDATOR ] PII: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:10.175144] [INFO ] [MAIN ] PII: Combined data validation passed. [2025-09-05T18:48:10.181283] [INFO ] [MAIN ] PIPR: Loaded 7097 existing records. [2025-09-05T18:48:10.616100] [INFO ] [MAIN ] PII: Update completed successfully. [2025-09-05T18:48:10.678819] [INFO ] [MAIN ] PIPR: Found 1 missing trading days. [2025-09-05T18:48:10.669699] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-05T18:48:10.675239] [INFO ] [MAIN ] Update Progress: 1682/2363 symbols completed. PII took 4.5s. Estimated remaining: 19m 29s. Rate: 35.0 symbols/min [2025-09-05T18:48:10.687370] [INFO ] [MAIN ] PIPR: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:10.688572] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-05T18:48:10.688879] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-05T18:48:10.806358] [INFO ] [MAIN ] PINS: Update completed successfully. [2025-09-05T18:48:10.819512] [INFO ] [MAIN ] Update Progress: 1683/2363 symbols completed. PINS took 4.7s. Estimated remaining: 19m 26s. Rate: 35.0 symbols/min [2025-09-05T18:48:10.956487] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:11.053834] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:11.059767] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:48:11.095737] [INFO ] [MAIN ] PIPR: Adding 82 new records, updating 0 existing records. [2025-09-05T18:48:11.095854] [INFO ] [MAIN ] PJT: Loaded 9728 existing records. [2025-09-05T18:48:11.197560] [INFO ] [MAIN ] PIPR: Combined dataset has 7179 total records. [2025-09-05T18:48:11.338872] [INFO ] [MAIN ] PJT: Found 1 missing trading days. [2025-09-05T18:48:11.366918] [INFO ] [MAIN ] PJT: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:11.378266] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-05T18:48:11.395120] [INFO ] [MAIN ] PK: Loaded 25195 existing records. [2025-09-05T18:48:11.560285] [WARN ] [VALIDATOR ] PIPR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:11.792878] [INFO ] [MAIN ] PK: Found 1 missing trading days. [2025-09-05T18:48:11.816629] [INFO ] [MAIN ] PK: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:11.857950] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-05T18:48:11.864795] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:48:11.864655] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-05T18:48:11.911001] [INFO ] [MAIN ] PJT: Adding 110 new records, updating 0 existing records. [2025-09-05T18:48:11.914020] [INFO ] [MAIN ] PJT: Combined dataset has 9838 total records. [2025-09-05T18:48:12.101174] [WARN ] [VALIDATOR ] PJT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:12.311672] [WARN ] [VALIDATOR ] PJT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:12.311876] [INFO ] [MAIN ] PJT: Combined data validation passed. [2025-09-05T18:48:12.311590] [WARN ] [VALIDATOR ] PIPR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:12.312592] [INFO ] [MAIN ] PIPR: Combined data validation passed. [2025-09-05T18:48:12.413906] [INFO ] [MAIN ] PIPR: Update completed successfully. [2025-09-05T18:48:12.418879] [INFO ] [MAIN ] Update Progress: 1684/2363 symbols completed. PIPR took 2.4s. Estimated remaining: 19m 25s. Rate: 35.0 symbols/min [2025-09-05T18:48:12.545101] [INFO ] [MAIN ] PJT: Update completed successfully. [2025-09-05T18:48:12.551728] [INFO ] [MAIN ] Update Progress: 1685/2363 symbols completed. PJT took 1.9s. Estimated remaining: 19m 22s. Rate: 35.0 symbols/min [2025-09-05T18:48:12.666947] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:12.667007] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-05T18:48:12.679199] [WARN ] [MAIN ] PKE: No existing data found, performing full refresh instead. [2025-09-05T18:48:12.708662] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-05T18:48:12.714365] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-05T18:48:12.755727] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-05T18:48:12.819283] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:13.050720] [INFO ] [MAIN ] PKG: Loaded 18222 existing records. [2025-09-05T18:48:13.267247] [INFO ] [REMOTE ] PKE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:13.324456] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-05T18:48:13.364939] [INFO ] [MAIN ] PKG: Found 1 missing trading days. [2025-09-05T18:48:13.365480] [INFO ] [MAIN ] PKG: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:13.372739] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:48:13.468543] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-05T18:48:13.530414] [INFO ] [MAIN ] PK: Adding 386 new records, updating 0 existing records. [2025-09-05T18:48:13.534057] [INFO ] [MAIN ] PK: Combined dataset has 25581 total records. [2025-09-05T18:48:13.724960] [WARN ] [VALIDATOR ] PK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:13.928185] [WARN ] [VALIDATOR ] PK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:13.928464] [INFO ] [MAIN ] PK: Combined data validation passed. [2025-09-05T18:48:14.094233] [INFO ] [MAIN ] PK: Update completed successfully. [2025-09-05T18:48:14.097423] [INFO ] [MAIN ] Update Progress: 1686/2363 symbols completed. PK took 3.3s. Estimated remaining: 19m 21s. Rate: 35.0 symbols/min [2025-09-05T18:48:14.273584] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-05T18:48:14.277105] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:14.289349] [INFO ] [MAIN ] PKST: Loaded 8560 existing records. [2025-09-05T18:48:14.477757] [INFO ] [MAIN ] PKST: Found 1 missing trading days. [2025-09-05T18:48:14.477947] [INFO ] [MAIN ] PKST: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:14.502978] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-05T18:48:15.063500] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-05T18:48:15.190211] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-05T18:48:15.662457] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T18:48:15.781675] [INFO ] [MAIN ] PKG: Adding 303 new records, updating 0 existing records. [2025-09-05T18:48:15.785067] [INFO ] [MAIN ] PKG: Combined dataset has 18525 total records. [2025-09-05T18:48:15.868566] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-05T18:48:16.027347] [WARN ] [VALIDATOR ] PKG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:16.223794] [WARN ] [VALIDATOR ] PKG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:16.224001] [INFO ] [MAIN ] PKG: Combined data validation passed. [2025-09-05T18:48:16.342792] [INFO ] [MAIN ] PKG: Update completed successfully. [2025-09-05T18:48:16.344908] [INFO ] [MAIN ] Update Progress: 1687/2363 symbols completed. PKG took 3.8s. Estimated remaining: 19m 19s. Rate: 35.0 symbols/min [2025-09-05T18:48:16.517372] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:16.528285] [INFO ] [MAIN ] PKX: Loaded 10000 existing records. [2025-09-05T18:48:16.676637] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-05T18:48:16.691352] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-05T18:48:16.714959] [INFO ] [MAIN ] PKX: Found 1 missing trading days. [2025-09-05T18:48:16.718525] [INFO ] [MAIN ] PKX: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:17.463485] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-05T18:48:17.852796] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:48:17.909822] [INFO ] [MAIN ] PKST: Adding 119 new records, updating 0 existing records. [2025-09-05T18:48:17.911909] [INFO ] [MAIN ] PKST: Combined dataset has 8679 total records. [2025-09-05T18:48:18.024556] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:48:18.132934] [WARN ] [VALIDATOR ] PKST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:18.252013] [INFO ] [MAIN ] PKX: Adding 238 new records, updating 0 existing records. [2025-09-05T18:48:18.267784] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-05T18:48:18.325527] [INFO ] [MAIN ] PKX: Combined dataset has 10238 total records. [2025-09-05T18:48:18.549627] [WARN ] [VALIDATOR ] PKX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:18.748036] [WARN ] [VALIDATOR ] PKST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:18.748250] [INFO ] [MAIN ] PKST: Combined data validation passed. [2025-09-05T18:48:18.747947] [WARN ] [VALIDATOR ] PKX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:18.748945] [INFO ] [MAIN ] PKX: Combined data validation passed. [2025-09-05T18:48:18.857126] [INFO ] [MAIN ] PKX: Update completed successfully. [2025-09-05T18:48:18.859223] [INFO ] [MAIN ] Update Progress: 1688/2363 symbols completed. PKX took 2.5s. Estimated remaining: 19m 18s. Rate: 35.0 symbols/min [2025-09-05T18:48:19.002523] [INFO ] [MAIN ] PKST: Update completed successfully. [2025-09-05T18:48:19.003735] [INFO ] [MAIN ] Update Progress: 1689/2363 symbols completed. PKST took 4.9s. Estimated remaining: 19m 15s. Rate: 35.0 symbols/min [2025-09-05T18:48:18.997317] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-05T18:48:19.068561] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-05T18:48:19.062314] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:19.240615] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:19.279911] [INFO ] [MAIN ] PL: Loaded 39953 existing records. [2025-09-05T18:48:19.382049] [INFO ] [MAIN ] PLD: Loaded 25529 existing records. [2025-09-05T18:48:19.599108] [INFO ] [MAIN ] PL: Found 1 missing trading days. [2025-09-05T18:48:19.642123] [INFO ] [MAIN ] PL: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:19.650089] [INFO ] [MAIN ] PLD: Found 1 missing trading days. [2025-09-05T18:48:19.650447] [INFO ] [MAIN ] PLD: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:19.866789] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-05T18:48:19.868110] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-05T18:48:20.655668] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-05T18:48:20.663414] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-05T18:48:21.271761] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-05T18:48:21.463474] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-05T18:48:22.263564] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-05T18:48:22.387011] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-05T18:48:22.949924] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:48:23.068628] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-05T18:48:23.117753] [INFO ] [MAIN ] PL: Adding 389 new records, updating 0 existing records. [2025-09-05T18:48:23.121736] [INFO ] [MAIN ] PL: Combined dataset has 40342 total records. [2025-09-05T18:48:23.307605] [WARN ] [VALIDATOR ] PL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:48:23.509743] [WARN ] [VALIDATOR ] PL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:48:23.509979] [INFO ] [MAIN ] PL: Combined data validation passed. [2025-09-05T18:48:23.746412] [INFO ] [MAIN ] PL: Update completed successfully. [2025-09-05T18:48:23.750447] [INFO ] [MAIN ] Update Progress: 1690/2363 symbols completed. PL took 4.9s. Estimated remaining: 19m 15s. Rate: 35.0 symbols/min [2025-09-05T18:48:23.863525] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-05T18:48:23.930599] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:23.932553] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:48:23.932313] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-09-05T18:48:23.959446] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-05T18:48:23.959684] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-05T18:48:23.959747] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-05T18:48:24.310624] [INFO ] [MAIN ] PLD: Adding 385 new records, updating 0 existing records. [2025-09-05T18:48:24.449221] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:24.450714] [INFO ] [MAIN ] PLD: Combined dataset has 25914 total records. [2025-09-05T18:48:24.634468] [WARN ] [VALIDATOR ] PLD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:24.635329] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-05T18:48:24.666348] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-05T18:48:24.839726] [WARN ] [VALIDATOR ] PLD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:24.839952] [INFO ] [MAIN ] PLD: Combined data validation passed. [2025-09-05T18:48:25.008357] [INFO ] [MAIN ] PLD: Update completed successfully. [2025-09-05T18:48:25.011711] [INFO ] [MAIN ] Update Progress: 1691/2363 symbols completed. PLD took 5.9s. Estimated remaining: 19m 13s. Rate: 35.0 symbols/min [2025-09-05T18:48:25.186528] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:25.198880] [INFO ] [MAIN ] PLOW: Loaded 9586 existing records. [2025-09-05T18:48:25.370629] [INFO ] [MAIN ] PLOW: Found 1 missing trading days. [2025-09-05T18:48:25.370795] [INFO ] [MAIN ] PLOW: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:25.463435] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-05T18:48:26.149254] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:48:26.199147] [INFO ] [MAIN ] PLOW: Adding 99 new records, updating 0 existing records. [2025-09-05T18:48:26.201261] [INFO ] [MAIN ] PLOW: Combined dataset has 9685 total records. [2025-09-05T18:48:26.268589] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-05T18:48:26.385709] [WARN ] [VALIDATOR ] PLOW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:26.600863] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-05T18:48:26.621240] [WARN ] [VALIDATOR ] PLOW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:26.621497] [INFO ] [MAIN ] PLOW: Combined data validation passed. [2025-09-05T18:48:26.683192] [INFO ] [MAIN ] PLOW: Update completed successfully. [2025-09-05T18:48:26.684562] [INFO ] [MAIN ] Update Progress: 1692/2363 symbols completed. PLOW took 1.7s. Estimated remaining: 19m 11s. Rate: 35.0 symbols/min [2025-09-05T18:48:26.866320] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:26.892812] [INFO ] [MAIN ] PLYM: Loaded 24438 existing records. [2025-09-05T18:48:27.063814] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-05T18:48:27.071743] [INFO ] [MAIN ] PLYM: Found 1 missing trading days. [2025-09-05T18:48:27.072963] [INFO ] [MAIN ] PLYM: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:27.325751] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-05T18:48:27.863477] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-05T18:48:28.647855] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:48:28.649155] [INFO ] [REMOTE ] PINE: Full fetch complete (15893 records). [2025-09-05T18:48:28.670126] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-05T18:48:28.989875] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-05T18:48:29.061276] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-05T18:48:29.134811] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-05T18:48:29.134980] [INFO ] [MAIN ] Update Progress: 1693/2363 symbols completed. PINE took 23.0s. Estimated remaining: 19m 10s. Rate: 35.0 symbols/min [2025-09-05T18:48:29.316925] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:29.349579] [INFO ] [MAIN ] PM: Loaded 25670 existing records. [2025-09-05T18:48:29.468696] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-05T18:48:29.535586] [INFO ] [MAIN ] PM: Found 1 missing trading days. [2025-09-05T18:48:29.535779] [INFO ] [MAIN ] PM: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:29.903682] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:48:30.016679] [INFO ] [MAIN ] PLYM: Adding 299 new records, updating 0 existing records. [2025-09-05T18:48:30.034200] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-05T18:48:30.040660] [INFO ] [MAIN ] PLYM: Combined dataset has 24737 total records. [2025-09-05T18:48:30.218073] [WARN ] [VALIDATOR ] PLYM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:48:30.270361] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-05T18:48:30.420731] [WARN ] [VALIDATOR ] PLYM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:48:30.420944] [INFO ] [MAIN ] PLYM: Combined data validation passed. [2025-09-05T18:48:30.571604] [INFO ] [MAIN ] PLYM: Update completed successfully. [2025-09-05T18:48:30.574705] [INFO ] [MAIN ] Update Progress: 1694/2363 symbols completed. PLYM took 3.9s. Estimated remaining: 19m 8s. Rate: 35.0 symbols/min [2025-09-05T18:48:30.746874] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:30.747093] [WARN ] [MAIN ] PML: No existing data found, performing full refresh instead. [2025-09-05T18:48:30.747232] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-05T18:48:30.747280] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-05T18:48:30.747333] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-05T18:48:31.068778] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-05T18:48:31.108067] [INFO ] [REMOTE ] PML: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:31.339525] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-05T18:48:31.863475] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-05T18:48:31.960157] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:48:32.109714] [INFO ] [MAIN ] PM: Adding 390 new records, updating 0 existing records. [2025-09-05T18:48:32.113512] [INFO ] [MAIN ] PM: Combined dataset has 26060 total records. [2025-09-05T18:48:32.310248] [WARN ] [VALIDATOR ] PM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:32.418341] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T18:48:32.441809] [INFO ] [REMOTE ] PKE: Full fetch complete (13017 records). [2025-09-05T18:48:32.667066] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-05T18:48:32.932823] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-05T18:48:32.966966] [WARN ] [VALIDATOR ] PM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:32.972442] [INFO ] [MAIN ] PM: Combined data validation passed. [2025-09-05T18:48:33.059304] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-05T18:48:33.071187] [INFO ] [MAIN ] Update Progress: 1695/2363 symbols completed. PKE took 20.7s. Estimated remaining: 19m 7s. Rate: 35.0 symbols/min [2025-09-05T18:48:33.344565] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:33.345036] [WARN ] [MAIN ] PMM: No existing data found, performing full refresh instead. [2025-09-05T18:48:33.356358] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-05T18:48:33.356462] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-05T18:48:33.356520] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-05T18:48:33.361946] [INFO ] [MAIN ] PM: Update completed successfully. [2025-09-05T18:48:33.419549] [INFO ] [MAIN ] Update Progress: 1696/2363 symbols completed. PM took 4.3s. Estimated remaining: 19m 4s. Rate: 35.0 symbols/min [2025-09-05T18:48:33.476967] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-05T18:48:33.841314] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:33.925776] [INFO ] [MAIN ] PMO: Loaded 4196 existing records. [2025-09-05T18:48:33.929132] [INFO ] [REMOTE ] PMM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:34.112290] [INFO ] [MAIN ] PMO: Found 1 missing trading days. [2025-09-05T18:48:34.112429] [INFO ] [MAIN ] PMO: Need to fetch 1 months: 2025-09 [2025-09-05T18:48:34.263479] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-05T18:48:34.499408] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-05T18:48:34.695487] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-05T18:48:35.063477] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-05T18:48:35.863484] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-05T18:48:36.165767] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-05T18:48:36.535363] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-05T18:48:36.663465] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-05T18:48:37.449738] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-05T18:48:37.463428] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-05T18:48:38.263497] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-05T18:48:38.457025] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-05T18:48:39.063551] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-05T18:48:39.863484] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-05T18:48:40.007975] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-05T18:48:40.084827] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-05T18:48:40.663506] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-05T18:48:40.792500] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-05T18:48:41.463467] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-05T18:48:42.115730] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-05T18:48:42.263458] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-05T18:48:42.346426] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-05T18:48:43.063459] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-05T18:48:43.863507] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-05T18:48:43.991877] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-05T18:48:44.026705] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-05T18:48:44.663460] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-05T18:48:45.194923] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-05T18:48:45.464133] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-05T18:48:45.465007] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-05T18:48:46.263487] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-05T18:48:47.063443] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-05T18:48:47.266465] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-05T18:48:47.408590] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-05T18:48:47.841348] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-05T18:48:47.863464] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-05T18:48:48.589586] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:48:48.590734] [INFO ] [REMOTE ] PMM: Full fetch complete (13079 records). [2025-09-05T18:48:48.668560] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-05T18:48:48.963734] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-05T18:48:49.018086] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-05T18:48:49.018268] [INFO ] [MAIN ] Update Progress: 1697/2363 symbols completed. PMM took 15.9s. Estimated remaining: 19m 8s. Rate: 34.8 symbols/min [2025-09-05T18:48:49.203507] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:49.203741] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-09-05T18:48:49.203930] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-05T18:48:49.203971] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-05T18:48:49.204018] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-05T18:48:49.478535] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-05T18:48:49.618550] [INFO ] [REMOTE ] PMT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:49.912930] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-05T18:48:50.263488] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-05T18:48:51.063537] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-05T18:48:51.195761] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-05T18:48:51.424822] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-05T18:48:51.863452] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-05T18:48:52.431239] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-05T18:48:52.615455] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:48:52.618123] [INFO ] [REMOTE ] PLNT: Full fetch complete (53237 records). [2025-09-05T18:48:52.673131] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-05T18:48:52.987592] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-05T18:48:53.215705] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-05T18:48:53.215867] [INFO ] [MAIN ] Update Progress: 1698/2363 symbols completed. PLNT took 29.5s. Estimated remaining: 19m 7s. Rate: 34.8 symbols/min [2025-09-05T18:48:53.386262] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:53.386420] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-05T18:48:53.386543] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-05T18:48:53.386583] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-05T18:48:53.386629] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-05T18:48:53.468624] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-05T18:48:53.753116] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:54.172113] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-05T18:48:54.263424] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-05T18:48:54.417215] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (20.15 seconds). [2025-09-05T18:48:54.449223] [INFO ] [MAIN ] PMO: Adding 78 new records, updating 0 existing records. [2025-09-05T18:48:54.450855] [INFO ] [MAIN ] PMO: Combined dataset has 4274 total records. [2025-09-05T18:48:54.629718] [WARN ] [VALIDATOR ] PMO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:48:54.825437] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-05T18:48:54.842211] [WARN ] [VALIDATOR ] PMO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:48:54.842450] [INFO ] [MAIN ] PMO: Combined data validation passed. [2025-09-05T18:48:54.869060] [INFO ] [MAIN ] PMO: Update completed successfully. [2025-09-05T18:48:54.869662] [INFO ] [MAIN ] Update Progress: 1699/2363 symbols completed. PMO took 21.4s. Estimated remaining: 19m 6s. Rate: 34.8 symbols/min [2025-09-05T18:48:55.043498] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:55.044256] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-05T18:48:55.044428] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-05T18:48:55.044469] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-05T18:48:55.044515] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-05T18:48:55.075353] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-05T18:48:55.401186] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:55.802191] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-05T18:48:55.863445] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-05T18:48:56.473380] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T18:48:56.475493] [INFO ] [REMOTE ] PML: Full fetch complete (21200 records). [2025-09-05T18:48:56.672481] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-05T18:48:56.839107] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-05T18:48:56.934900] [INFO ] [MAIN ] PML: Full history saved. [2025-09-05T18:48:56.935047] [INFO ] [MAIN ] Update Progress: 1700/2363 symbols completed. PML took 26.4s. Estimated remaining: 19m 4s. Rate: 34.8 symbols/min [2025-09-05T18:48:57.033098] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-05T18:48:57.114251] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:48:57.114421] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-05T18:48:57.114576] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-05T18:48:57.114622] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-05T18:48:57.114700] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-05T18:48:57.464702] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-05T18:48:57.470232] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:48:57.516897] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-05T18:48:58.197445] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-05T18:48:58.263504] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-05T18:48:59.063470] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-05T18:48:59.314072] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-05T18:48:59.739891] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-05T18:48:59.863511] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-05T18:49:00.064870] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-05T18:49:00.663549] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-05T18:49:01.020575] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-05T18:49:01.463549] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-05T18:49:02.219656] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-05T18:49:02.263497] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-05T18:49:03.032489] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-05T18:49:03.063424] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-05T18:49:03.718610] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-05T18:49:03.863477] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-05T18:49:04.066241] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-05T18:49:04.663489] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-05T18:49:04.873012] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-05T18:49:05.463528] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-05T18:49:06.263492] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-05T18:49:06.372728] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-05T18:49:06.534702] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-05T18:49:07.063511] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-05T18:49:07.863497] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-05T18:49:08.345298] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-05T18:49:08.491769] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-05T18:49:08.663489] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-05T18:49:09.208687] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-05T18:49:09.463536] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-05T18:49:10.263523] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-05T18:49:10.655846] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-05T18:49:11.064200] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-05T18:49:11.064122] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-05T18:49:11.499512] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-05T18:49:11.863492] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-05T18:49:12.663553] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-05T18:49:13.094126] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-05T18:49:13.316309] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-05T18:49:13.463462] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-05T18:49:13.832393] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:49:13.834636] [INFO ] [REMOTE ] PMT: Full fetch complete (44105 records). [2025-09-05T18:49:14.214559] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-05T18:49:14.276592] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-05T18:49:14.423351] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-05T18:49:14.423512] [INFO ] [MAIN ] Update Progress: 1701/2363 symbols completed. PMT took 25.4s. Estimated remaining: 19m 8s. Rate: 34.6 symbols/min [2025-09-05T18:49:14.610591] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:14.638752] [INFO ] [MAIN ] PNC: Loaded 24818 existing records. [2025-09-05T18:49:14.818417] [INFO ] [MAIN ] PNC: Found 1 missing trading days. [2025-09-05T18:49:14.818565] [INFO ] [MAIN ] PNC: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:15.062575] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-05T18:49:15.064045] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-05T18:49:15.684011] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-05T18:49:15.863464] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-05T18:49:16.535681] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:49:16.536512] [INFO ] [REMOTE ] PMTV: Full fetch complete (5871 records). [2025-09-05T18:49:16.668606] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-05T18:49:16.719798] [WARN ] [VALIDATOR ] PMTV: Not fatal, but first date in data (2025-02-14) does not match expected start date (2025-01-31) [2025-09-05T18:49:16.910032] [WARN ] [VALIDATOR ] PMTV: Missing days changed. Total missing: 10 No longer missing: 2025-01-29, 2025-01-30, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13 [2025-09-05T18:49:16.910271] [INFO ] [MAIN ] PMTV: Fetched primary data is valid. [2025-09-05T18:49:16.933247] [INFO ] [MAIN ] PMTV: Full history saved. [2025-09-05T18:49:16.933369] [INFO ] [MAIN ] Update Progress: 1702/2363 symbols completed. PMTV took 22.1s. Estimated remaining: 19m 7s. Rate: 34.6 symbols/min [2025-09-05T18:49:17.104658] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:17.111257] [INFO ] [MAIN ] PNI: Loaded 5245 existing records. [2025-09-05T18:49:17.287237] [INFO ] [MAIN ] PNI: Found 1 missing trading days. [2025-09-05T18:49:17.287389] [INFO ] [MAIN ] PNI: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:17.367681] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-05T18:49:17.463487] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-05T18:49:17.891591] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-05T18:49:17.892378] [INFO ] [REMOTE ] PMTW: Full fetch complete (3369 records). [2025-09-05T18:49:18.075345] [WARN ] [VALIDATOR ] PMTW: Not fatal, but first date in data (2025-06-12) does not match expected start date (2025-01-31) [2025-09-05T18:49:18.261737] [WARN ] [VALIDATOR ] PMTW: Missing days changed. Total missing: 91 No longer missing: 2025-01-29, 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11 [2025-09-05T18:49:18.261947] [INFO ] [MAIN ] PMTW: Fetched primary data is valid. [2025-09-05T18:49:18.272112] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-05T18:49:18.285058] [INFO ] [MAIN ] PMTW: Full history saved. [2025-09-05T18:49:18.285143] [INFO ] [MAIN ] Update Progress: 1703/2363 symbols completed. PMTW took 21.4s. Estimated remaining: 19m 5s. Rate: 34.6 symbols/min [2025-09-05T18:49:18.455203] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:18.470703] [INFO ] [MAIN ] PNNT: Loaded 14960 existing records. [2025-09-05T18:49:18.645308] [INFO ] [MAIN ] PNNT: Found 1 missing trading days. [2025-09-05T18:49:18.645473] [INFO ] [MAIN ] PNNT: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:18.672271] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-05T18:49:19.063501] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-05T18:49:19.703136] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:49:19.868810] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-05T18:49:19.894119] [INFO ] [MAIN ] PNC: Adding 368 new records, updating 0 existing records. [2025-09-05T18:49:19.899880] [INFO ] [MAIN ] PNC: Combined dataset has 25186 total records. [2025-09-05T18:49:20.206227] [WARN ] [VALIDATOR ] PNC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:20.355758] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:49:20.565743] [INFO ] [MAIN ] PNNT: Adding 209 new records, updating 0 existing records. [2025-09-05T18:49:20.570225] [INFO ] [MAIN ] PNNT: Combined dataset has 15169 total records. [2025-09-05T18:49:20.668695] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-05T18:49:20.769183] [WARN ] [VALIDATOR ] PNNT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:20.984023] [WARN ] [VALIDATOR ] PNNT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:20.983909] [WARN ] [VALIDATOR ] PNC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:20.984345] [INFO ] [MAIN ] PNC: Combined data validation passed. [2025-09-05T18:49:20.984447] [INFO ] [MAIN ] PNNT: Combined data validation passed. [2025-09-05T18:49:21.154997] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-05T18:49:21.186868] [INFO ] [MAIN ] PNNT: Update completed successfully. [2025-09-05T18:49:21.188895] [INFO ] [MAIN ] Update Progress: 1704/2363 symbols completed. PNNT took 2.9s. Estimated remaining: 19m 4s. Rate: 34.6 symbols/min [2025-09-05T18:49:21.375942] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:21.376535] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-05T18:49:21.377291] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-05T18:49:21.377910] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-05T18:49:21.378714] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-05T18:49:21.468669] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-05T18:49:21.765689] [INFO ] [REMOTE ] PNR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:49:21.799739] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-05T18:49:21.810685] [INFO ] [MAIN ] PNC: Update completed successfully. [2025-09-05T18:49:21.813873] [INFO ] [MAIN ] Update Progress: 1705/2363 symbols completed. PNC took 7.4s. Estimated remaining: 19m 2s. Rate: 34.6 symbols/min [2025-09-05T18:49:21.989676] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:21.989883] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-09-05T18:49:21.990015] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-05T18:49:21.990054] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-05T18:49:21.990099] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-05T18:49:22.263439] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-05T18:49:22.341070] [INFO ] [REMOTE ] PNW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:49:22.801184] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-05T18:49:23.063475] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-05T18:49:23.863454] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-05T18:49:23.930874] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:49:23.962917] [INFO ] [MAIN ] PNI: Adding 98 new records, updating 0 existing records. [2025-09-05T18:49:23.964807] [INFO ] [MAIN ] PNI: Combined dataset has 5343 total records. [2025-09-05T18:49:24.138459] [WARN ] [VALIDATOR ] PNI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:49:24.335321] [WARN ] [VALIDATOR ] PNI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:49:24.335567] [INFO ] [MAIN ] PNI: Combined data validation passed. [2025-09-05T18:49:24.382254] [INFO ] [MAIN ] PNI: Update completed successfully. [2025-09-05T18:49:24.383503] [INFO ] [MAIN ] Update Progress: 1706/2363 symbols completed. PNI took 7.4s. Estimated remaining: 19m 0s. Rate: 34.6 symbols/min [2025-09-05T18:49:24.556596] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:24.579323] [INFO ] [MAIN ] POR: Loaded 22851 existing records. [2025-09-05T18:49:24.669855] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-05T18:49:24.758365] [INFO ] [MAIN ] POR: Found 1 missing trading days. [2025-09-05T18:49:24.758517] [INFO ] [MAIN ] POR: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:25.463535] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-05T18:49:25.470701] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T18:49:25.471579] [INFO ] [REMOTE ] PMTU: Full fetch complete (917 records). [2025-09-05T18:49:25.675225] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-05T18:49:25.897917] [WARN ] [VALIDATOR ] PMTU: Missing days changed. Total missing: 6 New missing: 2025-08-27, 2025-09-03 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-06-06, 2025-07-08, 2025-08-01, 2025-08-13, 2025-08-27, 2025-09-03 [2025-09-05T18:49:25.898193] [INFO ] [MAIN ] PMTU: Fetched primary data is valid. [2025-09-05T18:49:25.902886] [INFO ] [MAIN ] PMTU: Full history saved. [2025-09-05T18:49:25.902967] [INFO ] [MAIN ] Update Progress: 1707/2363 symbols completed. PMTU took 32.7s. Estimated remaining: 18m 58s. Rate: 34.6 symbols/min [2025-09-05T18:49:26.019515] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:49:26.143054] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:26.227856] [INFO ] [MAIN ] POR: Adding 349 new records, updating 0 existing records. [2025-09-05T18:49:26.237432] [INFO ] [MAIN ] POR: Combined dataset has 23200 total records. [2025-09-05T18:49:26.280352] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-05T18:49:26.323580] [INFO ] [MAIN ] POST: Loaded 18780 existing records. [2025-09-05T18:49:26.564830] [WARN ] [VALIDATOR ] POR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:26.685259] [INFO ] [MAIN ] POST: Found 1 missing trading days. [2025-09-05T18:49:26.706777] [INFO ] [MAIN ] POST: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:26.812988] [WARN ] [VALIDATOR ] POR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:26.813215] [INFO ] [MAIN ] POR: Combined data validation passed. [2025-09-05T18:49:26.954916] [INFO ] [MAIN ] POR: Update completed successfully. [2025-09-05T18:49:26.957935] [INFO ] [MAIN ] Update Progress: 1708/2363 symbols completed. POR took 2.6s. Estimated remaining: 18m 56s. Rate: 34.6 symbols/min [2025-09-05T18:49:27.064495] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-05T18:49:27.137419] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:27.162280] [INFO ] [MAIN ] PPG: Loaded 23888 existing records. [2025-09-05T18:49:27.338451] [INFO ] [MAIN ] PPG: Found 1 missing trading days. [2025-09-05T18:49:27.338605] [INFO ] [MAIN ] PPG: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:27.449056] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-05T18:49:27.563705] [INFO ] [MAIN ] POST: Adding 333 new records, updating 0 existing records. [2025-09-05T18:49:27.567413] [INFO ] [MAIN ] POST: Combined dataset has 19113 total records. [2025-09-05T18:49:27.767220] [WARN ] [VALIDATOR ] POST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:27.769234] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-05T18:49:27.868503] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-05T18:49:28.016321] [WARN ] [VALIDATOR ] POST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:28.016580] [INFO ] [MAIN ] POST: Combined data validation passed. [2025-09-05T18:49:28.134105] [INFO ] [MAIN ] POST: Update completed successfully. [2025-09-05T18:49:28.136255] [INFO ] [MAIN ] Update Progress: 1709/2363 symbols completed. POST took 2.2s. Estimated remaining: 18m 54s. Rate: 34.6 symbols/min [2025-09-05T18:49:28.305658] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:28.333174] [INFO ] [MAIN ] PPL: Loaded 25568 existing records. [2025-09-05T18:49:28.520896] [INFO ] [MAIN ] PPL: Found 1 missing trading days. [2025-09-05T18:49:28.521073] [INFO ] [MAIN ] PPL: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:28.663492] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-05T18:49:29.236131] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:49:29.383076] [INFO ] [MAIN ] PPL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:49:29.388472] [INFO ] [MAIN ] PPL: Combined dataset has 25958 total records. [2025-09-05T18:49:29.464828] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-05T18:49:29.572037] [WARN ] [VALIDATOR ] PPL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:29.701175] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-05T18:49:29.819145] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-05T18:49:29.963719] [INFO ] [MAIN ] PPG: Adding 371 new records, updating 0 existing records. [2025-09-05T18:49:29.967206] [WARN ] [VALIDATOR ] PPL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:29.967372] [INFO ] [MAIN ] PPL: Combined data validation passed. [2025-09-05T18:49:29.970007] [INFO ] [MAIN ] PPG: Combined dataset has 24259 total records. [2025-09-05T18:49:30.314730] [WARN ] [VALIDATOR ] PPG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:30.281014] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-05T18:49:30.341138] [INFO ] [MAIN ] PPL: Update completed successfully. [2025-09-05T18:49:30.379748] [INFO ] [MAIN ] Update Progress: 1710/2363 symbols completed. PPL took 2.2s. Estimated remaining: 18m 53s. Rate: 34.6 symbols/min [2025-09-05T18:49:30.696348] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:30.709197] [INFO ] [MAIN ] PPT: Loaded 9770 existing records. [2025-09-05T18:49:30.893225] [INFO ] [MAIN ] PPT: Found 1 missing trading days. [2025-09-05T18:49:30.893480] [INFO ] [MAIN ] PPT: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:30.900777] [WARN ] [VALIDATOR ] PPG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:30.901002] [INFO ] [MAIN ] PPG: Combined data validation passed. [2025-09-05T18:49:31.064791] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-05T18:49:31.069238] [INFO ] [MAIN ] PPG: Update completed successfully. [2025-09-05T18:49:31.071954] [INFO ] [MAIN ] Update Progress: 1711/2363 symbols completed. PPG took 4.1s. Estimated remaining: 18m 51s. Rate: 34.6 symbols/min [2025-09-05T18:49:31.249584] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:31.277156] [INFO ] [MAIN ] PR: Loaded 25613 existing records. [2025-09-05T18:49:31.459674] [INFO ] [MAIN ] PR: Found 1 missing trading days. [2025-09-05T18:49:31.459907] [INFO ] [MAIN ] PR: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:31.863470] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-05T18:49:32.016592] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-05T18:49:32.411014] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-05T18:49:32.663477] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-05T18:49:32.889530] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T18:49:32.945955] [INFO ] [MAIN ] PPT: Adding 118 new records, updating 0 existing records. [2025-09-05T18:49:32.948110] [INFO ] [MAIN ] PPT: Combined dataset has 9888 total records. [2025-09-05T18:49:33.124907] [WARN ] [VALIDATOR ] PPT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:33.313719] [WARN ] [VALIDATOR ] PPT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:33.313938] [INFO ] [MAIN ] PPT: Combined data validation passed. [2025-09-05T18:49:33.372295] [INFO ] [MAIN ] PPT: Update completed successfully. [2025-09-05T18:49:33.373429] [INFO ] [MAIN ] Update Progress: 1712/2363 symbols completed. PPT took 3.0s. Estimated remaining: 18m 49s. Rate: 34.6 symbols/min [2025-09-05T18:49:33.471364] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-05T18:49:33.546801] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:33.573334] [INFO ] [MAIN ] PRA: Loaded 27088 existing records. [2025-09-05T18:49:33.753321] [INFO ] [MAIN ] PRA: Found 1 missing trading days. [2025-09-05T18:49:33.753467] [INFO ] [MAIN ] PRA: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:34.014694] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:49:34.163521] [INFO ] [MAIN ] PR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:49:34.167322] [INFO ] [MAIN ] PR: Combined dataset has 26003 total records. [2025-09-05T18:49:34.269910] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-05T18:49:34.358422] [WARN ] [VALIDATOR ] PR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:34.540879] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-05T18:49:34.601059] [WARN ] [VALIDATOR ] PR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:34.601309] [INFO ] [MAIN ] PR: Combined data validation passed. [2025-09-05T18:49:34.761701] [INFO ] [MAIN ] PR: Update completed successfully. [2025-09-05T18:49:34.764662] [INFO ] [MAIN ] Update Progress: 1713/2363 symbols completed. PR took 3.7s. Estimated remaining: 18m 47s. Rate: 34.6 symbols/min [2025-09-05T18:49:34.947747] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:34.950610] [INFO ] [MAIN ] PRCS: Loaded 1311 existing records. [2025-09-05T18:49:35.068639] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-05T18:49:35.137885] [INFO ] [MAIN ] PRCS: Found 1 missing trading days. [2025-09-05T18:49:35.138022] [INFO ] [MAIN ] PRCS: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:35.511619] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-05T18:49:35.617673] [INFO ] [MAIN ] PRA: Adding 215 new records, updating 0 existing records. [2025-09-05T18:49:35.621760] [INFO ] [MAIN ] PRA: Combined dataset has 27303 total records. [2025-09-05T18:49:35.838093] [WARN ] [VALIDATOR ] PRA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:49:35.868733] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-05T18:49:35.886514] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-05T18:49:36.053676] [WARN ] [VALIDATOR ] PRA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:49:36.053899] [INFO ] [MAIN ] PRA: Combined data validation passed. [2025-09-05T18:49:36.216710] [INFO ] [MAIN ] PRA: Update completed successfully. [2025-09-05T18:49:36.220091] [INFO ] [MAIN ] Update Progress: 1714/2363 symbols completed. PRA took 2.8s. Estimated remaining: 18m 45s. Rate: 34.6 symbols/min [2025-09-05T18:49:36.391758] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:36.392034] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-09-05T18:49:36.392196] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-05T18:49:36.392244] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-05T18:49:36.392292] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-05T18:49:36.463475] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:49:36.488385] [INFO ] [MAIN ] PRCS: Adding 28 new records, updating 0 existing records. [2025-09-05T18:49:36.517409] [INFO ] [MAIN ] PRCS: Combined dataset has 1339 total records. [2025-09-05T18:49:36.665338] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-05T18:49:36.906706] [WARN ] [VALIDATOR ] PRCS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:37.032070] [INFO ] [REMOTE ] PRG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:49:37.155254] [WARN ] [VALIDATOR ] PRCS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:37.155483] [INFO ] [MAIN ] PRCS: Combined data validation passed. [2025-09-05T18:49:37.164827] [INFO ] [MAIN ] PRCS: Update completed successfully. [2025-09-05T18:49:37.165162] [INFO ] [MAIN ] Update Progress: 1715/2363 symbols completed. PRCS took 2.4s. Estimated remaining: 18m 43s. Rate: 34.6 symbols/min [2025-09-05T18:49:37.349311] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:37.369718] [INFO ] [MAIN ] PRGO: Loaded 21684 existing records. [2025-09-05T18:49:37.472491] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-05T18:49:37.555309] [INFO ] [MAIN ] PRGO: Found 1 missing trading days. [2025-09-05T18:49:37.555465] [INFO ] [MAIN ] PRGO: Need to fetch 1 months: 2025-09 [2025-09-05T18:49:38.263539] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-05T18:49:38.481573] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-05T18:49:38.713322] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-05T18:49:38.938290] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:49:39.071830] [INFO ] [MAIN ] PRGO: Adding 361 new records, updating 0 existing records. [2025-09-05T18:49:39.068693] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-05T18:49:39.076075] [INFO ] [MAIN ] PRGO: Combined dataset has 22045 total records. [2025-09-05T18:49:39.261080] [WARN ] [VALIDATOR ] PRGO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:49:39.455908] [WARN ] [VALIDATOR ] PRGO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:49:39.456110] [INFO ] [MAIN ] PRGO: Combined data validation passed. [2025-09-05T18:49:39.588730] [INFO ] [MAIN ] PRGO: Update completed successfully. [2025-09-05T18:49:39.591540] [INFO ] [MAIN ] Update Progress: 1716/2363 symbols completed. PRGO took 2.4s. Estimated remaining: 18m 42s. Rate: 34.6 symbols/min [2025-09-05T18:49:39.766494] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:49:39.766731] [WARN ] [MAIN ] PRH: No existing data found, performing full refresh instead. [2025-09-05T18:49:39.766860] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-05T18:49:39.766899] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-05T18:49:39.766944] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-05T18:49:39.867669] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-05T18:49:40.123497] [INFO ] [REMOTE ] PRH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:49:40.170165] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-05T18:49:40.663484] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-05T18:49:41.345836] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-05T18:49:41.463476] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-05T18:49:41.718964] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-05T18:49:42.263525] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-05T18:49:42.568467] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-05T18:49:43.063476] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-05T18:49:43.863475] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-05T18:49:43.990395] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-05T18:49:44.580314] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-05T18:49:44.663439] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-05T18:49:44.750391] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-05T18:49:45.250457] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-05T18:49:45.463461] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-05T18:49:46.263463] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-05T18:49:46.338562] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-05T18:49:47.063469] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-05T18:49:47.753792] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-05T18:49:47.857348] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-05T18:49:47.866384] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-05T18:49:48.436468] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-05T18:49:48.663473] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-05T18:49:49.463476] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-05T18:49:49.767729] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-05T18:49:50.263461] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-05T18:49:51.063533] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-05T18:49:51.407213] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-05T18:49:51.863540] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-05T18:49:52.032874] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-05T18:49:52.418870] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-05T18:49:52.663522] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-05T18:49:53.134108] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-05T18:49:53.463495] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-05T18:49:53.880172] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-05T18:49:54.073971] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:49:54.076763] [INFO ] [REMOTE ] PNR: Full fetch complete (52767 records). [2025-09-05T18:49:54.271804] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-05T18:49:54.450912] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-09-05T18:49:54.686741] [INFO ] [MAIN ] PNR: Full history saved. [2025-09-05T18:49:54.686899] [INFO ] [MAIN ] Update Progress: 1717/2363 symbols completed. PNR took 33.5s. Estimated remaining: 18m 45s. Rate: 34.4 symbols/min [2025-09-05T18:49:55.063527] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-05T18:49:55.092837] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:49:55.096238] [INFO ] [REMOTE ] PNW: Full fetch complete (49905 records). [2025-09-05T18:49:55.470664] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-05T18:49:55.579135] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-05T18:49:55.707627] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-05T18:49:55.707795] [INFO ] [MAIN ] Update Progress: 1718/2363 symbols completed. PNW took 33.9s. Estimated remaining: 18m 43s. Rate: 34.5 symbols/min [2025-09-05T18:49:55.863489] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-05T18:49:56.307109] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-05T18:49:56.663488] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-05T18:49:57.463524] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-05T18:49:57.948564] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-05T18:49:58.030208] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:49:58.031060] [INFO ] [REMOTE ] PRH: Full fetch complete (5940 records). [2025-09-05T18:49:58.272881] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-05T18:49:58.395985] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-05T18:49:58.420685] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-05T18:49:58.420819] [INFO ] [MAIN ] Update Progress: 1719/2363 symbols completed. PRH took 18.8s. Estimated remaining: 18m 42s. Rate: 34.4 symbols/min [2025-09-05T18:49:59.689750] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-05T18:49:59.696948] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-05T18:50:00.671285] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-05T18:50:00.677399] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-05T18:50:01.081796] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-05T18:50:01.083534] [INFO ] [REMOTE ] PRG: Full fetch complete (34258 records). [2025-09-05T18:50:01.455503] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-05T18:50:01.604994] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-05T18:50:01.605143] [INFO ] [MAIN ] Update Progress: 1720/2363 symbols completed. PRG took 25.4s. Estimated remaining: 18m 41s. Rate: 34.4 symbols/min [2025-09-05T18:50:02.277566] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:02.381368] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:02.387876] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:02.388553] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-09-05T18:50:02.408321] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:02.409253] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-09-05T18:50:02.409504] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-05T18:50:02.409556] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-05T18:50:02.409878] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-05T18:50:02.410004] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-05T18:50:02.410166] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-05T18:50:02.410254] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-05T18:50:02.539212] [INFO ] [MAIN ] PRLB: Loaded 9691 existing records. [2025-09-05T18:50:02.918829] [INFO ] [MAIN ] PRKS: Loaded 31570 existing records. [2025-09-05T18:50:03.320420] [INFO ] [MAIN ] PRLB: Found 1 missing trading days. [2025-09-05T18:50:03.437663] [INFO ] [MAIN ] PRLB: Need to fetch 1 months: 2025-09 [2025-09-05T18:50:03.459957] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-05T18:50:03.652536] [INFO ] [REMOTE ] PRI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:03.656700] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:03.680235] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-05T18:50:03.676688] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-05T18:50:03.689861] [INFO ] [MAIN ] PRKS: Found 1 missing trading days. [2025-09-05T18:50:03.691467] [INFO ] [MAIN ] PRKS: Need to fetch 1 months: 2025-09 [2025-09-05T18:50:03.691940] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-05T18:50:03.997978] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:50:04.049876] [INFO ] [MAIN ] PRLB: Adding 110 new records, updating 0 existing records. [2025-09-05T18:50:04.052100] [INFO ] [MAIN ] PRLB: Combined dataset has 9801 total records. [2025-09-05T18:50:04.237845] [WARN ] [VALIDATOR ] PRLB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:50:04.448929] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:50:04.616823] [INFO ] [MAIN ] PRKS: Adding 370 new records, updating 0 existing records. [2025-09-05T18:50:04.631763] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-05T18:50:04.635881] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-05T18:50:04.638985] [INFO ] [MAIN ] PRKS: Combined dataset has 31940 total records. [2025-09-05T18:50:04.854626] [WARN ] [VALIDATOR ] PRKS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:50:05.076720] [WARN ] [VALIDATOR ] PRLB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:50:05.077247] [INFO ] [MAIN ] PRLB: Combined data validation passed. [2025-09-05T18:50:05.166752] [WARN ] [VALIDATOR ] PRKS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:50:05.169688] [INFO ] [MAIN ] PRKS: Combined data validation passed. [2025-09-05T18:50:05.168465] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-05T18:50:05.179469] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-05T18:50:05.241840] [INFO ] [MAIN ] PRLB: Update completed successfully. [2025-09-05T18:50:05.243320] [INFO ] [MAIN ] Update Progress: 1721/2363 symbols completed. PRLB took 3.6s. Estimated remaining: 18m 40s. Rate: 34.4 symbols/min [2025-09-05T18:50:05.506364] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:05.586198] [INFO ] [MAIN ] PRM: Loaded 21286 existing records. [2025-09-05T18:50:05.723467] [INFO ] [MAIN ] PRKS: Update completed successfully. [2025-09-05T18:50:05.752825] [INFO ] [MAIN ] Update Progress: 1722/2363 symbols completed. PRKS took 4.1s. Estimated remaining: 18m 37s. Rate: 34.4 symbols/min [2025-09-05T18:50:05.813618] [INFO ] [MAIN ] PRM: Found 1 missing trading days. [2025-09-05T18:50:05.857160] [INFO ] [MAIN ] PRM: Need to fetch 1 months: 2025-09 [2025-09-05T18:50:05.863105] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-05T18:50:05.957338] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:05.969055] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-05T18:50:05.995127] [INFO ] [MAIN ] PRMB: Loaded 25437 existing records. [2025-09-05T18:50:06.175517] [INFO ] [MAIN ] PRMB: Found 1 missing trading days. [2025-09-05T18:50:06.175693] [INFO ] [MAIN ] PRMB: Need to fetch 1 months: 2025-09 [2025-09-05T18:50:06.263512] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-05T18:50:06.537448] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-05T18:50:07.063487] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-05T18:50:07.287501] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:50:07.417779] [INFO ] [MAIN ] PRM: Adding 357 new records, updating 0 existing records. [2025-09-05T18:50:07.432187] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-05T18:50:07.432398] [INFO ] [MAIN ] PRM: Combined dataset has 21643 total records. [2025-09-05T18:50:07.623388] [WARN ] [VALIDATOR ] PRM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:50:07.795075] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:50:07.873126] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-05T18:50:07.977862] [INFO ] [MAIN ] PRMB: Adding 387 new records, updating 0 existing records. [2025-09-05T18:50:07.983345] [INFO ] [MAIN ] PRMB: Combined dataset has 25824 total records. [2025-09-05T18:50:08.180745] [WARN ] [VALIDATOR ] PRMB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:50:08.388195] [WARN ] [VALIDATOR ] PRM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:50:08.388870] [INFO ] [MAIN ] PRM: Combined data validation passed. [2025-09-05T18:50:08.454907] [WARN ] [VALIDATOR ] PRMB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:50:08.455508] [INFO ] [MAIN ] PRMB: Combined data validation passed. [2025-09-05T18:50:08.585405] [INFO ] [MAIN ] PRM: Update completed successfully. [2025-09-05T18:50:08.588122] [INFO ] [MAIN ] Update Progress: 1723/2363 symbols completed. PRM took 3.3s. Estimated remaining: 18m 36s. Rate: 34.4 symbols/min [2025-09-05T18:50:08.683427] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-05T18:50:08.816759] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:08.818265] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-09-05T18:50:08.818828] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-05T18:50:08.819184] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-05T18:50:08.822140] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-05T18:50:09.197049] [INFO ] [MAIN ] PRMB: Update completed successfully. [2025-09-05T18:50:09.205966] [INFO ] [MAIN ] Update Progress: 1724/2363 symbols completed. PRMB took 3.4s. Estimated remaining: 18m 34s. Rate: 34.4 symbols/min [2025-09-05T18:50:09.294397] [INFO ] [REMOTE ] PRO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:09.480387] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-05T18:50:09.484949] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:09.485713] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-05T18:50:09.486914] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-05T18:50:09.487019] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-05T18:50:09.487076] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-05T18:50:09.886530] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-05T18:50:09.963679] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:09.986925] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-05T18:50:10.263540] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-05T18:50:10.839856] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-05T18:50:11.063556] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-05T18:50:11.545976] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-05T18:50:11.863457] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-05T18:50:11.976704] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-05T18:50:12.667709] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-05T18:50:12.675164] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-05T18:50:13.463531] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-05T18:50:13.946633] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-05T18:50:14.263503] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-05T18:50:14.289515] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-05T18:50:15.063502] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-05T18:50:15.863555] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-05T18:50:15.913913] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-05T18:50:16.440171] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-05T18:50:16.663519] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-05T18:50:16.713374] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-05T18:50:17.463515] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-05T18:50:17.750017] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-05T18:50:18.263476] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-05T18:50:18.584467] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-05T18:50:19.063571] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-05T18:50:19.364022] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-05T18:50:19.365485] [INFO ] [REMOTE ] PRI: Full fetch complete (19867 records). [2025-09-05T18:50:19.728234] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-05T18:50:19.824589] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-05T18:50:19.857290] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-05T18:50:19.857468] [INFO ] [MAIN ] Update Progress: 1725/2363 symbols completed. PRI took 18.3s. Estimated remaining: 18m 35s. Rate: 34.3 symbols/min [2025-09-05T18:50:19.870625] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-05T18:50:20.065347] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:20.065592] [WARN ] [MAIN ] PRT: No existing data found, performing full refresh instead. [2025-09-05T18:50:20.065825] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-05T18:50:20.065900] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-05T18:50:20.065958] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-05T18:50:20.431311] [INFO ] [REMOTE ] PRT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:20.663494] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-05T18:50:21.184225] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-05T18:50:21.463526] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-05T18:50:22.022006] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-05T18:50:22.175249] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-05T18:50:22.263552] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-05T18:50:23.063487] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-05T18:50:23.619317] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-05T18:50:23.632881] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-05T18:50:23.863531] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-05T18:50:24.617847] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-05T18:50:24.663431] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-05T18:50:25.180591] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-05T18:50:25.463483] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-05T18:50:26.263519] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-05T18:50:26.697524] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-05T18:50:27.063600] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-05T18:50:27.552309] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-05T18:50:27.863496] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-05T18:50:28.587564] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-05T18:50:28.644604] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-05T18:50:28.663419] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-05T18:50:29.463567] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-05T18:50:30.263490] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-05T18:50:30.466959] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-05T18:50:30.845509] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-05T18:50:31.063490] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-05T18:50:31.577037] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-05T18:50:31.863519] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-05T18:50:32.164857] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-05T18:50:32.590989] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:50:32.594148] [INFO ] [REMOTE ] PRIM: Full fetch complete (48419 records). [2025-09-05T18:50:32.668764] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-05T18:50:32.971488] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-05T18:50:33.205400] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-05T18:50:33.205593] [INFO ] [MAIN ] Update Progress: 1726/2363 symbols completed. PRIM took 31.6s. Estimated remaining: 18m 38s. Rate: 34.2 symbols/min [2025-09-05T18:50:33.338387] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T18:50:33.382367] [INFO ] [REMOTE ] PRO: Full fetch complete (39466 records). [2025-09-05T18:50:33.402338] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:33.402613] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-09-05T18:50:33.467412] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-05T18:50:33.486371] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-05T18:50:33.508634] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-05T18:50:33.563171] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-05T18:50:34.031691] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-05T18:50:34.218349] [INFO ] [REMOTE ] PRU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:34.263504] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-05T18:50:34.347874] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-05T18:50:34.348032] [INFO ] [MAIN ] Update Progress: 1727/2363 symbols completed. PRO took 25.7s. Estimated remaining: 18m 36s. Rate: 34.2 symbols/min [2025-09-05T18:50:34.517702] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:34.517902] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-05T18:50:34.518026] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-05T18:50:34.518065] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-05T18:50:34.518110] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-05T18:50:34.875176] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:34.899403] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-05T18:50:35.063463] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-05T18:50:35.692934] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-05T18:50:35.841417] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-05T18:50:35.863439] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-05T18:50:36.663487] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-05T18:50:37.106817] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-05T18:50:37.463483] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-05T18:50:37.669460] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-05T18:50:37.948237] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-05T18:50:38.263499] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-05T18:50:38.536709] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-05T18:50:39.063513] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-05T18:50:39.863471] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-05T18:50:40.475102] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-05T18:50:40.663475] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-05T18:50:40.740219] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-05T18:50:40.998613] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-05T18:50:41.463479] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-05T18:50:42.263478] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-05T18:50:42.938290] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-05T18:50:43.018464] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-05T18:50:43.063440] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-05T18:50:43.863490] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-05T18:50:44.663463] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-05T18:50:44.780622] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-05T18:50:44.861002] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-05T18:50:44.962628] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-05T18:50:44.963539] [INFO ] [REMOTE ] PRT: Full fetch complete (6131 records). [2025-09-05T18:50:45.325880] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-05T18:50:45.352139] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-05T18:50:45.352320] [INFO ] [MAIN ] Update Progress: 1728/2363 symbols completed. PRT took 25.5s. Estimated remaining: 18m 38s. Rate: 34.1 symbols/min [2025-09-05T18:50:45.468521] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-05T18:50:45.536303] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:45.536550] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-09-05T18:50:45.536701] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-05T18:50:45.536743] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-05T18:50:45.536789] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-05T18:50:45.943707] [INFO ] [REMOTE ] PSA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:45.947252] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-05T18:50:46.263536] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-05T18:50:47.063465] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-05T18:50:47.371882] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-05T18:50:47.863457] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-05T18:50:48.032962] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-05T18:50:48.211810] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-05T18:50:48.663464] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-05T18:50:49.463464] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-05T18:50:50.263516] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-05T18:50:50.295595] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:50:50.297467] [INFO ] [REMOTE ] PRSU: Full fetch complete (26959 records). [2025-09-05T18:50:50.636011] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-05T18:50:50.680813] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-09-05T18:50:50.799006] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-05T18:50:50.841233] [INFO ] [MAIN ] PRSU: Full history saved. [2025-09-05T18:50:50.841400] [INFO ] [MAIN ] Update Progress: 1729/2363 symbols completed. PRSU took 41.6s. Estimated remaining: 18m 37s. Rate: 34.0 symbols/min [2025-09-05T18:50:51.018677] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:51.024079] [INFO ] [MAIN ] PSBD: Loaded 3620 existing records. [2025-09-05T18:50:51.068680] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-05T18:50:51.206957] [INFO ] [MAIN ] PSBD: Found 1 missing trading days. [2025-09-05T18:50:51.207118] [INFO ] [MAIN ] PSBD: Need to fetch 1 months: 2025-09 [2025-09-05T18:50:51.863468] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-05T18:50:52.191175] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-05T18:50:52.675563] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-05T18:50:52.673853] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-05T18:50:53.463521] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-05T18:50:53.794547] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-05T18:50:53.795224] [INFO ] [REMOTE ] PRVS: Full fetch complete (884 records). [2025-09-05T18:50:53.795608] [FATAL] [VALIDATOR ] PRVS: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:50:53.795703] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:50:53.795742] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:50:53.795788] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-05T18:50:53.795849] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-05T18:50:53.795984] [INFO ] [MAIN ] Update Progress: 1730/2363 symbols completed. PRVS took 19.4s. Estimated remaining: 18m 36s. Rate: 34.0 symbols/min [2025-09-05T18:50:53.986499] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:53.990960] [INFO ] [MAIN ] PSF: Loaded 3001 existing records. [2025-09-05T18:50:54.166028] [INFO ] [MAIN ] PSF: Found 1 missing trading days. [2025-09-05T18:50:54.166318] [INFO ] [MAIN ] PSF: Need to fetch 1 months: 2025-09 [2025-09-05T18:50:54.263517] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-05T18:50:54.405471] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-05T18:50:55.063527] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-05T18:50:55.684536] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T18:50:55.709839] [INFO ] [MAIN ] PSBD: Adding 40 new records, updating 0 existing records. [2025-09-05T18:50:55.711568] [INFO ] [MAIN ] PSBD: Combined dataset has 3660 total records. [2025-09-05T18:50:55.872887] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-05T18:50:55.903061] [WARN ] [VALIDATOR ] PSBD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:50:56.125478] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-05T18:50:56.140102] [WARN ] [VALIDATOR ] PSBD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:50:56.140322] [INFO ] [MAIN ] PSBD: Combined data validation passed. [2025-09-05T18:50:56.163792] [INFO ] [MAIN ] PSBD: Update completed successfully. [2025-09-05T18:50:56.164478] [INFO ] [MAIN ] Update Progress: 1731/2363 symbols completed. PSBD took 5.3s. Estimated remaining: 18m 34s. Rate: 34.0 symbols/min [2025-09-05T18:50:56.333808] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:56.333977] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-09-05T18:50:56.334115] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-05T18:50:56.334155] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-05T18:50:56.334201] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-05T18:50:56.665533] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-05T18:50:56.687865] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:50:56.698002] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:50:56.701614] [INFO ] [REMOTE ] PRU: Full fetch complete (56187 records). [2025-09-05T18:50:57.079249] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-05T18:50:57.349201] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-05T18:50:57.349535] [INFO ] [MAIN ] Update Progress: 1732/2363 symbols completed. PRU took 24.1s. Estimated remaining: 18m 32s. Rate: 34.0 symbols/min [2025-09-05T18:50:57.468707] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-05T18:50:57.527267] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:57.566515] [INFO ] [MAIN ] PSN: Loaded 34579 existing records. [2025-09-05T18:50:57.751818] [INFO ] [MAIN ] PSN: Found 1 missing trading days. [2025-09-05T18:50:57.752019] [INFO ] [MAIN ] PSN: Need to fetch 1 months: 2025-09 [2025-09-05T18:50:58.192178] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-05T18:50:58.268610] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-05T18:50:58.288506] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-05T18:50:59.063514] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-05T18:50:59.085077] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:50:59.110147] [INFO ] [MAIN ] PSF: Adding 93 new records, updating 0 existing records. [2025-09-05T18:50:59.111952] [INFO ] [MAIN ] PSF: Combined dataset has 3094 total records. [2025-09-05T18:50:59.289901] [WARN ] [VALIDATOR ] PSF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:50:59.477730] [WARN ] [VALIDATOR ] PSF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:50:59.477966] [INFO ] [MAIN ] PSF: Combined data validation passed. [2025-09-05T18:50:59.498590] [INFO ] [MAIN ] PSF: Update completed successfully. [2025-09-05T18:50:59.499152] [INFO ] [MAIN ] Update Progress: 1733/2363 symbols completed. PSF took 5.7s. Estimated remaining: 18m 31s. Rate: 34.0 symbols/min [2025-09-05T18:50:59.672462] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:50:59.692214] [INFO ] [MAIN ] PSO: Loaded 17563 existing records. [2025-09-05T18:50:59.865017] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-05T18:50:59.864947] [INFO ] [MAIN ] PSO: Found 1 missing trading days. [2025-09-05T18:50:59.865367] [INFO ] [MAIN ] PSO: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:00.592655] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-05T18:51:00.663431] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-05T18:51:00.687497] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:51:00.830405] [INFO ] [MAIN ] PSN: Adding 361 new records, updating 0 existing records. [2025-09-05T18:51:00.835343] [INFO ] [MAIN ] PSN: Combined dataset has 34940 total records. [2025-09-05T18:51:01.013619] [WARN ] [VALIDATOR ] PSN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:51:01.208136] [WARN ] [VALIDATOR ] PSN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:51:01.208357] [INFO ] [MAIN ] PSN: Combined data validation passed. [2025-09-05T18:51:01.428179] [INFO ] [MAIN ] PSN: Update completed successfully. [2025-09-05T18:51:01.431842] [INFO ] [MAIN ] Update Progress: 1734/2363 symbols completed. PSN took 4.1s. Estimated remaining: 18m 29s. Rate: 34.0 symbols/min [2025-09-05T18:51:01.469676] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-05T18:51:01.631224] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:01.647784] [INFO ] [MAIN ] PSQH: Loaded 15368 existing records. [2025-09-05T18:51:01.843339] [INFO ] [MAIN ] PSQH: Found 1 missing trading days. [2025-09-05T18:51:01.843516] [INFO ] [MAIN ] PSQH: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:01.907293] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-05T18:51:02.263513] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-05T18:51:02.633276] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-05T18:51:02.981103] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:51:03.068542] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-05T18:51:03.085148] [INFO ] [MAIN ] PSO: Adding 266 new records, updating 0 existing records. [2025-09-05T18:51:03.089070] [INFO ] [MAIN ] PSO: Combined dataset has 17829 total records. [2025-09-05T18:51:03.272237] [WARN ] [VALIDATOR ] PSO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:03.473566] [WARN ] [VALIDATOR ] PSO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:03.473807] [INFO ] [MAIN ] PSO: Combined data validation passed. [2025-09-05T18:51:03.585848] [INFO ] [MAIN ] PSO: Update completed successfully. [2025-09-05T18:51:03.587858] [INFO ] [MAIN ] Update Progress: 1735/2363 symbols completed. PSO took 4.1s. Estimated remaining: 18m 28s. Rate: 34.0 symbols/min [2025-09-05T18:51:03.761488] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:03.787111] [INFO ] [MAIN ] PSTG: Loaded 25076 existing records. [2025-09-05T18:51:03.868637] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-05T18:51:03.972731] [INFO ] [MAIN ] PSTG: Found 1 missing trading days. [2025-09-05T18:51:03.972909] [INFO ] [MAIN ] PSTG: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:04.663508] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-05T18:51:04.805533] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-05T18:51:04.871734] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-05T18:51:04.974218] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-05T18:51:05.146862] [INFO ] [MAIN ] PSTG: Adding 389 new records, updating 0 existing records. [2025-09-05T18:51:05.151750] [INFO ] [MAIN ] PSTG: Combined dataset has 25465 total records. [2025-09-05T18:51:05.427757] [WARN ] [VALIDATOR ] PSTG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:05.468732] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-05T18:51:05.715326] [WARN ] [VALIDATOR ] PSTG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:05.715628] [INFO ] [MAIN ] PSTG: Combined data validation passed. [2025-09-05T18:51:05.927025] [INFO ] [MAIN ] PSTG: Update completed successfully. [2025-09-05T18:51:05.932178] [INFO ] [MAIN ] Update Progress: 1736/2363 symbols completed. PSTG took 2.3s. Estimated remaining: 18m 26s. Rate: 34.0 symbols/min [2025-09-05T18:51:06.168846] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:06.183476] [INFO ] [MAIN ] PSTL: Loaded 9090 existing records. [2025-09-05T18:51:06.272321] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-05T18:51:06.380791] [INFO ] [MAIN ] PSTL: Found 1 missing trading days. [2025-09-05T18:51:06.380953] [INFO ] [MAIN ] PSTL: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:06.873504] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T18:51:06.990613] [INFO ] [MAIN ] PSQH: Adding 312 new records, updating 0 existing records. [2025-09-05T18:51:06.994010] [INFO ] [MAIN ] PSQH: Combined dataset has 15680 total records. [2025-09-05T18:51:07.071385] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-05T18:51:07.184054] [WARN ] [VALIDATOR ] PSQH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:07.378276] [WARN ] [VALIDATOR ] PSQH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:07.378528] [INFO ] [MAIN ] PSQH: Combined data validation passed. [2025-09-05T18:51:07.482581] [INFO ] [MAIN ] PSQH: Update completed successfully. [2025-09-05T18:51:07.484652] [INFO ] [MAIN ] Update Progress: 1737/2363 symbols completed. PSQH took 6.1s. Estimated remaining: 18m 24s. Rate: 34.0 symbols/min [2025-09-05T18:51:07.658110] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:07.686410] [INFO ] [MAIN ] PSX: Loaded 25377 existing records. [2025-09-05T18:51:07.865432] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-05T18:51:07.876191] [INFO ] [MAIN ] PSX: Found 1 missing trading days. [2025-09-05T18:51:07.877212] [INFO ] [MAIN ] PSX: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:07.896270] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-05T18:51:08.352197] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:51:08.411544] [INFO ] [MAIN ] PSTL: Adding 124 new records, updating 0 existing records. [2025-09-05T18:51:08.414173] [INFO ] [MAIN ] PSTL: Combined dataset has 9214 total records. [2025-09-05T18:51:08.614378] [WARN ] [VALIDATOR ] PSTL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:08.675605] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-05T18:51:08.826707] [WARN ] [VALIDATOR ] PSTL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:08.826918] [INFO ] [MAIN ] PSTL: Combined data validation passed. [2025-09-05T18:51:08.892668] [INFO ] [MAIN ] PSTL: Update completed successfully. [2025-09-05T18:51:08.894793] [INFO ] [MAIN ] Update Progress: 1738/2363 symbols completed. PSTL took 3.0s. Estimated remaining: 18m 22s. Rate: 34.0 symbols/min [2025-09-05T18:51:09.091243] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:09.126530] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-05T18:51:09.139848] [INFO ] [MAIN ] PTA: Loaded 7163 existing records. [2025-09-05T18:51:09.333303] [INFO ] [MAIN ] PTA: Found 1 missing trading days. [2025-09-05T18:51:09.333517] [INFO ] [MAIN ] PTA: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:09.380454] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:51:09.468604] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-05T18:51:09.540129] [INFO ] [MAIN ] PSX: Adding 387 new records, updating 0 existing records. [2025-09-05T18:51:09.547033] [INFO ] [MAIN ] PSX: Combined dataset has 25764 total records. [2025-09-05T18:51:09.740221] [WARN ] [VALIDATOR ] PSX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:09.970549] [WARN ] [VALIDATOR ] PSX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:09.970833] [INFO ] [MAIN ] PSX: Combined data validation passed. [2025-09-05T18:51:10.152565] [INFO ] [MAIN ] PSX: Update completed successfully. [2025-09-05T18:51:10.157489] [INFO ] [MAIN ] Update Progress: 1739/2363 symbols completed. PSX took 2.7s. Estimated remaining: 18m 20s. Rate: 34.0 symbols/min [2025-09-05T18:51:10.269126] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-05T18:51:10.348098] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:10.385085] [INFO ] [MAIN ] PTY: Loaded 27954 existing records. [2025-09-05T18:51:10.577045] [INFO ] [MAIN ] PTY: Found 1 missing trading days. [2025-09-05T18:51:10.577233] [INFO ] [MAIN ] PTY: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:10.973415] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-05T18:51:11.063482] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-05T18:51:11.162352] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T18:51:11.217920] [INFO ] [MAIN ] PTA: Adding 172 new records, updating 0 existing records. [2025-09-05T18:51:11.220080] [INFO ] [MAIN ] PTA: Combined dataset has 7335 total records. [2025-09-05T18:51:11.406209] [WARN ] [VALIDATOR ] PTA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:11.602806] [WARN ] [VALIDATOR ] PTA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:11.603036] [INFO ] [MAIN ] PTA: Combined data validation passed. [2025-09-05T18:51:11.652600] [INFO ] [MAIN ] PTA: Update completed successfully. [2025-09-05T18:51:11.653863] [INFO ] [MAIN ] Update Progress: 1740/2363 symbols completed. PTA took 2.8s. Estimated remaining: 18m 18s. Rate: 34.0 symbols/min [2025-09-05T18:51:11.832215] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:11.832403] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-09-05T18:51:11.832571] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-05T18:51:11.832620] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-05T18:51:11.832689] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-05T18:51:11.864389] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-05T18:51:12.257730] [INFO ] [REMOTE ] PUK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:51:12.278500] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-05T18:51:12.663476] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-05T18:51:13.299760] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-05T18:51:13.463503] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-05T18:51:13.828767] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:51:13.831860] [INFO ] [REMOTE ] PSA: Full fetch complete (44958 records). [2025-09-05T18:51:14.197166] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-05T18:51:14.263474] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-05T18:51:14.350393] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-05T18:51:14.469762] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-05T18:51:14.469925] [INFO ] [MAIN ] Update Progress: 1741/2363 symbols completed. PSA took 29.1s. Estimated remaining: 18m 17s. Rate: 34.0 symbols/min [2025-09-05T18:51:14.644465] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:14.667170] [INFO ] [MAIN ] PUMP: Loaded 23411 existing records. [2025-09-05T18:51:14.842264] [INFO ] [MAIN ] PUMP: Found 1 missing trading days. [2025-09-05T18:51:14.842404] [INFO ] [MAIN ] PUMP: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:15.063469] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-05T18:51:15.418078] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:51:15.538808] [INFO ] [MAIN ] PTY: Adding 274 new records, updating 0 existing records. [2025-09-05T18:51:15.543201] [INFO ] [MAIN ] PTY: Combined dataset has 28228 total records. [2025-09-05T18:51:15.696956] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:51:15.758445] [WARN ] [VALIDATOR ] PTY: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:51:15.865378] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-05T18:51:16.035832] [INFO ] [MAIN ] PUMP: Adding 356 new records, updating 0 existing records. [2025-09-05T18:51:16.076025] [INFO ] [MAIN ] PUMP: Combined dataset has 23767 total records. [2025-09-05T18:51:16.261900] [WARN ] [VALIDATOR ] PUMP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:16.462375] [WARN ] [VALIDATOR ] PTY: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:51:16.462444] [WARN ] [VALIDATOR ] PUMP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:16.462699] [INFO ] [MAIN ] PTY: Combined data validation passed. [2025-09-05T18:51:16.462775] [INFO ] [MAIN ] PUMP: Combined data validation passed. [2025-09-05T18:51:16.667672] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-05T18:51:16.721944] [INFO ] [MAIN ] PUMP: Update completed successfully. [2025-09-05T18:51:16.739883] [INFO ] [MAIN ] Update Progress: 1742/2363 symbols completed. PUMP took 2.3s. Estimated remaining: 18m 15s. Rate: 34.0 symbols/min [2025-09-05T18:51:16.962794] [INFO ] [MAIN ] PTY: Update completed successfully. [2025-09-05T18:51:16.964845] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:16.968195] [INFO ] [MAIN ] Update Progress: 1743/2363 symbols completed. PTY took 6.8s. Estimated remaining: 18m 13s. Rate: 34.0 symbols/min [2025-09-05T18:51:16.968382] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-09-05T18:51:17.001530] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-05T18:51:17.027039] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-05T18:51:17.067112] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-05T18:51:17.231695] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:17.253692] [WARN ] [MAIN ] PVL: No existing data found, performing full refresh instead. [2025-09-05T18:51:17.270270] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-05T18:51:17.280761] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-05T18:51:17.295182] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-05T18:51:17.762105] [INFO ] [REMOTE ] PVH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:51:17.789761] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-05T18:51:17.804979] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-05T18:51:17.923925] [INFO ] [REMOTE ] PVL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:51:17.946361] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-05T18:51:18.263526] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-05T18:51:18.691342] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-05T18:51:19.063489] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-05T18:51:19.364507] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-05T18:51:19.863460] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-05T18:51:20.663484] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-05T18:51:20.882004] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-05T18:51:21.170264] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-05T18:51:21.250369] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-05T18:51:21.463512] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-05T18:51:21.921385] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:51:21.923143] [INFO ] [REMOTE ] PSFE: Full fetch complete (34161 records). [2025-09-05T18:51:22.275435] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-05T18:51:22.291729] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-05T18:51:22.447895] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-05T18:51:22.448145] [INFO ] [MAIN ] Update Progress: 1744/2363 symbols completed. PSFE took 26.3s. Estimated remaining: 18m 13s. Rate: 34.0 symbols/min [2025-09-05T18:51:22.630613] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:22.654567] [INFO ] [MAIN ] PWR: Loaded 22047 existing records. [2025-09-05T18:51:22.831819] [INFO ] [MAIN ] PWR: Found 1 missing trading days. [2025-09-05T18:51:22.831953] [INFO ] [MAIN ] PWR: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:23.063509] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-05T18:51:23.863457] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-05T18:51:24.170310] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-05T18:51:24.432921] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-05T18:51:24.513986] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:51:24.648871] [INFO ] [MAIN ] PWR: Adding 368 new records, updating 0 existing records. [2025-09-05T18:51:24.652851] [INFO ] [MAIN ] PWR: Combined dataset has 22415 total records. [2025-09-05T18:51:24.668612] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-05T18:51:24.866876] [WARN ] [VALIDATOR ] PWR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:25.064275] [WARN ] [VALIDATOR ] PWR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:25.064501] [INFO ] [MAIN ] PWR: Combined data validation passed. [2025-09-05T18:51:25.210122] [INFO ] [MAIN ] PWR: Update completed successfully. [2025-09-05T18:51:25.212562] [INFO ] [MAIN ] Update Progress: 1745/2363 symbols completed. PWR took 2.8s. Estimated remaining: 18m 11s. Rate: 34.0 symbols/min [2025-09-05T18:51:25.386788] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:25.405287] [INFO ] [MAIN ] PX: Loaded 16984 existing records. [2025-09-05T18:51:25.472883] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-05T18:51:25.589919] [INFO ] [MAIN ] PX: Found 1 missing trading days. [2025-09-05T18:51:25.590098] [INFO ] [MAIN ] PX: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:26.016455] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-05T18:51:26.263437] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-05T18:51:26.349309] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-05T18:51:27.063522] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-05T18:51:27.524615] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-05T18:51:27.863470] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-05T18:51:28.061311] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-05T18:51:28.479626] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-05T18:51:28.663494] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-05T18:51:29.368272] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-05T18:51:29.463481] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-05T18:51:30.263472] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-05T18:51:30.910278] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-05T18:51:31.063522] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-05T18:51:31.513198] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-05T18:51:31.863552] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-05T18:51:32.113828] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-05T18:51:32.191673] [INFO ] [MAIN ] PX: Adding 213 new records, updating 0 existing records. [2025-09-05T18:51:32.195085] [INFO ] [MAIN ] PX: Combined dataset has 17197 total records. [2025-09-05T18:51:32.378523] [WARN ] [VALIDATOR ] PX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:32.567727] [WARN ] [VALIDATOR ] PX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:32.567960] [INFO ] [MAIN ] PX: Combined data validation passed. [2025-09-05T18:51:32.663899] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-05T18:51:32.681859] [INFO ] [MAIN ] PX: Update completed successfully. [2025-09-05T18:51:32.684416] [INFO ] [MAIN ] Update Progress: 1746/2363 symbols completed. PX took 7.5s. Estimated remaining: 18m 12s. Rate: 33.9 symbols/min [2025-09-05T18:51:32.818877] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-05T18:51:32.893266] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:32.893690] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-05T18:51:32.893836] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-05T18:51:32.893891] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-05T18:51:32.893963] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-05T18:51:33.245092] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:51:33.440533] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-05T18:51:33.463432] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-05T18:51:33.924366] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:51:33.925418] [INFO ] [REMOTE ] PVL: Full fetch complete (5156 records). [2025-09-05T18:51:34.268600] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-05T18:51:34.330267] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-05T18:51:34.353934] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-05T18:51:34.354121] [INFO ] [MAIN ] Update Progress: 1747/2363 symbols completed. PVL took 17.4s. Estimated remaining: 18m 10s. Rate: 33.9 symbols/min [2025-09-05T18:51:34.530121] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:34.530329] [WARN ] [MAIN ] QD: No existing data found, performing full refresh instead. [2025-09-05T18:51:34.530455] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-05T18:51:34.530515] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-05T18:51:34.530591] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-05T18:51:34.886504] [INFO ] [REMOTE ] QD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:51:35.063480] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-05T18:51:35.634252] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-05T18:51:35.863480] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-05T18:51:36.663492] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-05T18:51:37.468549] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-05T18:51:37.489668] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-05T18:51:37.572218] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-05T18:51:37.817218] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-05T18:51:38.263492] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-05T18:51:39.063540] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-05T18:51:39.117344] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-05T18:51:39.863466] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-05T18:51:40.214869] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-05T18:51:40.663446] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-05T18:51:41.069447] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.81 seconds). [2025-09-05T18:51:41.218179] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-05T18:51:41.463490] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-05T18:51:42.029794] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-05T18:51:42.032553] [INFO ] [REMOTE ] PUK: Full fetch complete (48872 records). [2025-09-05T18:51:42.265838] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-05T18:51:42.379314] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-05T18:51:42.472628] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-05T18:51:42.716074] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-05T18:51:42.716271] [INFO ] [MAIN ] Update Progress: 1748/2363 symbols completed. PUK took 31.1s. Estimated remaining: 18m 10s. Rate: 33.8 symbols/min [2025-09-05T18:51:42.906745] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:42.931558] [INFO ] [MAIN ] QGEN: Loaded 23533 existing records. [2025-09-05T18:51:43.078562] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-05T18:51:43.121024] [INFO ] [MAIN ] QGEN: Found 1 missing trading days. [2025-09-05T18:51:43.121200] [INFO ] [MAIN ] QGEN: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:43.863475] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-05T18:51:44.408189] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-05T18:51:44.453296] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:51:44.595678] [INFO ] [MAIN ] QGEN: Adding 317 new records, updating 0 existing records. [2025-09-05T18:51:44.599163] [INFO ] [MAIN ] QGEN: Combined dataset has 23850 total records. [2025-09-05T18:51:44.668558] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-05T18:51:44.794003] [WARN ] [VALIDATOR ] QGEN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:45.034904] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-05T18:51:45.054875] [WARN ] [VALIDATOR ] QGEN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:45.055079] [INFO ] [MAIN ] QGEN: Combined data validation passed. [2025-09-05T18:51:45.209833] [INFO ] [MAIN ] QGEN: Update completed successfully. [2025-09-05T18:51:45.212796] [INFO ] [MAIN ] Update Progress: 1749/2363 symbols completed. QGEN took 2.5s. Estimated remaining: 18m 9s. Rate: 33.8 symbols/min [2025-09-05T18:51:45.407221] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:45.434043] [INFO ] [MAIN ] QS: Loaded 25777 existing records. [2025-09-05T18:51:45.468589] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-05T18:51:45.619079] [INFO ] [MAIN ] QS: Found 1 missing trading days. [2025-09-05T18:51:45.619208] [INFO ] [MAIN ] QS: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:45.731039] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-05T18:51:46.263492] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-05T18:51:47.063479] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-05T18:51:47.331926] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-05T18:51:47.863520] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-05T18:51:48.172354] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-05T18:51:48.517217] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-05T18:51:48.540413] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:51:48.668616] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-05T18:51:48.710981] [INFO ] [MAIN ] QS: Adding 390 new records, updating 0 existing records. [2025-09-05T18:51:48.716096] [INFO ] [MAIN ] QS: Combined dataset has 26167 total records. [2025-09-05T18:51:48.963462] [WARN ] [VALIDATOR ] QS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:49.176273] [WARN ] [VALIDATOR ] QS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:49.176484] [INFO ] [MAIN ] QS: Combined data validation passed. [2025-09-05T18:51:49.334806] [INFO ] [MAIN ] QS: Update completed successfully. [2025-09-05T18:51:49.338249] [INFO ] [MAIN ] Update Progress: 1750/2363 symbols completed. QS took 4.1s. Estimated remaining: 18m 8s. Rate: 33.8 symbols/min [2025-09-05T18:51:49.468628] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-05T18:51:49.515949] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:49.540098] [INFO ] [MAIN ] QSR: Loaded 24974 existing records. [2025-09-05T18:51:49.715093] [INFO ] [MAIN ] QSR: Found 1 missing trading days. [2025-09-05T18:51:49.715270] [INFO ] [MAIN ] QSR: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:50.263527] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-05T18:51:50.765300] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-05T18:51:51.063469] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-05T18:51:51.507890] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-05T18:51:51.609334] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-05T18:51:51.863470] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-05T18:51:52.128307] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-05T18:51:52.663525] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-05T18:51:52.997747] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-05T18:51:52.999606] [INFO ] [REMOTE ] QD: Full fetch complete (30573 records). [2025-09-05T18:51:53.373103] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-05T18:51:53.464502] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-05T18:51:53.507569] [INFO ] [MAIN ] QD: Full history saved. [2025-09-05T18:51:53.507729] [INFO ] [MAIN ] Update Progress: 1751/2363 symbols completed. QD took 19.2s. Estimated remaining: 18m 7s. Rate: 33.8 symbols/min [2025-09-05T18:51:53.691310] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:53.709819] [INFO ] [MAIN ] QTWO: Loaded 17546 existing records. [2025-09-05T18:51:53.882522] [INFO ] [MAIN ] QTWO: Found 1 missing trading days. [2025-09-05T18:51:53.882701] [INFO ] [MAIN ] QTWO: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:54.218875] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:51:54.221994] [INFO ] [REMOTE ] PVH: Full fetch complete (54290 records). [2025-09-05T18:51:54.268600] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-05T18:51:54.610518] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-05T18:51:54.751291] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-05T18:51:54.911276] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:51:55.071804] [INFO ] [MAIN ] QSR: Adding 387 new records, updating 0 existing records. [2025-09-05T18:51:55.069273] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-05T18:51:55.081907] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-05T18:51:55.082087] [INFO ] [MAIN ] Update Progress: 1752/2363 symbols completed. PVH took 38.3s. Estimated remaining: 18m 5s. Rate: 33.8 symbols/min [2025-09-05T18:51:55.124912] [INFO ] [MAIN ] QSR: Combined dataset has 25361 total records. [2025-09-05T18:51:55.403434] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:55.457909] [WARN ] [VALIDATOR ] QSR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:55.569772] [INFO ] [MAIN ] QUAD: Loaded 10869 existing records. [2025-09-05T18:51:55.794614] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:51:55.856620] [INFO ] [MAIN ] QUAD: Found 1 missing trading days. [2025-09-05T18:51:55.867751] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-05T18:51:55.873251] [INFO ] [MAIN ] QUAD: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:55.964732] [INFO ] [MAIN ] QTWO: Adding 291 new records, updating 0 existing records. [2025-09-05T18:51:55.969056] [INFO ] [MAIN ] QTWO: Combined dataset has 17837 total records. [2025-09-05T18:51:56.156123] [WARN ] [VALIDATOR ] QTWO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:56.380876] [WARN ] [VALIDATOR ] QSR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:56.381361] [INFO ] [MAIN ] QSR: Combined data validation passed. [2025-09-05T18:51:56.389683] [WARN ] [VALIDATOR ] QTWO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:56.389929] [INFO ] [MAIN ] QTWO: Combined data validation passed. [2025-09-05T18:51:56.611125] [INFO ] [MAIN ] QTWO: Update completed successfully. [2025-09-05T18:51:56.613863] [INFO ] [MAIN ] Update Progress: 1753/2363 symbols completed. QTWO took 3.1s. Estimated remaining: 18m 3s. Rate: 33.8 symbols/min [2025-09-05T18:51:56.668559] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-05T18:51:56.812267] [INFO ] [MAIN ] QSR: Update completed successfully. [2025-09-05T18:51:56.847263] [INFO ] [MAIN ] Update Progress: 1754/2363 symbols completed. QSR took 7.5s. Estimated remaining: 18m 1s. Rate: 33.8 symbols/min [2025-09-05T18:51:56.952507] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:57.044577] [INFO ] [MAIN ] QVCC: Loaded 4194 existing records. [2025-09-05T18:51:57.087684] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:57.178151] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:51:57.190383] [INFO ] [MAIN ] QVCD: Loaded 2074 existing records. [2025-09-05T18:51:57.347835] [INFO ] [MAIN ] QVCC: Found 1 missing trading days. [2025-09-05T18:51:57.368522] [INFO ] [MAIN ] QVCC: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:57.419348] [INFO ] [MAIN ] QUAD: Adding 152 new records, updating 0 existing records. [2025-09-05T18:51:57.467473] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-05T18:51:57.492102] [INFO ] [MAIN ] QVCD: Found 1 missing trading days. [2025-09-05T18:51:57.492985] [INFO ] [MAIN ] QVCD: Need to fetch 1 months: 2025-09 [2025-09-05T18:51:57.494219] [INFO ] [MAIN ] QUAD: Combined dataset has 11021 total records. [2025-09-05T18:51:57.673920] [WARN ] [VALIDATOR ] QUAD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:57.868451] [WARN ] [VALIDATOR ] QUAD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:57.868714] [INFO ] [MAIN ] QUAD: Combined data validation passed. [2025-09-05T18:51:57.935557] [INFO ] [MAIN ] QUAD: Update completed successfully. [2025-09-05T18:51:57.937084] [INFO ] [MAIN ] Update Progress: 1755/2363 symbols completed. QUAD took 2.9s. Estimated remaining: 17m 59s. Rate: 33.8 symbols/min [2025-09-05T18:51:58.108266] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:58.108431] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-09-05T18:51:58.108583] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-05T18:51:58.108634] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-05T18:51:58.108710] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-05T18:51:58.277163] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-05T18:51:58.478258] [INFO ] [REMOTE ] QXO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:51:58.482449] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:51:58.520417] [INFO ] [MAIN ] QVCC: Adding 50 new records, updating 0 existing records. [2025-09-05T18:51:58.522463] [INFO ] [MAIN ] QVCC: Combined dataset has 4244 total records. [2025-09-05T18:51:58.746779] [WARN ] [VALIDATOR ] QVCC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:59.075863] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-05T18:51:59.082415] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-09-05T18:51:59.109843] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:51:59.130916] [INFO ] [MAIN ] QVCD: Adding 24 new records, updating 0 existing records. [2025-09-05T18:51:59.134723] [INFO ] [MAIN ] QVCD: Combined dataset has 2098 total records. [2025-09-05T18:51:59.262526] [WARN ] [VALIDATOR ] QVCC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:51:59.292425] [INFO ] [MAIN ] QVCC: Combined data validation passed. [2025-09-05T18:51:59.432100] [INFO ] [MAIN ] QVCC: Update completed successfully. [2025-09-05T18:51:59.442727] [WARN ] [VALIDATOR ] QVCD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:51:59.444314] [INFO ] [MAIN ] Update Progress: 1756/2363 symbols completed. QVCC took 2.8s. Estimated remaining: 17m 57s. Rate: 33.8 symbols/min [2025-09-05T18:51:59.867220] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-05T18:51:59.885610] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:51:59.903258] [INFO ] [MAIN ] R: Loaded 12578 existing records. [2025-09-05T18:52:00.084930] [INFO ] [MAIN ] R: Found 1 missing trading days. [2025-09-05T18:52:00.085280] [INFO ] [MAIN ] R: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:00.088732] [WARN ] [VALIDATOR ] QVCD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:00.088912] [INFO ] [MAIN ] QVCD: Combined data validation passed. [2025-09-05T18:52:00.102887] [INFO ] [MAIN ] QVCD: Update completed successfully. [2025-09-05T18:52:00.103371] [INFO ] [MAIN ] Update Progress: 1757/2363 symbols completed. QVCD took 3.2s. Estimated remaining: 17m 55s. Rate: 33.8 symbols/min [2025-09-05T18:52:00.663566] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-05T18:52:00.955832] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-05T18:52:01.080432] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:52:01.139721] [INFO ] [MAIN ] R: Adding 163 new records, updating 0 existing records. [2025-09-05T18:52:01.142175] [INFO ] [MAIN ] R: Combined dataset has 12741 total records. [2025-09-05T18:52:01.326126] [WARN ] [VALIDATOR ] R: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:01.469847] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-05T18:52:01.525275] [WARN ] [VALIDATOR ] R: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:01.525532] [INFO ] [MAIN ] R: Combined data validation passed. [2025-09-05T18:52:01.614222] [INFO ] [MAIN ] R: Update completed successfully. [2025-09-05T18:52:01.615909] [INFO ] [MAIN ] Update Progress: 1758/2363 symbols completed. R took 2.1s. Estimated remaining: 17m 53s. Rate: 33.8 symbols/min [2025-09-05T18:52:02.597840] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-05T18:52:02.611032] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-05T18:52:02.930758] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-05T18:52:03.063426] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-05T18:52:04.372305] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-05T18:52:04.383332] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-05T18:52:05.548632] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-09-05T18:52:05.551548] [INFO ] [REMOTE ] QBTS: Full fetch complete (58423 records). [2025-09-05T18:52:05.930499] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-09-05T18:52:06.185923] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-05T18:52:06.199494] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-05T18:52:06.236469] [INFO ] [MAIN ] QBTS: Full history saved. [2025-09-05T18:52:06.236599] [INFO ] [MAIN ] Update Progress: 1759/2363 symbols completed. QBTS took 33.6s. Estimated remaining: 17m 52s. Rate: 33.8 symbols/min [2025-09-05T18:52:07.732290] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-05T18:52:07.744057] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-05T18:52:09.721956] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-05T18:52:09.732869] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-05T18:52:11.581299] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-05T18:52:11.593346] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-05T18:52:13.346306] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-05T18:52:13.357984] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-05T18:52:15.224499] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-05T18:52:15.227682] [INFO ] [REMOTE ] QXO: Full fetch complete (57389 records). [2025-09-05T18:52:15.617618] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-05T18:52:15.878887] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-05T18:52:15.879031] [INFO ] [MAIN ] Update Progress: 1760/2363 symbols completed. QXO took 17.9s. Estimated remaining: 17m 53s. Rate: 33.7 symbols/min [2025-09-05T18:52:16.625663] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:16.678485] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:16.682208] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:16.687133] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-09-05T18:52:16.686954] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-09-05T18:52:16.687364] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-05T18:52:16.686596] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:16.687554] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-05T18:52:16.687999] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-05T18:52:16.687759] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-09-05T18:52:16.706056] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-05T18:52:16.711711] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-05T18:52:16.705914] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-05T18:52:16.726697] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-05T18:52:16.726777] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-05T18:52:16.727127] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-05T18:52:16.975728] [INFO ] [MAIN ] RAMP: Loaded 16724 existing records. [2025-09-05T18:52:17.769341] [INFO ] [MAIN ] RAMP: Found 1 missing trading days. [2025-09-05T18:52:17.908072] [INFO ] [MAIN ] RAMP: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:17.959594] [INFO ] [REMOTE ] RA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:52:18.006939] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-05T18:52:17.968773] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-05T18:52:18.006697] [INFO ] [REMOTE ] RACE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:52:18.033499] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-05T18:52:18.038417] [INFO ] [REMOTE ] RBA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:52:18.038995] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-05T18:52:18.613326] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:52:18.713866] [INFO ] [MAIN ] RAMP: Adding 327 new records, updating 0 existing records. [2025-09-05T18:52:18.716629] [INFO ] [MAIN ] RAMP: Combined dataset has 17051 total records. [2025-09-05T18:52:18.893414] [WARN ] [VALIDATOR ] RAMP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:19.087507] [WARN ] [VALIDATOR ] RAMP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:19.087742] [INFO ] [MAIN ] RAMP: Combined data validation passed. [2025-09-05T18:52:19.191204] [INFO ] [MAIN ] RAMP: Update completed successfully. [2025-09-05T18:52:19.192877] [INFO ] [MAIN ] Update Progress: 1761/2363 symbols completed. RAMP took 3.3s. Estimated remaining: 17m 52s. Rate: 33.7 symbols/min [2025-09-05T18:52:19.415954] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:19.430187] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-05T18:52:19.435102] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-05T18:52:19.441799] [INFO ] [MAIN ] RBC: Loaded 6917 existing records. [2025-09-05T18:52:19.563124] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-05T18:52:19.585323] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-05T18:52:19.643135] [INFO ] [MAIN ] RBC: Found 1 missing trading days. [2025-09-05T18:52:19.643285] [INFO ] [MAIN ] RBC: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:19.643526] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-05T18:52:19.673841] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-05T18:52:19.683038] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-05T18:52:20.009846] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-05T18:52:20.042798] [INFO ] [MAIN ] RBC: Adding 102 new records, updating 0 existing records. [2025-09-05T18:52:20.044553] [INFO ] [MAIN ] RBC: Combined dataset has 7019 total records. [2025-09-05T18:52:20.222098] [WARN ] [VALIDATOR ] RBC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:20.410601] [WARN ] [VALIDATOR ] RBC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:20.410836] [INFO ] [MAIN ] RBC: Combined data validation passed. [2025-09-05T18:52:20.455978] [INFO ] [MAIN ] RBC: Update completed successfully. [2025-09-05T18:52:20.457077] [INFO ] [MAIN ] Update Progress: 1762/2363 symbols completed. RBC took 1.3s. Estimated remaining: 17m 50s. Rate: 33.7 symbols/min [2025-09-05T18:52:20.632922] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:20.677348] [INFO ] [MAIN ] RBLX: Loaded 40471 existing records. [2025-09-05T18:52:20.860444] [INFO ] [MAIN ] RBLX: Found 1 missing trading days. [2025-09-05T18:52:20.860631] [INFO ] [MAIN ] RBLX: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:20.866101] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-05T18:52:20.875747] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-05T18:52:20.880958] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-05T18:52:21.287012] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-05T18:52:21.294514] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-05T18:52:21.796746] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:52:21.910618] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-05T18:52:21.944946] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-05T18:52:22.004148] [INFO ] [MAIN ] RBLX: Adding 390 new records, updating 0 existing records. [2025-09-05T18:52:22.008458] [INFO ] [MAIN ] RBLX: Combined dataset has 40861 total records. [2025-09-05T18:52:22.191617] [WARN ] [VALIDATOR ] RBLX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:52:22.394138] [WARN ] [VALIDATOR ] RBLX: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:52:22.394409] [INFO ] [MAIN ] RBLX: Combined data validation passed. [2025-09-05T18:52:22.635901] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-05T18:52:22.646133] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-05T18:52:22.682694] [INFO ] [MAIN ] RBLX: Update completed successfully. [2025-09-05T18:52:22.688436] [INFO ] [MAIN ] Update Progress: 1763/2363 symbols completed. RBLX took 2.2s. Estimated remaining: 17m 48s. Rate: 33.7 symbols/min [2025-09-05T18:52:22.859818] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:22.865474] [INFO ] [MAIN ] RBOT: Loaded 2776 existing records. [2025-09-05T18:52:23.046272] [INFO ] [MAIN ] RBOT: Found 1 missing trading days. [2025-09-05T18:52:23.046552] [INFO ] [MAIN ] RBOT: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:23.046942] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-05T18:52:23.088765] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-05T18:52:23.097655] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-05T18:52:23.655972] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:52:23.676003] [INFO ] [MAIN ] RBOT: Adding 20 new records, updating 0 existing records. [2025-09-05T18:52:23.677384] [INFO ] [MAIN ] RBOT: Combined dataset has 2796 total records. [2025-09-05T18:52:23.871262] [WARN ] [VALIDATOR ] RBOT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:24.010228] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-05T18:52:24.095578] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-05T18:52:24.106024] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-05T18:52:24.117224] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-05T18:52:24.130503] [WARN ] [VALIDATOR ] RBOT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:24.130719] [INFO ] [MAIN ] RBOT: Combined data validation passed. [2025-09-05T18:52:24.148656] [INFO ] [MAIN ] RBOT: Update completed successfully. [2025-09-05T18:52:24.149168] [INFO ] [MAIN ] Update Progress: 1764/2363 symbols completed. RBOT took 1.5s. Estimated remaining: 17m 46s. Rate: 33.7 symbols/min [2025-09-05T18:52:24.325157] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:24.354798] [INFO ] [MAIN ] RBRK: Loaded 25419 existing records. [2025-09-05T18:52:24.537116] [INFO ] [MAIN ] RBRK: Found 1 missing trading days. [2025-09-05T18:52:24.537298] [INFO ] [MAIN ] RBRK: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:24.537629] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-05T18:52:24.599311] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-05T18:52:24.607689] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-05T18:52:25.105433] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-05T18:52:25.109921] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-05T18:52:25.343378] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T18:52:25.494031] [INFO ] [MAIN ] RBRK: Adding 390 new records, updating 0 existing records. [2025-09-05T18:52:25.497391] [INFO ] [MAIN ] RBRK: Combined dataset has 25809 total records. [2025-09-05T18:52:25.700023] [WARN ] [VALIDATOR ] RBRK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:25.950560] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-05T18:52:25.962203] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-05T18:52:25.977084] [WARN ] [VALIDATOR ] RBRK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:25.977313] [INFO ] [MAIN ] RBRK: Combined data validation passed. [2025-09-05T18:52:26.149223] [INFO ] [MAIN ] RBRK: Update completed successfully. [2025-09-05T18:52:26.152910] [INFO ] [MAIN ] Update Progress: 1765/2363 symbols completed. RBRK took 2.0s. Estimated remaining: 17m 45s. Rate: 33.7 symbols/min [2025-09-05T18:52:26.327452] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:26.351203] [INFO ] [MAIN ] RC: Loaded 22780 existing records. [2025-09-05T18:52:26.555593] [INFO ] [MAIN ] RC: Found 1 missing trading days. [2025-09-05T18:52:26.556798] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-05T18:52:26.556915] [INFO ] [MAIN ] RC: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:26.557309] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-05T18:52:26.563672] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-05T18:52:26.690301] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-05T18:52:27.063457] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-05T18:52:27.414834] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:52:27.557364] [INFO ] [MAIN ] RC: Adding 339 new records, updating 0 existing records. [2025-09-05T18:52:27.560705] [INFO ] [MAIN ] RC: Combined dataset has 23119 total records. [2025-09-05T18:52:27.749474] [WARN ] [VALIDATOR ] RC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:27.957267] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-05T18:52:27.964215] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-05T18:52:27.998948] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-05T18:52:28.018460] [WARN ] [VALIDATOR ] RC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:28.018680] [INFO ] [MAIN ] RC: Combined data validation passed. [2025-09-05T18:52:28.158803] [INFO ] [MAIN ] RC: Update completed successfully. [2025-09-05T18:52:28.161591] [INFO ] [MAIN ] Update Progress: 1766/2363 symbols completed. RC took 2.0s. Estimated remaining: 17m 43s. Rate: 33.7 symbols/min [2025-09-05T18:52:28.335832] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:28.338450] [INFO ] [MAIN ] RCB: Loaded 623 existing records. [2025-09-05T18:52:28.514389] [INFO ] [MAIN ] RCB: Found 1 missing trading days. [2025-09-05T18:52:28.514560] [INFO ] [MAIN ] RCB: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:28.533078] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-05T18:52:28.663430] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-05T18:52:28.696109] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-05T18:52:29.463509] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-05T18:52:29.990534] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T18:52:29.995007] [INFO ] [MAIN ] RCB: Adding 13 new records, updating 0 existing records. [2025-09-05T18:52:29.996586] [INFO ] [MAIN ] RCB: Combined dataset has 636 total records. [2025-09-05T18:52:30.127123] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-05T18:52:30.206406] [WARN ] [VALIDATOR ] RCB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:30.268698] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-05T18:52:30.397032] [WARN ] [VALIDATOR ] RCB: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-07-17 [2025-09-05T18:52:30.397303] [INFO ] [MAIN ] RCB: Combined data validation passed. [2025-09-05T18:52:30.402560] [INFO ] [MAIN ] RCB: Update completed successfully. [2025-09-05T18:52:30.402797] [INFO ] [MAIN ] Update Progress: 1767/2363 symbols completed. RCB took 2.2s. Estimated remaining: 17m 41s. Rate: 33.7 symbols/min [2025-09-05T18:52:30.577318] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:30.580700] [INFO ] [MAIN ] RCD: Loaded 1727 existing records. [2025-09-05T18:52:30.760058] [INFO ] [MAIN ] RCD: Found 1 missing trading days. [2025-09-05T18:52:30.760218] [INFO ] [MAIN ] RCD: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:31.063464] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-05T18:52:31.863514] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-05T18:52:31.928551] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-05T18:52:32.148503] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-05T18:52:32.159351] [INFO ] [MAIN ] RCD: Adding 24 new records, updating 0 existing records. [2025-09-05T18:52:32.160741] [INFO ] [MAIN ] RCD: Combined dataset has 1751 total records. [2025-09-05T18:52:32.269504] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:52:32.271172] [INFO ] [REMOTE ] RA: Full fetch complete (24108 records). [2025-09-05T18:52:32.455078] [WARN ] [VALIDATOR ] RCD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:32.669272] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-05T18:52:32.934397] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-05T18:52:33.043826] [WARN ] [VALIDATOR ] RCD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:33.044918] [INFO ] [MAIN ] RCD: Combined data validation passed. [2025-09-05T18:52:33.055029] [INFO ] [MAIN ] RA: Full history saved. [2025-09-05T18:52:33.058000] [INFO ] [MAIN ] Update Progress: 1768/2363 symbols completed. RA took 17.2s. Estimated remaining: 17m 40s. Rate: 33.7 symbols/min [2025-09-05T18:52:33.091915] [INFO ] [MAIN ] RCD: Update completed successfully. [2025-09-05T18:52:33.133765] [INFO ] [MAIN ] Update Progress: 1769/2363 symbols completed. RCD took 2.7s. Estimated remaining: 17m 37s. Rate: 33.7 symbols/min [2025-09-05T18:52:33.389609] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:33.420452] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:33.440807] [INFO ] [MAIN ] RCI: Loaded 23297 existing records. [2025-09-05T18:52:33.468545] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-05T18:52:33.563939] [INFO ] [MAIN ] RCL: Loaded 24793 existing records. [2025-09-05T18:52:33.764780] [INFO ] [MAIN ] RCI: Found 1 missing trading days. [2025-09-05T18:52:33.789441] [INFO ] [MAIN ] RCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:33.824370] [INFO ] [MAIN ] RCL: Found 1 missing trading days. [2025-09-05T18:52:33.824545] [INFO ] [MAIN ] RCL: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:34.263511] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-05T18:52:34.359699] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-05T18:52:34.925220] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-05T18:52:35.006804] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:52:35.068566] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-05T18:52:35.151905] [INFO ] [MAIN ] RCI: Adding 368 new records, updating 0 existing records. [2025-09-05T18:52:35.155308] [INFO ] [MAIN ] RCI: Combined dataset has 23665 total records. [2025-09-05T18:52:35.341019] [WARN ] [VALIDATOR ] RCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:35.546002] [WARN ] [VALIDATOR ] RCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:35.546225] [INFO ] [MAIN ] RCI: Combined data validation passed. [2025-09-05T18:52:35.701486] [INFO ] [MAIN ] RCI: Update completed successfully. [2025-09-05T18:52:35.704379] [INFO ] [MAIN ] Update Progress: 1770/2363 symbols completed. RCI took 2.6s. Estimated remaining: 17m 36s. Rate: 33.7 symbols/min [2025-09-05T18:52:35.885504] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:35.881948] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-05T18:52:35.895016] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:52:35.979046] [INFO ] [MAIN ] RCS: Loaded 5513 existing records. [2025-09-05T18:52:36.154703] [INFO ] [MAIN ] RCL: Adding 376 new records, updating 0 existing records. [2025-09-05T18:52:36.241400] [INFO ] [MAIN ] RCS: Found 1 missing trading days. [2025-09-05T18:52:36.241756] [INFO ] [MAIN ] RCS: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:36.242314] [INFO ] [MAIN ] RCL: Combined dataset has 25169 total records. [2025-09-05T18:52:36.429497] [WARN ] [VALIDATOR ] RCL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:36.626625] [WARN ] [VALIDATOR ] RCL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:36.626867] [INFO ] [MAIN ] RCL: Combined data validation passed. [2025-09-05T18:52:36.685600] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-05T18:52:36.794271] [INFO ] [MAIN ] RCL: Update completed successfully. [2025-09-05T18:52:36.797513] [INFO ] [MAIN ] Update Progress: 1771/2363 symbols completed. RCL took 3.7s. Estimated remaining: 17m 34s. Rate: 33.7 symbols/min [2025-09-05T18:52:36.967721] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:36.967891] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-09-05T18:52:36.968263] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-05T18:52:36.973343] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-05T18:52:36.973556] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:52:36.973614] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-05T18:52:37.068923] [INFO ] [REMOTE ] RACE: Full fetch complete (36819 records). [2025-09-05T18:52:37.347723] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:52:37.470940] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-05T18:52:37.493152] [INFO ] [MAIN ] RCS: Adding 69 new records, updating 0 existing records. [2025-09-05T18:52:37.713679] [INFO ] [MAIN ] RCS: Combined dataset has 5582 total records. [2025-09-05T18:52:37.797255] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:52:37.928604] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-05T18:52:38.039085] [WARN ] [VALIDATOR ] RCS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:38.273938] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-05T18:52:38.375930] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-05T18:52:38.376224] [INFO ] [MAIN ] Update Progress: 1772/2363 symbols completed. RACE took 22.5s. Estimated remaining: 17m 32s. Rate: 33.7 symbols/min [2025-09-05T18:52:38.553928] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:38.554667] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-09-05T18:52:38.555268] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-05T18:52:38.555456] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-05T18:52:38.555718] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-05T18:52:38.840708] [WARN ] [VALIDATOR ] RCS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:38.875165] [INFO ] [MAIN ] RCS: Combined data validation passed. [2025-09-05T18:52:38.912510] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:52:38.949439] [INFO ] [MAIN ] RCS: Update completed successfully. [2025-09-05T18:52:38.950493] [INFO ] [MAIN ] Update Progress: 1773/2363 symbols completed. RCS took 3.2s. Estimated remaining: 17m 30s. Rate: 33.7 symbols/min [2025-09-05T18:52:39.068526] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-05T18:52:39.126304] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:39.150419] [INFO ] [MAIN ] RDN: Loaded 20935 existing records. [2025-09-05T18:52:39.331498] [INFO ] [MAIN ] RDN: Found 1 missing trading days. [2025-09-05T18:52:39.331689] [INFO ] [MAIN ] RDN: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:39.452690] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-05T18:52:39.677625] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-05T18:52:39.863474] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-05T18:52:40.663454] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-05T18:52:40.858405] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:52:40.861064] [INFO ] [REMOTE ] RBA: Full fetch complete (50188 records). [2025-09-05T18:52:41.237198] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-05T18:52:41.391867] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-05T18:52:41.463843] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-05T18:52:41.519455] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-05T18:52:41.519621] [INFO ] [MAIN ] Update Progress: 1774/2363 symbols completed. RBA took 25.6s. Estimated remaining: 17m 28s. Rate: 33.7 symbols/min [2025-09-05T18:52:41.689717] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:41.715460] [INFO ] [MAIN ] RDW: Loaded 25513 existing records. [2025-09-05T18:52:41.904014] [INFO ] [MAIN ] RDW: Found 1 missing trading days. [2025-09-05T18:52:41.904189] [INFO ] [MAIN ] RDW: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:42.130582] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-05T18:52:42.263444] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-05T18:52:43.063519] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-05T18:52:43.638727] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:52:43.765889] [INFO ] [MAIN ] RDN: Adding 303 new records, updating 0 existing records. [2025-09-05T18:52:43.769824] [INFO ] [MAIN ] RDN: Combined dataset has 21238 total records. [2025-09-05T18:52:43.864244] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-05T18:52:43.987480] [WARN ] [VALIDATOR ] RDN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:44.026814] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-05T18:52:44.128488] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-05T18:52:44.246515] [WARN ] [VALIDATOR ] RDN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:44.246788] [INFO ] [MAIN ] RDN: Combined data validation passed. [2025-09-05T18:52:44.384926] [INFO ] [MAIN ] RDN: Update completed successfully. [2025-09-05T18:52:44.387227] [INFO ] [MAIN ] Update Progress: 1775/2363 symbols completed. RDN took 5.4s. Estimated remaining: 17m 27s. Rate: 33.7 symbols/min [2025-09-05T18:52:44.561607] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:44.583587] [INFO ] [MAIN ] RDY: Loaded 22254 existing records. [2025-09-05T18:52:44.668739] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-05T18:52:44.760315] [INFO ] [MAIN ] RDY: Found 1 missing trading days. [2025-09-05T18:52:44.760508] [INFO ] [MAIN ] RDY: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:44.943419] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:52:45.092341] [INFO ] [MAIN ] RDW: Adding 383 new records, updating 0 existing records. [2025-09-05T18:52:45.095585] [INFO ] [MAIN ] RDW: Combined dataset has 25896 total records. [2025-09-05T18:52:45.271056] [WARN ] [VALIDATOR ] RDW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:45.463491] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-05T18:52:45.466924] [WARN ] [VALIDATOR ] RDW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:45.467112] [INFO ] [MAIN ] RDW: Combined data validation passed. [2025-09-05T18:52:45.627627] [INFO ] [MAIN ] RDW: Update completed successfully. [2025-09-05T18:52:45.630905] [INFO ] [MAIN ] Update Progress: 1776/2363 symbols completed. RDW took 4.1s. Estimated remaining: 17m 25s. Rate: 33.7 symbols/min [2025-09-05T18:52:45.798187] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:45.821254] [INFO ] [MAIN ] RELX: Loaded 23457 existing records. [2025-09-05T18:52:45.994906] [INFO ] [MAIN ] RELX: Found 1 missing trading days. [2025-09-05T18:52:45.995082] [INFO ] [MAIN ] RELX: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:46.263442] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-05T18:52:46.846200] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:52:46.971275] [INFO ] [MAIN ] RDY: Adding 298 new records, updating 0 existing records. [2025-09-05T18:52:47.002079] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-05T18:52:47.012800] [INFO ] [MAIN ] RDY: Combined dataset has 22552 total records. [2025-09-05T18:52:47.075846] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-05T18:52:47.195893] [WARN ] [VALIDATOR ] RDY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:47.385974] [WARN ] [VALIDATOR ] RDY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:47.386198] [INFO ] [MAIN ] RDY: Combined data validation passed. [2025-09-05T18:52:47.499937] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:52:47.652401] [INFO ] [MAIN ] RELX: Adding 359 new records, updating 0 existing records. [2025-09-05T18:52:47.677097] [INFO ] [MAIN ] RDY: Update completed successfully. [2025-09-05T18:52:47.680324] [INFO ] [MAIN ] Update Progress: 1777/2363 symbols completed. RDY took 3.3s. Estimated remaining: 17m 23s. Rate: 33.7 symbols/min [2025-09-05T18:52:47.681133] [INFO ] [MAIN ] RELX: Combined dataset has 23816 total records. [2025-09-05T18:52:47.865453] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-05T18:52:48.051272] [WARN ] [VALIDATOR ] RELX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:48.053035] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:48.257172] [INFO ] [MAIN ] RERE: Loaded 21036 existing records. [2025-09-05T18:52:48.436912] [INFO ] [MAIN ] RERE: Found 1 missing trading days. [2025-09-05T18:52:48.437361] [INFO ] [MAIN ] RERE: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:48.477677] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-05T18:52:48.493172] [WARN ] [VALIDATOR ] RELX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:48.493361] [INFO ] [MAIN ] RELX: Combined data validation passed. [2025-09-05T18:52:48.640137] [INFO ] [MAIN ] RELX: Update completed successfully. [2025-09-05T18:52:48.642610] [INFO ] [MAIN ] Update Progress: 1778/2363 symbols completed. RELX took 3.0s. Estimated remaining: 17m 21s. Rate: 33.7 symbols/min [2025-09-05T18:52:48.671704] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-05T18:52:48.815799] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:48.837829] [INFO ] [MAIN ] RES: Loaded 22590 existing records. [2025-09-05T18:52:49.014165] [INFO ] [MAIN ] RES: Found 1 missing trading days. [2025-09-05T18:52:49.014302] [INFO ] [MAIN ] RES: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:49.099804] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-05T18:52:49.463519] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-05T18:52:50.263471] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-05T18:52:50.992596] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-05T18:52:51.063451] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-05T18:52:51.172764] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-05T18:52:51.785105] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T18:52:51.868555] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-05T18:52:51.925892] [INFO ] [MAIN ] RERE: Adding 379 new records, updating 0 existing records. [2025-09-05T18:52:51.930240] [INFO ] [MAIN ] RERE: Combined dataset has 21415 total records. [2025-09-05T18:52:52.118043] [WARN ] [VALIDATOR ] RERE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:52.324893] [WARN ] [VALIDATOR ] RERE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:52.325164] [INFO ] [MAIN ] RERE: Combined data validation passed. [2025-09-05T18:52:52.450958] [INFO ] [MAIN ] RERE: Update completed successfully. [2025-09-05T18:52:52.453627] [INFO ] [MAIN ] Update Progress: 1779/2363 symbols completed. RERE took 4.8s. Estimated remaining: 17m 20s. Rate: 33.7 symbols/min [2025-09-05T18:52:52.631859] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:52.639954] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:52:52.664818] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-05T18:52:52.785297] [INFO ] [MAIN ] REVG: Loaded 19299 existing records. [2025-09-05T18:52:52.784515] [INFO ] [MAIN ] RES: Adding 339 new records, updating 0 existing records. [2025-09-05T18:52:52.967894] [INFO ] [MAIN ] REVG: Found 1 missing trading days. [2025-09-05T18:52:52.968087] [INFO ] [MAIN ] REVG: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:52.963013] [INFO ] [MAIN ] RES: Combined dataset has 22929 total records. [2025-09-05T18:52:53.147898] [WARN ] [VALIDATOR ] RES: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:53.324917] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-05T18:52:53.377339] [WARN ] [VALIDATOR ] RES: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:53.377545] [INFO ] [MAIN ] RES: Combined data validation passed. [2025-09-05T18:52:53.463786] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-05T18:52:53.514390] [INFO ] [MAIN ] RES: Update completed successfully. [2025-09-05T18:52:53.517105] [INFO ] [MAIN ] Update Progress: 1780/2363 symbols completed. RES took 4.9s. Estimated remaining: 17m 18s. Rate: 33.7 symbols/min [2025-09-05T18:52:53.702768] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:53.711693] [INFO ] [MAIN ] REX: Loaded 5770 existing records. [2025-09-05T18:52:53.899939] [INFO ] [MAIN ] REX: Found 1 missing trading days. [2025-09-05T18:52:53.900077] [INFO ] [MAIN ] REX: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:54.263470] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-05T18:52:55.046614] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-05T18:52:55.063413] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-05T18:52:55.272360] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:52:55.422886] [INFO ] [MAIN ] REVG: Adding 365 new records, updating 0 existing records. [2025-09-05T18:52:55.423777] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-05T18:52:55.428288] [INFO ] [REMOTE ] RCUS: Full fetch complete (46455 records). [2025-09-05T18:52:55.504377] [INFO ] [MAIN ] REVG: Combined dataset has 19664 total records. [2025-09-05T18:52:55.878552] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-05T18:52:55.929128] [WARN ] [VALIDATOR ] REVG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:55.973000] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (3.31 seconds). [2025-09-05T18:52:56.158883] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-05T18:52:56.424034] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-05T18:52:56.424367] [INFO ] [MAIN ] Update Progress: 1781/2363 symbols completed. RCUS took 19.6s. Estimated remaining: 17m 17s. Rate: 33.7 symbols/min [2025-09-05T18:52:56.517966] [WARN ] [VALIDATOR ] REVG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:56.528918] [INFO ] [MAIN ] REVG: Combined data validation passed. [2025-09-05T18:52:56.654053] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:56.664280] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-05T18:52:56.727399] [INFO ] [MAIN ] REVG: Update completed successfully. [2025-09-05T18:52:56.729770] [INFO ] [MAIN ] Update Progress: 1782/2363 symbols completed. REVG took 4.3s. Estimated remaining: 17m 14s. Rate: 33.7 symbols/min [2025-09-05T18:52:56.889001] [INFO ] [MAIN ] REXR: Loaded 24826 existing records. [2025-09-05T18:52:56.899058] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:52:56.928231] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:56.963034] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-09-05T18:52:57.029584] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-05T18:52:57.029700] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-05T18:52:57.029514] [INFO ] [MAIN ] REX: Adding 103 new records, updating 0 existing records. [2025-09-05T18:52:57.034993] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-05T18:52:57.141530] [INFO ] [MAIN ] REX: Combined dataset has 5873 total records. [2025-09-05T18:52:57.344380] [INFO ] [MAIN ] REXR: Found 1 missing trading days. [2025-09-05T18:52:57.365052] [INFO ] [MAIN ] REXR: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:57.468539] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-05T18:52:57.631537] [WARN ] [VALIDATOR ] REX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:57.823986] [INFO ] [REMOTE ] REZI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:52:57.959756] [WARN ] [VALIDATOR ] REX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:57.959964] [INFO ] [MAIN ] REX: Combined data validation passed. [2025-09-05T18:52:57.995743] [INFO ] [MAIN ] REX: Update completed successfully. [2025-09-05T18:52:57.996698] [INFO ] [MAIN ] Update Progress: 1783/2363 symbols completed. REX took 4.5s. Estimated remaining: 17m 13s. Rate: 33.7 symbols/min [2025-09-05T18:52:58.166250] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:58.192351] [INFO ] [MAIN ] RF: Loaded 25623 existing records. [2025-09-05T18:52:58.268540] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-05T18:52:58.377941] [INFO ] [MAIN ] RF: Found 1 missing trading days. [2025-09-05T18:52:58.378123] [INFO ] [MAIN ] RF: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:58.386083] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:52:58.536132] [INFO ] [MAIN ] REXR: Adding 388 new records, updating 0 existing records. [2025-09-05T18:52:58.539415] [INFO ] [MAIN ] REXR: Combined dataset has 25214 total records. [2025-09-05T18:52:58.724853] [WARN ] [VALIDATOR ] REXR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:52:58.930745] [WARN ] [VALIDATOR ] REXR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:52:58.930968] [INFO ] [MAIN ] REXR: Combined data validation passed. [2025-09-05T18:52:59.068136] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-05T18:52:59.124602] [INFO ] [MAIN ] REXR: Update completed successfully. [2025-09-05T18:52:59.127457] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-05T18:52:59.141417] [INFO ] [MAIN ] Update Progress: 1784/2363 symbols completed. REXR took 2.7s. Estimated remaining: 17m 11s. Rate: 33.7 symbols/min [2025-09-05T18:52:59.323343] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:52:59.330395] [INFO ] [MAIN ] RFI: Loaded 5266 existing records. [2025-09-05T18:52:59.505340] [INFO ] [MAIN ] RFI: Found 1 missing trading days. [2025-09-05T18:52:59.505536] [INFO ] [MAIN ] RFI: Need to fetch 1 months: 2025-09 [2025-09-05T18:52:59.758126] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-05T18:52:59.773128] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:52:59.868613] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-05T18:52:59.933104] [INFO ] [MAIN ] RF: Adding 390 new records, updating 0 existing records. [2025-09-05T18:52:59.936827] [INFO ] [MAIN ] RF: Combined dataset has 26013 total records. [2025-09-05T18:53:00.121127] [WARN ] [VALIDATOR ] RF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:00.325046] [WARN ] [VALIDATOR ] RF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:00.325265] [INFO ] [MAIN ] RF: Combined data validation passed. [2025-09-05T18:53:00.488586] [INFO ] [MAIN ] RF: Update completed successfully. [2025-09-05T18:53:00.492087] [INFO ] [MAIN ] Update Progress: 1785/2363 symbols completed. RF took 2.5s. Estimated remaining: 17m 9s. Rate: 33.7 symbols/min [2025-09-05T18:53:00.668849] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-05T18:53:00.671742] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:00.680551] [INFO ] [MAIN ] RFL: Loaded 5940 existing records. [2025-09-05T18:53:00.852639] [INFO ] [MAIN ] RFL: Found 1 missing trading days. [2025-09-05T18:53:00.852822] [INFO ] [MAIN ] RFL: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:01.463498] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-05T18:53:01.696041] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-05T18:53:01.733812] [INFO ] [MAIN ] RFL: Adding 39 new records, updating 0 existing records. [2025-09-05T18:53:01.735782] [INFO ] [MAIN ] RFL: Combined dataset has 5979 total records. [2025-09-05T18:53:01.917163] [WARN ] [VALIDATOR ] RFL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:02.117971] [WARN ] [VALIDATOR ] RFL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:02.118196] [INFO ] [MAIN ] RFL: Combined data validation passed. [2025-09-05T18:53:02.175829] [INFO ] [MAIN ] RFL: Update completed successfully. [2025-09-05T18:53:02.176814] [INFO ] [MAIN ] Update Progress: 1786/2363 symbols completed. RFL took 1.7s. Estimated remaining: 17m 7s. Rate: 33.7 symbols/min [2025-09-05T18:53:02.178812] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-05T18:53:02.267599] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-05T18:53:02.367376] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:02.367540] [WARN ] [MAIN ] RFM: No existing data found, performing full refresh instead. [2025-09-05T18:53:02.367704] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-05T18:53:02.367748] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-05T18:53:02.367800] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-05T18:53:02.724523] [INFO ] [REMOTE ] RFM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:53:03.063445] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-05T18:53:03.228585] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-05T18:53:03.348086] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T18:53:03.376799] [INFO ] [MAIN ] RFI: Adding 65 new records, updating 0 existing records. [2025-09-05T18:53:03.378428] [INFO ] [MAIN ] RFI: Combined dataset has 5331 total records. [2025-09-05T18:53:03.557313] [WARN ] [VALIDATOR ] RFI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:03.672589] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-05T18:53:03.756986] [WARN ] [VALIDATOR ] RFI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:03.757181] [INFO ] [MAIN ] RFI: Combined data validation passed. [2025-09-05T18:53:03.791075] [INFO ] [MAIN ] RFI: Update completed successfully. [2025-09-05T18:53:03.791885] [INFO ] [MAIN ] Update Progress: 1787/2363 symbols completed. RFI took 4.6s. Estimated remaining: 17m 5s. Rate: 33.7 symbols/min [2025-09-05T18:53:03.868540] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-05T18:53:03.962154] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:03.970047] [INFO ] [MAIN ] RFMZ: Loaded 6535 existing records. [2025-09-05T18:53:04.140471] [INFO ] [MAIN ] RFMZ: Found 1 missing trading days. [2025-09-05T18:53:04.140615] [INFO ] [MAIN ] RFMZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:04.407825] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-05T18:53:04.663497] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-05T18:53:05.463516] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-05T18:53:06.122900] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:53:06.157737] [INFO ] [MAIN ] RFMZ: Adding 87 new records, updating 0 existing records. [2025-09-05T18:53:06.159627] [INFO ] [MAIN ] RFMZ: Combined dataset has 6622 total records. [2025-09-05T18:53:06.271912] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-05T18:53:06.344400] [WARN ] [VALIDATOR ] RFMZ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:06.554688] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-05T18:53:06.574225] [WARN ] [VALIDATOR ] RFMZ: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:06.574439] [INFO ] [MAIN ] RFMZ: Combined data validation passed. [2025-09-05T18:53:06.615202] [INFO ] [MAIN ] RFMZ: Update completed successfully. [2025-09-05T18:53:06.616299] [INFO ] [MAIN ] Update Progress: 1788/2363 symbols completed. RFMZ took 2.8s. Estimated remaining: 17m 4s. Rate: 33.7 symbols/min [2025-09-05T18:53:06.772720] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-05T18:53:06.794803] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:06.809672] [INFO ] [MAIN ] RGA: Loaded 13202 existing records. [2025-09-05T18:53:06.986839] [INFO ] [MAIN ] RGA: Found 1 missing trading days. [2025-09-05T18:53:06.986990] [INFO ] [MAIN ] RGA: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:07.063463] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-05T18:53:07.602700] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:53:07.668302] [INFO ] [MAIN ] RGA: Adding 150 new records, updating 0 existing records. [2025-09-05T18:53:07.670527] [INFO ] [MAIN ] RGA: Combined dataset has 13352 total records. [2025-09-05T18:53:07.845491] [WARN ] [VALIDATOR ] RGA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:07.868631] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-05T18:53:08.045969] [WARN ] [VALIDATOR ] RGA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:08.046175] [INFO ] [MAIN ] RGA: Combined data validation passed. [2025-09-05T18:53:08.133114] [INFO ] [MAIN ] RGA: Update completed successfully. [2025-09-05T18:53:08.134572] [INFO ] [MAIN ] Update Progress: 1789/2363 symbols completed. RGA took 1.5s. Estimated remaining: 17m 2s. Rate: 33.7 symbols/min [2025-09-05T18:53:08.306390] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:08.322183] [INFO ] [MAIN ] RGR: Loaded 15483 existing records. [2025-09-05T18:53:08.495554] [INFO ] [MAIN ] RGR: Found 1 missing trading days. [2025-09-05T18:53:08.495697] [INFO ] [MAIN ] RGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:08.663440] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-05T18:53:09.117001] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:53:09.172195] [INFO ] [MAIN ] RGR: Adding 127 new records, updating 0 existing records. [2025-09-05T18:53:09.174306] [INFO ] [MAIN ] RGR: Combined dataset has 15610 total records. [2025-09-05T18:53:09.354792] [WARN ] [VALIDATOR ] RGR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:09.468630] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-05T18:53:09.548444] [WARN ] [VALIDATOR ] RGR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:09.548664] [INFO ] [MAIN ] RGR: Combined data validation passed. [2025-09-05T18:53:09.644090] [INFO ] [MAIN ] RGR: Update completed successfully. [2025-09-05T18:53:09.645999] [INFO ] [MAIN ] Update Progress: 1790/2363 symbols completed. RGR took 1.5s. Estimated remaining: 16m 60s. Rate: 33.7 symbols/min [2025-09-05T18:53:09.815987] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:09.819953] [INFO ] [MAIN ] RGT: Loaded 2107 existing records. [2025-09-05T18:53:09.996480] [INFO ] [MAIN ] RGT: Found 1 missing trading days. [2025-09-05T18:53:09.996677] [INFO ] [MAIN ] RGT: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:10.091804] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-05T18:53:10.182901] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-05T18:53:10.263453] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-05T18:53:11.063513] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-05T18:53:11.863482] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-05T18:53:12.265845] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-05T18:53:12.423601] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-05T18:53:12.663515] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-05T18:53:13.146546] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:53:13.154279] [INFO ] [MAIN ] RGT: Adding 5 new records, updating 0 existing records. [2025-09-05T18:53:13.155814] [INFO ] [MAIN ] RGT: Combined dataset has 2112 total records. [2025-09-05T18:53:13.332613] [WARN ] [VALIDATOR ] RGT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:13.474111] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-05T18:53:13.527501] [WARN ] [VALIDATOR ] RGT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:13.527769] [INFO ] [MAIN ] RGT: Combined data validation passed. [2025-09-05T18:53:13.541755] [INFO ] [MAIN ] RGT: Update completed successfully. [2025-09-05T18:53:13.542224] [INFO ] [MAIN ] Update Progress: 1791/2363 symbols completed. RGT took 3.9s. Estimated remaining: 16m 59s. Rate: 33.7 symbols/min [2025-09-05T18:53:13.720715] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:13.745004] [INFO ] [MAIN ] RH: Loaded 22454 existing records. [2025-09-05T18:53:13.941292] [INFO ] [MAIN ] RH: Found 1 missing trading days. [2025-09-05T18:53:13.941490] [INFO ] [MAIN ] RH: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:14.267997] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-05T18:53:14.273776] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-09-05T18:53:14.930753] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:53:15.067518] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-05T18:53:15.067447] [INFO ] [MAIN ] RH: Adding 356 new records, updating 0 existing records. [2025-09-05T18:53:15.073173] [INFO ] [MAIN ] RH: Combined dataset has 22810 total records. [2025-09-05T18:53:15.292286] [WARN ] [VALIDATOR ] RH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:15.495375] [WARN ] [VALIDATOR ] RH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:15.495623] [INFO ] [MAIN ] RH: Combined data validation passed. [2025-09-05T18:53:15.659103] [INFO ] [MAIN ] RH: Update completed successfully. [2025-09-05T18:53:15.663481] [INFO ] [MAIN ] Update Progress: 1792/2363 symbols completed. RH took 2.1s. Estimated remaining: 16m 57s. Rate: 33.7 symbols/min [2025-09-05T18:53:15.871216] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-05T18:53:15.866085] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-05T18:53:15.869511] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:15.879803] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-09-05T18:53:15.881346] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-05T18:53:15.881537] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-05T18:53:15.881594] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-05T18:53:16.139991] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:53:16.180276] [INFO ] [REMOTE ] RDDT: Full fetch complete (58459 records). [2025-09-05T18:53:16.362556] [INFO ] [REMOTE ] RHI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:53:16.630711] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-05T18:53:16.699449] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-05T18:53:16.751129] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-05T18:53:16.920371] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-05T18:53:16.920554] [INFO ] [MAIN ] Update Progress: 1793/2363 symbols completed. RDDT took 38.5s. Estimated remaining: 16m 55s. Rate: 33.7 symbols/min [2025-09-05T18:53:17.093397] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:17.131580] [INFO ] [MAIN ] RHP: Loaded 30792 existing records. [2025-09-05T18:53:17.314562] [INFO ] [MAIN ] RHP: Found 1 missing trading days. [2025-09-05T18:53:17.314744] [INFO ] [MAIN ] RHP: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:17.463522] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-05T18:53:18.263483] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-05T18:53:18.389814] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-05T18:53:18.850598] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:53:18.980299] [INFO ] [MAIN ] RHP: Adding 298 new records, updating 0 existing records. [2025-09-05T18:53:19.015501] [INFO ] [MAIN ] RHP: Combined dataset has 31090 total records. [2025-09-05T18:53:19.015383] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-05T18:53:19.068513] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-05T18:53:19.203808] [WARN ] [VALIDATOR ] RHP: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:19.474521] [WARN ] [VALIDATOR ] RHP: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:19.474761] [INFO ] [MAIN ] RHP: Combined data validation passed. [2025-09-05T18:53:19.689887] [INFO ] [MAIN ] RHP: Update completed successfully. [2025-09-05T18:53:19.693657] [INFO ] [MAIN ] Update Progress: 1794/2363 symbols completed. RHP took 2.8s. Estimated remaining: 16m 54s. Rate: 33.7 symbols/min [2025-09-05T18:53:19.867124] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:19.865265] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-05T18:53:19.896373] [INFO ] [MAIN ] RIG: Loaded 25676 existing records. [2025-09-05T18:53:20.079458] [INFO ] [MAIN ] RIG: Found 1 missing trading days. [2025-09-05T18:53:20.079611] [INFO ] [MAIN ] RIG: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:20.283126] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-05T18:53:20.663495] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-05T18:53:21.020358] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-05T18:53:21.463453] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-05T18:53:21.726716] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:53:21.880194] [INFO ] [MAIN ] RIG: Adding 390 new records, updating 0 existing records. [2025-09-05T18:53:21.883458] [INFO ] [MAIN ] RIG: Combined dataset has 26066 total records. [2025-09-05T18:53:22.062900] [WARN ] [VALIDATOR ] RIG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:22.261365] [WARN ] [VALIDATOR ] RIG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:22.261560] [INFO ] [MAIN ] RIG: Combined data validation passed. [2025-09-05T18:53:22.263445] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-05T18:53:22.415099] [INFO ] [MAIN ] RIG: Update completed successfully. [2025-09-05T18:53:22.418323] [INFO ] [MAIN ] Update Progress: 1795/2363 symbols completed. RIG took 2.7s. Estimated remaining: 16m 52s. Rate: 33.7 symbols/min [2025-09-05T18:53:22.587333] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:22.612752] [INFO ] [MAIN ] RIO: Loaded 25529 existing records. [2025-09-05T18:53:22.791703] [INFO ] [MAIN ] RIO: Found 1 missing trading days. [2025-09-05T18:53:22.791883] [INFO ] [MAIN ] RIO: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:22.890065] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-05T18:53:23.063507] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-05T18:53:23.515040] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-05T18:53:23.863521] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-05T18:53:24.134587] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:53:24.282230] [INFO ] [MAIN ] RIO: Adding 389 new records, updating 0 existing records. [2025-09-05T18:53:24.285535] [INFO ] [MAIN ] RIO: Combined dataset has 25918 total records. [2025-09-05T18:53:24.380380] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T18:53:24.391796] [INFO ] [REMOTE ] RFM: Full fetch complete (4058 records). [2025-09-05T18:53:24.569426] [WARN ] [VALIDATOR ] RIO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:24.664905] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-05T18:53:25.020115] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-05T18:53:25.042686] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-05T18:53:25.043046] [INFO ] [MAIN ] Update Progress: 1796/2363 symbols completed. RFM took 22.9s. Estimated remaining: 16m 51s. Rate: 33.7 symbols/min [2025-09-05T18:53:25.218799] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:25.226186] [WARN ] [VALIDATOR ] RIO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:25.226382] [INFO ] [MAIN ] RIO: Combined data validation passed. [2025-09-05T18:53:25.399402] [INFO ] [MAIN ] RITM: Loaded 25214 existing records. [2025-09-05T18:53:25.478504] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-05T18:53:25.494909] [INFO ] [MAIN ] RIO: Update completed successfully. [2025-09-05T18:53:25.505012] [INFO ] [MAIN ] Update Progress: 1797/2363 symbols completed. RIO took 3.1s. Estimated remaining: 16m 48s. Rate: 33.7 symbols/min [2025-09-05T18:53:25.595817] [INFO ] [MAIN ] RITM: Found 1 missing trading days. [2025-09-05T18:53:25.595981] [INFO ] [MAIN ] RITM: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:26.263563] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-05T18:53:26.435845] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-05T18:53:26.788667] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-05T18:53:26.791492] [INFO ] [REMOTE ] REZI: Full fetch complete (49785 records). [2025-09-05T18:53:27.073634] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-05T18:53:27.168889] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:53:27.214866] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-05T18:53:27.395157] [INFO ] [MAIN ] RITM: Adding 389 new records, updating 0 existing records. [2025-09-05T18:53:27.432250] [INFO ] [MAIN ] RITM: Combined dataset has 25603 total records. [2025-09-05T18:53:27.635363] [WARN ] [VALIDATOR ] RITM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:27.937156] [WARN ] [VALIDATOR ] RITM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:27.938784] [INFO ] [MAIN ] RITM: Combined data validation passed. [2025-09-05T18:53:28.044933] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-05T18:53:28.048889] [INFO ] [MAIN ] Update Progress: 1798/2363 symbols completed. REZI took 31.3s. Estimated remaining: 16m 47s. Rate: 33.7 symbols/min [2025-09-05T18:53:28.111311] [INFO ] [MAIN ] RITM: Update completed successfully. [2025-09-05T18:53:28.114630] [INFO ] [MAIN ] Update Progress: 1799/2363 symbols completed. RITM took 3.1s. Estimated remaining: 16m 45s. Rate: 33.7 symbols/min [2025-09-05T18:53:29.506192] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-05T18:53:29.517029] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-05T18:53:31.866994] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-05T18:53:31.876697] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-05T18:53:33.579441] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-05T18:53:33.589939] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-05T18:53:35.356811] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-05T18:53:35.368377] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-05T18:53:37.163398] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-05T18:53:37.175292] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-05T18:53:37.931774] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:53:37.935824] [INFO ] [REMOTE ] RHI: Full fetch complete (53475 records). [2025-09-05T18:53:38.342207] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-05T18:53:38.590965] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-05T18:53:38.591149] [INFO ] [MAIN ] Update Progress: 1800/2363 symbols completed. RHI took 22.9s. Estimated remaining: 16m 46s. Rate: 33.6 symbols/min [2025-09-05T18:53:39.270435] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:39.293922] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:39.236778] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:39.294762] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:39.304699] [INFO ] [MAIN ] RIV: Loaded 5730 existing records. [2025-09-05T18:53:39.520531] [INFO ] [MAIN ] RIV: Found 1 missing trading days. [2025-09-05T18:53:39.515126] [INFO ] [MAIN ] RKT: Loaded 25714 existing records. [2025-09-05T18:53:39.521273] [INFO ] [MAIN ] RIV: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:39.551812] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-05T18:53:39.591121] [INFO ] [MAIN ] RJF: Loaded 35136 existing records. [2025-09-05T18:53:39.603018] [INFO ] [MAIN ] RL: Loaded 30865 existing records. [2025-09-05T18:53:39.991824] [INFO ] [MAIN ] RKT: Found 1 missing trading days. [2025-09-05T18:53:40.055913] [INFO ] [MAIN ] RKT: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:40.055818] [INFO ] [MAIN ] RL: Found 1 missing trading days. [2025-09-05T18:53:40.067938] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-05T18:53:40.095490] [INFO ] [MAIN ] RJF: Found 1 missing trading days. [2025-09-05T18:53:40.096620] [INFO ] [MAIN ] RJF: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:40.096951] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-05T18:53:40.095626] [INFO ] [MAIN ] RL: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:40.097334] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-05T18:53:40.482711] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T18:53:40.556119] [INFO ] [MAIN ] RIV: Adding 185 new records, updating 0 existing records. [2025-09-05T18:53:40.558310] [INFO ] [MAIN ] RIV: Combined dataset has 5915 total records. [2025-09-05T18:53:40.739541] [WARN ] [VALIDATOR ] RIV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:40.928360] [WARN ] [VALIDATOR ] RIV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:40.928557] [INFO ] [MAIN ] RIV: Combined data validation passed. [2025-09-05T18:53:40.969792] [INFO ] [MAIN ] RIV: Update completed successfully. [2025-09-05T18:53:40.973666] [INFO ] [MAIN ] Update Progress: 1801/2363 symbols completed. RIV took 2.4s. Estimated remaining: 16m 44s. Rate: 33.6 symbols/min [2025-09-05T18:53:40.973897] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:53:41.277788] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:41.304389] [INFO ] [MAIN ] RKT: Adding 390 new records, updating 0 existing records. [2025-09-05T18:53:41.306706] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:53:41.359677] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-05T18:53:41.438411] [INFO ] [MAIN ] RKT: Combined dataset has 26104 total records. [2025-09-05T18:53:41.618891] [INFO ] [MAIN ] RJF: Adding 324 new records, updating 0 existing records. [2025-09-05T18:53:41.689126] [INFO ] [MAIN ] RLI: Loaded 25468 existing records. [2025-09-05T18:53:41.701091] [INFO ] [MAIN ] RL: Adding 267 new records, updating 0 existing records. [2025-09-05T18:53:41.875787] [WARN ] [VALIDATOR ] RKT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:41.891026] [INFO ] [MAIN ] RJF: Combined dataset has 35460 total records. [2025-09-05T18:53:42.008578] [INFO ] [MAIN ] RL: Combined dataset has 31132 total records. [2025-09-05T18:53:42.156446] [INFO ] [MAIN ] RLI: Found 1 missing trading days. [2025-09-05T18:53:42.215722] [INFO ] [MAIN ] RLI: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:42.291984] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-05T18:53:42.444730] [WARN ] [VALIDATOR ] RJF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:42.607263] [WARN ] [VALIDATOR ] RL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:42.945191] [WARN ] [VALIDATOR ] RJF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:42.945477] [INFO ] [MAIN ] RJF: Combined data validation passed. [2025-09-05T18:53:42.945121] [WARN ] [VALIDATOR ] RL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:42.945052] [WARN ] [VALIDATOR ] RKT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:42.946067] [INFO ] [MAIN ] RKT: Combined data validation passed. [2025-09-05T18:53:42.945938] [INFO ] [MAIN ] RL: Combined data validation passed. [2025-09-05T18:53:43.266393] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:53:43.452604] [INFO ] [MAIN ] RLI: Adding 254 new records, updating 0 existing records. [2025-09-05T18:53:43.518550] [INFO ] [MAIN ] RKT: Update completed successfully. [2025-09-05T18:53:43.533740] [INFO ] [MAIN ] Update Progress: 1802/2363 symbols completed. RKT took 4.9s. Estimated remaining: 16m 42s. Rate: 33.6 symbols/min [2025-09-05T18:53:43.646209] [INFO ] [MAIN ] RLI: Combined dataset has 25722 total records. [2025-09-05T18:53:43.923735] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:43.993696] [WARN ] [VALIDATOR ] RLI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:44.025154] [INFO ] [MAIN ] RJF: Update completed successfully. [2025-09-05T18:53:44.044081] [INFO ] [MAIN ] Update Progress: 1803/2363 symbols completed. RJF took 5.5s. Estimated remaining: 16m 40s. Rate: 33.6 symbols/min [2025-09-05T18:53:44.171617] [INFO ] [MAIN ] RLJ: Loaded 22366 existing records. [2025-09-05T18:53:44.500138] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:44.507617] [INFO ] [MAIN ] RL: Update completed successfully. [2025-09-05T18:53:44.527288] [INFO ] [MAIN ] Update Progress: 1804/2363 symbols completed. RL took 5.9s. Estimated remaining: 16m 38s. Rate: 33.6 symbols/min [2025-09-05T18:53:44.609430] [INFO ] [MAIN ] RLJ: Found 1 missing trading days. [2025-09-05T18:53:44.623813] [INFO ] [MAIN ] RLJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:44.659986] [INFO ] [MAIN ] RLTY: Loaded 5255 existing records. [2025-09-05T18:53:44.652126] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-05T18:53:44.857883] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:44.872687] [WARN ] [MAIN ] RLX: No existing data found, performing full refresh instead. [2025-09-05T18:53:44.882184] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-05T18:53:44.892674] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-05T18:53:44.923407] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-05T18:53:44.960333] [INFO ] [MAIN ] RLTY: Found 1 missing trading days. [2025-09-05T18:53:44.970165] [INFO ] [MAIN ] RLTY: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:44.980928] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-05T18:53:45.326287] [INFO ] [REMOTE ] RLX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:53:45.326886] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-05T18:53:45.331706] [WARN ] [VALIDATOR ] RLI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:45.331881] [INFO ] [MAIN ] RLI: Combined data validation passed. [2025-09-05T18:53:45.494056] [INFO ] [MAIN ] RLI: Update completed successfully. [2025-09-05T18:53:45.497129] [INFO ] [MAIN ] Update Progress: 1805/2363 symbols completed. RLI took 4.5s. Estimated remaining: 16m 36s. Rate: 33.6 symbols/min [2025-09-05T18:53:45.649667] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:53:45.699406] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:45.747727] [WARN ] [MAIN ] RM: No existing data found, performing full refresh instead. [2025-09-05T18:53:45.763195] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T18:53:45.799988] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-05T18:53:45.805166] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-05T18:53:45.825694] [INFO ] [MAIN ] RLTY: Adding 82 new records, updating 0 existing records. [2025-09-05T18:53:45.825744] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-05T18:53:45.933112] [INFO ] [MAIN ] RLJ: Adding 378 new records, updating 0 existing records. [2025-09-05T18:53:45.972829] [INFO ] [MAIN ] RLTY: Combined dataset has 5337 total records. [2025-09-05T18:53:46.209850] [INFO ] [MAIN ] RLJ: Combined dataset has 22744 total records. [2025-09-05T18:53:46.368437] [WARN ] [VALIDATOR ] RLTY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:46.649701] [INFO ] [REMOTE ] RM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:53:46.699215] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-05T18:53:46.743878] [WARN ] [VALIDATOR ] RLJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:53:47.023463] [WARN ] [VALIDATOR ] RLTY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:47.023530] [WARN ] [VALIDATOR ] RLJ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:53:47.023781] [INFO ] [MAIN ] RLJ: Combined data validation passed. [2025-09-05T18:53:47.023851] [INFO ] [MAIN ] RLTY: Combined data validation passed. [2025-09-05T18:53:47.147202] [INFO ] [MAIN ] RLTY: Update completed successfully. [2025-09-05T18:53:47.149358] [INFO ] [MAIN ] Update Progress: 1806/2363 symbols completed. RLTY took 3.1s. Estimated remaining: 16m 34s. Rate: 33.6 symbols/min [2025-09-05T18:53:47.342832] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:47.344708] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-09-05T18:53:47.349033] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-05T18:53:47.356590] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-05T18:53:47.364356] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-05T18:53:47.397749] [INFO ] [MAIN ] RLJ: Update completed successfully. [2025-09-05T18:53:47.434823] [INFO ] [MAIN ] Update Progress: 1807/2363 symbols completed. RLJ took 3.8s. Estimated remaining: 16m 32s. Rate: 33.6 symbols/min [2025-09-05T18:53:47.758840] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:47.793197] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-09-05T18:53:47.817593] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-05T18:53:47.817685] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-05T18:53:47.829340] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-05T18:53:48.010466] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:53:48.021631] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-05T18:53:48.188229] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-05T18:53:48.220502] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-09-05T18:53:48.234317] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-05T18:53:48.257045] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-05T18:53:48.336720] [INFO ] [REMOTE ] RMD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:53:48.337011] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-05T18:53:48.564080] [WARN ] [REMOTE ] RMD: No data returned for month 2025-01 [2025-09-05T18:53:48.564617] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-05T18:53:49.161434] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-05T18:53:49.165845] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-05T18:53:49.208782] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-05T18:53:49.211071] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-05T18:53:49.677559] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-05T18:53:49.681325] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-05T18:53:50.128542] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-05T18:53:50.137160] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-05T18:53:50.330034] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-05T18:53:50.334785] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-05T18:53:50.426730] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-05T18:53:50.436094] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-05T18:53:50.462615] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-05T18:53:50.464998] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-05T18:53:51.379729] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-05T18:53:51.384227] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-05T18:53:51.453383] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-05T18:53:51.455796] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-05T18:53:51.910944] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-05T18:53:51.921552] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-05T18:53:52.043894] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-05T18:53:52.046661] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-05T18:53:52.376589] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-05T18:53:52.381088] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-05T18:53:52.464537] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-05T18:53:52.551077] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-05T18:53:52.663421] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-05T18:53:53.094718] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-05T18:53:53.463463] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-05T18:53:53.555822] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-05T18:53:53.889042] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-05T18:53:54.263508] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-05T18:53:55.030267] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-05T18:53:55.063427] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-05T18:53:55.441439] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-05T18:53:55.832258] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:53:55.833300] [INFO ] [REMOTE ] RM: Full fetch complete (8604 records). [2025-09-05T18:53:55.868578] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-05T18:53:56.196513] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-05T18:53:56.233455] [INFO ] [MAIN ] RM: Full history saved. [2025-09-05T18:53:56.233610] [INFO ] [MAIN ] Update Progress: 1808/2363 symbols completed. RM took 10.7s. Estimated remaining: 16m 32s. Rate: 33.6 symbols/min [2025-09-05T18:53:56.405941] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:56.411968] [INFO ] [MAIN ] RMI: Loaded 3467 existing records. [2025-09-05T18:53:56.590830] [INFO ] [MAIN ] RMI: Found 1 missing trading days. [2025-09-05T18:53:56.591039] [INFO ] [MAIN ] RMI: Need to fetch 1 months: 2025-09 [2025-09-05T18:53:56.663463] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-05T18:53:57.096040] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-05T18:53:57.436466] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:53:57.455453] [INFO ] [MAIN ] RMI: Adding 74 new records, updating 0 existing records. [2025-09-05T18:53:57.457169] [INFO ] [MAIN ] RMI: Combined dataset has 3541 total records. [2025-09-05T18:53:57.468599] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-05T18:53:57.650022] [WARN ] [VALIDATOR ] RMI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:53:57.846690] [WARN ] [VALIDATOR ] RMI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:53:57.846893] [INFO ] [MAIN ] RMI: Combined data validation passed. [2025-09-05T18:53:57.869317] [INFO ] [MAIN ] RMI: Update completed successfully. [2025-09-05T18:53:57.869895] [INFO ] [MAIN ] Update Progress: 1809/2363 symbols completed. RMI took 1.6s. Estimated remaining: 16m 30s. Rate: 33.6 symbols/min [2025-09-05T18:53:58.056590] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:53:58.056838] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-09-05T18:53:58.056971] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-05T18:53:58.057064] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-05T18:53:58.057115] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-05T18:53:58.269555] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-05T18:53:58.426567] [INFO ] [REMOTE ] RMM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:53:58.913923] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-05T18:53:59.063508] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-05T18:53:59.863493] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-05T18:53:59.921482] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-05T18:53:59.960788] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-05T18:54:00.663567] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-05T18:54:01.200346] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-05T18:54:01.421581] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-05T18:54:01.463467] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-05T18:54:01.947541] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-05T18:54:02.263568] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-05T18:54:03.063497] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-05T18:54:03.863482] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-05T18:54:04.287007] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-05T18:54:04.400029] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-05T18:54:04.663536] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-05T18:54:04.682176] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-05T18:54:05.463480] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-05T18:54:05.942402] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:54:05.943903] [INFO ] [REMOTE ] RMAX: Full fetch complete (22991 records). [2025-09-05T18:54:06.268674] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-05T18:54:06.312494] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-05T18:54:06.415079] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-05T18:54:06.415255] [INFO ] [MAIN ] Update Progress: 1810/2363 symbols completed. RMAX took 19.3s. Estimated remaining: 16m 31s. Rate: 33.5 symbols/min [2025-09-05T18:54:06.595681] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:06.602165] [INFO ] [MAIN ] RMMZ: Loaded 2526 existing records. [2025-09-05T18:54:06.774015] [INFO ] [MAIN ] RMMZ: Found 1 missing trading days. [2025-09-05T18:54:06.774221] [INFO ] [MAIN ] RMMZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:06.828103] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-05T18:54:07.063509] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-05T18:54:07.864020] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-05T18:54:08.116162] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:54:08.119795] [INFO ] [REMOTE ] RLX: Full fetch complete (52183 records). [2025-09-05T18:54:08.549591] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-05T18:54:08.549336] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-05T18:54:08.666009] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-05T18:54:08.774263] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-05T18:54:08.807510] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-05T18:54:08.807680] [INFO ] [MAIN ] Update Progress: 1811/2363 symbols completed. RLX took 24.3s. Estimated remaining: 16m 29s. Rate: 33.5 symbols/min [2025-09-05T18:54:08.991046] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:09.007900] [INFO ] [MAIN ] RMT: Loaded 13247 existing records. [2025-09-05T18:54:09.179505] [INFO ] [MAIN ] RMT: Found 1 missing trading days. [2025-09-05T18:54:09.180838] [INFO ] [MAIN ] RMT: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:09.253501] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T18:54:09.264583] [INFO ] [MAIN ] RMMZ: Adding 39 new records, updating 0 existing records. [2025-09-05T18:54:09.265976] [INFO ] [MAIN ] RMMZ: Combined dataset has 2565 total records. [2025-09-05T18:54:09.454689] [WARN ] [VALIDATOR ] RMMZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:54:09.468636] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-05T18:54:09.655926] [WARN ] [VALIDATOR ] RMMZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:54:09.656151] [INFO ] [MAIN ] RMMZ: Combined data validation passed. [2025-09-05T18:54:09.674730] [INFO ] [MAIN ] RMMZ: Update completed successfully. [2025-09-05T18:54:09.675273] [INFO ] [MAIN ] Update Progress: 1812/2363 symbols completed. RMMZ took 3.3s. Estimated remaining: 16m 27s. Rate: 33.5 symbols/min [2025-09-05T18:54:09.856947] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:09.857164] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-09-05T18:54:09.857309] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-05T18:54:09.857365] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-05T18:54:09.857421] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-05T18:54:10.219144] [INFO ] [REMOTE ] RNG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:54:10.263417] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-05T18:54:10.401947] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-05T18:54:11.063468] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-05T18:54:11.857345] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-05T18:54:11.867022] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-05T18:54:11.971367] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-05T18:54:12.663554] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-05T18:54:13.463538] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-05T18:54:13.589507] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-05T18:54:14.000537] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T18:54:14.049342] [INFO ] [MAIN ] RMT: Adding 81 new records, updating 0 existing records. [2025-09-05T18:54:14.051759] [INFO ] [MAIN ] RMT: Combined dataset has 13328 total records. [2025-09-05T18:54:14.234927] [WARN ] [VALIDATOR ] RMT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:54:14.273316] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-05T18:54:14.448484] [WARN ] [VALIDATOR ] RMT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:54:14.448710] [INFO ] [MAIN ] RMT: Combined data validation passed. [2025-09-05T18:54:14.534405] [INFO ] [MAIN ] RMT: Update completed successfully. [2025-09-05T18:54:14.535873] [INFO ] [MAIN ] Update Progress: 1813/2363 symbols completed. RMT took 5.7s. Estimated remaining: 16m 26s. Rate: 33.5 symbols/min [2025-09-05T18:54:14.714358] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:14.726602] [INFO ] [MAIN ] RNGR: Loaded 10884 existing records. [2025-09-05T18:54:14.905256] [INFO ] [MAIN ] RNGR: Found 1 missing trading days. [2025-09-05T18:54:14.905460] [INFO ] [MAIN ] RNGR: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:15.063530] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-05T18:54:15.251133] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-05T18:54:15.688713] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-05T18:54:15.863504] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-05T18:54:16.663479] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-05T18:54:16.950531] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-05T18:54:16.972930] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-05T18:54:17.379764] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T18:54:17.385006] [INFO ] [REMOTE ] RMD: Full fetch complete (46223 records). [2025-09-05T18:54:17.468611] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-05T18:54:17.567312] [WARN ] [VALIDATOR ] RMD: Not fatal, but first date in data (2025-02-03) does not match expected start date (2025-01-31) [2025-09-05T18:54:17.761196] [WARN ] [VALIDATOR ] RMD: Missing days changed. Total missing: 1 No longer missing: 2025-01-29, 2025-01-30, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31 [2025-09-05T18:54:17.761465] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-05T18:54:17.971582] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-05T18:54:17.971744] [INFO ] [MAIN ] Update Progress: 1814/2363 symbols completed. RMD took 30.5s. Estimated remaining: 16m 25s. Rate: 33.4 symbols/min [2025-09-05T18:54:18.140134] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:18.140311] [WARN ] [MAIN ] RNP: No existing data found, performing full refresh instead. [2025-09-05T18:54:18.140429] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-05T18:54:18.140467] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-05T18:54:18.140513] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-05T18:54:18.279184] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-05T18:54:18.493101] [INFO ] [REMOTE ] RNP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:54:18.555311] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T18:54:18.602612] [INFO ] [MAIN ] RNGR: Adding 126 new records, updating 0 existing records. [2025-09-05T18:54:18.604875] [INFO ] [MAIN ] RNGR: Combined dataset has 11010 total records. [2025-09-05T18:54:18.780787] [WARN ] [VALIDATOR ] RNGR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:54:18.965850] [WARN ] [VALIDATOR ] RNGR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:54:18.966052] [INFO ] [MAIN ] RNGR: Combined data validation passed. [2025-09-05T18:54:19.034069] [INFO ] [MAIN ] RNGR: Update completed successfully. [2025-09-05T18:54:19.035342] [INFO ] [MAIN ] Update Progress: 1815/2363 symbols completed. RNGR took 4.5s. Estimated remaining: 16m 23s. Rate: 33.5 symbols/min [2025-09-05T18:54:19.067345] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-05T18:54:19.207034] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:19.207198] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-09-05T18:54:19.207317] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-05T18:54:19.207356] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-05T18:54:19.207400] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-05T18:54:19.625928] [INFO ] [REMOTE ] RNR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:54:19.863479] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-05T18:54:20.089435] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-05T18:54:20.668547] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-05T18:54:20.675412] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-05T18:54:20.698307] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T18:54:20.699911] [INFO ] [REMOTE ] RMM: Full fetch complete (10984 records). [2025-09-05T18:54:21.070308] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-05T18:54:21.124579] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-05T18:54:21.124749] [INFO ] [MAIN ] Update Progress: 1816/2363 symbols completed. RMM took 23.3s. Estimated remaining: 16m 21s. Rate: 33.5 symbols/min [2025-09-05T18:54:21.301076] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:21.322608] [INFO ] [MAIN ] RNST: Loaded 16580 existing records. [2025-09-05T18:54:21.468542] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-05T18:54:21.498022] [INFO ] [MAIN ] RNST: Found 1 missing trading days. [2025-09-05T18:54:21.499033] [INFO ] [MAIN ] RNST: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:22.263507] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-05T18:54:22.387150] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-05T18:54:22.954493] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:54:23.039354] [INFO ] [MAIN ] RNST: Adding 267 new records, updating 0 existing records. [2025-09-05T18:54:23.042426] [INFO ] [MAIN ] RNST: Combined dataset has 16847 total records. [2025-09-05T18:54:23.073723] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-05T18:54:23.221303] [WARN ] [VALIDATOR ] RNST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:54:23.414143] [WARN ] [VALIDATOR ] RNST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:54:23.414395] [INFO ] [MAIN ] RNST: Combined data validation passed. [2025-09-05T18:54:23.527295] [INFO ] [MAIN ] RNST: Update completed successfully. [2025-09-05T18:54:23.530042] [INFO ] [MAIN ] Update Progress: 1817/2363 symbols completed. RNST took 2.4s. Estimated remaining: 16m 20s. Rate: 33.4 symbols/min [2025-09-05T18:54:23.723937] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-05T18:54:23.746916] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:23.755374] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-09-05T18:54:23.755580] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-05T18:54:23.755696] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-05T18:54:23.755751] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-05T18:54:23.868631] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-05T18:54:24.117208] [INFO ] [REMOTE ] ROG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:54:24.296670] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-05T18:54:24.663478] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-05T18:54:25.463510] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-05T18:54:25.492239] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-05T18:54:26.076864] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-05T18:54:26.263471] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-05T18:54:26.676824] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-05T18:54:27.063470] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-05T18:54:27.399900] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-05T18:54:27.863471] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-05T18:54:28.542778] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-05T18:54:28.569121] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-05T18:54:28.663506] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-05T18:54:29.463483] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-05T18:54:30.263502] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-05T18:54:30.412178] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-05T18:54:31.063498] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-05T18:54:31.294951] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-05T18:54:31.693263] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-05T18:54:31.863511] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-05T18:54:32.420437] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-05T18:54:32.663473] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-05T18:54:33.463509] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-05T18:54:34.151605] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-05T18:54:34.195713] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-05T18:54:34.263476] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-05T18:54:34.428932] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-05T18:54:34.523004] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-05T18:54:34.525951] [INFO ] [REMOTE ] RNG: Full fetch complete (52459 records). [2025-09-05T18:54:34.901102] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-05T18:54:35.071182] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-05T18:54:35.128525] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-05T18:54:35.128990] [INFO ] [MAIN ] Update Progress: 1818/2363 symbols completed. RNG took 25.5s. Estimated remaining: 16m 21s. Rate: 33.3 symbols/min [2025-09-05T18:54:35.297630] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:35.334851] [INFO ] [MAIN ] ROK: Loaded 33327 existing records. [2025-09-05T18:54:35.510271] [INFO ] [MAIN ] ROK: Found 1 missing trading days. [2025-09-05T18:54:35.510514] [INFO ] [MAIN ] ROK: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:35.863527] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-05T18:54:36.440944] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-05T18:54:36.571332] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:54:36.668762] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-05T18:54:36.700532] [INFO ] [MAIN ] ROK: Adding 274 new records, updating 0 existing records. [2025-09-05T18:54:36.705449] [INFO ] [MAIN ] ROK: Combined dataset has 33601 total records. [2025-09-05T18:54:36.908102] [WARN ] [VALIDATOR ] ROK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:54:37.129661] [WARN ] [VALIDATOR ] ROK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:54:37.129974] [INFO ] [MAIN ] ROK: Combined data validation passed. [2025-09-05T18:54:37.378361] [INFO ] [MAIN ] ROK: Update completed successfully. [2025-09-05T18:54:37.383777] [INFO ] [MAIN ] Update Progress: 1819/2363 symbols completed. ROK took 2.3s. Estimated remaining: 16m 19s. Rate: 33.3 symbols/min [2025-09-05T18:54:37.468781] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-05T18:54:37.568466] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:37.568806] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-09-05T18:54:37.568945] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-05T18:54:37.568986] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-05T18:54:37.569033] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-05T18:54:37.937574] [INFO ] [REMOTE ] ROL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:54:38.252984] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-05T18:54:38.266681] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-05T18:54:38.269723] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-05T18:54:39.063468] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-05T18:54:39.863471] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-05T18:54:39.902443] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-05T18:54:39.954729] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-05T18:54:40.663527] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-05T18:54:40.910364] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-05T18:54:41.463539] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-05T18:54:42.101188] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-05T18:54:42.263517] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-05T18:54:42.374894] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:54:42.376156] [INFO ] [REMOTE ] RNP: Full fetch complete (17339 records). [2025-09-05T18:54:42.757818] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-05T18:54:42.835574] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-05T18:54:42.835750] [INFO ] [MAIN ] Update Progress: 1820/2363 symbols completed. RNP took 24.9s. Estimated remaining: 16m 18s. Rate: 33.3 symbols/min [2025-09-05T18:54:43.003107] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:43.023399] [INFO ] [MAIN ] RPM: Loaded 19647 existing records. [2025-09-05T18:54:43.068567] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-05T18:54:43.200099] [INFO ] [MAIN ] RPM: Found 1 missing trading days. [2025-09-05T18:54:43.200249] [INFO ] [MAIN ] RPM: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:43.863530] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-05T18:54:43.900677] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-05T18:54:44.388689] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-05T18:54:44.663474] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-05T18:54:45.463499] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-05T18:54:45.814205] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-05T18:54:45.948524] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T18:54:45.950056] [INFO ] [REMOTE ] ROG: Full fetch complete (25235 records). [2025-09-05T18:54:46.264872] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-05T18:54:46.323897] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-05T18:54:46.431695] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-05T18:54:46.468060] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-05T18:54:46.468204] [INFO ] [MAIN ] Update Progress: 1821/2363 symbols completed. ROG took 22.9s. Estimated remaining: 16m 17s. Rate: 33.3 symbols/min [2025-09-05T18:54:46.636886] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:46.637036] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-09-05T18:54:46.637161] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-05T18:54:46.637201] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-05T18:54:46.637246] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-05T18:54:46.992525] [INFO ] [REMOTE ] RPT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:54:47.063472] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-05T18:54:47.855896] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-05T18:54:47.866369] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-05T18:54:48.245537] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-05T18:54:48.639420] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:54:48.668592] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-05T18:54:48.746271] [INFO ] [MAIN ] RPM: Adding 295 new records, updating 0 existing records. [2025-09-05T18:54:48.749308] [INFO ] [MAIN ] RPM: Combined dataset has 19942 total records. [2025-09-05T18:54:48.928772] [WARN ] [VALIDATOR ] RPM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:54:49.124255] [WARN ] [VALIDATOR ] RPM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:54:49.124499] [INFO ] [MAIN ] RPM: Combined data validation passed. [2025-09-05T18:54:49.254382] [INFO ] [MAIN ] RPM: Update completed successfully. [2025-09-05T18:54:49.256264] [INFO ] [MAIN ] Update Progress: 1822/2363 symbols completed. RPM took 6.4s. Estimated remaining: 16m 16s. Rate: 33.3 symbols/min [2025-09-05T18:54:49.427841] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:49.442869] [INFO ] [MAIN ] RQI: Loaded 13703 existing records. [2025-09-05T18:54:49.473339] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-05T18:54:49.617378] [INFO ] [MAIN ] RQI: Found 1 missing trading days. [2025-09-05T18:54:49.617517] [INFO ] [MAIN ] RQI: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:49.754070] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-05T18:54:50.263470] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-05T18:54:50.794742] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-05T18:54:51.063481] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-05T18:54:51.832224] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-05T18:54:51.863415] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-05T18:54:52.663511] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-05T18:54:52.873367] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-05T18:54:53.149456] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-05T18:54:53.463505] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-05T18:54:53.784424] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T18:54:53.873739] [INFO ] [MAIN ] RQI: Adding 244 new records, updating 0 existing records. [2025-09-05T18:54:53.879455] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-05T18:54:53.882784] [INFO ] [REMOTE ] RNR: Full fetch complete (38960 records). [2025-09-05T18:54:53.937106] [INFO ] [MAIN ] RQI: Combined dataset has 13947 total records. [2025-09-05T18:54:54.270951] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-05T18:54:54.327771] [WARN ] [VALIDATOR ] RQI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:54:54.662928] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-05T18:54:54.838982] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-05T18:54:54.839052] [WARN ] [VALIDATOR ] RQI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:54:54.839238] [INFO ] [MAIN ] Update Progress: 1823/2363 symbols completed. RNR took 35.8s. Estimated remaining: 16m 15s. Rate: 33.2 symbols/min [2025-09-05T18:54:54.839417] [INFO ] [MAIN ] RQI: Combined data validation passed. [2025-09-05T18:54:55.065852] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-05T18:54:55.088184] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:55.089357] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-09-05T18:54:55.091298] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-05T18:54:55.091883] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-05T18:54:55.092404] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-05T18:54:55.476886] [INFO ] [REMOTE ] RRC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:54:55.482494] [INFO ] [MAIN ] RQI: Update completed successfully. [2025-09-05T18:54:55.484190] [INFO ] [MAIN ] Update Progress: 1824/2363 symbols completed. RQI took 6.2s. Estimated remaining: 16m 13s. Rate: 33.2 symbols/min [2025-09-05T18:54:55.654259] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:55.674763] [INFO ] [MAIN ] RRX: Loaded 19023 existing records. [2025-09-05T18:54:55.863515] [INFO ] [MAIN ] RRX: Found 1 missing trading days. [2025-09-05T18:54:55.874286] [INFO ] [MAIN ] RRX: Need to fetch 1 months: 2025-09 [2025-09-05T18:54:55.863690] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-05T18:54:55.876923] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-05T18:54:56.156719] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-05T18:54:56.663473] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-05T18:54:57.316949] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-05T18:54:57.463485] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-05T18:54:58.263460] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-05T18:54:58.344000] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-05T18:54:58.824011] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:54:58.991287] [INFO ] [MAIN ] RRX: Adding 306 new records, updating 0 existing records. [2025-09-05T18:54:58.994826] [INFO ] [MAIN ] RRX: Combined dataset has 19329 total records. [2025-09-05T18:54:59.072721] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-05T18:54:59.182730] [WARN ] [VALIDATOR ] RRX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:54:59.392607] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-05T18:54:59.442506] [WARN ] [VALIDATOR ] RRX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:54:59.442752] [INFO ] [MAIN ] RRX: Combined data validation passed. [2025-09-05T18:54:59.571817] [INFO ] [MAIN ] RRX: Update completed successfully. [2025-09-05T18:54:59.574014] [INFO ] [MAIN ] Update Progress: 1825/2363 symbols completed. RRX took 4.1s. Estimated remaining: 16m 12s. Rate: 33.2 symbols/min [2025-09-05T18:54:59.757980] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:54:59.772244] [INFO ] [MAIN ] RS: Loaded 12385 existing records. [2025-09-05T18:54:59.868561] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-05T18:54:59.964291] [INFO ] [MAIN ] RS: Found 1 missing trading days. [2025-09-05T18:54:59.964459] [INFO ] [MAIN ] RS: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:00.663614] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-05T18:55:00.978758] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-05T18:55:01.076627] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-05T18:55:01.463521] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-05T18:55:02.123674] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T18:55:02.180976] [INFO ] [MAIN ] RS: Adding 138 new records, updating 0 existing records. [2025-09-05T18:55:02.183550] [INFO ] [MAIN ] RS: Combined dataset has 12523 total records. [2025-09-05T18:55:02.268771] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-05T18:55:02.365813] [WARN ] [VALIDATOR ] RS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:02.601335] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-05T18:55:02.620013] [WARN ] [VALIDATOR ] RS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:02.620398] [INFO ] [MAIN ] RS: Combined data validation passed. [2025-09-05T18:55:02.704722] [INFO ] [MAIN ] RS: Update completed successfully. [2025-09-05T18:55:02.706659] [INFO ] [MAIN ] Update Progress: 1826/2363 symbols completed. RS took 3.1s. Estimated remaining: 16m 10s. Rate: 33.2 symbols/min [2025-09-05T18:55:02.877257] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:02.877529] [WARN ] [MAIN ] RSF: No existing data found, performing full refresh instead. [2025-09-05T18:55:02.877683] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-05T18:55:02.877724] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-05T18:55:02.877773] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-05T18:55:03.070855] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-05T18:55:03.166715] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-05T18:55:03.259154] [INFO ] [REMOTE ] RSF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:55:03.863567] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-05T18:55:04.616758] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-05T18:55:04.663438] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-05T18:55:05.463483] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-05T18:55:05.540401] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-05T18:55:06.092402] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-05T18:55:06.110969] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T18:55:06.118044] [INFO ] [REMOTE ] ROL: Full fetch complete (54749 records). [2025-09-05T18:55:06.271207] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-05T18:55:06.507878] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-05T18:55:06.771363] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-05T18:55:06.771634] [INFO ] [MAIN ] Update Progress: 1827/2363 symbols completed. ROL took 29.4s. Estimated remaining: 16m 9s. Rate: 33.2 symbols/min [2025-09-05T18:55:06.948853] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:06.972688] [INFO ] [MAIN ] RSG: Loaded 22499 existing records. [2025-09-05T18:55:07.071970] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-05T18:55:07.153596] [INFO ] [MAIN ] RSG: Found 1 missing trading days. [2025-09-05T18:55:07.153778] [INFO ] [MAIN ] RSG: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:07.863497] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-05T18:55:07.984990] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-05T18:55:08.126771] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-05T18:55:08.663488] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-05T18:55:08.917505] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T18:55:09.022937] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-05T18:55:09.056466] [INFO ] [MAIN ] RSG: Adding 364 new records, updating 0 existing records. [2025-09-05T18:55:09.059854] [INFO ] [MAIN ] RSG: Combined dataset has 22863 total records. [2025-09-05T18:55:09.242674] [WARN ] [VALIDATOR ] RSG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:09.459713] [WARN ] [VALIDATOR ] RSG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:09.459960] [INFO ] [MAIN ] RSG: Combined data validation passed. [2025-09-05T18:55:09.517497] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-05T18:55:09.620627] [INFO ] [MAIN ] RSG: Update completed successfully. [2025-09-05T18:55:09.623781] [INFO ] [MAIN ] Update Progress: 1828/2363 symbols completed. RSG took 2.9s. Estimated remaining: 16m 8s. Rate: 33.2 symbols/min [2025-09-05T18:55:09.797412] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:09.819914] [INFO ] [MAIN ] RSI: Loaded 22276 existing records. [2025-09-05T18:55:10.012294] [INFO ] [MAIN ] RSI: Found 1 missing trading days. [2025-09-05T18:55:10.012503] [INFO ] [MAIN ] RSI: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:10.263491] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-05T18:55:10.695288] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-05T18:55:10.722464] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-05T18:55:11.063513] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-05T18:55:11.437313] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-05T18:55:11.863478] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-05T18:55:12.428549] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-05T18:55:12.663471] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-05T18:55:13.463514] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-05T18:55:13.888164] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-05T18:55:14.263536] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-05T18:55:14.726144] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-05T18:55:14.727691] [INFO ] [REMOTE ] RPT: Full fetch complete (22052 records). [2025-09-05T18:55:15.064912] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-05T18:55:15.101383] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-05T18:55:15.211208] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-05T18:55:15.251421] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-05T18:55:15.251597] [INFO ] [MAIN ] Update Progress: 1829/2363 symbols completed. RPT took 28.8s. Estimated remaining: 16m 7s. Rate: 33.1 symbols/min [2025-09-05T18:55:15.434605] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:15.452665] [INFO ] [MAIN ] RSKD: Loaded 16533 existing records. [2025-09-05T18:55:15.626389] [INFO ] [MAIN ] RSKD: Found 1 missing trading days. [2025-09-05T18:55:15.626569] [INFO ] [MAIN ] RSKD: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:15.863477] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-05T18:55:16.002270] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T18:55:16.140238] [INFO ] [MAIN ] RSI: Adding 363 new records, updating 0 existing records. [2025-09-05T18:55:16.143350] [INFO ] [MAIN ] RSI: Combined dataset has 22639 total records. [2025-09-05T18:55:16.324962] [WARN ] [VALIDATOR ] RSI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:16.518962] [WARN ] [VALIDATOR ] RSI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:16.519158] [INFO ] [MAIN ] RSI: Combined data validation passed. [2025-09-05T18:55:16.668089] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-05T18:55:16.676924] [INFO ] [MAIN ] RSI: Update completed successfully. [2025-09-05T18:55:16.679495] [INFO ] [MAIN ] Update Progress: 1830/2363 symbols completed. RSI took 7.1s. Estimated remaining: 16m 5s. Rate: 33.1 symbols/min [2025-09-05T18:55:16.856989] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:16.876615] [INFO ] [MAIN ] RTO: Loaded 18989 existing records. [2025-09-05T18:55:17.055681] [INFO ] [MAIN ] RTO: Found 1 missing trading days. [2025-09-05T18:55:17.055818] [INFO ] [MAIN ] RTO: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:17.398993] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T18:55:17.468063] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-05T18:55:17.485592] [INFO ] [MAIN ] RSKD: Adding 175 new records, updating 0 existing records. [2025-09-05T18:55:17.488696] [INFO ] [MAIN ] RSKD: Combined dataset has 16708 total records. [2025-09-05T18:55:17.698847] [WARN ] [VALIDATOR ] RSKD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:17.796213] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-05T18:55:17.908024] [WARN ] [VALIDATOR ] RSKD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:17.908215] [INFO ] [MAIN ] RSKD: Combined data validation passed. [2025-09-05T18:55:18.009486] [INFO ] [MAIN ] RSKD: Update completed successfully. [2025-09-05T18:55:18.011786] [INFO ] [MAIN ] Update Progress: 1831/2363 symbols completed. RSKD took 2.8s. Estimated remaining: 16m 3s. Rate: 33.1 symbols/min [2025-09-05T18:55:18.147016] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:55:18.211373] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:18.268579] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-05T18:55:18.317045] [INFO ] [MAIN ] RTO: Adding 245 new records, updating 0 existing records. [2025-09-05T18:55:18.328343] [INFO ] [MAIN ] RTO: Combined dataset has 19234 total records. [2025-09-05T18:55:18.458889] [INFO ] [MAIN ] RTX: Loaded 25708 existing records. [2025-09-05T18:55:18.651975] [WARN ] [VALIDATOR ] RTO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:18.819599] [INFO ] [MAIN ] RTX: Found 1 missing trading days. [2025-09-05T18:55:18.821964] [INFO ] [MAIN ] RTX: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:18.912149] [WARN ] [VALIDATOR ] RTO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:18.912345] [INFO ] [MAIN ] RTO: Combined data validation passed. [2025-09-05T18:55:19.035777] [INFO ] [MAIN ] RTO: Update completed successfully. [2025-09-05T18:55:19.037932] [INFO ] [MAIN ] Update Progress: 1832/2363 symbols completed. RTO took 2.4s. Estimated remaining: 16m 1s. Rate: 33.2 symbols/min [2025-09-05T18:55:19.069447] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-05T18:55:19.171632] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-05T18:55:19.224379] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:19.224538] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-09-05T18:55:19.224812] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-05T18:55:19.224869] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-05T18:55:19.224919] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-05T18:55:19.576063] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:55:19.863470] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-05T18:55:20.453329] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T18:55:20.604781] [INFO ] [MAIN ] RTX: Adding 390 new records, updating 0 existing records. [2025-09-05T18:55:20.613738] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T18:55:20.616865] [INFO ] [REMOTE ] RRC: Full fetch complete (57395 records). [2025-09-05T18:55:20.670451] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-05T18:55:20.670582] [INFO ] [MAIN ] RTX: Combined dataset has 26098 total records. [2025-09-05T18:55:21.105571] [WARN ] [VALIDATOR ] RTX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:21.307034] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-05T18:55:21.489675] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-05T18:55:21.505897] [WARN ] [VALIDATOR ] RTX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:21.507127] [INFO ] [MAIN ] RTX: Combined data validation passed. [2025-09-05T18:55:21.779355] [INFO ] [MAIN ] RTX: Update completed successfully. [2025-09-05T18:55:21.809564] [INFO ] [MAIN ] Update Progress: 1833/2363 symbols completed. RTX took 3.8s. Estimated remaining: 15m 59s. Rate: 33.1 symbols/min [2025-09-05T18:55:22.025591] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:22.026619] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-09-05T18:55:22.026775] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-05T18:55:22.027396] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-05T18:55:22.027832] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-05T18:55:22.131109] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-05T18:55:22.142565] [INFO ] [MAIN ] Update Progress: 1834/2363 symbols completed. RRC took 27.3s. Estimated remaining: 15m 57s. Rate: 33.2 symbols/min [2025-09-05T18:55:22.206575] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-05T18:55:22.288631] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-05T18:55:22.518686] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:22.539883] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-09-05T18:55:22.598613] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-05T18:55:22.598818] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-05T18:55:22.603440] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-05T18:55:22.603310] [INFO ] [REMOTE ] RVT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:55:22.913526] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-05T18:55:22.999969] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:55:23.063425] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-05T18:55:23.116869] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-05T18:55:23.863546] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-05T18:55:24.376771] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-05T18:55:24.663508] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-05T18:55:24.725473] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T18:55:24.726329] [INFO ] [REMOTE ] RSF: Full fetch complete (4410 records). [2025-09-05T18:55:25.078600] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-05T18:55:25.101821] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-05T18:55:25.101919] [INFO ] [MAIN ] Update Progress: 1835/2363 symbols completed. RSF took 22.4s. Estimated remaining: 15m 56s. Rate: 33.1 symbols/min [2025-09-05T18:55:25.273014] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:25.294236] [INFO ] [MAIN ] RWT: Loaded 18817 existing records. [2025-09-05T18:55:25.468586] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-05T18:55:25.476151] [INFO ] [MAIN ] RWT: Found 1 missing trading days. [2025-09-05T18:55:25.476368] [INFO ] [MAIN ] RWT: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:25.788230] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-05T18:55:26.263485] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-05T18:55:27.063511] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-05T18:55:27.256659] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-05T18:55:27.865604] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-05T18:55:27.867130] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-05T18:55:27.985825] [INFO ] [MAIN ] RWT: Adding 321 new records, updating 0 existing records. [2025-09-05T18:55:27.990098] [INFO ] [MAIN ] RWT: Combined dataset has 19138 total records. [2025-09-05T18:55:28.172347] [WARN ] [VALIDATOR ] RWT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:28.383250] [WARN ] [VALIDATOR ] RWT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:28.383489] [INFO ] [MAIN ] RWT: Combined data validation passed. [2025-09-05T18:55:28.506669] [INFO ] [MAIN ] RWT: Update completed successfully. [2025-09-05T18:55:28.509267] [INFO ] [MAIN ] Update Progress: 1836/2363 symbols completed. RWT took 3.4s. Estimated remaining: 15m 54s. Rate: 33.1 symbols/min [2025-09-05T18:55:28.667286] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-05T18:55:28.687920] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:28.691499] [INFO ] [MAIN ] RWTN: Loaded 991 existing records. [2025-09-05T18:55:28.867296] [INFO ] [MAIN ] RWTN: Found 1 missing trading days. [2025-09-05T18:55:28.867458] [INFO ] [MAIN ] RWTN: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:29.077248] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-05T18:55:29.220974] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-05T18:55:29.463474] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-05T18:55:30.263506] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-05T18:55:31.030475] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-05T18:55:31.063442] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-05T18:55:31.132681] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T18:55:31.141529] [INFO ] [MAIN ] RWTN: Adding 6 new records, updating 0 existing records. [2025-09-05T18:55:31.142884] [INFO ] [MAIN ] RWTN: Combined dataset has 997 total records. [2025-09-05T18:55:31.319313] [WARN ] [VALIDATOR ] RWTN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:31.510703] [WARN ] [VALIDATOR ] RWTN: Missing days changed. Total missing: 85 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-23, 2025-07-02 [2025-09-05T18:55:31.510932] [INFO ] [MAIN ] RWTN: Combined data validation passed. [2025-09-05T18:55:31.518250] [INFO ] [MAIN ] RWTN: Update completed successfully. [2025-09-05T18:55:31.518516] [INFO ] [MAIN ] Update Progress: 1837/2363 symbols completed. RWTN took 3.0s. Estimated remaining: 15m 53s. Rate: 33.1 symbols/min [2025-09-05T18:55:31.863527] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-05T18:55:31.994463] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-05T18:55:32.074294] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-05T18:55:32.663476] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-05T18:55:33.463530] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-05T18:55:33.733540] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-05T18:55:34.263516] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-05T18:55:34.519534] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-05T18:55:35.063524] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-05T18:55:35.637323] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-05T18:55:35.863505] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-05T18:55:35.937439] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-05T18:55:36.437078] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-05T18:55:36.663473] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-05T18:55:37.463487] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-05T18:55:37.617669] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-05T18:55:38.263572] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-05T18:55:38.604972] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-05T18:55:38.720876] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-05T18:55:39.063470] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-05T18:55:39.871318] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-05T18:55:39.892085] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-05T18:55:40.663496] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-05T18:55:40.777730] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-05T18:55:40.875016] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-05T18:55:41.463526] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-05T18:55:42.263540] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-05T18:55:42.526534] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-05T18:55:42.858526] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-05T18:55:43.063505] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-05T18:55:43.863441] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-05T18:55:44.084766] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T18:55:44.086736] [INFO ] [REMOTE ] RVT: Full fetch complete (29627 records). [2025-09-05T18:55:44.347008] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-05T18:55:44.403065] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T18:55:44.441303] [INFO ] [REMOTE ] RVLV: Full fetch complete (52228 records). [2025-09-05T18:55:44.669108] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-05T18:55:44.663691] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-05T18:55:45.020067] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-05T18:55:45.148348] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-05T18:55:45.149535] [INFO ] [MAIN ] Update Progress: 1838/2363 symbols completed. RVT took 23.3s. Estimated remaining: 15m 54s. Rate: 33.0 symbols/min [2025-09-05T18:55:45.271930] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-05T18:55:45.272096] [INFO ] [MAIN ] Update Progress: 1839/2363 symbols completed. RVLV took 26.2s. Estimated remaining: 15m 52s. Rate: 33.0 symbols/min [2025-09-05T18:55:46.521511] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-05T18:55:46.531582] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-05T18:55:47.231889] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:55:47.235151] [INFO ] [REMOTE ] RVTY: Full fetch complete (51379 records). [2025-09-05T18:55:47.633458] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-05T18:55:47.867685] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-05T18:55:47.867839] [INFO ] [MAIN ] Update Progress: 1840/2363 symbols completed. RVTY took 25.7s. Estimated remaining: 15m 51s. Rate: 33.0 symbols/min [2025-09-05T18:55:48.422098] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:48.544037] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:48.546322] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:48.525218] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-05T18:55:48.559708] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-05T18:55:48.557737] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-09-05T18:55:48.578608] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:48.578686] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-05T18:55:48.579366] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-05T18:55:48.579522] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-05T18:55:48.584951] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-05T18:55:48.656661] [INFO ] [MAIN ] RWTO: Loaded 1999 existing records. [2025-09-05T18:55:48.626813] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-05T18:55:48.968859] [INFO ] [MAIN ] RXO: Loaded 22806 existing records. [2025-09-05T18:55:49.196325] [INFO ] [MAIN ] RWTO: Found 1 missing trading days. [2025-09-05T18:55:49.343714] [INFO ] [MAIN ] RWTO: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:49.373790] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-05T18:55:49.619822] [INFO ] [MAIN ] RXO: Found 1 missing trading days. [2025-09-05T18:55:49.656843] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:55:49.667532] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-05T18:55:49.672784] [INFO ] [MAIN ] RXO: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:49.735237] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-05T18:55:49.733791] [INFO ] [REMOTE ] RY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:55:49.735718] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-05T18:55:50.174537] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-05T18:55:50.175933] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-05T18:55:50.291059] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T18:55:50.301331] [INFO ] [MAIN ] RWTO: Adding 27 new records, updating 0 existing records. [2025-09-05T18:55:50.302760] [INFO ] [MAIN ] RWTO: Combined dataset has 2026 total records. [2025-09-05T18:55:50.481329] [WARN ] [VALIDATOR ] RWTO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:50.673652] [WARN ] [VALIDATOR ] RWTO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:50.673849] [INFO ] [MAIN ] RWTO: Combined data validation passed. [2025-09-05T18:55:50.687348] [INFO ] [MAIN ] RWTO: Update completed successfully. [2025-09-05T18:55:50.687747] [INFO ] [MAIN ] Update Progress: 1841/2363 symbols completed. RWTO took 2.8s. Estimated remaining: 15m 49s. Rate: 33.0 symbols/min [2025-09-05T18:55:50.857894] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:50.874287] [INFO ] [MAIN ] RYAM: Loaded 16226 existing records. [2025-09-05T18:55:51.052909] [INFO ] [MAIN ] RYAM: Found 1 missing trading days. [2025-09-05T18:55:51.053057] [INFO ] [MAIN ] RYAM: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:51.053268] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-05T18:55:51.154666] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:55:51.282875] [INFO ] [MAIN ] RXO: Adding 314 new records, updating 0 existing records. [2025-09-05T18:55:51.289889] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-05T18:55:51.291886] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-05T18:55:51.292912] [INFO ] [MAIN ] RXO: Combined dataset has 23120 total records. [2025-09-05T18:55:51.475597] [WARN ] [VALIDATOR ] RXO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:51.689663] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-05T18:55:51.708725] [WARN ] [VALIDATOR ] RXO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:51.708956] [INFO ] [MAIN ] RXO: Combined data validation passed. [2025-09-05T18:55:51.850263] [INFO ] [MAIN ] RXO: Update completed successfully. [2025-09-05T18:55:51.852695] [INFO ] [MAIN ] Update Progress: 1842/2363 symbols completed. RXO took 4.0s. Estimated remaining: 15m 47s. Rate: 33.0 symbols/min [2025-09-05T18:55:51.878986] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-05T18:55:52.036552] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:52.059036] [INFO ] [MAIN ] RYAN: Loaded 20744 existing records. [2025-09-05T18:55:52.164521] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-05T18:55:52.240012] [INFO ] [MAIN ] RYAN: Found 1 missing trading days. [2025-09-05T18:55:52.240186] [INFO ] [MAIN ] RYAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:52.512415] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:55:52.623520] [INFO ] [MAIN ] RYAM: Adding 248 new records, updating 0 existing records. [2025-09-05T18:55:52.626638] [INFO ] [MAIN ] RYAM: Combined dataset has 16474 total records. [2025-09-05T18:55:52.669196] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-05T18:55:52.824591] [WARN ] [VALIDATOR ] RYAM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:53.034488] [WARN ] [VALIDATOR ] RYAM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:53.034838] [INFO ] [MAIN ] RYAM: Combined data validation passed. [2025-09-05T18:55:53.146432] [INFO ] [MAIN ] RYAM: Update completed successfully. [2025-09-05T18:55:53.149216] [INFO ] [MAIN ] Update Progress: 1843/2363 symbols completed. RYAM took 2.5s. Estimated remaining: 15m 45s. Rate: 33.0 symbols/min [2025-09-05T18:55:53.394705] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:53.396617] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-05T18:55:53.423307] [INFO ] [MAIN ] RYI: Loaded 16440 existing records. [2025-09-05T18:55:53.470025] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-05T18:55:53.732621] [INFO ] [MAIN ] RYI: Found 1 missing trading days. [2025-09-05T18:55:53.732859] [INFO ] [MAIN ] RYI: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:53.855766] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-05T18:55:54.263533] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-05T18:55:54.792180] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-05T18:55:54.845481] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T18:55:54.971475] [INFO ] [MAIN ] RYAN: Adding 353 new records, updating 0 existing records. [2025-09-05T18:55:54.976047] [INFO ] [MAIN ] RYAN: Combined dataset has 21097 total records. [2025-09-05T18:55:55.068726] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-05T18:55:55.163908] [WARN ] [VALIDATOR ] RYAN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:55.359212] [WARN ] [VALIDATOR ] RYAN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:55.359452] [INFO ] [MAIN ] RYAN: Combined data validation passed. [2025-09-05T18:55:55.497295] [INFO ] [MAIN ] RYAN: Update completed successfully. [2025-09-05T18:55:55.499820] [INFO ] [MAIN ] Update Progress: 1844/2363 symbols completed. RYAN took 3.6s. Estimated remaining: 15m 43s. Rate: 33.0 symbols/min [2025-09-05T18:55:55.669031] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:55.691360] [INFO ] [MAIN ] RYN: Loaded 21858 existing records. [2025-09-05T18:55:55.865435] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-05T18:55:55.865366] [INFO ] [MAIN ] RYN: Found 1 missing trading days. [2025-09-05T18:55:55.865631] [INFO ] [MAIN ] RYN: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:56.060342] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T18:55:56.176137] [INFO ] [MAIN ] RYI: Adding 151 new records, updating 364 existing records. [2025-09-05T18:55:56.180380] [INFO ] [MAIN ] RYI: Combined dataset has 16591 total records. [2025-09-05T18:55:56.348542] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-05T18:55:56.372569] [WARN ] [VALIDATOR ] RYI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:55:56.567826] [WARN ] [VALIDATOR ] RYI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:55:56.568032] [INFO ] [MAIN ] RYI: Combined data validation passed. [2025-09-05T18:55:56.668680] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-05T18:55:56.668987] [INFO ] [MAIN ] RYI: Update completed successfully. [2025-09-05T18:55:56.671854] [INFO ] [MAIN ] Update Progress: 1845/2363 symbols completed. RYI took 3.5s. Estimated remaining: 15m 41s. Rate: 33.0 symbols/min [2025-09-05T18:55:56.842736] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:56.848186] [INFO ] [MAIN ] RZB: Loaded 3886 existing records. [2025-09-05T18:55:57.018256] [INFO ] [MAIN ] RZB: Found 1 missing trading days. [2025-09-05T18:55:57.018448] [INFO ] [MAIN ] RZB: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:57.463515] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-05T18:55:57.924839] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-05T18:55:58.056390] [INFO ] [MAIN ] RYN: Adding 308 new records, updating 0 existing records. [2025-09-05T18:55:58.059594] [INFO ] [MAIN ] RYN: Combined dataset has 22166 total records. [2025-09-05T18:55:58.296893] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-05T18:55:58.301506] [WARN ] [VALIDATOR ] RYN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:58.507880] [WARN ] [VALIDATOR ] RYN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:58.508112] [INFO ] [MAIN ] RYN: Combined data validation passed. [2025-09-05T18:55:58.645245] [INFO ] [MAIN ] RYN: Update completed successfully. [2025-09-05T18:55:58.648001] [INFO ] [MAIN ] Update Progress: 1846/2363 symbols completed. RYN took 3.1s. Estimated remaining: 15m 40s. Rate: 33.0 symbols/min [2025-09-05T18:55:58.811293] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-05T18:55:58.829496] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:55:58.836420] [INFO ] [MAIN ] RZC: Loaded 3333 existing records. [2025-09-05T18:55:59.016639] [INFO ] [MAIN ] RZC: Found 1 missing trading days. [2025-09-05T18:55:59.016911] [INFO ] [MAIN ] RZC: Need to fetch 1 months: 2025-09 [2025-09-05T18:55:59.063486] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-05T18:55:59.133116] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-05T18:55:59.578142] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:55:59.597069] [INFO ] [MAIN ] RZC: Adding 50 new records, updating 0 existing records. [2025-09-05T18:55:59.598431] [INFO ] [MAIN ] RZC: Combined dataset has 3383 total records. [2025-09-05T18:55:59.773968] [WARN ] [VALIDATOR ] RZC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:55:59.871622] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-05T18:55:59.962833] [WARN ] [VALIDATOR ] RZC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:55:59.963035] [INFO ] [MAIN ] RZC: Combined data validation passed. [2025-09-05T18:55:59.983830] [INFO ] [MAIN ] RZC: Update completed successfully. [2025-09-05T18:55:59.984348] [INFO ] [MAIN ] Update Progress: 1847/2363 symbols completed. RZC took 1.3s. Estimated remaining: 15m 38s. Rate: 33.0 symbols/min [2025-09-05T18:56:00.154572] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:00.181043] [INFO ] [MAIN ] S: Loaded 25575 existing records. [2025-09-05T18:56:00.356909] [INFO ] [MAIN ] S: Found 1 missing trading days. [2025-09-05T18:56:00.357077] [INFO ] [MAIN ] S: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:00.575891] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T18:56:00.588382] [INFO ] [MAIN ] RZB: Adding 20 new records, updating 0 existing records. [2025-09-05T18:56:00.589797] [INFO ] [MAIN ] RZB: Combined dataset has 3906 total records. [2025-09-05T18:56:00.668558] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-05T18:56:00.772135] [WARN ] [VALIDATOR ] RZB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:00.957606] [WARN ] [VALIDATOR ] RZB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:00.957822] [INFO ] [MAIN ] RZB: Combined data validation passed. [2025-09-05T18:56:00.982678] [INFO ] [MAIN ] RZB: Update completed successfully. [2025-09-05T18:56:00.983225] [INFO ] [MAIN ] Update Progress: 1848/2363 symbols completed. RZB took 4.3s. Estimated remaining: 15m 36s. Rate: 33.0 symbols/min [2025-09-05T18:56:01.153210] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:01.153363] [WARN ] [MAIN ] SA: No existing data found, performing full refresh instead. [2025-09-05T18:56:01.153486] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-05T18:56:01.153529] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-05T18:56:01.153595] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-05T18:56:01.255555] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-05T18:56:01.475017] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-05T18:56:01.511983] [INFO ] [REMOTE ] SA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:56:02.263532] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-05T18:56:03.063500] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-05T18:56:03.739889] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T18:56:03.740880] [INFO ] [REMOTE ] RWTP: Full fetch complete (3799 records). [2025-09-05T18:56:03.868233] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-05T18:56:04.106429] [INFO ] [MAIN ] RWTP: Fetched primary data is valid. [2025-09-05T18:56:04.142458] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-05T18:56:04.154582] [INFO ] [MAIN ] RWTP: Full history saved. [2025-09-05T18:56:04.154833] [INFO ] [MAIN ] Update Progress: 1849/2363 symbols completed. RWTP took 16.3s. Estimated remaining: 15m 34s. Rate: 33.0 symbols/min [2025-09-05T18:56:04.267924] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-09-05T18:56:04.381926] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:04.467320] [INFO ] [MAIN ] SABA: Loaded 4448 existing records. [2025-09-05T18:56:04.573097] [INFO ] [MAIN ] S: Adding 390 new records, updating 0 existing records. [2025-09-05T18:56:04.665567] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-05T18:56:04.687012] [INFO ] [MAIN ] SABA: Found 1 missing trading days. [2025-09-05T18:56:04.688365] [INFO ] [MAIN ] SABA: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:04.689364] [INFO ] [MAIN ] S: Combined dataset has 25965 total records. [2025-09-05T18:56:04.882695] [WARN ] [VALIDATOR ] S: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:05.083157] [WARN ] [VALIDATOR ] S: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:05.083403] [INFO ] [MAIN ] S: Combined data validation passed. [2025-09-05T18:56:05.242127] [INFO ] [MAIN ] S: Update completed successfully. [2025-09-05T18:56:05.245173] [INFO ] [MAIN ] Update Progress: 1850/2363 symbols completed. S took 5.3s. Estimated remaining: 15m 32s. Rate: 33.0 symbols/min [2025-09-05T18:56:05.427123] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:05.442475] [INFO ] [MAIN ] SAFE: Loaded 14531 existing records. [2025-09-05T18:56:05.474468] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-05T18:56:05.631043] [INFO ] [MAIN ] SAFE: Found 1 missing trading days. [2025-09-05T18:56:05.631174] [INFO ] [MAIN ] SAFE: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:05.839934] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-05T18:56:06.263488] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-05T18:56:06.408019] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-05T18:56:06.436452] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-05T18:56:06.472007] [INFO ] [MAIN ] SABA: Adding 63 new records, updating 0 existing records. [2025-09-05T18:56:06.474084] [INFO ] [MAIN ] SABA: Combined dataset has 4511 total records. [2025-09-05T18:56:06.655260] [WARN ] [VALIDATOR ] SABA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:06.844332] [WARN ] [VALIDATOR ] SABA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:06.844555] [INFO ] [MAIN ] SABA: Combined data validation passed. [2025-09-05T18:56:06.873410] [INFO ] [MAIN ] SABA: Update completed successfully. [2025-09-05T18:56:06.874099] [INFO ] [MAIN ] Update Progress: 1851/2363 symbols completed. SABA took 2.7s. Estimated remaining: 15m 30s. Rate: 33.0 symbols/min [2025-09-05T18:56:07.048150] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:07.061966] [INFO ] [MAIN ] SAH: Loaded 10223 existing records. [2025-09-05T18:56:07.073414] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-05T18:56:07.255751] [INFO ] [MAIN ] SAH: Found 1 missing trading days. [2025-09-05T18:56:07.256009] [INFO ] [MAIN ] SAH: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:07.261218] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:56:07.346519] [INFO ] [MAIN ] SAFE: Adding 243 new records, updating 0 existing records. [2025-09-05T18:56:07.349443] [INFO ] [MAIN ] SAFE: Combined dataset has 14774 total records. [2025-09-05T18:56:07.527503] [WARN ] [VALIDATOR ] SAFE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:07.719034] [WARN ] [VALIDATOR ] SAFE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:07.719237] [INFO ] [MAIN ] SAFE: Combined data validation passed. [2025-09-05T18:56:07.811729] [INFO ] [MAIN ] SAFE: Update completed successfully. [2025-09-05T18:56:07.813356] [INFO ] [MAIN ] Update Progress: 1852/2363 symbols completed. SAFE took 2.6s. Estimated remaining: 15m 28s. Rate: 33.0 symbols/min [2025-09-05T18:56:07.868573] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-05T18:56:07.990210] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:07.992407] [INFO ] [MAIN ] SAJ: Loaded 364 existing records. [2025-09-05T18:56:08.165738] [INFO ] [MAIN ] SAJ: Found 1 missing trading days. [2025-09-05T18:56:08.165903] [INFO ] [MAIN ] SAJ: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:08.663516] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-05T18:56:08.931580] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-05T18:56:09.463530] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-05T18:56:09.515706] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-05T18:56:09.532083] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:56:09.580874] [INFO ] [MAIN ] SAH: Adding 95 new records, updating 0 existing records. [2025-09-05T18:56:09.583366] [INFO ] [MAIN ] SAH: Combined dataset has 10318 total records. [2025-09-05T18:56:09.760296] [WARN ] [VALIDATOR ] SAH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:09.963204] [WARN ] [VALIDATOR ] SAH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:09.963449] [INFO ] [MAIN ] SAH: Combined data validation passed. [2025-09-05T18:56:10.029536] [INFO ] [MAIN ] SAH: Update completed successfully. [2025-09-05T18:56:10.030898] [INFO ] [MAIN ] Update Progress: 1853/2363 symbols completed. SAH took 3.2s. Estimated remaining: 15m 26s. Rate: 33.0 symbols/min [2025-09-05T18:56:10.201530] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:10.201712] [WARN ] [MAIN ] SAM: No existing data found, performing full refresh instead. [2025-09-05T18:56:10.201839] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-05T18:56:10.201902] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-05T18:56:10.201987] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-05T18:56:10.268726] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-05T18:56:10.556193] [INFO ] [REMOTE ] SAM: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:56:10.745311] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T18:56:10.748319] [INFO ] [MAIN ] SAJ: Adding 3 new records, updating 0 existing records. [2025-09-05T18:56:10.749733] [INFO ] [MAIN ] SAJ: Combined dataset has 367 total records. [2025-09-05T18:56:10.933853] [WARN ] [VALIDATOR ] SAJ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:11.063955] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-05T18:56:11.130984] [WARN ] [VALIDATOR ] SAJ: Missing days changed. Total missing: 87 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-16, 2025-06-26, 2025-06-30, 2025-07-14 [2025-09-05T18:56:11.131189] [INFO ] [MAIN ] SAJ: Combined data validation passed. [2025-09-05T18:56:11.134906] [INFO ] [MAIN ] SAJ: Update completed successfully. [2025-09-05T18:56:11.135079] [INFO ] [MAIN ] Update Progress: 1854/2363 symbols completed. SAJ took 3.3s. Estimated remaining: 15m 24s. Rate: 33.0 symbols/min [2025-09-05T18:56:11.318050] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-05T18:56:11.346350] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:11.372013] [INFO ] [MAIN ] SAN: Loaded 25326 existing records. [2025-09-05T18:56:11.548322] [INFO ] [MAIN ] SAN: Found 1 missing trading days. [2025-09-05T18:56:11.548491] [INFO ] [MAIN ] SAN: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:11.863475] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-05T18:56:11.933839] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-05T18:56:12.663522] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-05T18:56:13.463477] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-05T18:56:13.511626] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-05T18:56:14.059356] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-05T18:56:14.263521] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-05T18:56:15.063552] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-05T18:56:15.235039] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-05T18:56:15.812956] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-05T18:56:15.863513] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-05T18:56:16.663497] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-05T18:56:16.796705] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-05T18:56:17.061228] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-05T18:56:17.463524] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-05T18:56:17.959624] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:56:17.962875] [INFO ] [REMOTE ] RY: Full fetch complete (52329 records). [2025-09-05T18:56:18.268611] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-05T18:56:18.341375] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-05T18:56:18.600246] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-05T18:56:18.619082] [INFO ] [MAIN ] RY: Full history saved. [2025-09-05T18:56:18.619239] [INFO ] [MAIN ] Update Progress: 1855/2363 symbols completed. RY took 30.8s. Estimated remaining: 15m 24s. Rate: 33.0 symbols/min [2025-09-05T18:56:18.807985] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:18.837803] [INFO ] [MAIN ] SAND: Loaded 24851 existing records. [2025-09-05T18:56:19.022737] [INFO ] [MAIN ] SAND: Found 1 missing trading days. [2025-09-05T18:56:19.022925] [INFO ] [MAIN ] SAND: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:19.063520] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-05T18:56:19.863480] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-05T18:56:19.890131] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-05T18:56:20.045302] [INFO ] [MAIN ] SAN: Adding 377 new records, updating 0 existing records. [2025-09-05T18:56:20.049664] [INFO ] [MAIN ] SAN: Combined dataset has 25703 total records. [2025-09-05T18:56:20.237350] [WARN ] [VALIDATOR ] SAN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:20.434583] [WARN ] [VALIDATOR ] SAN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:20.434847] [INFO ] [MAIN ] SAN: Combined data validation passed. [2025-09-05T18:56:20.616778] [INFO ] [MAIN ] SAN: Update completed successfully. [2025-09-05T18:56:20.619738] [INFO ] [MAIN ] Update Progress: 1856/2363 symbols completed. SAN took 9.5s. Estimated remaining: 15m 22s. Rate: 33.0 symbols/min [2025-09-05T18:56:20.623699] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-05T18:56:20.669222] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-05T18:56:20.821216] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:20.846288] [INFO ] [MAIN ] SAP: Loaded 23429 existing records. [2025-09-05T18:56:21.032403] [INFO ] [MAIN ] SAP: Found 1 missing trading days. [2025-09-05T18:56:21.032533] [INFO ] [MAIN ] SAP: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:21.252213] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-05T18:56:21.397614] [INFO ] [MAIN ] SAND: Adding 373 new records, updating 0 existing records. [2025-09-05T18:56:21.401079] [INFO ] [MAIN ] SAND: Combined dataset has 25224 total records. [2025-09-05T18:56:21.468717] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-05T18:56:21.583713] [WARN ] [VALIDATOR ] SAND: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:21.791665] [WARN ] [VALIDATOR ] SAND: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:21.791947] [INFO ] [MAIN ] SAND: Combined data validation passed. [2025-09-05T18:56:21.953849] [INFO ] [MAIN ] SAND: Update completed successfully. [2025-09-05T18:56:21.957091] [INFO ] [MAIN ] Update Progress: 1857/2363 symbols completed. SAND took 3.3s. Estimated remaining: 15m 20s. Rate: 33.0 symbols/min [2025-09-05T18:56:22.127255] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:22.136580] [INFO ] [MAIN ] SAR: Loaded 8307 existing records. [2025-09-05T18:56:22.341593] [INFO ] [MAIN ] SAR: Found 1 missing trading days. [2025-09-05T18:56:22.283714] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-05T18:56:22.341852] [INFO ] [MAIN ] SAR: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:22.353499] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-05T18:56:22.923786] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:56:23.068563] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-05T18:56:23.074324] [INFO ] [MAIN ] SAP: Adding 372 new records, updating 0 existing records. [2025-09-05T18:56:23.078426] [INFO ] [MAIN ] SAP: Combined dataset has 23801 total records. [2025-09-05T18:56:23.262377] [WARN ] [VALIDATOR ] SAP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:23.461592] [WARN ] [VALIDATOR ] SAP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:23.461852] [INFO ] [MAIN ] SAP: Combined data validation passed. [2025-09-05T18:56:23.623008] [INFO ] [MAIN ] SAP: Update completed successfully. [2025-09-05T18:56:23.626525] [INFO ] [MAIN ] Update Progress: 1858/2363 symbols completed. SAP took 3.0s. Estimated remaining: 15m 19s. Rate: 33.0 symbols/min [2025-09-05T18:56:23.731017] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-05T18:56:23.845605] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:23.845826] [WARN ] [MAIN ] SARO: No existing data found, performing full refresh instead. [2025-09-05T18:56:23.845966] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-05T18:56:23.846007] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-05T18:56:23.846053] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-05T18:56:23.868695] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-05T18:56:24.215639] [INFO ] [REMOTE ] SARO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:56:24.663455] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-05T18:56:24.777049] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-05T18:56:25.275251] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-05T18:56:25.463526] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-05T18:56:26.263511] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-05T18:56:26.432256] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-05T18:56:26.522607] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-05T18:56:27.063492] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-05T18:56:27.213924] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:56:27.318709] [INFO ] [MAIN ] SAR: Adding 150 new records, updating 354 existing records. [2025-09-05T18:56:27.321928] [INFO ] [MAIN ] SAR: Combined dataset has 8457 total records. [2025-09-05T18:56:27.500794] [WARN ] [VALIDATOR ] SAR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:27.694947] [WARN ] [VALIDATOR ] SAR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:27.695178] [INFO ] [MAIN ] SAR: Combined data validation passed. [2025-09-05T18:56:27.748959] [INFO ] [MAIN ] SAR: Update completed successfully. [2025-09-05T18:56:27.750187] [INFO ] [MAIN ] Update Progress: 1859/2363 symbols completed. SAR took 5.8s. Estimated remaining: 15m 17s. Rate: 33.0 symbols/min [2025-09-05T18:56:27.868704] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-05T18:56:27.934168] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:27.936576] [INFO ] [MAIN ] SAT: Loaded 499 existing records. [2025-09-05T18:56:28.106756] [INFO ] [MAIN ] SAT: Found 1 missing trading days. [2025-09-05T18:56:28.106898] [INFO ] [MAIN ] SAT: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:28.663470] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-05T18:56:28.910053] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-05T18:56:28.912916] [INFO ] [REMOTE ] SA: Full fetch complete (46353 records). [2025-09-05T18:56:29.295726] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-05T18:56:29.400893] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-05T18:56:29.472627] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-05T18:56:29.528985] [INFO ] [MAIN ] SA: Full history saved. [2025-09-05T18:56:29.529231] [INFO ] [MAIN ] Update Progress: 1860/2363 symbols completed. SA took 28.5s. Estimated remaining: 15m 16s. Rate: 33.0 symbols/min [2025-09-05T18:56:29.715038] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:29.718068] [INFO ] [MAIN ] SAY: Loaded 476 existing records. [2025-09-05T18:56:29.885625] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-05T18:56:29.909547] [INFO ] [MAIN ] SAT: Adding 7 new records, updating 0 existing records. [2025-09-05T18:56:29.912115] [INFO ] [MAIN ] SAY: Found 1 missing trading days. [2025-09-05T18:56:29.914273] [INFO ] [MAIN ] SAY: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:29.915133] [INFO ] [MAIN ] SAT: Combined dataset has 506 total records. [2025-09-05T18:56:30.114852] [WARN ] [VALIDATOR ] SAT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:30.265407] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-05T18:56:30.318756] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-05T18:56:30.338065] [WARN ] [VALIDATOR ] SAT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:30.338306] [INFO ] [MAIN ] SAT: Combined data validation passed. [2025-09-05T18:56:30.342898] [INFO ] [MAIN ] SAT: Update completed successfully. [2025-09-05T18:56:30.343144] [INFO ] [MAIN ] Update Progress: 1861/2363 symbols completed. SAT took 2.6s. Estimated remaining: 15m 14s. Rate: 33.0 symbols/min [2025-09-05T18:56:30.520863] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:30.521205] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-05T18:56:30.521363] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-05T18:56:30.521411] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-05T18:56:30.521460] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-05T18:56:30.876283] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:56:31.063491] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-05T18:56:31.575235] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-05T18:56:31.577983] [INFO ] [MAIN ] SAY: Adding 2 new records, updating 0 existing records. [2025-09-05T18:56:31.579085] [INFO ] [MAIN ] SAY: Combined dataset has 478 total records. [2025-09-05T18:56:31.773304] [WARN ] [VALIDATOR ] SAY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:31.871447] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-05T18:56:31.958404] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-05T18:56:31.964603] [INFO ] [REMOTE ] SAM: Full fetch complete (23602 records). [2025-09-05T18:56:32.347094] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-05T18:56:32.485917] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-05T18:56:32.486477] [INFO ] [MAIN ] Update Progress: 1862/2363 symbols completed. SAM took 22.5s. Estimated remaining: 15m 12s. Rate: 33.0 symbols/min [2025-09-05T18:56:32.602448] [WARN ] [VALIDATOR ] SAY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:32.618440] [INFO ] [MAIN ] SAY: Combined data validation passed. [2025-09-05T18:56:32.675301] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-05T18:56:32.675056] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:32.683879] [INFO ] [MAIN ] SAY: Update completed successfully. [2025-09-05T18:56:32.684479] [INFO ] [MAIN ] Update Progress: 1863/2363 symbols completed. SAY took 3.2s. Estimated remaining: 15m 10s. Rate: 33.0 symbols/min [2025-09-05T18:56:32.807440] [INFO ] [MAIN ] SB: Loaded 15771 existing records. [2025-09-05T18:56:32.974764] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:33.028329] [INFO ] [MAIN ] SBDS: Loaded 637 existing records. [2025-09-05T18:56:33.081247] [INFO ] [MAIN ] SB: Found 1 missing trading days. [2025-09-05T18:56:33.127146] [INFO ] [MAIN ] SB: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:33.222106] [INFO ] [MAIN ] SBDS: Found 1 missing trading days. [2025-09-05T18:56:33.222267] [INFO ] [MAIN ] SBDS: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:33.394972] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-05T18:56:33.463449] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-05T18:56:33.600327] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-05T18:56:33.955902] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-05T18:56:34.263481] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-05T18:56:34.844699] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-05T18:56:35.063505] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-05T18:56:35.508856] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-05T18:56:35.863533] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-05T18:56:36.663531] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-05T18:56:37.124394] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-05T18:56:37.463474] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-05T18:56:37.475484] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-05T18:56:37.563378] [INFO ] [MAIN ] SB: Adding 147 new records, updating 0 existing records. [2025-09-05T18:56:37.565968] [INFO ] [MAIN ] SB: Combined dataset has 15918 total records. [2025-09-05T18:56:37.745466] [WARN ] [VALIDATOR ] SB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:37.938829] [WARN ] [VALIDATOR ] SB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:37.939060] [INFO ] [MAIN ] SB: Combined data validation passed. [2025-09-05T18:56:38.036904] [INFO ] [MAIN ] SB: Update completed successfully. [2025-09-05T18:56:38.038556] [INFO ] [MAIN ] Update Progress: 1864/2363 symbols completed. SB took 5.6s. Estimated remaining: 15m 9s. Rate: 33.0 symbols/min [2025-09-05T18:56:38.208037] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:38.232088] [INFO ] [MAIN ] SBH: Loaded 23540 existing records. [2025-09-05T18:56:38.268732] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-05T18:56:38.410587] [INFO ] [MAIN ] SBH: Found 1 missing trading days. [2025-09-05T18:56:38.410780] [INFO ] [MAIN ] SBH: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:38.669278] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-05T18:56:38.707498] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-05T18:56:39.063459] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-05T18:56:39.392899] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-05T18:56:39.863541] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-05T18:56:40.663521] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-05T18:56:40.979092] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-05T18:56:41.461049] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-05T18:56:41.471319] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-05T18:56:42.263506] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-05T18:56:42.713744] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T18:56:42.719518] [INFO ] [MAIN ] SBDS: Adding 26 new records, updating 0 existing records. [2025-09-05T18:56:42.720859] [INFO ] [MAIN ] SBDS: Combined dataset has 663 total records. [2025-09-05T18:56:42.903061] [WARN ] [VALIDATOR ] SBDS: Not fatal, but first date in data (2025-07-24) does not match expected start date (2025-01-31) [2025-09-05T18:56:43.065147] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-05T18:56:43.099215] [WARN ] [VALIDATOR ] SBDS: Missing days changed. Total missing: 119 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23 [2025-09-05T18:56:43.099450] [INFO ] [MAIN ] SBDS: Combined data validation passed. [2025-09-05T18:56:43.105152] [INFO ] [MAIN ] SBDS: Update completed successfully. [2025-09-05T18:56:43.105409] [INFO ] [MAIN ] Update Progress: 1865/2363 symbols completed. SBDS took 10.4s. Estimated remaining: 15m 8s. Rate: 32.9 symbols/min [2025-09-05T18:56:43.280522] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:43.286299] [INFO ] [MAIN ] SBI: Loaded 3867 existing records. [2025-09-05T18:56:43.456918] [INFO ] [MAIN ] SBI: Found 1 missing trading days. [2025-09-05T18:56:43.457126] [INFO ] [MAIN ] SBI: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:43.464617] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-05T18:56:43.539148] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-05T18:56:43.550333] [INFO ] [REMOTE ] SAZ: Full fetch complete (1498 records). [2025-09-05T18:56:43.705575] [INFO ] [MAIN ] SBH: Adding 381 new records, updating 0 existing records. [2025-09-05T18:56:43.814569] [INFO ] [MAIN ] SBH: Combined dataset has 23921 total records. [2025-09-05T18:56:43.876444] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-05T18:56:44.188226] [WARN ] [VALIDATOR ] SBH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:44.405533] [WARN ] [VALIDATOR ] SBH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:44.405635] [WARN ] [VALIDATOR ] SAZ: Missing days changed. Total missing: 1 No longer missing: 2025-01-29, 2025-01-30, 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-07-31 [2025-09-05T18:56:44.405841] [INFO ] [MAIN ] SBH: Combined data validation passed. [2025-09-05T18:56:44.405971] [INFO ] [MAIN ] SAZ: Fetched primary data is valid. [2025-09-05T18:56:44.414693] [INFO ] [MAIN ] SAZ: Full history saved. [2025-09-05T18:56:44.414819] [INFO ] [MAIN ] Update Progress: 1866/2363 symbols completed. SAZ took 14.1s. Estimated remaining: 15m 6s. Rate: 32.9 symbols/min [2025-09-05T18:56:44.569882] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:56:44.626173] [INFO ] [MAIN ] SBI: Adding 31 new records, updating 0 existing records. [2025-09-05T18:56:44.682447] [INFO ] [MAIN ] SBI: Combined dataset has 3898 total records. [2025-09-05T18:56:44.696903] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-05T18:56:44.718867] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:44.826926] [INFO ] [MAIN ] SBR: Loaded 3553 existing records. [2025-09-05T18:56:45.038971] [INFO ] [MAIN ] SBH: Update completed successfully. [2025-09-05T18:56:45.045927] [WARN ] [VALIDATOR ] SBI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:45.067931] [INFO ] [MAIN ] Update Progress: 1867/2363 symbols completed. SBH took 7.0s. Estimated remaining: 15m 4s. Rate: 32.9 symbols/min [2025-09-05T18:56:45.308834] [INFO ] [MAIN ] SBR: Found 1 missing trading days. [2025-09-05T18:56:45.331197] [INFO ] [MAIN ] SBR: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:45.466521] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-05T18:56:45.519009] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:45.554424] [WARN ] [VALIDATOR ] SBI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:45.555802] [INFO ] [MAIN ] SBI: Combined data validation passed. [2025-09-05T18:56:45.556610] [INFO ] [MAIN ] SBS: Loaded 23307 existing records. [2025-09-05T18:56:45.681136] [INFO ] [MAIN ] SBI: Update completed successfully. [2025-09-05T18:56:45.684068] [INFO ] [MAIN ] Update Progress: 1868/2363 symbols completed. SBI took 2.6s. Estimated remaining: 15m 1s. Rate: 32.9 symbols/min [2025-09-05T18:56:45.882633] [INFO ] [MAIN ] SBS: Found 1 missing trading days. [2025-09-05T18:56:45.906950] [INFO ] [MAIN ] SBS: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:45.938960] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:45.948537] [INFO ] [MAIN ] SBSI: Loaded 7010 existing records. [2025-09-05T18:56:46.127260] [INFO ] [MAIN ] SBSI: Found 1 missing trading days. [2025-09-05T18:56:46.127479] [INFO ] [MAIN ] SBSI: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:46.191462] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-05T18:56:46.204711] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T18:56:46.233257] [INFO ] [MAIN ] SBR: Adding 91 new records, updating 0 existing records. [2025-09-05T18:56:46.235077] [INFO ] [MAIN ] SBR: Combined dataset has 3644 total records. [2025-09-05T18:56:46.268597] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-05T18:56:46.416169] [WARN ] [VALIDATOR ] SBR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:46.601414] [WARN ] [VALIDATOR ] SBR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:46.601674] [INFO ] [MAIN ] SBR: Combined data validation passed. [2025-09-05T18:56:46.626062] [INFO ] [MAIN ] SBR: Update completed successfully. [2025-09-05T18:56:46.626631] [INFO ] [MAIN ] Update Progress: 1869/2363 symbols completed. SBR took 2.2s. Estimated remaining: 14m 59s. Rate: 33.0 symbols/min [2025-09-05T18:56:46.795214] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:46.823445] [INFO ] [MAIN ] SBSW: Loaded 25455 existing records. [2025-09-05T18:56:46.998485] [INFO ] [MAIN ] SBSW: Found 1 missing trading days. [2025-09-05T18:56:46.998692] [INFO ] [MAIN ] SBSW: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:47.063454] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-05T18:56:47.433332] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T18:56:47.477582] [INFO ] [MAIN ] SBSI: Adding 94 new records, updating 0 existing records. [2025-09-05T18:56:47.479531] [INFO ] [MAIN ] SBSI: Combined dataset has 7104 total records. [2025-09-05T18:56:47.718610] [WARN ] [VALIDATOR ] SBSI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:47.868569] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-05T18:56:47.921748] [WARN ] [VALIDATOR ] SBSI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:47.921940] [INFO ] [MAIN ] SBSI: Combined data validation passed. [2025-09-05T18:56:47.973975] [INFO ] [MAIN ] SBSI: Update completed successfully. [2025-09-05T18:56:47.975263] [INFO ] [MAIN ] Update Progress: 1870/2363 symbols completed. SBSI took 2.3s. Estimated remaining: 14m 57s. Rate: 33.0 symbols/min [2025-09-05T18:56:48.157762] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:48.157936] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-05T18:56:48.158069] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-05T18:56:48.158109] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-05T18:56:48.158157] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-05T18:56:48.531571] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:56:48.663472] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-05T18:56:48.822790] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-05T18:56:49.051942] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:56:49.186586] [INFO ] [MAIN ] SBS: Adding 378 new records, updating 0 existing records. [2025-09-05T18:56:49.189826] [INFO ] [MAIN ] SBS: Combined dataset has 23685 total records. [2025-09-05T18:56:49.285373] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-05T18:56:49.374998] [WARN ] [VALIDATOR ] SBS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:49.468824] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-05T18:56:49.578476] [WARN ] [VALIDATOR ] SBS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:49.578769] [INFO ] [MAIN ] SBS: Combined data validation passed. [2025-09-05T18:56:49.730199] [INFO ] [MAIN ] SBS: Update completed successfully. [2025-09-05T18:56:49.733479] [INFO ] [MAIN ] Update Progress: 1871/2363 symbols completed. SBS took 4.7s. Estimated remaining: 14m 56s. Rate: 33.0 symbols/min [2025-09-05T18:56:49.914174] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:49.914362] [WARN ] [MAIN ] SCCO: No existing data found, performing full refresh instead. [2025-09-05T18:56:49.914511] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-05T18:56:49.914553] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-05T18:56:49.914601] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-05T18:56:50.266538] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-05T18:56:50.292238] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:56:50.611574] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-05T18:56:51.063472] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-05T18:56:51.138898] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-05T18:56:51.317954] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-05T18:56:51.863481] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-05T18:56:52.256038] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-05T18:56:52.663464] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-05T18:56:53.175941] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-05T18:56:53.463506] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-05T18:56:54.237527] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-05T18:56:54.263495] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-05T18:56:55.063477] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-05T18:56:55.863480] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-05T18:56:55.893874] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-05T18:56:56.663541] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-05T18:56:56.785970] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-05T18:56:56.938934] [INFO ] [MAIN ] SBSW: Adding 387 new records, updating 0 existing records. [2025-09-05T18:56:56.943393] [INFO ] [MAIN ] SBSW: Combined dataset has 25842 total records. [2025-09-05T18:56:57.109903] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T18:56:57.131209] [INFO ] [REMOTE ] SARO: Full fetch complete (52033 records). [2025-09-05T18:56:57.134476] [WARN ] [VALIDATOR ] SBSW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:56:57.486965] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-05T18:56:57.724146] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-05T18:56:57.738415] [WARN ] [VALIDATOR ] SBSW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:56:57.738714] [INFO ] [MAIN ] SBSW: Combined data validation passed. [2025-09-05T18:56:57.975366] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-05T18:56:58.116223] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-05T18:56:58.118151] [INFO ] [MAIN ] Update Progress: 1872/2363 symbols completed. SARO took 34.5s. Estimated remaining: 14m 56s. Rate: 32.9 symbols/min [2025-09-05T18:56:58.151494] [INFO ] [MAIN ] SBSW: Update completed successfully. [2025-09-05T18:56:58.192979] [INFO ] [MAIN ] Update Progress: 1873/2363 symbols completed. SBSW took 11.6s. Estimated remaining: 14m 53s. Rate: 32.9 symbols/min [2025-09-05T18:56:58.270086] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-05T18:56:58.435857] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:58.490546] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:56:58.500832] [INFO ] [MAIN ] SCD: Loaded 8111 existing records. [2025-09-05T18:56:58.686530] [INFO ] [MAIN ] SCD: Found 1 missing trading days. [2025-09-05T18:56:58.694459] [INFO ] [MAIN ] SCD: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:58.696346] [INFO ] [MAIN ] SCHW: Loaded 25667 existing records. [2025-09-05T18:56:58.836414] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-05T18:56:58.898814] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-05T18:56:58.936809] [INFO ] [MAIN ] SCHW: Found 1 missing trading days. [2025-09-05T18:56:58.936935] [INFO ] [MAIN ] SCHW: Need to fetch 1 months: 2025-09 [2025-09-05T18:56:59.063445] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-05T18:56:59.863458] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-05T18:57:00.569801] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T18:57:00.570481] [INFO ] [REMOTE ] SBXD: Full fetch complete (2911 records). [2025-09-05T18:57:00.669231] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-05T18:57:00.750635] [WARN ] [VALIDATOR ] SBXD: Not fatal, but first date in data (2025-02-03) does not match expected start date (2025-01-31) [2025-09-05T18:57:00.934051] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-05T18:57:01.088148] [INFO ] [MAIN ] SCHW: Adding 390 new records, updating 0 existing records. [2025-09-05T18:57:01.093051] [INFO ] [MAIN ] SCHW: Combined dataset has 26057 total records. [2025-09-05T18:57:01.273784] [WARN ] [VALIDATOR ] SCHW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:01.463721] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-05T18:57:01.471614] [WARN ] [VALIDATOR ] SBXD: Missing days changed. Total missing: 17 No longer missing: 2025-01-29, 2025-01-30, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-12, 2025-03-17, 2025-03-18, 2025-03-21, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-05-01, 2025-05-02, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-06, 2025-03-11, 2025-03-13, 2025-03-14, 2025-03-19, 2025-03-20, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-04-15, 2025-04-22, 2025-04-23, 2025-04-30, 2025-05-05, 2025-05-16 [2025-09-05T18:57:01.475724] [INFO ] [MAIN ] SBXD: Fetched primary data is valid. [2025-09-05T18:57:01.475770] [WARN ] [VALIDATOR ] SCHW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:01.476531] [INFO ] [MAIN ] SCHW: Combined data validation passed. [2025-09-05T18:57:01.589270] [INFO ] [MAIN ] SBXD: Full history saved. [2025-09-05T18:57:01.592832] [INFO ] [MAIN ] Update Progress: 1874/2363 symbols completed. SBXD took 13.6s. Estimated remaining: 14m 52s. Rate: 32.9 symbols/min [2025-09-05T18:57:01.730294] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T18:57:01.850833] [INFO ] [MAIN ] SCD: Adding 93 new records, updating 0 existing records. [2025-09-05T18:57:01.912718] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:01.962141] [INFO ] [MAIN ] SCD: Combined dataset has 8204 total records. [2025-09-05T18:57:01.962470] [INFO ] [MAIN ] SCHW: Update completed successfully. [2025-09-05T18:57:01.983947] [INFO ] [MAIN ] Update Progress: 1875/2363 symbols completed. SCHW took 3.8s. Estimated remaining: 14m 50s. Rate: 32.9 symbols/min [2025-09-05T18:57:02.230263] [INFO ] [MAIN ] SCI: Loaded 21923 existing records. [2025-09-05T18:57:02.425540] [WARN ] [VALIDATOR ] SCD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:02.463599] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:02.696356] [INFO ] [MAIN ] SCI: Found 1 missing trading days. [2025-09-05T18:57:02.696623] [INFO ] [MAIN ] SCL: Loaded 6407 existing records. [2025-09-05T18:57:02.734503] [INFO ] [MAIN ] SCI: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:02.768085] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-05T18:57:02.940841] [INFO ] [MAIN ] SCL: Found 1 missing trading days. [2025-09-05T18:57:02.941109] [INFO ] [MAIN ] SCL: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:02.950402] [WARN ] [VALIDATOR ] SCD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:02.950619] [INFO ] [MAIN ] SCD: Combined data validation passed. [2025-09-05T18:57:03.001518] [INFO ] [MAIN ] SCD: Update completed successfully. [2025-09-05T18:57:03.002786] [INFO ] [MAIN ] Update Progress: 1876/2363 symbols completed. SCD took 4.9s. Estimated remaining: 14m 48s. Rate: 32.9 symbols/min [2025-09-05T18:57:03.071397] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-05T18:57:03.173243] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:03.184740] [INFO ] [MAIN ] SCM: Loaded 8768 existing records. [2025-09-05T18:57:03.358098] [INFO ] [MAIN ] SCM: Found 1 missing trading days. [2025-09-05T18:57:03.358242] [INFO ] [MAIN ] SCM: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:03.863511] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-05T18:57:03.970217] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-05T18:57:04.140270] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:57:04.187903] [INFO ] [MAIN ] SCL: Adding 134 new records, updating 0 existing records. [2025-09-05T18:57:04.198744] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T18:57:04.209347] [INFO ] [MAIN ] SCL: Combined dataset has 6541 total records. [2025-09-05T18:57:04.533999] [INFO ] [MAIN ] SCI: Adding 310 new records, updating 0 existing records. [2025-09-05T18:57:04.526805] [WARN ] [VALIDATOR ] SCL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:04.651965] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:57:04.693276] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-05T18:57:04.728698] [INFO ] [MAIN ] SCI: Combined dataset has 22233 total records. [2025-09-05T18:57:04.763350] [INFO ] [MAIN ] SCM: Adding 142 new records, updating 0 existing records. [2025-09-05T18:57:04.912737] [INFO ] [MAIN ] SCM: Combined dataset has 8910 total records. [2025-09-05T18:57:05.012554] [WARN ] [VALIDATOR ] SCI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:05.267908] [WARN ] [VALIDATOR ] SCM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:05.582882] [WARN ] [VALIDATOR ] SCL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:05.582806] [WARN ] [VALIDATOR ] SCM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:05.583441] [INFO ] [MAIN ] SCL: Combined data validation passed. [2025-09-05T18:57:05.582714] [WARN ] [VALIDATOR ] SCI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:05.583840] [INFO ] [MAIN ] SCM: Combined data validation passed. [2025-09-05T18:57:05.585120] [INFO ] [MAIN ] SCI: Combined data validation passed. [2025-09-05T18:57:05.829269] [INFO ] [MAIN ] SCL: Update completed successfully. [2025-09-05T18:57:05.841859] [INFO ] [MAIN ] Update Progress: 1877/2363 symbols completed. SCL took 3.8s. Estimated remaining: 14m 46s. Rate: 32.9 symbols/min [2025-09-05T18:57:05.844486] [INFO ] [MAIN ] SCI: Update completed successfully. [2025-09-05T18:57:05.847717] [INFO ] [MAIN ] Update Progress: 1878/2363 symbols completed. SCI took 4.3s. Estimated remaining: 14m 44s. Rate: 32.9 symbols/min [2025-09-05T18:57:05.853521] [INFO ] [MAIN ] SCM: Update completed successfully. [2025-09-05T18:57:05.854712] [INFO ] [MAIN ] Update Progress: 1879/2363 symbols completed. SCM took 2.9s. Estimated remaining: 14m 41s. Rate: 32.9 symbols/min [2025-09-05T18:57:06.521288] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-05T18:57:06.532716] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-05T18:57:08.252858] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-05T18:57:08.263357] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-05T18:57:10.008928] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-05T18:57:10.019119] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-05T18:57:11.978979] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-05T18:57:11.991727] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-05T18:57:13.383236] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-05T18:57:13.399273] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-05T18:57:14.693096] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:57:14.695860] [INFO ] [REMOTE ] SCCO: Full fetch complete (53668 records). [2025-09-05T18:57:15.074793] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-05T18:57:15.318451] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-05T18:57:15.318657] [INFO ] [MAIN ] Update Progress: 1880/2363 symbols completed. SCCO took 25.6s. Estimated remaining: 14m 42s. Rate: 32.9 symbols/min [2025-09-05T18:57:15.868242] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:16.017127] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:16.042164] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:16.063150] [INFO ] [MAIN ] SDHY: Loaded 4901 existing records. [2025-09-05T18:57:16.064890] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:16.065113] [WARN ] [MAIN ] SCS: No existing data found, performing full refresh instead. [2025-09-05T18:57:16.132989] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-05T18:57:16.133263] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-05T18:57:16.168293] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-05T18:57:16.162580] [INFO ] [MAIN ] SDHC: Loaded 5165 existing records. [2025-09-05T18:57:16.453632] [INFO ] [MAIN ] SD: Loaded 13692 existing records. [2025-09-05T18:57:16.456428] [INFO ] [MAIN ] SDHY: Found 1 missing trading days. [2025-09-05T18:57:16.516041] [INFO ] [MAIN ] SDHY: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:16.554177] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-05T18:57:16.664708] [INFO ] [MAIN ] SDHC: Found 1 missing trading days. [2025-09-05T18:57:16.753372] [INFO ] [MAIN ] SDHC: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:16.782363] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-05T18:57:16.909841] [INFO ] [MAIN ] SD: Found 1 missing trading days. [2025-09-05T18:57:16.915205] [INFO ] [MAIN ] SD: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:16.927625] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-05T18:57:17.016261] [INFO ] [REMOTE ] SCS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:57:17.016574] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-05T18:57:17.502150] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T18:57:17.531482] [INFO ] [MAIN ] SDHY: Adding 78 new records, updating 0 existing records. [2025-09-05T18:57:17.533251] [INFO ] [MAIN ] SDHY: Combined dataset has 4979 total records. [2025-09-05T18:57:17.694545] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T18:57:17.726318] [WARN ] [VALIDATOR ] SDHY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:17.748379] [INFO ] [MAIN ] SDHC: Adding 107 new records, updating 0 existing records. [2025-09-05T18:57:17.857861] [INFO ] [MAIN ] SDHC: Combined dataset has 5272 total records. [2025-09-05T18:57:18.047871] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T18:57:18.192568] [WARN ] [VALIDATOR ] SDHC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:18.221539] [INFO ] [MAIN ] SD: Adding 200 new records, updating 0 existing records. [2025-09-05T18:57:18.342774] [INFO ] [MAIN ] SD: Combined dataset has 13892 total records. [2025-09-05T18:57:18.654252] [WARN ] [VALIDATOR ] SD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:18.874743] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-05T18:57:18.883103] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-05T18:57:18.888809] [WARN ] [VALIDATOR ] SDHY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:18.888871] [WARN ] [VALIDATOR ] SDHC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:18.889619] [INFO ] [MAIN ] SDHY: Combined data validation passed. [2025-09-05T18:57:18.890141] [INFO ] [MAIN ] SDHC: Combined data validation passed. [2025-09-05T18:57:18.953386] [INFO ] [MAIN ] SDHY: Update completed successfully. [2025-09-05T18:57:18.958372] [INFO ] [MAIN ] Update Progress: 1881/2363 symbols completed. SDHY took 3.6s. Estimated remaining: 14m 40s. Rate: 32.9 symbols/min [2025-09-05T18:57:18.957822] [INFO ] [MAIN ] SDHC: Update completed successfully. [2025-09-05T18:57:18.995354] [INFO ] [MAIN ] Update Progress: 1882/2363 symbols completed. SDHC took 3.7s. Estimated remaining: 14m 38s. Rate: 32.9 symbols/min [2025-09-05T18:57:19.242478] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:19.315122] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:19.325637] [WARN ] [VALIDATOR ] SD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:19.325841] [INFO ] [MAIN ] SD: Combined data validation passed. [2025-09-05T18:57:19.334478] [INFO ] [MAIN ] SDRL: Loaded 20074 existing records. [2025-09-05T18:57:19.530751] [INFO ] [MAIN ] SE: Loaded 25508 existing records. [2025-09-05T18:57:19.671774] [INFO ] [MAIN ] SDRL: Found 1 missing trading days. [2025-09-05T18:57:19.684547] [INFO ] [MAIN ] SDRL: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:19.710958] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-05T18:57:19.793150] [INFO ] [MAIN ] SD: Update completed successfully. [2025-09-05T18:57:19.801266] [INFO ] [MAIN ] Update Progress: 1883/2363 symbols completed. SD took 4.5s. Estimated remaining: 14m 36s. Rate: 32.9 symbols/min [2025-09-05T18:57:19.802448] [INFO ] [MAIN ] SE: Found 1 missing trading days. [2025-09-05T18:57:19.847076] [INFO ] [MAIN ] SE: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:19.890969] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-05T18:57:19.987936] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:20.011374] [INFO ] [MAIN ] SEE: Loaded 22129 existing records. [2025-09-05T18:57:20.193461] [INFO ] [MAIN ] SEE: Found 1 missing trading days. [2025-09-05T18:57:20.193682] [INFO ] [MAIN ] SEE: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:20.193936] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-05T18:57:20.218620] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-05T18:57:20.226531] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-05T18:57:21.603328] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-05T18:57:21.724419] [INFO ] [MAIN ] SDRL: Adding 315 new records, updating 0 existing records. [2025-09-05T18:57:21.732352] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:57:21.807377] [INFO ] [MAIN ] SDRL: Combined dataset has 20389 total records. [2025-09-05T18:57:21.962693] [INFO ] [MAIN ] SEE: Adding 370 new records, updating 0 existing records. [2025-09-05T18:57:22.062871] [INFO ] [MAIN ] SEE: Combined dataset has 22499 total records. [2025-09-05T18:57:22.066305] [WARN ] [VALIDATOR ] SDRL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:22.404830] [WARN ] [VALIDATOR ] SEE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:22.557077] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-05T18:57:22.595025] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-05T18:57:22.745996] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-05T18:57:22.854523] [INFO ] [MAIN ] SE: Adding 390 new records, updating 0 existing records. [2025-09-05T18:57:22.867312] [INFO ] [MAIN ] SE: Combined dataset has 25898 total records. [2025-09-05T18:57:23.055514] [WARN ] [VALIDATOR ] SE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:23.098090] [WARN ] [VALIDATOR ] SDRL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:23.098001] [WARN ] [VALIDATOR ] SEE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:23.125716] [INFO ] [MAIN ] SEE: Combined data validation passed. [2025-09-05T18:57:23.125616] [INFO ] [MAIN ] SDRL: Combined data validation passed. [2025-09-05T18:57:23.530390] [INFO ] [MAIN ] SEE: Update completed successfully. [2025-09-05T18:57:23.530478] [INFO ] [MAIN ] SDRL: Update completed successfully. [2025-09-05T18:57:23.535447] [INFO ] [MAIN ] Update Progress: 1884/2363 symbols completed. SEE took 3.7s. Estimated remaining: 14m 35s. Rate: 32.9 symbols/min [2025-09-05T18:57:23.540132] [INFO ] [MAIN ] Update Progress: 1885/2363 symbols completed. SDRL took 4.6s. Estimated remaining: 14m 32s. Rate: 32.9 symbols/min [2025-09-05T18:57:23.853847] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:23.874736] [WARN ] [MAIN ] SEG: No existing data found, performing full refresh instead. [2025-09-05T18:57:23.906580] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-05T18:57:23.909876] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-05T18:57:23.909657] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:23.910961] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-05T18:57:23.917254] [WARN ] [VALIDATOR ] SE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:23.952323] [INFO ] [MAIN ] SE: Combined data validation passed. [2025-09-05T18:57:24.116836] [INFO ] [MAIN ] SEI: Loaded 23397 existing records. [2025-09-05T18:57:24.538569] [INFO ] [MAIN ] SEI: Found 1 missing trading days. [2025-09-05T18:57:24.577903] [INFO ] [MAIN ] SEI: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:24.610523] [INFO ] [REMOTE ] SEG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:57:24.612529] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-05T18:57:24.618481] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-05T18:57:24.688790] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-05T18:57:24.701528] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-05T18:57:24.704780] [INFO ] [MAIN ] SE: Update completed successfully. [2025-09-05T18:57:24.707682] [INFO ] [MAIN ] Update Progress: 1886/2363 symbols completed. SE took 5.7s. Estimated remaining: 14m 30s. Rate: 32.9 symbols/min [2025-09-05T18:57:24.880263] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:24.901570] [INFO ] [MAIN ] SEM: Loaded 20886 existing records. [2025-09-05T18:57:25.078563] [INFO ] [MAIN ] SEM: Found 1 missing trading days. [2025-09-05T18:57:25.078714] [INFO ] [MAIN ] SEM: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:25.078921] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-05T18:57:25.463916] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-05T18:57:25.467108] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-05T18:57:26.183494] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-05T18:57:26.191595] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-05T18:57:26.231050] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T18:57:26.350580] [INFO ] [MAIN ] SEM: Adding 306 new records, updating 0 existing records. [2025-09-05T18:57:26.357878] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-05T18:57:26.396868] [INFO ] [MAIN ] SEM: Combined dataset has 21192 total records. [2025-09-05T18:57:26.604581] [INFO ] [MAIN ] SEI: Adding 369 new records, updating 0 existing records. [2025-09-05T18:57:26.687508] [WARN ] [VALIDATOR ] SEM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:26.752553] [INFO ] [MAIN ] SEI: Combined dataset has 23766 total records. [2025-09-05T18:57:27.059076] [WARN ] [VALIDATOR ] SEI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:27.156185] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-05T18:57:27.182792] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-05T18:57:27.281913] [WARN ] [VALIDATOR ] SEI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:27.282187] [INFO ] [MAIN ] SEI: Combined data validation passed. [2025-09-05T18:57:27.281984] [WARN ] [VALIDATOR ] SEM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:27.282528] [INFO ] [MAIN ] SEM: Combined data validation passed. [2025-09-05T18:57:27.546799] [INFO ] [MAIN ] SEI: Update completed successfully. [2025-09-05T18:57:27.559588] [INFO ] [MAIN ] Update Progress: 1887/2363 symbols completed. SEI took 4.0s. Estimated remaining: 14m 29s. Rate: 32.9 symbols/min [2025-09-05T18:57:27.593763] [INFO ] [MAIN ] SEM: Update completed successfully. [2025-09-05T18:57:27.629312] [INFO ] [MAIN ] Update Progress: 1888/2363 symbols completed. SEM took 2.9s. Estimated remaining: 14m 26s. Rate: 32.9 symbols/min [2025-09-05T18:57:27.919671] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:27.923770] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:27.969318] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-05T18:57:27.986077] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-05T18:57:27.993091] [INFO ] [MAIN ] SEMR: Loaded 20375 existing records. [2025-09-05T18:57:28.031263] [INFO ] [MAIN ] SES: Loaded 24337 existing records. [2025-09-05T18:57:28.308021] [INFO ] [MAIN ] SEMR: Found 1 missing trading days. [2025-09-05T18:57:28.334776] [INFO ] [MAIN ] SEMR: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:28.335959] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-05T18:57:28.361803] [INFO ] [MAIN ] SES: Found 1 missing trading days. [2025-09-05T18:57:28.361967] [INFO ] [MAIN ] SES: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:28.362212] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-05T18:57:28.498953] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-05T18:57:28.503289] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-05T18:57:29.535080] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-05T18:57:29.544570] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-05T18:57:29.672456] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-05T18:57:29.676055] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-05T18:57:29.914218] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-05T18:57:30.035467] [INFO ] [MAIN ] SEMR: Adding 320 new records, updating 0 existing records. [2025-09-05T18:57:30.038557] [INFO ] [MAIN ] SEMR: Combined dataset has 20695 total records. [2025-09-05T18:57:30.221352] [WARN ] [VALIDATOR ] SEMR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:30.261170] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-05T18:57:30.565571] [INFO ] [MAIN ] SES: Adding 314 new records, updating 0 existing records. [2025-09-05T18:57:30.580082] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-05T18:57:30.584449] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-05T18:57:30.585673] [INFO ] [MAIN ] SES: Combined dataset has 24651 total records. [2025-09-05T18:57:30.780835] [WARN ] [VALIDATOR ] SES: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:30.984920] [WARN ] [VALIDATOR ] SEMR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:30.985323] [INFO ] [MAIN ] SEMR: Combined data validation passed. [2025-09-05T18:57:30.988904] [WARN ] [VALIDATOR ] SES: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:30.989342] [INFO ] [MAIN ] SES: Combined data validation passed. [2025-09-05T18:57:31.232765] [INFO ] [MAIN ] SES: Update completed successfully. [2025-09-05T18:57:31.236787] [INFO ] [MAIN ] Update Progress: 1889/2363 symbols completed. SES took 3.6s. Estimated remaining: 14m 25s. Rate: 32.9 symbols/min [2025-09-05T18:57:31.415788] [INFO ] [MAIN ] SEMR: Update completed successfully. [2025-09-05T18:57:31.443072] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:31.441662] [INFO ] [MAIN ] Update Progress: 1890/2363 symbols completed. SEMR took 3.9s. Estimated remaining: 14m 23s. Rate: 32.9 symbols/min [2025-09-05T18:57:31.623719] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:31.662588] [INFO ] [MAIN ] SF: Loaded 19068 existing records. [2025-09-05T18:57:31.664033] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-05T18:57:31.661580] [INFO ] [MAIN ] SFB: Loaded 1736 existing records. [2025-09-05T18:57:31.866897] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-05T18:57:32.042694] [INFO ] [MAIN ] SFB: Found 1 missing trading days. [2025-09-05T18:57:32.041442] [INFO ] [MAIN ] SF: Found 1 missing trading days. [2025-09-05T18:57:32.050548] [INFO ] [MAIN ] SFB: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:32.050604] [INFO ] [MAIN ] SF: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:32.051970] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-05T18:57:32.051664] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-05T18:57:32.050969] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-05T18:57:32.057051] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-05T18:57:32.662226] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T18:57:32.670819] [INFO ] [MAIN ] SFB: Adding 22 new records, updating 0 existing records. [2025-09-05T18:57:32.672047] [INFO ] [MAIN ] SFB: Combined dataset has 1758 total records. [2025-09-05T18:57:32.855922] [WARN ] [VALIDATOR ] SFB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:33.044058] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-05T18:57:33.047999] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-05T18:57:33.059123] [WARN ] [VALIDATOR ] SFB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:33.059318] [INFO ] [MAIN ] SFB: Combined data validation passed. [2025-09-05T18:57:33.071613] [INFO ] [MAIN ] SFB: Update completed successfully. [2025-09-05T18:57:33.072029] [INFO ] [MAIN ] Update Progress: 1891/2363 symbols completed. SFB took 1.6s. Estimated remaining: 14m 21s. Rate: 32.9 symbols/min [2025-09-05T18:57:33.241180] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:33.252084] [INFO ] [MAIN ] SFBS: Loaded 10116 existing records. [2025-09-05T18:57:33.390234] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T18:57:33.407013] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T18:57:33.430243] [INFO ] [REMOTE ] SCS: Full fetch complete (45596 records). [2025-09-05T18:57:33.459788] [INFO ] [MAIN ] SFBS: Found 1 missing trading days. [2025-09-05T18:57:33.463460] [INFO ] [MAIN ] SFBS: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:33.463807] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-05T18:57:33.652479] [INFO ] [MAIN ] SF: Adding 328 new records, updating 0 existing records. [2025-09-05T18:57:33.830638] [INFO ] [MAIN ] SF: Combined dataset has 19396 total records. [2025-09-05T18:57:34.027784] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-05T18:57:34.102131] [WARN ] [VALIDATOR ] SF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:34.470211] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-05T18:57:34.480282] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-05T18:57:34.564835] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-05T18:57:34.565170] [INFO ] [MAIN ] Update Progress: 1892/2363 symbols completed. SCS took 19.2s. Estimated remaining: 14m 19s. Rate: 32.9 symbols/min [2025-09-05T18:57:34.740715] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:34.746942] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-05T18:57:34.818144] [INFO ] [MAIN ] SFBS: Adding 181 new records, updating 0 existing records. [2025-09-05T18:57:34.819466] [WARN ] [VALIDATOR ] SF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:34.821144] [INFO ] [MAIN ] SF: Combined data validation passed. [2025-09-05T18:57:34.822261] [INFO ] [MAIN ] SFBS: Combined dataset has 10297 total records. [2025-09-05T18:57:34.988170] [INFO ] [MAIN ] SFL: Loaded 21233 existing records. [2025-09-05T18:57:35.247064] [WARN ] [VALIDATOR ] SFBS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:35.334442] [INFO ] [MAIN ] SF: Update completed successfully. [2025-09-05T18:57:35.340451] [INFO ] [MAIN ] Update Progress: 1893/2363 symbols completed. SF took 4.1s. Estimated remaining: 14m 17s. Rate: 32.9 symbols/min [2025-09-05T18:57:35.345810] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T18:57:35.460926] [INFO ] [MAIN ] SFL: Found 1 missing trading days. [2025-09-05T18:57:35.491957] [INFO ] [REMOTE ] SEG: Full fetch complete (15592 records). [2025-09-05T18:57:35.504667] [INFO ] [MAIN ] SFL: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:35.518589] [FATAL] [VALIDATOR ] SEG: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:57:35.544832] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-05T18:57:35.544975] [FATAL] [MAIN ] SEG: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:57:35.561967] [WARN ] [MAIN ] SEG: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:57:35.572483] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-05T18:57:35.629478] [INFO ] [LOCAL ] SEG: Starting deletion of derivative data. [2025-09-05T18:57:35.638212] [INFO ] [MAIN ] Update Progress: 1894/2363 symbols completed. SEG took 12.1s. Estimated remaining: 14m 15s. Rate: 32.9 symbols/min [2025-09-05T18:57:35.711673] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:35.894232] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:35.905520] [INFO ] [MAIN ] SG: Loaded 25584 existing records. [2025-09-05T18:57:36.071060] [INFO ] [MAIN ] SGHC: Loaded 22377 existing records. [2025-09-05T18:57:36.145868] [INFO ] [MAIN ] SG: Found 1 missing trading days. [2025-09-05T18:57:36.167028] [INFO ] [MAIN ] SG: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:36.167509] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-05T18:57:36.287040] [INFO ] [MAIN ] SGHC: Found 1 missing trading days. [2025-09-05T18:57:36.287708] [INFO ] [MAIN ] SGHC: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:36.287939] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-05T18:57:36.293581] [WARN ] [VALIDATOR ] SFBS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:36.293825] [INFO ] [MAIN ] SFBS: Combined data validation passed. [2025-09-05T18:57:36.358288] [INFO ] [MAIN ] SFBS: Update completed successfully. [2025-09-05T18:57:36.359537] [INFO ] [MAIN ] Update Progress: 1895/2363 symbols completed. SFBS took 3.3s. Estimated remaining: 14m 13s. Rate: 32.9 symbols/min [2025-09-05T18:57:36.529195] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:36.552836] [INFO ] [MAIN ] SGI: Loaded 24745 existing records. [2025-09-05T18:57:36.729182] [INFO ] [MAIN ] SGI: Found 1 missing trading days. [2025-09-05T18:57:36.729330] [INFO ] [MAIN ] SGI: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:36.729577] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-05T18:57:37.002265] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:57:37.134554] [INFO ] [MAIN ] SFL: Adding 303 new records, updating 0 existing records. [2025-09-05T18:57:37.138294] [INFO ] [MAIN ] SFL: Combined dataset has 21536 total records. [2025-09-05T18:57:37.321241] [WARN ] [VALIDATOR ] SFL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:37.523149] [WARN ] [VALIDATOR ] SFL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:37.523349] [INFO ] [MAIN ] SFL: Combined data validation passed. [2025-09-05T18:57:37.652426] [INFO ] [MAIN ] SFL: Update completed successfully. [2025-09-05T18:57:37.655270] [INFO ] [MAIN ] Update Progress: 1896/2363 symbols completed. SFL took 3.1s. Estimated remaining: 14m 11s. Rate: 32.9 symbols/min [2025-09-05T18:57:37.833319] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:37.841916] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T18:57:37.909097] [INFO ] [MAIN ] SGU: Loaded 3658 existing records. [2025-09-05T18:57:37.901102] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-05T18:57:38.183775] [INFO ] [MAIN ] SG: Adding 383 new records, updating 0 existing records. [2025-09-05T18:57:38.324398] [INFO ] [MAIN ] SGU: Found 1 missing trading days. [2025-09-05T18:57:38.349716] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-05T18:57:38.348952] [INFO ] [MAIN ] SGHC: Adding 380 new records, updating 0 existing records. [2025-09-05T18:57:38.352679] [INFO ] [MAIN ] SG: Combined dataset has 25967 total records. [2025-09-05T18:57:38.349059] [INFO ] [MAIN ] SGU: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:38.375245] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-05T18:57:38.611611] [INFO ] [MAIN ] SGHC: Combined dataset has 22757 total records. [2025-09-05T18:57:38.693616] [INFO ] [MAIN ] SGI: Adding 380 new records, updating 0 existing records. [2025-09-05T18:57:38.698849] [WARN ] [VALIDATOR ] SG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:39.003126] [INFO ] [MAIN ] SGI: Combined dataset has 25125 total records. [2025-09-05T18:57:39.133990] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-05T18:57:39.126321] [WARN ] [VALIDATOR ] SGHC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:39.249024] [INFO ] [MAIN ] SGU: Adding 44 new records, updating 0 existing records. [2025-09-05T18:57:39.308719] [INFO ] [MAIN ] SGU: Combined dataset has 3702 total records. [2025-09-05T18:57:39.499723] [WARN ] [VALIDATOR ] SGI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:39.865421] [WARN ] [VALIDATOR ] SGU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:40.062710] [WARN ] [VALIDATOR ] SG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:40.100432] [INFO ] [MAIN ] SG: Combined data validation passed. [2025-09-05T18:57:40.308348] [WARN ] [VALIDATOR ] SGU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:40.309670] [INFO ] [MAIN ] SG: Update completed successfully. [2025-09-05T18:57:40.308460] [WARN ] [VALIDATOR ] SGHC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:40.313488] [INFO ] [MAIN ] Update Progress: 1897/2363 symbols completed. SG took 5.0s. Estimated remaining: 14m 9s. Rate: 32.9 symbols/min [2025-09-05T18:57:40.309512] [WARN ] [VALIDATOR ] SGI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:40.310045] [INFO ] [MAIN ] SGHC: Combined data validation passed. [2025-09-05T18:57:40.314021] [INFO ] [MAIN ] SGI: Combined data validation passed. [2025-09-05T18:57:40.309842] [INFO ] [MAIN ] SGU: Combined data validation passed. [2025-09-05T18:57:40.557009] [INFO ] [MAIN ] SGU: Update completed successfully. [2025-09-05T18:57:40.628573] [INFO ] [MAIN ] Update Progress: 1898/2363 symbols completed. SGU took 3.0s. Estimated remaining: 14m 7s. Rate: 32.9 symbols/min [2025-09-05T18:57:40.724341] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:40.740771] [WARN ] [MAIN ] SHAK: No existing data found, performing full refresh instead. [2025-09-05T18:57:40.753283] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-05T18:57:40.759087] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-05T18:57:40.782177] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-05T18:57:41.072592] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:41.284098] [INFO ] [MAIN ] SHCO: Loaded 18629 existing records. [2025-09-05T18:57:41.410699] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:57:41.425319] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-05T18:57:41.457796] [INFO ] [MAIN ] SGHC: Update completed successfully. [2025-09-05T18:57:41.472127] [INFO ] [MAIN ] Update Progress: 1899/2363 symbols completed. SGHC took 5.8s. Estimated remaining: 14m 5s. Rate: 33.0 symbols/min [2025-09-05T18:57:41.665509] [INFO ] [MAIN ] SHCO: Found 1 missing trading days. [2025-09-05T18:57:41.689726] [INFO ] [MAIN ] SHCO: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:41.690021] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-05T18:57:41.690136] [INFO ] [MAIN ] SGI: Update completed successfully. [2025-09-05T18:57:41.693184] [INFO ] [MAIN ] Update Progress: 1900/2363 symbols completed. SGI took 5.3s. Estimated remaining: 14m 3s. Rate: 33.0 symbols/min [2025-09-05T18:57:41.877065] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:41.959908] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:41.983580] [INFO ] [MAIN ] SHEL: Loaded 25611 existing records. [2025-09-05T18:57:42.092189] [INFO ] [MAIN ] SHG: Loaded 12043 existing records. [2025-09-05T18:57:42.300227] [INFO ] [MAIN ] SHEL: Found 1 missing trading days. [2025-09-05T18:57:42.326532] [INFO ] [MAIN ] SHEL: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:42.334402] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-05T18:57:42.355450] [INFO ] [MAIN ] SHG: Found 1 missing trading days. [2025-09-05T18:57:42.355685] [INFO ] [MAIN ] SHG: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:42.355926] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-05T18:57:43.227420] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-05T18:57:43.238261] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-05T18:57:43.248349] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T18:57:43.340695] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:57:43.368747] [INFO ] [MAIN ] SHCO: Adding 258 new records, updating 0 existing records. [2025-09-05T18:57:43.432657] [INFO ] [MAIN ] SHG: Adding 169 new records, updating 0 existing records. [2025-09-05T18:57:43.434509] [INFO ] [MAIN ] SHCO: Combined dataset has 18887 total records. [2025-09-05T18:57:43.516528] [INFO ] [MAIN ] SHG: Combined dataset has 12212 total records. [2025-09-05T18:57:43.714402] [WARN ] [VALIDATOR ] SHCO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:57:43.902690] [WARN ] [VALIDATOR ] SHG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:44.169675] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-05T18:57:44.337082] [INFO ] [MAIN ] SHEL: Adding 390 new records, updating 0 existing records. [2025-09-05T18:57:44.345937] [INFO ] [MAIN ] SHEL: Combined dataset has 26001 total records. [2025-09-05T18:57:44.351668] [WARN ] [VALIDATOR ] SHCO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:57:44.357931] [WARN ] [VALIDATOR ] SHG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:44.422713] [INFO ] [MAIN ] SHCO: Combined data validation passed. [2025-09-05T18:57:44.415968] [INFO ] [MAIN ] SHG: Combined data validation passed. [2025-09-05T18:57:44.626244] [WARN ] [VALIDATOR ] SHEL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:44.897681] [INFO ] [MAIN ] SHG: Update completed successfully. [2025-09-05T18:57:44.899626] [INFO ] [MAIN ] Update Progress: 1901/2363 symbols completed. SHG took 3.2s. Estimated remaining: 14m 1s. Rate: 33.0 symbols/min [2025-09-05T18:57:45.086597] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:45.087415] [INFO ] [MAIN ] SHCO: Update completed successfully. [2025-09-05T18:57:45.089453] [INFO ] [MAIN ] Update Progress: 1902/2363 symbols completed. SHCO took 4.4s. Estimated remaining: 13m 59s. Rate: 33.0 symbols/min [2025-09-05T18:57:45.290461] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:45.292072] [INFO ] [MAIN ] SHO: Loaded 23509 existing records. [2025-09-05T18:57:45.372093] [INFO ] [MAIN ] SHOC: Loaded 1415 existing records. [2025-09-05T18:57:45.619231] [INFO ] [MAIN ] SHO: Found 1 missing trading days. [2025-09-05T18:57:45.634715] [INFO ] [MAIN ] SHO: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:45.666204] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-05T18:57:45.684815] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-05T18:57:45.687471] [INFO ] [MAIN ] SHOC: Found 1 missing trading days. [2025-09-05T18:57:45.697969] [INFO ] [MAIN ] SHOC: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:45.698366] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-05T18:57:45.699056] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-05T18:57:45.701537] [WARN ] [VALIDATOR ] SHEL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:45.701694] [INFO ] [MAIN ] SHEL: Combined data validation passed. [2025-09-05T18:57:45.897905] [INFO ] [MAIN ] SHEL: Update completed successfully. [2025-09-05T18:57:45.901947] [INFO ] [MAIN ] Update Progress: 1903/2363 symbols completed. SHEL took 4.4s. Estimated remaining: 13m 57s. Rate: 33.0 symbols/min [2025-09-05T18:57:46.082172] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:46.082354] [WARN ] [MAIN ] SHW: No existing data found, performing full refresh instead. [2025-09-05T18:57:46.082497] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-05T18:57:46.082542] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-05T18:57:46.082590] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-05T18:57:46.263115] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:57:46.353475] [INFO ] [MAIN ] SHOC: Adding 26 new records, updating 0 existing records. [2025-09-05T18:57:46.383271] [INFO ] [MAIN ] SHOC: Combined dataset has 1441 total records. [2025-09-05T18:57:46.564417] [INFO ] [REMOTE ] SHW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:57:46.575975] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-05T18:57:46.658436] [WARN ] [VALIDATOR ] SHOC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:46.854730] [WARN ] [VALIDATOR ] SHOC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:46.854961] [INFO ] [MAIN ] SHOC: Combined data validation passed. [2025-09-05T18:57:46.865459] [INFO ] [MAIN ] SHOC: Update completed successfully. [2025-09-05T18:57:46.865777] [INFO ] [MAIN ] Update Progress: 1904/2363 symbols completed. SHOC took 1.8s. Estimated remaining: 13m 55s. Rate: 33.0 symbols/min [2025-09-05T18:57:47.025596] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T18:57:47.071451] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:47.079063] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-05T18:57:47.079275] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-05T18:57:47.079332] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-05T18:57:47.084630] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-05T18:57:47.342498] [INFO ] [MAIN ] SHO: Adding 351 new records, updating 0 existing records. [2025-09-05T18:57:47.466697] [INFO ] [MAIN ] SHO: Combined dataset has 23860 total records. [2025-09-05T18:57:47.611151] [INFO ] [REMOTE ] SI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:57:47.631519] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-05T18:57:47.809238] [WARN ] [VALIDATOR ] SHO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:48.030324] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-05T18:57:48.043962] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-05T18:57:48.053927] [WARN ] [VALIDATOR ] SHO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:48.054153] [INFO ] [MAIN ] SHO: Combined data validation passed. [2025-09-05T18:57:48.112483] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-05T18:57:48.122581] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-05T18:57:48.194307] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-05T18:57:48.205061] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-05T18:57:48.250085] [INFO ] [MAIN ] SHO: Update completed successfully. [2025-09-05T18:57:48.253049] [INFO ] [MAIN ] Update Progress: 1905/2363 symbols completed. SHO took 3.4s. Estimated remaining: 13m 53s. Rate: 33.0 symbols/min [2025-09-05T18:57:48.384334] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-05T18:57:48.428976] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:48.449786] [INFO ] [MAIN ] SID: Loaded 20528 existing records. [2025-09-05T18:57:48.630712] [INFO ] [MAIN ] SID: Found 1 missing trading days. [2025-09-05T18:57:48.630869] [INFO ] [MAIN ] SID: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:48.663418] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-05T18:57:49.463491] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-05T18:57:49.652043] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-05T18:57:49.933271] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-05T18:57:50.148634] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-05T18:57:50.268191] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-05T18:57:50.269917] [INFO ] [MAIN ] SID: Adding 218 new records, updating 0 existing records. [2025-09-05T18:57:50.275810] [INFO ] [MAIN ] SID: Combined dataset has 20746 total records. [2025-09-05T18:57:50.463280] [WARN ] [VALIDATOR ] SID: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:50.594838] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-05T18:57:50.721211] [WARN ] [VALIDATOR ] SID: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:50.721447] [INFO ] [MAIN ] SID: Combined data validation passed. [2025-09-05T18:57:50.842098] [INFO ] [MAIN ] SID: Update completed successfully. [2025-09-05T18:57:50.844726] [INFO ] [MAIN ] Update Progress: 1906/2363 symbols completed. SID took 2.6s. Estimated remaining: 13m 51s. Rate: 33.0 symbols/min [2025-09-05T18:57:51.020960] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:51.043883] [INFO ] [MAIN ] SIG: Loaded 21902 existing records. [2025-09-05T18:57:51.074375] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-05T18:57:51.237141] [INFO ] [MAIN ] SIG: Found 1 missing trading days. [2025-09-05T18:57:51.237351] [INFO ] [MAIN ] SIG: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:51.851887] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-05T18:57:51.864963] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-05T18:57:52.663467] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-05T18:57:53.145906] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-05T18:57:53.281916] [INFO ] [MAIN ] SIG: Adding 338 new records, updating 0 existing records. [2025-09-05T18:57:53.287926] [INFO ] [MAIN ] SIG: Combined dataset has 22240 total records. [2025-09-05T18:57:53.463782] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-05T18:57:53.486300] [WARN ] [VALIDATOR ] SIG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:57:53.725626] [WARN ] [VALIDATOR ] SIG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:57:53.748481] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-05T18:57:53.749766] [INFO ] [MAIN ] SIG: Combined data validation passed. [2025-09-05T18:57:53.752810] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-05T18:57:53.912797] [INFO ] [MAIN ] SIG: Update completed successfully. [2025-09-05T18:57:53.915718] [INFO ] [MAIN ] Update Progress: 1907/2363 symbols completed. SIG took 3.1s. Estimated remaining: 13m 50s. Rate: 33.0 symbols/min [2025-09-05T18:57:54.089076] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:54.108108] [INFO ] [MAIN ] SII: Loaded 18221 existing records. [2025-09-05T18:57:54.268168] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-05T18:57:54.295752] [INFO ] [MAIN ] SII: Found 1 missing trading days. [2025-09-05T18:57:54.295929] [INFO ] [MAIN ] SII: Need to fetch 1 months: 2025-09 [2025-09-05T18:57:54.517804] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-05T18:57:54.667606] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-05T18:57:55.063467] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-05T18:57:55.334178] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-05T18:57:55.863463] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-05T18:57:56.316678] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-05T18:57:56.663462] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-05T18:57:57.463477] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-05T18:57:57.723839] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-05T18:57:58.263459] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-05T18:57:58.445609] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:57:58.530067] [INFO ] [MAIN ] SII: Adding 161 new records, updating 0 existing records. [2025-09-05T18:57:58.532684] [INFO ] [MAIN ] SII: Combined dataset has 18382 total records. [2025-09-05T18:57:58.712979] [WARN ] [VALIDATOR ] SII: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:57:58.910084] [WARN ] [VALIDATOR ] SII: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:57:58.910332] [INFO ] [MAIN ] SII: Combined data validation passed. [2025-09-05T18:57:59.030348] [INFO ] [MAIN ] SII: Update completed successfully. [2025-09-05T18:57:59.032303] [INFO ] [MAIN ] Update Progress: 1908/2363 symbols completed. SII took 5.1s. Estimated remaining: 13m 49s. Rate: 32.9 symbols/min [2025-09-05T18:57:59.064315] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-05T18:57:59.205179] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:57:59.205376] [WARN ] [MAIN ] SILA: No existing data found, performing full refresh instead. [2025-09-05T18:57:59.205509] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-05T18:57:59.205559] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-05T18:57:59.205628] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-05T18:57:59.557089] [INFO ] [REMOTE ] SILA: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:57:59.696210] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-05T18:57:59.863466] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-05T18:58:00.663531] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-05T18:58:00.978269] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-05T18:58:01.463584] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-05T18:58:01.864095] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-05T18:58:02.190461] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-05T18:58:02.263470] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-05T18:58:02.938636] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-05T18:58:03.063456] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-05T18:58:03.535873] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-05T18:58:03.863483] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-05T18:58:04.663492] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-05T18:58:04.927230] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-05T18:58:05.359613] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-05T18:58:05.463527] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-05T18:58:06.126851] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:58:06.128758] [INFO ] [REMOTE ] SI: Full fetch complete (3942 records). [2025-09-05T18:58:06.264218] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-05T18:58:06.385437] [WARN ] [VALIDATOR ] SI: Not fatal, but first date in data (2025-07-31) does not match expected start date (2025-01-31) [2025-09-05T18:58:06.610016] [WARN ] [VALIDATOR ] SI: Missing days changed. Total missing: 124 No longer missing: 2025-01-29, 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17, 2025-07-18, 2025-07-21, 2025-07-22, 2025-07-23, 2025-07-24, 2025-07-25, 2025-07-28, 2025-07-29, 2025-07-30 [2025-09-05T18:58:06.610234] [INFO ] [MAIN ] SI: Fetched primary data is valid. [2025-09-05T18:58:06.645016] [INFO ] [MAIN ] SI: Full history saved. [2025-09-05T18:58:06.658242] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-05T18:58:06.657352] [INFO ] [MAIN ] Update Progress: 1909/2363 symbols completed. SI took 19.8s. Estimated remaining: 13m 48s. Rate: 32.9 symbols/min [2025-09-05T18:58:06.842792] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:06.843028] [WARN ] [MAIN ] SITC: No existing data found, performing full refresh instead. [2025-09-05T18:58:06.843162] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-05T18:58:06.843203] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-05T18:58:06.843255] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-05T18:58:07.070691] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-05T18:58:07.207238] [INFO ] [REMOTE ] SITC: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:58:07.863495] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-05T18:58:08.040106] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-05T18:58:08.663537] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-05T18:58:09.047197] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-05T18:58:09.397595] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-05T18:58:09.463516] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-05T18:58:10.137787] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-05T18:58:10.263435] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-05T18:58:11.068881] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-05T18:58:11.085436] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-05T18:58:11.672764] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-05T18:58:11.863511] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-05T18:58:12.663514] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-05T18:58:12.899448] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-05T18:58:12.902733] [INFO ] [REMOTE ] SHW: Full fetch complete (54800 records). [2025-09-05T18:58:13.273190] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-05T18:58:13.404395] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-05T18:58:13.493801] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-05T18:58:13.560223] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-05T18:58:13.560392] [INFO ] [MAIN ] Update Progress: 1910/2363 symbols completed. SHW took 27.7s. Estimated remaining: 13m 48s. Rate: 32.8 symbols/min [2025-09-05T18:58:13.728479] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:13.728701] [WARN ] [MAIN ] SITE: No existing data found, performing full refresh instead. [2025-09-05T18:58:13.728881] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-05T18:58:13.728920] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-05T18:58:13.728966] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-05T18:58:14.078616] [INFO ] [REMOTE ] SITE: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:58:14.248802] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T18:58:14.252721] [INFO ] [REMOTE ] SHAK: Full fetch complete (53719 records). [2025-09-05T18:58:14.268657] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-05T18:58:14.655391] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-05T18:58:14.885257] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-05T18:58:14.913321] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-05T18:58:14.913458] [INFO ] [MAIN ] Update Progress: 1911/2363 symbols completed. SHAK took 34.6s. Estimated remaining: 13m 46s. Rate: 32.8 symbols/min [2025-09-05T18:58:15.086978] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-05T18:58:15.089434] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:15.132170] [INFO ] [MAIN ] SJM: Loaded 37754 existing records. [2025-09-05T18:58:15.328225] [INFO ] [MAIN ] SJM: Found 1 missing trading days. [2025-09-05T18:58:15.328417] [INFO ] [MAIN ] SJM: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:15.863501] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-05T18:58:16.094590] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T18:58:16.096244] [INFO ] [REMOTE ] SILA: Full fetch complete (34573 records). [2025-09-05T18:58:16.096780] [FATAL] [VALIDATOR ] SILA: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:58:16.096860] [FATAL] [MAIN ] SILA: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:58:16.096905] [WARN ] [MAIN ] SILA: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:58:16.096945] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-05T18:58:16.097041] [INFO ] [LOCAL ] SILA: Starting deletion of derivative data. [2025-09-05T18:58:16.097129] [INFO ] [MAIN ] Update Progress: 1912/2363 symbols completed. SILA took 17.1s. Estimated remaining: 13m 44s. Rate: 32.8 symbols/min [2025-09-05T18:58:16.269937] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:16.299915] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-05T18:58:16.312982] [INFO ] [MAIN ] SJT: Loaded 10002 existing records. [2025-09-05T18:58:16.483561] [INFO ] [MAIN ] SJT: Found 1 missing trading days. [2025-09-05T18:58:16.483735] [INFO ] [MAIN ] SJT: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:16.663472] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-05T18:58:17.214340] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T18:58:17.373335] [INFO ] [MAIN ] SJM: Adding 378 new records, updating 0 existing records. [2025-09-05T18:58:17.377861] [INFO ] [MAIN ] SJM: Combined dataset has 38132 total records. [2025-09-05T18:58:17.471570] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-05T18:58:17.566379] [WARN ] [VALIDATOR ] SJM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:58:17.770691] [WARN ] [VALIDATOR ] SJM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:58:17.770943] [INFO ] [MAIN ] SJM: Combined data validation passed. [2025-09-05T18:58:17.871285] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:58:17.950079] [INFO ] [MAIN ] SJT: Adding 340 new records, updating 0 existing records. [2025-09-05T18:58:17.976837] [INFO ] [MAIN ] SJT: Combined dataset has 10342 total records. [2025-09-05T18:58:18.289172] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-05T18:58:18.295666] [INFO ] [MAIN ] SJM: Update completed successfully. [2025-09-05T18:58:18.299552] [INFO ] [MAIN ] Update Progress: 1913/2363 symbols completed. SJM took 3.4s. Estimated remaining: 13m 42s. Rate: 32.8 symbols/min [2025-09-05T18:58:18.295473] [WARN ] [VALIDATOR ] SJT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:18.665521] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:18.698694] [WARN ] [VALIDATOR ] SJT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:18.699587] [INFO ] [MAIN ] SKE: Loaded 26337 existing records. [2025-09-05T18:58:18.699787] [INFO ] [MAIN ] SJT: Combined data validation passed. [2025-09-05T18:58:18.926007] [INFO ] [MAIN ] SKE: Found 1 missing trading days. [2025-09-05T18:58:18.929677] [INFO ] [MAIN ] SKE: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:18.955968] [INFO ] [MAIN ] SJT: Update completed successfully. [2025-09-05T18:58:18.968234] [INFO ] [MAIN ] Update Progress: 1914/2363 symbols completed. SJT took 2.9s. Estimated remaining: 13m 40s. Rate: 32.9 symbols/min [2025-09-05T18:58:19.041913] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-05T18:58:19.064476] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-05T18:58:19.156350] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:19.161691] [INFO ] [MAIN ] SKIL: Loaded 3189 existing records. [2025-09-05T18:58:19.344697] [INFO ] [MAIN ] SKIL: Found 1 missing trading days. [2025-09-05T18:58:19.344859] [INFO ] [MAIN ] SKIL: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:19.863515] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-05T18:58:19.905535] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-05T18:58:20.604769] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:58:20.668585] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-05T18:58:20.736845] [INFO ] [MAIN ] SKE: Adding 227 new records, updating 0 existing records. [2025-09-05T18:58:20.739907] [INFO ] [MAIN ] SKE: Combined dataset has 26564 total records. [2025-09-05T18:58:20.917005] [WARN ] [VALIDATOR ] SKE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T18:58:21.170707] [WARN ] [VALIDATOR ] SKE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T18:58:21.170928] [INFO ] [MAIN ] SKE: Combined data validation passed. [2025-09-05T18:58:21.326250] [INFO ] [MAIN ] SKE: Update completed successfully. [2025-09-05T18:58:21.329559] [INFO ] [MAIN ] Update Progress: 1915/2363 symbols completed. SKE took 3.0s. Estimated remaining: 13m 38s. Rate: 32.9 symbols/min [2025-09-05T18:58:21.499296] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-05T18:58:21.501583] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:21.501893] [WARN ] [MAIN ] SKLZ: No existing data found, performing full refresh instead. [2025-09-05T18:58:21.502931] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-05T18:58:21.503000] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-05T18:58:21.503075] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-05T18:58:21.801356] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-05T18:58:21.907065] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:58:22.151351] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-05T18:58:22.263523] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-05T18:58:22.271265] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T18:58:22.283726] [INFO ] [MAIN ] SKIL: Adding 20 new records, updating 0 existing records. [2025-09-05T18:58:22.285620] [INFO ] [MAIN ] SKIL: Combined dataset has 3209 total records. [2025-09-05T18:58:22.480532] [WARN ] [VALIDATOR ] SKIL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:22.678602] [WARN ] [VALIDATOR ] SKIL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:22.678830] [INFO ] [MAIN ] SKIL: Combined data validation passed. [2025-09-05T18:58:22.699274] [INFO ] [MAIN ] SKIL: Update completed successfully. [2025-09-05T18:58:22.699779] [INFO ] [MAIN ] Update Progress: 1916/2363 symbols completed. SKIL took 3.7s. Estimated remaining: 13m 36s. Rate: 32.9 symbols/min [2025-09-05T18:58:22.878528] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:22.895988] [INFO ] [MAIN ] SKM: Loaded 16399 existing records. [2025-09-05T18:58:23.068677] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-05T18:58:23.076117] [INFO ] [MAIN ] SKM: Found 1 missing trading days. [2025-09-05T18:58:23.077277] [INFO ] [MAIN ] SKM: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:23.294601] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-05T18:58:23.863496] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-05T18:58:24.415214] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-05T18:58:24.524448] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-05T18:58:24.663474] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-05T18:58:25.463525] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-05T18:58:25.580670] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-05T18:58:26.263476] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-05T18:58:27.007812] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-05T18:58:27.063475] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-05T18:58:27.787880] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-05T18:58:27.863465] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-05T18:58:28.437598] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-05T18:58:28.668770] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-05T18:58:28.680810] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-05T18:58:29.463518] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-05T18:58:30.263530] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-05T18:58:30.365191] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-05T18:58:31.054278] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-05T18:58:31.069707] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-05T18:58:31.073138] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-05T18:58:31.863494] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-05T18:58:32.539510] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-05T18:58:32.627852] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-05T18:58:32.663430] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-05T18:58:33.463473] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-05T18:58:34.110112] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-05T18:58:34.263482] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-05T18:58:34.663639] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T18:58:34.666967] [INFO ] [REMOTE ] SITC: Full fetch complete (45023 records). [2025-09-05T18:58:35.033157] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-05T18:58:35.093134] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-05T18:58:35.230930] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-05T18:58:35.231118] [INFO ] [MAIN ] Update Progress: 1917/2363 symbols completed. SITC took 28.6s. Estimated remaining: 13m 37s. Rate: 32.8 symbols/min [2025-09-05T18:58:35.513068] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T18:58:35.618884] [INFO ] [MAIN ] SKM: Adding 230 new records, updating 0 existing records. [2025-09-05T18:58:35.621810] [INFO ] [MAIN ] SKM: Combined dataset has 16629 total records. [2025-09-05T18:58:35.805180] [WARN ] [VALIDATOR ] SKM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:35.868722] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-05T18:58:36.009178] [WARN ] [VALIDATOR ] SKM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:36.009422] [INFO ] [MAIN ] SKM: Combined data validation passed. [2025-09-05T18:58:36.122583] [INFO ] [MAIN ] SKM: Update completed successfully. [2025-09-05T18:58:36.124224] [INFO ] [MAIN ] Update Progress: 1918/2363 symbols completed. SKM took 13.4s. Estimated remaining: 13m 35s. Rate: 32.8 symbols/min [2025-09-05T18:58:36.268085] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-05T18:58:36.663492] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-05T18:58:37.357930] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-05T18:58:37.463515] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-05T18:58:37.641825] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-05T18:58:38.263492] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-05T18:58:38.534107] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:58:38.537191] [INFO ] [REMOTE ] SITE: Full fetch complete (38339 records). [2025-09-05T18:58:38.945016] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-05T18:58:39.111964] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-05T18:58:39.112122] [INFO ] [MAIN ] Update Progress: 1919/2363 symbols completed. SITE took 25.6s. Estimated remaining: 13m 33s. Rate: 32.8 symbols/min [2025-09-05T18:58:39.140624] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-05T18:58:39.141919] [INFO ] [REMOTE ] SKLZ: Full fetch complete (13052 records). [2025-09-05T18:58:39.493932] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-05T18:58:39.544972] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-05T18:58:39.545117] [INFO ] [MAIN ] Update Progress: 1920/2363 symbols completed. SKLZ took 18.2s. Estimated remaining: 13m 31s. Rate: 32.8 symbols/min [2025-09-05T18:58:40.256891] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:40.236430] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:40.234397] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:40.258396] [WARN ] [MAIN ] SKYH: No existing data found, performing full refresh instead. [2025-09-05T18:58:40.263717] [WARN ] [MAIN ] SKY: No existing data found, performing full refresh instead. [2025-09-05T18:58:40.290926] [INFO ] [MAIN ] SKX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:40.291429] [WARN ] [MAIN ] SKX: No existing data found, performing full refresh instead. [2025-09-05T18:58:40.291516] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-05T18:58:40.291707] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-05T18:58:40.291858] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-05T18:58:40.291776] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-05T18:58:40.291806] [INFO ] [MAIN ] SKX: Wiping existing primary data before full refresh. [2025-09-05T18:58:40.292028] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-05T18:58:40.297385] [INFO ] [LOCAL ] SKX: Starting deletion of primary data. [2025-09-05T18:58:40.327677] [INFO ] [MAIN ] SKX: Starting full primary refresh. [2025-09-05T18:58:40.327581] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-05T18:58:40.773437] [INFO ] [MAIN ] SKT: Loaded 19971 existing records. [2025-09-05T18:58:41.435854] [INFO ] [REMOTE ] SKY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:58:41.466145] [INFO ] [MAIN ] SKT: Found 1 missing trading days. [2025-09-05T18:58:41.518393] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:58:41.528884] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-05T18:58:41.514439] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-05T18:58:41.553745] [INFO ] [MAIN ] SKT: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:41.569032] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-05T18:58:41.589471] [INFO ] [REMOTE ] SKX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:58:41.590623] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-01. [2025-09-05T18:58:42.653936] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-05T18:58:42.657072] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-05T18:58:42.904494] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T18:58:43.027827] [INFO ] [MAIN ] SKT: Adding 315 new records, updating 0 existing records. [2025-09-05T18:58:43.031201] [INFO ] [MAIN ] SKT: Combined dataset has 20286 total records. [2025-09-05T18:58:43.221480] [WARN ] [VALIDATOR ] SKT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:43.457173] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-05T18:58:43.468050] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-02. [2025-09-05T18:58:43.476719] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-05T18:58:43.488806] [WARN ] [VALIDATOR ] SKT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:43.489039] [INFO ] [MAIN ] SKT: Combined data validation passed. [2025-09-05T18:58:43.623461] [INFO ] [MAIN ] SKT: Update completed successfully. [2025-09-05T18:58:43.625935] [INFO ] [MAIN ] Update Progress: 1921/2363 symbols completed. SKT took 4.1s. Estimated remaining: 13m 30s. Rate: 32.7 symbols/min [2025-09-05T18:58:43.805470] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-05T18:58:43.823202] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:43.858208] [INFO ] [MAIN ] SLB: Loaded 25679 existing records. [2025-09-05T18:58:43.869702] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-05T18:58:44.042979] [INFO ] [MAIN ] SLB: Found 1 missing trading days. [2025-09-05T18:58:44.043183] [INFO ] [MAIN ] SLB: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:44.663498] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-05T18:58:45.045685] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-05T18:58:45.447678] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-05T18:58:45.463502] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-03. [2025-09-05T18:58:46.263453] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-05T18:58:46.575443] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-05T18:58:46.733045] [INFO ] [MAIN ] SLB: Adding 390 new records, updating 0 existing records. [2025-09-05T18:58:46.736796] [INFO ] [MAIN ] SLB: Combined dataset has 26069 total records. [2025-09-05T18:58:46.919580] [WARN ] [VALIDATOR ] SLB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:47.067785] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-05T18:58:47.125128] [WARN ] [VALIDATOR ] SLB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:47.125356] [INFO ] [MAIN ] SLB: Combined data validation passed. [2025-09-05T18:58:47.291897] [INFO ] [MAIN ] SLB: Update completed successfully. [2025-09-05T18:58:47.295240] [INFO ] [MAIN ] Update Progress: 1922/2363 symbols completed. SLB took 3.7s. Estimated remaining: 13m 28s. Rate: 32.7 symbols/min [2025-09-05T18:58:47.475461] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:47.524023] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-05T18:58:47.542184] [INFO ] [MAIN ] SLF: Loaded 19128 existing records. [2025-09-05T18:58:47.723324] [INFO ] [MAIN ] SLF: Found 1 missing trading days. [2025-09-05T18:58:47.723620] [INFO ] [MAIN ] SLF: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:47.745113] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-05T18:58:47.863450] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-05T18:58:48.343886] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-05T18:58:48.663481] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-05T18:58:48.905010] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-05T18:58:49.463516] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-04. [2025-09-05T18:58:50.263508] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-05T18:58:50.418078] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-05T18:58:50.520852] [INFO ] [MAIN ] SLF: Adding 306 new records, updating 0 existing records. [2025-09-05T18:58:50.524884] [INFO ] [MAIN ] SLF: Combined dataset has 19434 total records. [2025-09-05T18:58:50.710834] [WARN ] [VALIDATOR ] SLF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:50.933704] [WARN ] [VALIDATOR ] SLF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:50.933986] [INFO ] [MAIN ] SLF: Combined data validation passed. [2025-09-05T18:58:51.064521] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-05T18:58:51.101544] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-05T18:58:51.118008] [INFO ] [MAIN ] SLF: Update completed successfully. [2025-09-05T18:58:51.122776] [INFO ] [MAIN ] Update Progress: 1923/2363 symbols completed. SLF took 3.8s. Estimated remaining: 13m 27s. Rate: 32.7 symbols/min [2025-09-05T18:58:51.300136] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:51.322088] [INFO ] [MAIN ] SLG: Loaded 22076 existing records. [2025-09-05T18:58:51.514665] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-05T18:58:51.521885] [INFO ] [MAIN ] SLG: Found 1 missing trading days. [2025-09-05T18:58:51.530064] [INFO ] [MAIN ] SLG: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:51.863522] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-05T18:58:52.049927] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-05T18:58:52.663483] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-05. [2025-09-05T18:58:53.309062] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-05T18:58:53.438235] [INFO ] [MAIN ] SLG: Adding 347 new records, updating 0 existing records. [2025-09-05T18:58:53.441507] [INFO ] [MAIN ] SLG: Combined dataset has 22423 total records. [2025-09-05T18:58:53.472850] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-05T18:58:53.622637] [WARN ] [VALIDATOR ] SLG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:53.821224] [WARN ] [VALIDATOR ] SLG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:53.821444] [INFO ] [MAIN ] SLG: Combined data validation passed. [2025-09-05T18:58:53.962727] [INFO ] [MAIN ] SLG: Update completed successfully. [2025-09-05T18:58:53.965856] [INFO ] [MAIN ] Update Progress: 1924/2363 symbols completed. SLG took 2.8s. Estimated remaining: 13m 25s. Rate: 32.7 symbols/min [2025-09-05T18:58:54.143102] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:54.161929] [INFO ] [MAIN ] SLGN: Loaded 18983 existing records. [2025-09-05T18:58:54.266470] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-05T18:58:54.341550] [INFO ] [MAIN ] SLGN: Found 1 missing trading days. [2025-09-05T18:58:54.341771] [INFO ] [MAIN ] SLGN: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:54.722173] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-05T18:58:55.041744] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-05T18:58:55.063420] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-05T18:58:55.757112] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-05T18:58:55.863464] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-05T18:58:56.610669] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-05T18:58:56.663423] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-05T18:58:57.173596] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-05T18:58:57.304045] [INFO ] [MAIN ] SLGN: Adding 331 new records, updating 0 existing records. [2025-09-05T18:58:57.306878] [INFO ] [MAIN ] SLGN: Combined dataset has 19314 total records. [2025-09-05T18:58:57.463530] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-06. [2025-09-05T18:58:57.482904] [WARN ] [VALIDATOR ] SLGN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:58:57.676104] [WARN ] [VALIDATOR ] SLGN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:58:57.676316] [INFO ] [MAIN ] SLGN: Combined data validation passed. [2025-09-05T18:58:57.795234] [INFO ] [MAIN ] SLGN: Update completed successfully. [2025-09-05T18:58:57.797557] [INFO ] [MAIN ] Update Progress: 1925/2363 symbols completed. SLGN took 3.8s. Estimated remaining: 13m 24s. Rate: 32.7 symbols/min [2025-09-05T18:58:57.983778] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:58:57.986497] [INFO ] [MAIN ] SLNZ: Loaded 379 existing records. [2025-09-05T18:58:58.171070] [INFO ] [MAIN ] SLNZ: Found 1 missing trading days. [2025-09-05T18:58:58.171321] [INFO ] [MAIN ] SLNZ: Need to fetch 1 months: 2025-09 [2025-09-05T18:58:58.192727] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-05T18:58:58.263428] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-05T18:58:59.063553] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-05T18:58:59.217586] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-05T18:58:59.576186] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-05T18:58:59.849306] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T18:58:59.852596] [INFO ] [MAIN ] SLNZ: Adding 4 new records, updating 0 existing records. [2025-09-05T18:58:59.854518] [INFO ] [MAIN ] SLNZ: Combined dataset has 383 total records. [2025-09-05T18:58:59.868799] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-07. [2025-09-05T18:59:00.149548] [WARN ] [VALIDATOR ] SLNZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:00.346910] [WARN ] [VALIDATOR ] SLNZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:00.347119] [INFO ] [MAIN ] SLNZ: Combined data validation passed. [2025-09-05T18:59:00.350998] [INFO ] [MAIN ] SLNZ: Update completed successfully. [2025-09-05T18:59:00.351188] [INFO ] [MAIN ] Update Progress: 1926/2363 symbols completed. SLNZ took 2.6s. Estimated remaining: 13m 22s. Rate: 32.7 symbols/min [2025-09-05T18:59:00.519098] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:00.539705] [INFO ] [MAIN ] SLQT: Loaded 21208 existing records. [2025-09-05T18:59:00.679109] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-05T18:59:00.714550] [INFO ] [MAIN ] SLQT: Found 1 missing trading days. [2025-09-05T18:59:00.714692] [INFO ] [MAIN ] SLQT: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:01.463473] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-05T18:59:01.655592] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-05T18:59:02.086945] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-05T18:59:02.263509] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-08. [2025-09-05T18:59:03.063504] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-05T18:59:03.094620] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-05T18:59:03.222565] [INFO ] [MAIN ] SLQT: Adding 282 new records, updating 0 existing records. [2025-09-05T18:59:03.225765] [INFO ] [MAIN ] SLQT: Combined dataset has 21490 total records. [2025-09-05T18:59:03.402745] [WARN ] [VALIDATOR ] SLQT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:03.595671] [WARN ] [VALIDATOR ] SLQT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:03.595880] [INFO ] [MAIN ] SLQT: Combined data validation passed. [2025-09-05T18:59:03.719222] [INFO ] [MAIN ] SLQT: Update completed successfully. [2025-09-05T18:59:03.722023] [INFO ] [MAIN ] Update Progress: 1927/2363 symbols completed. SLQT took 3.4s. Estimated remaining: 13m 21s. Rate: 32.7 symbols/min [2025-09-05T18:59:03.878586] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-05T18:59:03.912506] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:03.927711] [INFO ] [MAIN ] SLVM: Loaded 13147 existing records. [2025-09-05T18:59:04.109727] [INFO ] [MAIN ] SLVM: Found 1 missing trading days. [2025-09-05T18:59:04.109988] [INFO ] [MAIN ] SLVM: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:04.140289] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-05T18:59:04.414708] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T18:59:04.417542] [INFO ] [REMOTE ] SKY: Full fetch complete (40418 records). [2025-09-05T18:59:04.670901] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-05T18:59:04.790495] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-05T18:59:04.973090] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-05T18:59:04.973242] [INFO ] [MAIN ] Update Progress: 1928/2363 symbols completed. SKY took 25.4s. Estimated remaining: 13m 19s. Rate: 32.7 symbols/min [2025-09-05T18:59:05.145509] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:05.155888] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-05T18:59:05.181262] [INFO ] [MAIN ] SM: Loaded 24916 existing records. [2025-09-05T18:59:05.361715] [INFO ] [MAIN ] SM: Found 1 missing trading days. [2025-09-05T18:59:05.361934] [INFO ] [MAIN ] SM: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:05.463503] [INFO ] [REMOTE ] SKX: Fetching primary data for 2025-09. [2025-09-05T18:59:05.784564] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T18:59:05.861146] [INFO ] [MAIN ] SLVM: Adding 220 new records, updating 0 existing records. [2025-09-05T18:59:05.863548] [INFO ] [MAIN ] SLVM: Combined dataset has 13367 total records. [2025-09-05T18:59:06.040607] [WARN ] [VALIDATOR ] SLVM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:06.236468] [WARN ] [VALIDATOR ] SLVM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:06.236725] [INFO ] [MAIN ] SLVM: Combined data validation passed. [2025-09-05T18:59:06.272975] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-05T18:59:06.324242] [INFO ] [MAIN ] SLVM: Update completed successfully. [2025-09-05T18:59:06.325652] [INFO ] [MAIN ] Update Progress: 1929/2363 symbols completed. SLVM took 2.6s. Estimated remaining: 13m 17s. Rate: 32.7 symbols/min [2025-09-05T18:59:06.502971] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:06.519917] [INFO ] [MAIN ] SMA: Loaded 16222 existing records. [2025-09-05T18:59:06.704692] [INFO ] [MAIN ] SMA: Found 1 missing trading days. [2025-09-05T18:59:06.704818] [INFO ] [MAIN ] SMA: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:06.927974] [INFO ] [REMOTE ] SKX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T18:59:06.932196] [INFO ] [REMOTE ] SKX: Full fetch complete (56134 records). [2025-09-05T18:59:07.073464] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-05T18:59:07.096763] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:59:07.155872] [INFO ] [REMOTE ] SKYH: Full fetch complete (17313 records). [2025-09-05T18:59:07.504750] [INFO ] [MAIN ] SKX: Fetched primary data is valid. [2025-09-05T18:59:07.775549] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-05T18:59:07.863991] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-05T18:59:07.998417] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-05T18:59:07.999105] [INFO ] [MAIN ] Update Progress: 1930/2363 symbols completed. SKYH took 28.5s. Estimated remaining: 13m 15s. Rate: 32.7 symbols/min [2025-09-05T18:59:08.176018] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:08.176696] [WARN ] [MAIN ] SMBK: No existing data found, performing full refresh instead. [2025-09-05T18:59:08.180171] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-05T18:59:08.180235] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-05T18:59:08.180296] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-05T18:59:08.180124] [INFO ] [MAIN ] SKX: Full history saved. [2025-09-05T18:59:08.222931] [INFO ] [MAIN ] Update Progress: 1931/2363 symbols completed. SKX took 28.7s. Estimated remaining: 13m 13s. Rate: 32.7 symbols/min [2025-09-05T18:59:08.606915] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:08.713910] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:59:08.714264] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-05T18:59:08.717179] [INFO ] [MAIN ] SMC: Loaded 5449 existing records. [2025-09-05T18:59:08.899212] [INFO ] [MAIN ] SMC: Found 1 missing trading days. [2025-09-05T18:59:08.900281] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-05T18:59:08.899714] [INFO ] [MAIN ] SMC: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:09.054590] [INFO ] [MAIN ] SM: Adding 385 new records, updating 0 existing records. [2025-09-05T18:59:09.055286] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-05T18:59:09.144802] [INFO ] [MAIN ] SMA: Adding 267 new records, updating 0 existing records. [2025-09-05T18:59:09.145017] [INFO ] [MAIN ] SM: Combined dataset has 25301 total records. [2025-09-05T18:59:09.262131] [INFO ] [MAIN ] SMA: Combined dataset has 16489 total records. [2025-09-05T18:59:09.398479] [WARN ] [VALIDATOR ] SM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:09.474057] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-05T18:59:09.657872] [WARN ] [VALIDATOR ] SMA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:09.840556] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-05T18:59:09.953474] [WARN ] [VALIDATOR ] SMA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:09.953901] [INFO ] [MAIN ] SMA: Combined data validation passed. [2025-09-05T18:59:09.953570] [WARN ] [VALIDATOR ] SM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:09.954342] [INFO ] [MAIN ] SM: Combined data validation passed. [2025-09-05T18:59:10.210931] [INFO ] [MAIN ] SMA: Update completed successfully. [2025-09-05T18:59:10.214126] [INFO ] [MAIN ] Update Progress: 1932/2363 symbols completed. SMA took 3.9s. Estimated remaining: 13m 11s. Rate: 32.7 symbols/min [2025-09-05T18:59:10.250509] [INFO ] [MAIN ] SM: Update completed successfully. [2025-09-05T18:59:10.274004] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-05T18:59:10.277206] [INFO ] [MAIN ] Update Progress: 1933/2363 symbols completed. SM took 5.3s. Estimated remaining: 13m 9s. Rate: 32.7 symbols/min [2025-09-05T18:59:10.536317] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:10.545958] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T18:59:10.627023] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:10.647034] [INFO ] [MAIN ] SMC: Adding 102 new records, updating 0 existing records. [2025-09-05T18:59:10.656707] [INFO ] [MAIN ] SMC: Combined dataset has 5551 total records. [2025-09-05T18:59:10.761572] [INFO ] [MAIN ] SMFG: Loaded 22706 existing records. [2025-09-05T18:59:10.948286] [INFO ] [MAIN ] SMG: Loaded 20263 existing records. [2025-09-05T18:59:10.977722] [WARN ] [VALIDATOR ] SMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:11.227761] [INFO ] [MAIN ] SMFG: Found 1 missing trading days. [2025-09-05T18:59:11.265325] [INFO ] [MAIN ] SMFG: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:11.281328] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-05T18:59:11.455678] [INFO ] [MAIN ] SMG: Found 1 missing trading days. [2025-09-05T18:59:11.476329] [INFO ] [MAIN ] SMG: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:11.482496] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-05T18:59:11.497692] [WARN ] [VALIDATOR ] SMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:11.497936] [INFO ] [MAIN ] SMC: Combined data validation passed. [2025-09-05T18:59:11.532274] [INFO ] [MAIN ] SMC: Update completed successfully. [2025-09-05T18:59:11.533292] [INFO ] [MAIN ] Update Progress: 1934/2363 symbols completed. SMC took 3.3s. Estimated remaining: 13m 7s. Rate: 32.7 symbols/min [2025-09-05T18:59:11.708582] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:11.715976] [INFO ] [MAIN ] SMHI: Loaded 6129 existing records. [2025-09-05T18:59:11.868739] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-05T18:59:11.897231] [INFO ] [MAIN ] SMHI: Found 1 missing trading days. [2025-09-05T18:59:11.897396] [INFO ] [MAIN ] SMHI: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:12.663475] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-05T18:59:13.007021] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-05T18:59:13.142538] [INFO ] [MAIN ] SMFG: Adding 343 new records, updating 0 existing records. [2025-09-05T18:59:13.145922] [INFO ] [MAIN ] SMFG: Combined dataset has 23049 total records. [2025-09-05T18:59:13.334351] [WARN ] [VALIDATOR ] SMFG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:13.411339] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T18:59:13.469834] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-05T18:59:13.482094] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T18:59:13.652463] [INFO ] [MAIN ] SMHI: Adding 50 new records, updating 0 existing records. [2025-09-05T18:59:13.690483] [INFO ] [MAIN ] SMG: Adding 357 new records, updating 0 existing records. [2025-09-05T18:59:13.697742] [INFO ] [MAIN ] SMHI: Combined dataset has 6179 total records. [2025-09-05T18:59:13.763096] [INFO ] [MAIN ] SMG: Combined dataset has 20620 total records. [2025-09-05T18:59:13.987342] [WARN ] [VALIDATOR ] SMHI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:14.096074] [WARN ] [VALIDATOR ] SMG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:14.459274] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-05T18:59:14.456662] [WARN ] [VALIDATOR ] SMFG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:14.463353] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-05T18:59:14.462017] [INFO ] [MAIN ] SMFG: Combined data validation passed. [2025-09-05T18:59:14.598797] [WARN ] [VALIDATOR ] SMG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:14.599380] [WARN ] [VALIDATOR ] SMHI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:14.600049] [INFO ] [MAIN ] SMG: Combined data validation passed. [2025-09-05T18:59:14.600389] [INFO ] [MAIN ] SMHI: Combined data validation passed. [2025-09-05T18:59:14.732870] [INFO ] [MAIN ] SMHI: Update completed successfully. [2025-09-05T18:59:14.735014] [INFO ] [MAIN ] Update Progress: 1935/2363 symbols completed. SMHI took 3.2s. Estimated remaining: 13m 5s. Rate: 32.7 symbols/min [2025-09-05T18:59:14.938097] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:14.955461] [INFO ] [MAIN ] SMP: Loaded 8720 existing records. [2025-09-05T18:59:14.967917] [INFO ] [MAIN ] SMFG: Update completed successfully. [2025-09-05T18:59:14.997495] [INFO ] [MAIN ] Update Progress: 1936/2363 symbols completed. SMFG took 4.8s. Estimated remaining: 13m 3s. Rate: 32.7 symbols/min [2025-09-05T18:59:15.259990] [INFO ] [MAIN ] SMP: Found 1 missing trading days. [2025-09-05T18:59:15.271599] [INFO ] [MAIN ] SMP: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:15.277289] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-05T18:59:15.336503] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:15.347450] [INFO ] [MAIN ] SMG: Update completed successfully. [2025-09-05T18:59:15.350505] [INFO ] [MAIN ] Update Progress: 1937/2363 symbols completed. SMG took 5.0s. Estimated remaining: 13m 1s. Rate: 32.7 symbols/min [2025-09-05T18:59:15.574526] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:15.591095] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-05T18:59:15.604219] [INFO ] [MAIN ] SMR: Loaded 25791 existing records. [2025-09-05T18:59:15.790326] [INFO ] [MAIN ] SMRT: Loaded 21174 existing records. [2025-09-05T18:59:15.846905] [INFO ] [MAIN ] SMR: Found 1 missing trading days. [2025-09-05T18:59:15.869848] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-05T18:59:15.891105] [INFO ] [MAIN ] SMR: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:15.994339] [INFO ] [MAIN ] SMRT: Found 1 missing trading days. [2025-09-05T18:59:15.994566] [INFO ] [MAIN ] SMRT: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:16.412002] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-05T18:59:16.485871] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T18:59:16.530403] [INFO ] [MAIN ] SMP: Adding 103 new records, updating 0 existing records. [2025-09-05T18:59:16.532472] [INFO ] [MAIN ] SMP: Combined dataset has 8823 total records. [2025-09-05T18:59:16.671727] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-05T18:59:16.709425] [WARN ] [VALIDATOR ] SMP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:16.902770] [WARN ] [VALIDATOR ] SMP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:16.902983] [INFO ] [MAIN ] SMP: Combined data validation passed. [2025-09-05T18:59:16.960682] [INFO ] [MAIN ] SMP: Update completed successfully. [2025-09-05T18:59:16.961980] [INFO ] [MAIN ] Update Progress: 1938/2363 symbols completed. SMP took 2.2s. Estimated remaining: 12m 59s. Rate: 32.7 symbols/min [2025-09-05T18:59:17.136548] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:17.152388] [INFO ] [MAIN ] SMWB: Loaded 16016 existing records. [2025-09-05T18:59:17.335517] [INFO ] [MAIN ] SMWB: Found 1 missing trading days. [2025-09-05T18:59:17.335711] [INFO ] [MAIN ] SMWB: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:17.463512] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-05T18:59:18.028132] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T18:59:18.132467] [INFO ] [MAIN ] SMRT: Adding 276 new records, updating 0 existing records. [2025-09-05T18:59:18.135431] [INFO ] [MAIN ] SMRT: Combined dataset has 21450 total records. [2025-09-05T18:59:18.275486] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-05T18:59:18.314312] [WARN ] [VALIDATOR ] SMRT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:18.509896] [WARN ] [VALIDATOR ] SMRT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:18.510110] [INFO ] [MAIN ] SMRT: Combined data validation passed. [2025-09-05T18:59:18.639978] [INFO ] [MAIN ] SMRT: Update completed successfully. [2025-09-05T18:59:18.642771] [INFO ] [MAIN ] Update Progress: 1939/2363 symbols completed. SMRT took 3.3s. Estimated remaining: 12m 57s. Rate: 32.7 symbols/min [2025-09-05T18:59:18.813131] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:18.836919] [INFO ] [MAIN ] SN: Loaded 23988 existing records. [2025-09-05T18:59:18.949466] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-05T18:59:19.067113] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-05T18:59:19.077598] [INFO ] [MAIN ] SN: Found 1 missing trading days. [2025-09-05T18:59:19.088763] [INFO ] [MAIN ] SN: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:19.130831] [INFO ] [MAIN ] SMWB: Adding 186 new records, updating 0 existing records. [2025-09-05T18:59:19.133549] [INFO ] [MAIN ] SMWB: Combined dataset has 16202 total records. [2025-09-05T18:59:19.319447] [WARN ] [VALIDATOR ] SMWB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:19.509587] [WARN ] [VALIDATOR ] SMWB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:19.509823] [INFO ] [MAIN ] SMWB: Combined data validation passed. [2025-09-05T18:59:19.611254] [INFO ] [MAIN ] SMWB: Update completed successfully. [2025-09-05T18:59:19.613250] [INFO ] [MAIN ] Update Progress: 1940/2363 symbols completed. SMWB took 2.7s. Estimated remaining: 12m 55s. Rate: 32.7 symbols/min [2025-09-05T18:59:19.783431] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:19.796081] [INFO ] [MAIN ] SNA: Loaded 11541 existing records. [2025-09-05T18:59:19.870832] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-05T18:59:19.971166] [INFO ] [MAIN ] SNA: Found 1 missing trading days. [2025-09-05T18:59:19.971303] [INFO ] [MAIN ] SNA: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:20.137227] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-05T18:59:20.552065] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-05T18:59:20.668558] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-05T18:59:20.698383] [INFO ] [MAIN ] SMR: Adding 390 new records, updating 0 existing records. [2025-09-05T18:59:20.702416] [INFO ] [MAIN ] SMR: Combined dataset has 26181 total records. [2025-09-05T18:59:20.882485] [WARN ] [VALIDATOR ] SMR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:21.076204] [WARN ] [VALIDATOR ] SMR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:21.076509] [INFO ] [MAIN ] SMR: Combined data validation passed. [2025-09-05T18:59:21.238404] [INFO ] [MAIN ] SMR: Update completed successfully. [2025-09-05T18:59:21.241325] [INFO ] [MAIN ] Update Progress: 1941/2363 symbols completed. SMR took 6.2s. Estimated remaining: 12m 53s. Rate: 32.7 symbols/min [2025-09-05T18:59:21.410759] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:21.435905] [INFO ] [MAIN ] SNAP: Loaded 25778 existing records. [2025-09-05T18:59:21.468563] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-05T18:59:21.624931] [INFO ] [MAIN ] SNAP: Found 1 missing trading days. [2025-09-05T18:59:21.625216] [INFO ] [MAIN ] SNAP: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:21.632745] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-05T18:59:21.771891] [INFO ] [MAIN ] SN: Adding 367 new records, updating 0 existing records. [2025-09-05T18:59:21.776062] [INFO ] [MAIN ] SN: Combined dataset has 24355 total records. [2025-09-05T18:59:21.961618] [WARN ] [VALIDATOR ] SN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:22.021853] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T18:59:22.150670] [INFO ] [MAIN ] SNA: Adding 112 new records, updating 0 existing records. [2025-09-05T18:59:22.223415] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-05T18:59:22.229964] [INFO ] [MAIN ] SNA: Combined dataset has 11653 total records. [2025-09-05T18:59:22.273004] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-05T18:59:22.434920] [WARN ] [VALIDATOR ] SNA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:22.632725] [WARN ] [VALIDATOR ] SN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:22.633745] [INFO ] [MAIN ] SN: Combined data validation passed. [2025-09-05T18:59:22.636976] [WARN ] [VALIDATOR ] SNA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:22.637408] [INFO ] [MAIN ] SNA: Combined data validation passed. [2025-09-05T18:59:22.809319] [INFO ] [MAIN ] SNA: Update completed successfully. [2025-09-05T18:59:22.812082] [INFO ] [MAIN ] Update Progress: 1942/2363 symbols completed. SNA took 3.2s. Estimated remaining: 12m 52s. Rate: 32.7 symbols/min [2025-09-05T18:59:22.994515] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:23.012028] [INFO ] [MAIN ] SNDA: Loaded 1899 existing records. [2025-09-05T18:59:23.084577] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-05T18:59:23.137752] [INFO ] [MAIN ] SN: Update completed successfully. [2025-09-05T18:59:23.156057] [INFO ] [MAIN ] Update Progress: 1943/2363 symbols completed. SN took 4.5s. Estimated remaining: 12m 49s. Rate: 32.8 symbols/min [2025-09-05T18:59:23.317246] [INFO ] [MAIN ] SNDA: Found 1 missing trading days. [2025-09-05T18:59:23.339764] [INFO ] [MAIN ] SNDA: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:23.409669] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:23.430191] [INFO ] [MAIN ] SNDR: Loaded 19202 existing records. [2025-09-05T18:59:23.609270] [INFO ] [MAIN ] SNDR: Found 1 missing trading days. [2025-09-05T18:59:23.609436] [INFO ] [MAIN ] SNDR: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:23.847933] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-05T18:59:23.863424] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-05T18:59:24.421479] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-05T18:59:24.422430] [INFO ] [REMOTE ] SMBK: Full fetch complete (8747 records). [2025-09-05T18:59:24.666425] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-05T18:59:24.780846] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-05T18:59:24.787746] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-05T18:59:24.978142] [INFO ] [MAIN ] SNAP: Adding 390 new records, updating 0 existing records. [2025-09-05T18:59:24.988361] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-05T18:59:24.988575] [INFO ] [MAIN ] Update Progress: 1944/2363 symbols completed. SMBK took 17.0s. Estimated remaining: 12m 48s. Rate: 32.8 symbols/min [2025-09-05T18:59:25.095581] [INFO ] [MAIN ] SNAP: Combined dataset has 26168 total records. [2025-09-05T18:59:25.242408] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:25.345577] [WARN ] [VALIDATOR ] SNAP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:25.468262] [INFO ] [MAIN ] SNN: Loaded 21671 existing records. [2025-09-05T18:59:25.467341] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-05T18:59:25.731072] [INFO ] [MAIN ] SNN: Found 1 missing trading days. [2025-09-05T18:59:25.731830] [INFO ] [MAIN ] SNN: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:25.748757] [WARN ] [VALIDATOR ] SNAP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:25.748982] [INFO ] [MAIN ] SNAP: Combined data validation passed. [2025-09-05T18:59:25.851080] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T18:59:25.967961] [INFO ] [MAIN ] SNDR: Adding 282 new records, updating 0 existing records. [2025-09-05T18:59:26.019950] [INFO ] [MAIN ] SNDR: Combined dataset has 19484 total records. [2025-09-05T18:59:26.064312] [INFO ] [MAIN ] SNAP: Update completed successfully. [2025-09-05T18:59:26.097423] [INFO ] [MAIN ] Update Progress: 1945/2363 symbols completed. SNAP took 4.9s. Estimated remaining: 12m 46s. Rate: 32.8 symbols/min [2025-09-05T18:59:26.102714] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T18:59:26.167292] [INFO ] [MAIN ] SNDA: Adding 22 new records, updating 0 existing records. [2025-09-05T18:59:26.259244] [INFO ] [MAIN ] SNDA: Combined dataset has 1921 total records. [2025-09-05T18:59:26.273327] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-05T18:59:26.358402] [WARN ] [VALIDATOR ] SNDR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:26.554770] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:26.709987] [WARN ] [VALIDATOR ] SNDA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:26.979684] [INFO ] [MAIN ] SNOW: Loaded 25577 existing records. [2025-09-05T18:59:27.176764] [INFO ] [MAIN ] SNOW: Found 1 missing trading days. [2025-09-05T18:59:27.177263] [INFO ] [MAIN ] SNOW: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:27.177623] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-05T18:59:27.194630] [WARN ] [VALIDATOR ] SNDA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:27.194720] [WARN ] [VALIDATOR ] SNDR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:27.194992] [INFO ] [MAIN ] SNDA: Combined data validation passed. [2025-09-05T18:59:27.195593] [INFO ] [MAIN ] SNDR: Combined data validation passed. [2025-09-05T18:59:27.209254] [INFO ] [MAIN ] SNDA: Update completed successfully. [2025-09-05T18:59:27.209834] [INFO ] [MAIN ] Update Progress: 1946/2363 symbols completed. SNDA took 4.4s. Estimated remaining: 12m 44s. Rate: 32.8 symbols/min [2025-09-05T18:59:27.482844] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:27.509798] [INFO ] [MAIN ] SNDR: Update completed successfully. [2025-09-05T18:59:27.512367] [INFO ] [MAIN ] Update Progress: 1947/2363 symbols completed. SNDR took 4.4s. Estimated remaining: 12m 41s. Rate: 32.8 symbols/min [2025-09-05T18:59:27.706487] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:27.703024] [INFO ] [MAIN ] SNV: Loaded 23503 existing records. [2025-09-05T18:59:27.903431] [INFO ] [MAIN ] SNV: Found 1 missing trading days. [2025-09-05T18:59:27.904343] [INFO ] [MAIN ] SNX: Loaded 17778 existing records. [2025-09-05T18:59:27.904394] [INFO ] [MAIN ] SNV: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:27.904706] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-05T18:59:28.081528] [INFO ] [MAIN ] SNX: Found 1 missing trading days. [2025-09-05T18:59:28.081722] [INFO ] [MAIN ] SNX: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:28.381239] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-05T18:59:28.507561] [INFO ] [MAIN ] SNN: Adding 341 new records, updating 0 existing records. [2025-09-05T18:59:28.510810] [INFO ] [MAIN ] SNN: Combined dataset has 22012 total records. [2025-09-05T18:59:28.671289] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-05T18:59:28.691747] [WARN ] [VALIDATOR ] SNN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:28.891450] [WARN ] [VALIDATOR ] SNN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:28.891685] [INFO ] [MAIN ] SNN: Combined data validation passed. [2025-09-05T18:59:29.031386] [INFO ] [MAIN ] SNN: Update completed successfully. [2025-09-05T18:59:29.034036] [INFO ] [MAIN ] Update Progress: 1948/2363 symbols completed. SNN took 4.0s. Estimated remaining: 12m 40s. Rate: 32.8 symbols/min [2025-09-05T18:59:29.202297] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:29.229127] [INFO ] [MAIN ] SO: Loaded 25629 existing records. [2025-09-05T18:59:29.409466] [INFO ] [MAIN ] SO: Found 1 missing trading days. [2025-09-05T18:59:29.409722] [INFO ] [MAIN ] SO: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:29.463527] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-05T18:59:29.540177] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-05T18:59:29.609363] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-05T18:59:29.779489] [INFO ] [MAIN ] SNOW: Adding 390 new records, updating 0 existing records. [2025-09-05T18:59:29.845719] [INFO ] [MAIN ] SNV: Adding 335 new records, updating 0 existing records. [2025-09-05T18:59:29.848500] [INFO ] [MAIN ] SNOW: Combined dataset has 25967 total records. [2025-09-05T18:59:29.949579] [INFO ] [MAIN ] SNV: Combined dataset has 23838 total records. [2025-09-05T18:59:29.992855] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T18:59:30.107728] [WARN ] [VALIDATOR ] SNOW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:30.429552] [INFO ] [MAIN ] SNX: Adding 286 new records, updating 0 existing records. [2025-09-05T18:59:30.526710] [WARN ] [VALIDATOR ] SNV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:30.640190] [INFO ] [MAIN ] SNX: Combined dataset has 18064 total records. [2025-09-05T18:59:30.985588] [WARN ] [VALIDATOR ] SNX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:31.105252] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-05T18:59:31.282674] [WARN ] [VALIDATOR ] SNOW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:31.283078] [INFO ] [MAIN ] SNOW: Combined data validation passed. [2025-09-05T18:59:31.282829] [WARN ] [VALIDATOR ] SNV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:31.326905] [INFO ] [MAIN ] SNV: Combined data validation passed. [2025-09-05T18:59:31.426516] [INFO ] [MAIN ] SO: Adding 390 new records, updating 0 existing records. [2025-09-05T18:59:31.599427] [INFO ] [MAIN ] SO: Combined dataset has 26019 total records. [2025-09-05T18:59:31.652763] [WARN ] [VALIDATOR ] SNX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:31.648757] [INFO ] [MAIN ] SNOW: Update completed successfully. [2025-09-05T18:59:31.680410] [INFO ] [MAIN ] SNX: Combined data validation passed. [2025-09-05T18:59:31.683731] [INFO ] [MAIN ] Update Progress: 1949/2363 symbols completed. SNOW took 5.6s. Estimated remaining: 12m 38s. Rate: 32.8 symbols/min [2025-09-05T18:59:32.039417] [INFO ] [MAIN ] SNX: Update completed successfully. [2025-09-05T18:59:32.062729] [INFO ] [MAIN ] Update Progress: 1950/2363 symbols completed. SNX took 4.6s. Estimated remaining: 12m 36s. Rate: 32.8 symbols/min [2025-09-05T18:59:32.074767] [WARN ] [VALIDATOR ] SO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:32.252778] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:32.274506] [WARN ] [MAIN ] SOBO: No existing data found, performing full refresh instead. [2025-09-05T18:59:32.295305] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-05T18:59:32.304481] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-05T18:59:32.354215] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-05T18:59:32.663579] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:32.832069] [INFO ] [MAIN ] SNV: Update completed successfully. [2025-09-05T18:59:32.851808] [INFO ] [MAIN ] Update Progress: 1951/2363 symbols completed. SNV took 5.6s. Estimated remaining: 12m 34s. Rate: 32.8 symbols/min [2025-09-05T18:59:32.906599] [INFO ] [MAIN ] SOC: Loaded 24265 existing records. [2025-09-05T18:59:33.195422] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:59:33.197361] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-05T18:59:33.334063] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:33.352342] [INFO ] [MAIN ] SOC: Found 1 missing trading days. [2025-09-05T18:59:33.352938] [INFO ] [MAIN ] SOC: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:33.353494] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-05T18:59:33.358262] [INFO ] [MAIN ] SOJC: Loaded 2116 existing records. [2025-09-05T18:59:33.530715] [INFO ] [MAIN ] SOJC: Found 1 missing trading days. [2025-09-05T18:59:33.531012] [INFO ] [MAIN ] SOJC: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:33.531272] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-05T18:59:33.533510] [WARN ] [VALIDATOR ] SO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:33.533674] [INFO ] [MAIN ] SO: Combined data validation passed. [2025-09-05T18:59:33.702516] [INFO ] [MAIN ] SO: Update completed successfully. [2025-09-05T18:59:33.705187] [INFO ] [MAIN ] Update Progress: 1952/2363 symbols completed. SO took 4.7s. Estimated remaining: 12m 32s. Rate: 32.8 symbols/min [2025-09-05T18:59:33.879553] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:33.887219] [INFO ] [MAIN ] SOJD: Loaded 5985 existing records. [2025-09-05T18:59:34.062071] [INFO ] [MAIN ] SOJD: Found 1 missing trading days. [2025-09-05T18:59:34.062215] [INFO ] [MAIN ] SOJD: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:34.062466] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-05T18:59:34.159025] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T18:59:34.172350] [INFO ] [MAIN ] SOJC: Adding 53 new records, updating 0 existing records. [2025-09-05T18:59:34.173895] [INFO ] [MAIN ] SOJC: Combined dataset has 2169 total records. [2025-09-05T18:59:34.359415] [WARN ] [VALIDATOR ] SOJC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:34.554488] [WARN ] [VALIDATOR ] SOJC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:34.554732] [INFO ] [MAIN ] SOJC: Combined data validation passed. [2025-09-05T18:59:34.568846] [INFO ] [MAIN ] SOJC: Update completed successfully. [2025-09-05T18:59:34.569267] [INFO ] [MAIN ] Update Progress: 1953/2363 symbols completed. SOJC took 1.7s. Estimated remaining: 12m 30s. Rate: 32.8 symbols/min [2025-09-05T18:59:34.747768] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:34.754131] [INFO ] [MAIN ] SOJE: Loaded 4339 existing records. [2025-09-05T18:59:34.926106] [INFO ] [MAIN ] SOJE: Found 1 missing trading days. [2025-09-05T18:59:34.926289] [INFO ] [MAIN ] SOJE: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:34.926497] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-05T18:59:34.941218] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T18:59:35.059503] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T18:59:35.128274] [INFO ] [MAIN ] SOC: Adding 386 new records, updating 0 existing records. [2025-09-05T18:59:35.119466] [INFO ] [MAIN ] SOJD: Adding 54 new records, updating 0 existing records. [2025-09-05T18:59:35.139231] [INFO ] [MAIN ] SOJD: Combined dataset has 6039 total records. [2025-09-05T18:59:35.197719] [INFO ] [MAIN ] SOC: Combined dataset has 24651 total records. [2025-09-05T18:59:35.440423] [WARN ] [VALIDATOR ] SOJD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:35.557481] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-05T18:59:35.605241] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-05T18:59:35.578067] [WARN ] [VALIDATOR ] SOC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:35.616101] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T18:59:35.726521] [INFO ] [MAIN ] SOJE: Adding 36 new records, updating 0 existing records. [2025-09-05T18:59:35.880719] [INFO ] [MAIN ] SOJE: Combined dataset has 4375 total records. [2025-09-05T18:59:36.151746] [WARN ] [VALIDATOR ] SOJE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:36.361055] [WARN ] [VALIDATOR ] SOJD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:36.361413] [WARN ] [VALIDATOR ] SOC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:36.362257] [INFO ] [MAIN ] SOC: Combined data validation passed. [2025-09-05T18:59:36.362075] [INFO ] [MAIN ] SOJD: Combined data validation passed. [2025-09-05T18:59:36.489217] [WARN ] [VALIDATOR ] SOJE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:36.511192] [INFO ] [MAIN ] SOJE: Combined data validation passed. [2025-09-05T18:59:36.525026] [INFO ] [MAIN ] SOJD: Update completed successfully. [2025-09-05T18:59:36.546180] [INFO ] [MAIN ] Update Progress: 1954/2363 symbols completed. SOJD took 2.8s. Estimated remaining: 12m 28s. Rate: 32.8 symbols/min [2025-09-05T18:59:36.653973] [INFO ] [MAIN ] SOJE: Update completed successfully. [2025-09-05T18:59:36.661715] [INFO ] [MAIN ] Update Progress: 1955/2363 symbols completed. SOJE took 2.1s. Estimated remaining: 12m 26s. Rate: 32.8 symbols/min [2025-09-05T18:59:36.874729] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:36.885176] [INFO ] [MAIN ] SOC: Update completed successfully. [2025-09-05T18:59:36.945102] [INFO ] [MAIN ] Update Progress: 1956/2363 symbols completed. SOC took 4.9s. Estimated remaining: 12m 23s. Rate: 32.8 symbols/min [2025-09-05T18:59:36.942494] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:36.966128] [INFO ] [MAIN ] SOJF: Loaded 4356 existing records. [2025-09-05T18:59:37.166350] [INFO ] [MAIN ] SOL: Loaded 6591 existing records. [2025-09-05T18:59:37.265483] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:37.411254] [INFO ] [MAIN ] SOJF: Found 1 missing trading days. [2025-09-05T18:59:37.442857] [INFO ] [MAIN ] SOJF: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:37.443244] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-05T18:59:37.500994] [INFO ] [MAIN ] SOL: Found 1 missing trading days. [2025-09-05T18:59:37.502196] [INFO ] [MAIN ] SOLV: Loaded 20216 existing records. [2025-09-05T18:59:37.502683] [INFO ] [MAIN ] SOL: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:37.503499] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-05T18:59:37.692571] [INFO ] [MAIN ] SOLV: Found 1 missing trading days. [2025-09-05T18:59:37.705293] [INFO ] [MAIN ] SOLV: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:37.705718] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-05T18:59:37.707737] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-05T18:59:37.715873] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-05T18:59:38.977173] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T18:59:39.113087] [INFO ] [MAIN ] SOLV: Adding 307 new records, updating 0 existing records. [2025-09-05T18:59:39.116193] [INFO ] [MAIN ] SOLV: Combined dataset has 20523 total records. [2025-09-05T18:59:39.300633] [WARN ] [VALIDATOR ] SOLV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:39.510228] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-05T18:59:39.520169] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-05T18:59:39.530917] [WARN ] [VALIDATOR ] SOLV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:39.531116] [INFO ] [MAIN ] SOLV: Combined data validation passed. [2025-09-05T18:59:39.659343] [INFO ] [MAIN ] SOLV: Update completed successfully. [2025-09-05T18:59:39.662064] [INFO ] [MAIN ] Update Progress: 1957/2363 symbols completed. SOLV took 2.7s. Estimated remaining: 12m 22s. Rate: 32.8 symbols/min [2025-09-05T18:59:40.314123] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-05T18:59:40.340182] [INFO ] [MAIN ] SOL: Adding 0 new records, updating 0 existing records. [2025-09-05T18:59:40.343054] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-09-05T18:59:40.344675] [INFO ] [MAIN ] SOL: Combined dataset has 6591 total records. [2025-09-05T18:59:40.367006] [INFO ] [MAIN ] SOJF: Adding 0 new records, updating 0 existing records. [2025-09-05T18:59:40.359721] [FATAL] [VALIDATOR ] SOL: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:59:40.367495] [FATAL] [MAIN ] SOL: Combined data validation failed. [2025-09-05T18:59:40.368192] [WARN ] [MAIN ] SOL: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:59:40.368340] [INFO ] [MAIN ] SOJF: Combined dataset has 4356 total records. [2025-09-05T18:59:40.368786] [FATAL] [VALIDATOR ] SOJF: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:59:40.368833] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-05T18:59:40.368925] [FATAL] [MAIN ] SOJF: Combined data validation failed. [2025-09-05T18:59:40.368995] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:59:40.369095] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-05T18:59:40.369434] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-05T18:59:40.369466] [INFO ] [LOCAL ] SOL: Starting deletion of derivative data. [2025-09-05T18:59:40.370629] [INFO ] [MAIN ] Update Progress: 1958/2363 symbols completed. SOL took 3.7s. Estimated remaining: 12m 20s. Rate: 32.8 symbols/min [2025-09-05T18:59:40.371226] [INFO ] [MAIN ] Update Progress: 1959/2363 symbols completed. SOJF took 3.8s. Estimated remaining: 12m 18s. Rate: 32.9 symbols/min [2025-09-05T18:59:40.679985] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-05T18:59:40.688907] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-05T18:59:41.903516] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-05T18:59:41.912574] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-05T18:59:43.337614] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-05T18:59:43.346757] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-05T18:59:45.013060] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-05T18:59:45.021231] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-05T18:59:46.031974] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-05T18:59:46.040266] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-05T18:59:47.322304] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-05T18:59:47.324503] [INFO ] [REMOTE ] SOBO: Full fetch complete (43478 records). [2025-09-05T18:59:47.325214] [FATAL] [VALIDATOR ] SOBO: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T18:59:47.325305] [FATAL] [MAIN ] SOBO: Fetched primary data is invalid. Refusing to save it. [2025-09-05T18:59:47.325344] [WARN ] [MAIN ] SOBO: Deleting existing primary and derivative data due to validation failure. [2025-09-05T18:59:47.325386] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-05T18:59:47.325452] [INFO ] [LOCAL ] SOBO: Starting deletion of derivative data. [2025-09-05T18:59:47.325539] [INFO ] [MAIN ] Update Progress: 1960/2363 symbols completed. SOBO took 15.6s. Estimated remaining: 12m 17s. Rate: 32.8 symbols/min [2025-09-05T18:59:47.992551] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:48.045678] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:48.064789] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:48.038148] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:48.069089] [INFO ] [MAIN ] SOR: Loaded 1400 existing records. [2025-09-05T18:59:48.137887] [INFO ] [MAIN ] SOS: Loaded 5077 existing records. [2025-09-05T18:59:48.388280] [INFO ] [MAIN ] SOR: Found 1 missing trading days. [2025-09-05T18:59:48.384424] [INFO ] [MAIN ] SON: Loaded 20324 existing records. [2025-09-05T18:59:48.394559] [INFO ] [MAIN ] SONY: Loaded 25475 existing records. [2025-09-05T18:59:48.410153] [INFO ] [MAIN ] SOR: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:48.435953] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-05T18:59:48.495634] [INFO ] [MAIN ] SOS: Found 1 missing trading days. [2025-09-05T18:59:48.546800] [INFO ] [MAIN ] SOS: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:48.559705] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-05T18:59:48.823790] [INFO ] [MAIN ] SON: Found 1 missing trading days. [2025-09-05T18:59:48.830590] [INFO ] [MAIN ] SON: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:48.830509] [INFO ] [MAIN ] SONY: Found 1 missing trading days. [2025-09-05T18:59:48.830931] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-05T18:59:48.831024] [INFO ] [MAIN ] SONY: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:48.831376] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-05T18:59:49.414234] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T18:59:49.423224] [INFO ] [MAIN ] SOR: Adding 15 new records, updating 0 existing records. [2025-09-05T18:59:49.424602] [INFO ] [MAIN ] SOR: Combined dataset has 1415 total records. [2025-09-05T18:59:49.531316] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T18:59:49.599733] [INFO ] [MAIN ] SOS: Adding 77 new records, updating 0 existing records. [2025-09-05T18:59:49.639540] [WARN ] [VALIDATOR ] SOR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:49.671340] [INFO ] [MAIN ] SOS: Combined dataset has 5154 total records. [2025-09-05T18:59:50.019389] [WARN ] [VALIDATOR ] SOS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:50.221739] [WARN ] [VALIDATOR ] SOS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:50.222104] [INFO ] [MAIN ] SOS: Combined data validation passed. [2025-09-05T18:59:50.221827] [WARN ] [VALIDATOR ] SOR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:50.222370] [INFO ] [MAIN ] SOR: Combined data validation passed. [2025-09-05T18:59:50.255200] [INFO ] [MAIN ] SOR: Update completed successfully. [2025-09-05T18:59:50.258162] [INFO ] [MAIN ] Update Progress: 1961/2363 symbols completed. SOR took 2.9s. Estimated remaining: 12m 15s. Rate: 32.8 symbols/min [2025-09-05T18:59:50.295219] [INFO ] [MAIN ] SOS: Update completed successfully. [2025-09-05T18:59:50.332978] [INFO ] [MAIN ] Update Progress: 1962/2363 symbols completed. SOS took 3.0s. Estimated remaining: 12m 13s. Rate: 32.8 symbols/min [2025-09-05T18:59:50.584922] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:50.598174] [WARN ] [MAIN ] SPB: No existing data found, performing full refresh instead. [2025-09-05T18:59:50.615448] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:50.615764] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-05T18:59:50.616207] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-05T18:59:50.616289] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-05T18:59:50.756672] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-05T18:59:50.851760] [INFO ] [MAIN ] SPCE: Loaded 23904 existing records. [2025-09-05T18:59:51.296793] [INFO ] [MAIN ] SONY: Adding 385 new records, updating 0 existing records. [2025-09-05T18:59:51.312876] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-05T18:59:51.407026] [INFO ] [REMOTE ] SPB: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:59:51.462339] [INFO ] [MAIN ] SPCE: Found 1 missing trading days. [2025-09-05T18:59:51.440609] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-05T18:59:51.469323] [INFO ] [MAIN ] SPCE: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:51.480177] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-05T18:59:51.540823] [INFO ] [MAIN ] SON: Adding 339 new records, updating 0 existing records. [2025-09-05T18:59:51.542238] [INFO ] [MAIN ] SONY: Combined dataset has 25860 total records. [2025-09-05T18:59:51.667997] [INFO ] [MAIN ] SON: Combined dataset has 20663 total records. [2025-09-05T18:59:51.809989] [WARN ] [VALIDATOR ] SONY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:52.179892] [WARN ] [VALIDATOR ] SON: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:52.612747] [WARN ] [VALIDATOR ] SON: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:52.612609] [WARN ] [VALIDATOR ] SONY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:52.613015] [INFO ] [MAIN ] SON: Combined data validation passed. [2025-09-05T18:59:52.613136] [INFO ] [MAIN ] SONY: Combined data validation passed. [2025-09-05T18:59:52.904361] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T18:59:53.057617] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-05T18:59:53.080709] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-05T18:59:53.115482] [INFO ] [MAIN ] SPCE: Adding 359 new records, updating 0 existing records. [2025-09-05T18:59:53.134186] [INFO ] [MAIN ] SPCE: Combined dataset has 24263 total records. [2025-09-05T18:59:53.337870] [WARN ] [VALIDATOR ] SPCE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:53.337975] [INFO ] [MAIN ] SON: Update completed successfully. [2025-09-05T18:59:53.352738] [INFO ] [MAIN ] Update Progress: 1963/2363 symbols completed. SON took 6.0s. Estimated remaining: 12m 11s. Rate: 32.8 symbols/min [2025-09-05T18:59:53.753610] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:53.765621] [INFO ] [MAIN ] SPE: Loaded 2997 existing records. [2025-09-05T18:59:53.816580] [INFO ] [MAIN ] SONY: Update completed successfully. [2025-09-05T18:59:53.844716] [INFO ] [MAIN ] Update Progress: 1964/2363 symbols completed. SONY took 6.5s. Estimated remaining: 12m 9s. Rate: 32.8 symbols/min [2025-09-05T18:59:54.080266] [INFO ] [MAIN ] SPE: Found 1 missing trading days. [2025-09-05T18:59:54.110834] [INFO ] [MAIN ] SPE: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:54.139622] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-05T18:59:54.143230] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:54.157638] [WARN ] [VALIDATOR ] SPCE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:54.157879] [INFO ] [MAIN ] SPCE: Combined data validation passed. [2025-09-05T18:59:54.226808] [INFO ] [MAIN ] SPG: Loaded 23802 existing records. [2025-09-05T18:59:54.454761] [INFO ] [MAIN ] SPG: Found 1 missing trading days. [2025-09-05T18:59:54.456629] [INFO ] [MAIN ] SPG: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:54.457166] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-05T18:59:54.502702] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-05T18:59:54.511107] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-05T18:59:54.545204] [INFO ] [MAIN ] SPCE: Update completed successfully. [2025-09-05T18:59:54.547787] [INFO ] [MAIN ] Update Progress: 1965/2363 symbols completed. SPCE took 4.2s. Estimated remaining: 12m 7s. Rate: 32.8 symbols/min [2025-09-05T18:59:54.720458] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:54.722834] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T18:59:54.741753] [INFO ] [MAIN ] SPE: Adding 52 new records, updating 0 existing records. [2025-09-05T18:59:54.743388] [INFO ] [MAIN ] SPE: Combined dataset has 3049 total records. [2025-09-05T18:59:54.917282] [INFO ] [MAIN ] SPGI: Loaded 21188 existing records. [2025-09-05T18:59:54.968496] [WARN ] [VALIDATOR ] SPE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:55.277805] [INFO ] [MAIN ] SPGI: Found 1 missing trading days. [2025-09-05T18:59:55.296469] [INFO ] [MAIN ] SPGI: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:55.296795] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-05T18:59:55.308188] [WARN ] [VALIDATOR ] SPE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:55.308403] [INFO ] [MAIN ] SPE: Combined data validation passed. [2025-09-05T18:59:55.328882] [INFO ] [MAIN ] SPE: Update completed successfully. [2025-09-05T18:59:55.329516] [INFO ] [MAIN ] Update Progress: 1966/2363 symbols completed. SPE took 2.0s. Estimated remaining: 12m 5s. Rate: 32.8 symbols/min [2025-09-05T18:59:55.522947] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:55.523157] [WARN ] [MAIN ] SPH: No existing data found, performing full refresh instead. [2025-09-05T18:59:55.523290] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-05T18:59:55.523332] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-05T18:59:55.523380] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-05T18:59:55.896775] [INFO ] [REMOTE ] SPH: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T18:59:55.897197] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-05T18:59:55.915698] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-05T18:59:55.922278] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-05T18:59:56.051823] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T18:59:56.206399] [INFO ] [MAIN ] SPG: Adding 377 new records, updating 0 existing records. [2025-09-05T18:59:56.209747] [INFO ] [MAIN ] SPG: Combined dataset has 24179 total records. [2025-09-05T18:59:56.389848] [WARN ] [VALIDATOR ] SPG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:56.586530] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T18:59:56.595578] [WARN ] [VALIDATOR ] SPG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:56.610120] [INFO ] [MAIN ] SPG: Combined data validation passed. [2025-09-05T18:59:56.812558] [INFO ] [MAIN ] SPGI: Adding 333 new records, updating 0 existing records. [2025-09-05T18:59:56.871568] [INFO ] [MAIN ] SPGI: Combined dataset has 21521 total records. [2025-09-05T18:59:56.921867] [INFO ] [MAIN ] SPG: Update completed successfully. [2025-09-05T18:59:56.950754] [INFO ] [MAIN ] Update Progress: 1967/2363 symbols completed. SPG took 3.1s. Estimated remaining: 12m 3s. Rate: 32.8 symbols/min [2025-09-05T18:59:57.178898] [WARN ] [VALIDATOR ] SPGI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:57.313692] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:57.467236] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-05T18:59:57.472730] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-05T18:59:57.481156] [INFO ] [MAIN ] SPHR: Loaded 17758 existing records. [2025-09-05T18:59:57.646497] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-05T18:59:57.705101] [INFO ] [MAIN ] SPHR: Found 1 missing trading days. [2025-09-05T18:59:57.705562] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-05T18:59:57.706107] [INFO ] [MAIN ] SPHR: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:57.706326] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-05T18:59:57.718054] [WARN ] [VALIDATOR ] SPGI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:57.718288] [INFO ] [MAIN ] SPGI: Combined data validation passed. [2025-09-05T18:59:57.866577] [INFO ] [MAIN ] SPGI: Update completed successfully. [2025-09-05T18:59:57.869530] [INFO ] [MAIN ] Update Progress: 1968/2363 symbols completed. SPGI took 3.3s. Estimated remaining: 12m 1s. Rate: 32.9 symbols/min [2025-09-05T18:59:58.055708] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T18:59:58.076788] [INFO ] [MAIN ] SPIR: Loaded 18055 existing records. [2025-09-05T18:59:58.255441] [INFO ] [MAIN ] SPIR: Found 1 missing trading days. [2025-09-05T18:59:58.255830] [INFO ] [MAIN ] SPIR: Need to fetch 1 months: 2025-09 [2025-09-05T18:59:58.256135] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-05T18:59:58.274058] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-05T18:59:58.279993] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-05T18:59:58.921921] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-05T18:59:58.929870] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-05T18:59:59.002996] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T18:59:59.128450] [INFO ] [MAIN ] SPHR: Adding 337 new records, updating 0 existing records. [2025-09-05T18:59:59.132754] [INFO ] [MAIN ] SPHR: Combined dataset has 18095 total records. [2025-09-05T18:59:59.327415] [WARN ] [VALIDATOR ] SPHR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:59.506516] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T18:59:59.636736] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-05T18:59:59.660931] [INFO ] [MAIN ] SPIR: Adding 249 new records, updating 0 existing records. [2025-09-05T18:59:59.668768] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-05T18:59:59.677327] [INFO ] [MAIN ] SPIR: Combined dataset has 18304 total records. [2025-09-05T18:59:59.868627] [WARN ] [VALIDATOR ] SPIR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T18:59:59.902221] [WARN ] [VALIDATOR ] SPHR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T18:59:59.963559] [INFO ] [MAIN ] SPHR: Combined data validation passed. [2025-09-05T19:00:00.189977] [INFO ] [MAIN ] SPHR: Update completed successfully. [2025-09-05T19:00:00.192366] [INFO ] [MAIN ] Update Progress: 1969/2363 symbols completed. SPHR took 3.2s. Estimated remaining: 11m 60s. Rate: 32.8 symbols/min [2025-09-05T19:00:00.377497] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:00.384289] [INFO ] [MAIN ] SPMC: Loaded 2477 existing records. [2025-09-05T19:00:00.517053] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-05T19:00:00.567935] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-05T19:00:00.601259] [INFO ] [MAIN ] SPMC: Found 1 missing trading days. [2025-09-05T19:00:00.602479] [INFO ] [MAIN ] SPMC: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:00.602993] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-05T19:00:00.610037] [WARN ] [VALIDATOR ] SPIR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:00.610241] [INFO ] [MAIN ] SPIR: Combined data validation passed. [2025-09-05T19:00:00.726182] [INFO ] [MAIN ] SPIR: Update completed successfully. [2025-09-05T19:00:00.727956] [INFO ] [MAIN ] Update Progress: 1970/2363 symbols completed. SPIR took 2.9s. Estimated remaining: 11m 58s. Rate: 32.9 symbols/min [2025-09-05T19:00:00.899932] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:00.902341] [INFO ] [MAIN ] SPME: Loaded 610 existing records. [2025-09-05T19:00:01.077430] [INFO ] [MAIN ] SPME: Found 1 missing trading days. [2025-09-05T19:00:01.077604] [INFO ] [MAIN ] SPME: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:01.077946] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-05T19:00:01.089953] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-05T19:00:01.436509] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T19:00:01.452797] [INFO ] [MAIN ] SPMC: Adding 43 new records, updating 0 existing records. [2025-09-05T19:00:01.454822] [INFO ] [MAIN ] SPMC: Combined dataset has 2520 total records. [2025-09-05T19:00:01.481452] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-05T19:00:01.574679] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T19:00:01.589567] [INFO ] [MAIN ] SPME: Adding 14 new records, updating 0 existing records. [2025-09-05T19:00:01.638829] [INFO ] [MAIN ] SPME: Combined dataset has 624 total records. [2025-09-05T19:00:01.730414] [WARN ] [VALIDATOR ] SPMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:02.108908] [WARN ] [VALIDATOR ] SPME: Not fatal, but first date in data (2025-07-18) does not match expected start date (2025-01-31) [2025-09-05T19:00:02.393110] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-05T19:00:02.403085] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-05T19:00:02.421322] [WARN ] [VALIDATOR ] SPMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:02.421415] [WARN ] [VALIDATOR ] SPME: Missing days changed. Total missing: 115 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13, 2025-06-16, 2025-06-17, 2025-06-18, 2025-06-20, 2025-06-23, 2025-06-24, 2025-06-25, 2025-06-26, 2025-06-27, 2025-06-30, 2025-07-01, 2025-07-02, 2025-07-03, 2025-07-07, 2025-07-08, 2025-07-09, 2025-07-10, 2025-07-11, 2025-07-14, 2025-07-15, 2025-07-16, 2025-07-17 [2025-09-05T19:00:02.421773] [INFO ] [MAIN ] SPME: Combined data validation passed. [2025-09-05T19:00:02.421903] [INFO ] [MAIN ] SPMC: Combined data validation passed. [2025-09-05T19:00:02.446738] [INFO ] [MAIN ] SPME: Update completed successfully. [2025-09-05T19:00:02.446504] [INFO ] [MAIN ] SPMC: Update completed successfully. [2025-09-05T19:00:02.447779] [INFO ] [MAIN ] Update Progress: 1971/2363 symbols completed. SPMC took 2.3s. Estimated remaining: 11m 56s. Rate: 32.9 symbols/min [2025-09-05T19:00:02.453553] [INFO ] [MAIN ] Update Progress: 1972/2363 symbols completed. SPME took 1.7s. Estimated remaining: 11m 54s. Rate: 32.9 symbols/min [2025-09-05T19:00:02.845818] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:02.847354] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:02.862909] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-05T19:00:02.898967] [INFO ] [MAIN ] SPOT: Loaded 23973 existing records. [2025-09-05T19:00:02.978441] [INFO ] [MAIN ] SPNT: Loaded 25898 existing records. [2025-09-05T19:00:03.065694] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-05T19:00:03.245778] [INFO ] [MAIN ] SPOT: Found 1 missing trading days. [2025-09-05T19:00:03.251839] [INFO ] [MAIN ] SPOT: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:03.336150] [INFO ] [MAIN ] SPNT: Found 1 missing trading days. [2025-09-05T19:00:03.336382] [INFO ] [MAIN ] SPNT: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:03.667228] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-05T19:00:03.863538] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-05T19:00:04.512783] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-05T19:00:04.663498] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-05T19:00:04.919284] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T19:00:05.027442] [INFO ] [MAIN ] SPNT: Adding 277 new records, updating 0 existing records. [2025-09-05T19:00:05.030599] [INFO ] [MAIN ] SPNT: Combined dataset has 26175 total records. [2025-09-05T19:00:05.209990] [WARN ] [VALIDATOR ] SPNT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:00:05.408637] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-05T19:00:05.424115] [WARN ] [VALIDATOR ] SPNT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:00:05.424377] [INFO ] [MAIN ] SPNT: Combined data validation passed. [2025-09-05T19:00:05.480049] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-05T19:00:05.588710] [INFO ] [MAIN ] SPNT: Update completed successfully. [2025-09-05T19:00:05.591954] [INFO ] [MAIN ] Update Progress: 1973/2363 symbols completed. SPNT took 3.1s. Estimated remaining: 11m 52s. Rate: 32.9 symbols/min [2025-09-05T19:00:05.768465] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:05.792217] [INFO ] [MAIN ] SPR: Loaded 18680 existing records. [2025-09-05T19:00:05.973986] [INFO ] [MAIN ] SPR: Found 1 missing trading days. [2025-09-05T19:00:05.974134] [INFO ] [MAIN ] SPR: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:06.263485] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-05T19:00:07.063510] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-05T19:00:07.611390] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:00:07.779012] [INFO ] [MAIN ] SPR: Adding 280 new records, updating 0 existing records. [2025-09-05T19:00:07.788974] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-05T19:00:07.817125] [INFO ] [MAIN ] SPR: Combined dataset has 18960 total records. [2025-09-05T19:00:07.884365] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-05T19:00:08.053319] [INFO ] [MAIN ] SPOT: Adding 359 new records, updating 0 existing records. [2025-09-05T19:00:08.133610] [WARN ] [VALIDATOR ] SPR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:08.167788] [INFO ] [MAIN ] SPOT: Combined dataset has 24332 total records. [2025-09-05T19:00:08.311082] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T19:00:08.441790] [INFO ] [REMOTE ] SPB: Full fetch complete (37417 records). [2025-09-05T19:00:08.568249] [WARN ] [VALIDATOR ] SPOT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:09.062905] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-05T19:00:09.151702] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-05T19:00:09.171963] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-05T19:00:09.177196] [WARN ] [VALIDATOR ] SPR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:09.177813] [INFO ] [MAIN ] SPR: Combined data validation passed. [2025-09-05T19:00:09.178441] [WARN ] [VALIDATOR ] SPOT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:09.179157] [INFO ] [MAIN ] SPOT: Combined data validation passed. [2025-09-05T19:00:09.576499] [INFO ] [MAIN ] SPOT: Update completed successfully. [2025-09-05T19:00:09.581441] [INFO ] [MAIN ] Update Progress: 1974/2363 symbols completed. SPOT took 7.1s. Estimated remaining: 11m 51s. Rate: 32.8 symbols/min [2025-09-05T19:00:09.818041] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:09.820959] [WARN ] [MAIN ] SPRU: No existing data found, performing full refresh instead. [2025-09-05T19:00:09.823487] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-05T19:00:09.824807] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-05T19:00:09.827142] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-05T19:00:09.894759] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-05T19:00:09.902284] [INFO ] [MAIN ] Update Progress: 1975/2363 symbols completed. SPB took 19.6s. Estimated remaining: 11m 48s. Rate: 32.9 symbols/min [2025-09-05T19:00:10.302854] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:10.309998] [INFO ] [MAIN ] SPR: Update completed successfully. [2025-09-05T19:00:10.323076] [INFO ] [MAIN ] Update Progress: 1976/2363 symbols completed. SPR took 4.7s. Estimated remaining: 11m 46s. Rate: 32.9 symbols/min [2025-09-05T19:00:10.402984] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:00:10.458217] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-05T19:00:10.490962] [INFO ] [MAIN ] SPXC: Loaded 11580 existing records. [2025-09-05T19:00:10.688862] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:10.719417] [WARN ] [MAIN ] SPXX: No existing data found, performing full refresh instead. [2025-09-05T19:00:10.751954] [INFO ] [MAIN ] SPXC: Found 1 missing trading days. [2025-09-05T19:00:10.752237] [INFO ] [MAIN ] SPXC: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:10.752148] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-05T19:00:10.752552] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-05T19:00:10.752326] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-05T19:00:10.753387] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-05T19:00:11.103460] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:00:11.103820] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-05T19:00:11.264323] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-05T19:00:11.373287] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-05T19:00:11.374809] [INFO ] [REMOTE ] SPH: Full fetch complete (21542 records). [2025-09-05T19:00:11.747572] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-05T19:00:11.800266] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-05T19:00:11.845352] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-05T19:00:11.845531] [INFO ] [MAIN ] Update Progress: 1977/2363 symbols completed. SPH took 16.5s. Estimated remaining: 11m 44s. Rate: 32.9 symbols/min [2025-09-05T19:00:11.868590] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-05T19:00:12.025286] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:12.066752] [INFO ] [MAIN ] SQM: Loaded 36563 existing records. [2025-09-05T19:00:12.251373] [INFO ] [MAIN ] SQM: Found 1 missing trading days. [2025-09-05T19:00:12.251551] [INFO ] [MAIN ] SQM: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:12.663485] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-05T19:00:12.790940] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-05T19:00:13.463518] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-05T19:00:13.507708] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-05T19:00:13.952242] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (3.20 seconds). [2025-09-05T19:00:14.016825] [INFO ] [MAIN ] SPXC: Adding 176 new records, updating 0 existing records. [2025-09-05T19:00:14.019143] [INFO ] [MAIN ] SPXC: Combined dataset has 11756 total records. [2025-09-05T19:00:14.196717] [WARN ] [VALIDATOR ] SPXC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:14.267236] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-05T19:00:14.267350] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-05T19:00:14.404241] [WARN ] [VALIDATOR ] SPXC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:14.404471] [INFO ] [MAIN ] SPXC: Combined data validation passed. [2025-09-05T19:00:14.479252] [INFO ] [MAIN ] SPXC: Update completed successfully. [2025-09-05T19:00:14.480790] [INFO ] [MAIN ] Update Progress: 1978/2363 symbols completed. SPXC took 4.6s. Estimated remaining: 11m 43s. Rate: 32.9 symbols/min [2025-09-05T19:00:14.651428] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:14.670500] [INFO ] [MAIN ] SQNS: Loaded 18477 existing records. [2025-09-05T19:00:14.843215] [INFO ] [MAIN ] SQNS: Found 1 missing trading days. [2025-09-05T19:00:14.843388] [INFO ] [MAIN ] SQNS: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:14.867028] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-05T19:00:15.063493] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-05T19:00:15.863475] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-05T19:00:16.414418] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:00:16.551437] [INFO ] [MAIN ] SQNS: Adding 364 new records, updating 0 existing records. [2025-09-05T19:00:16.554462] [INFO ] [MAIN ] SQNS: Combined dataset has 18841 total records. [2025-09-05T19:00:16.668535] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-05T19:00:16.737029] [WARN ] [VALIDATOR ] SQNS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:16.857982] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-05T19:00:16.944013] [WARN ] [VALIDATOR ] SQNS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:16.944237] [INFO ] [MAIN ] SQNS: Combined data validation passed. [2025-09-05T19:00:17.057707] [INFO ] [MAIN ] SQNS: Update completed successfully. [2025-09-05T19:00:17.060208] [INFO ] [MAIN ] Update Progress: 1979/2363 symbols completed. SQNS took 2.6s. Estimated remaining: 11m 41s. Rate: 32.9 symbols/min [2025-09-05T19:00:17.233595] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:17.250569] [INFO ] [MAIN ] SR: Loaded 15810 existing records. [2025-09-05T19:00:17.428191] [INFO ] [MAIN ] SR: Found 1 missing trading days. [2025-09-05T19:00:17.428356] [INFO ] [MAIN ] SR: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:17.463472] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-05T19:00:18.263529] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-05T19:00:18.659990] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T19:00:18.743090] [INFO ] [MAIN ] SR: Adding 186 new records, updating 0 existing records. [2025-09-05T19:00:18.746025] [INFO ] [MAIN ] SR: Combined dataset has 15996 total records. [2025-09-05T19:00:18.880996] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-05T19:00:18.934875] [WARN ] [VALIDATOR ] SR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:19.073745] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-05T19:00:19.125004] [WARN ] [VALIDATOR ] SR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:19.125236] [INFO ] [MAIN ] SR: Combined data validation passed. [2025-09-05T19:00:19.225507] [INFO ] [MAIN ] SR: Update completed successfully. [2025-09-05T19:00:19.227417] [INFO ] [MAIN ] Update Progress: 1980/2363 symbols completed. SR took 2.2s. Estimated remaining: 11m 39s. Rate: 32.9 symbols/min [2025-09-05T19:00:19.398088] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:19.423018] [INFO ] [MAIN ] SRE: Loaded 25411 existing records. [2025-09-05T19:00:19.598512] [INFO ] [MAIN ] SRE: Found 1 missing trading days. [2025-09-05T19:00:19.598666] [INFO ] [MAIN ] SRE: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:19.643822] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-05T19:00:19.863489] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-05T19:00:20.663547] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-05T19:00:21.157506] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-05T19:00:21.231284] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T19:00:21.399942] [INFO ] [MAIN ] SRE: Adding 390 new records, updating 0 existing records. [2025-09-05T19:00:21.403509] [INFO ] [MAIN ] SRE: Combined dataset has 25801 total records. [2025-09-05T19:00:21.468776] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-05T19:00:21.585231] [WARN ] [VALIDATOR ] SRE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:21.671017] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (5.00 seconds). [2025-09-05T19:00:21.947338] [INFO ] [MAIN ] SQM: Adding 369 new records, updating 0 existing records. [2025-09-05T19:00:21.955612] [INFO ] [MAIN ] SQM: Combined dataset has 36932 total records. [2025-09-05T19:00:22.132452] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-05T19:00:22.175743] [WARN ] [VALIDATOR ] SQM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:00:22.269011] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-05T19:00:22.281970] [WARN ] [VALIDATOR ] SRE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:22.303364] [INFO ] [MAIN ] SRE: Combined data validation passed. [2025-09-05T19:00:22.557073] [INFO ] [MAIN ] SRE: Update completed successfully. [2025-09-05T19:00:22.560203] [INFO ] [MAIN ] Update Progress: 1981/2363 symbols completed. SRE took 3.3s. Estimated remaining: 11m 38s. Rate: 32.8 symbols/min [2025-09-05T19:00:22.740710] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:22.742026] [WARN ] [VALIDATOR ] SQM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:00:22.742427] [INFO ] [MAIN ] SQM: Combined data validation passed. [2025-09-05T19:00:22.751384] [INFO ] [MAIN ] SREA: Loaded 7795 existing records. [2025-09-05T19:00:23.055811] [INFO ] [MAIN ] SREA: Found 1 missing trading days. [2025-09-05T19:00:23.096302] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-05T19:00:23.096560] [INFO ] [MAIN ] SREA: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:23.134796] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-05T19:00:23.166678] [INFO ] [MAIN ] SQM: Update completed successfully. [2025-09-05T19:00:23.170598] [INFO ] [MAIN ] Update Progress: 1982/2363 symbols completed. SQM took 11.3s. Estimated remaining: 11m 36s. Rate: 32.9 symbols/min [2025-09-05T19:00:23.352808] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:23.374162] [INFO ] [MAIN ] SRFM: Loaded 22789 existing records. [2025-09-05T19:00:23.565751] [INFO ] [MAIN ] SRFM: Found 1 missing trading days. [2025-09-05T19:00:23.566073] [INFO ] [MAIN ] SRFM: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:23.730272] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-05T19:00:23.863528] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-05T19:00:24.663446] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-05T19:00:24.675079] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-05T19:00:25.432929] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-05T19:00:25.463485] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-05T19:00:26.081155] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-05T19:00:26.263479] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-05T19:00:26.879819] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T19:00:26.902670] [INFO ] [MAIN ] SREA: Adding 54 new records, updating 0 existing records. [2025-09-05T19:00:26.904564] [INFO ] [MAIN ] SREA: Combined dataset has 7849 total records. [2025-09-05T19:00:27.065712] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-05T19:00:27.093374] [WARN ] [VALIDATOR ] SREA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:00:27.282625] [WARN ] [VALIDATOR ] SREA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:00:27.282849] [INFO ] [MAIN ] SREA: Combined data validation passed. [2025-09-05T19:00:27.333322] [INFO ] [MAIN ] SREA: Update completed successfully. [2025-09-05T19:00:27.334384] [INFO ] [MAIN ] Update Progress: 1983/2363 symbols completed. SREA took 4.8s. Estimated remaining: 11m 34s. Rate: 32.8 symbols/min [2025-09-05T19:00:27.506555] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:27.515006] [INFO ] [MAIN ] SRG: Loaded 6188 existing records. [2025-09-05T19:00:27.706947] [INFO ] [MAIN ] SRG: Found 1 missing trading days. [2025-09-05T19:00:27.707086] [INFO ] [MAIN ] SRG: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:27.863440] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-05T19:00:28.017080] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T19:00:28.018314] [INFO ] [REMOTE ] SPRU: Full fetch complete (8164 records). [2025-09-05T19:00:28.390592] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-05T19:00:28.435550] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-05T19:00:28.435831] [INFO ] [MAIN ] Update Progress: 1984/2363 symbols completed. SPRU took 18.9s. Estimated remaining: 11m 32s. Rate: 32.8 symbols/min [2025-09-05T19:00:28.551409] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T19:00:28.626278] [INFO ] [MAIN ] SRG: Adding 148 new records, updating 0 existing records. [2025-09-05T19:00:28.660885] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:28.662846] [INFO ] [MAIN ] SRG: Combined dataset has 6336 total records. [2025-09-05T19:00:28.669709] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-05T19:00:28.787391] [INFO ] [MAIN ] SRI: Loaded 13860 existing records. [2025-09-05T19:00:28.957667] [WARN ] [VALIDATOR ] SRG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:29.188866] [INFO ] [MAIN ] SRI: Found 1 missing trading days. [2025-09-05T19:00:29.227778] [INFO ] [MAIN ] SRI: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:29.269368] [WARN ] [VALIDATOR ] SRG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:29.269607] [INFO ] [MAIN ] SRG: Combined data validation passed. [2025-09-05T19:00:29.307129] [INFO ] [MAIN ] SRG: Update completed successfully. [2025-09-05T19:00:29.308198] [INFO ] [MAIN ] Update Progress: 1985/2363 symbols completed. SRG took 2.0s. Estimated remaining: 11m 30s. Rate: 32.9 symbols/min [2025-09-05T19:00:29.485756] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-05T19:00:29.489292] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:29.490360] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-05T19:00:29.490536] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-05T19:00:29.490595] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-05T19:00:29.490684] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-05T19:00:29.867622] [INFO ] [REMOTE ] SRL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:00:30.263520] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-05T19:00:30.492485] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-05T19:00:30.631275] [INFO ] [MAIN ] SRFM: Adding 364 new records, updating 0 existing records. [2025-09-05T19:00:30.639281] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T19:00:30.752378] [INFO ] [MAIN ] SRFM: Combined dataset has 23153 total records. [2025-09-05T19:00:30.752304] [INFO ] [MAIN ] SRI: Adding 192 new records, updating 0 existing records. [2025-09-05T19:00:30.839277] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T19:00:30.862785] [INFO ] [REMOTE ] SPXX: Full fetch complete (9607 records). [2025-09-05T19:00:30.868194] [INFO ] [MAIN ] SRI: Combined dataset has 14052 total records. [2025-09-05T19:00:31.081209] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-05T19:00:31.030797] [WARN ] [VALIDATOR ] SRFM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:31.421562] [WARN ] [VALIDATOR ] SRI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:31.717573] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-05T19:00:31.879702] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-05T19:00:31.879426] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-05T19:00:31.932150] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-05T19:00:31.934685] [INFO ] [MAIN ] Update Progress: 1986/2363 symbols completed. SPXX took 21.6s. Estimated remaining: 11m 29s. Rate: 32.8 symbols/min [2025-09-05T19:00:32.126434] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:32.137289] [INFO ] [MAIN ] SRV: Loaded 5716 existing records. [2025-09-05T19:00:32.263695] [WARN ] [VALIDATOR ] SRI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:32.263763] [WARN ] [VALIDATOR ] SRFM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:32.323119] [INFO ] [MAIN ] SRI: Combined data validation passed. [2025-09-05T19:00:32.346572] [INFO ] [MAIN ] SRFM: Combined data validation passed. [2025-09-05T19:00:32.346453] [INFO ] [MAIN ] SRV: Found 1 missing trading days. [2025-09-05T19:00:32.346990] [INFO ] [MAIN ] SRV: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:32.495796] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-05T19:00:32.524714] [INFO ] [MAIN ] SRI: Update completed successfully. [2025-09-05T19:00:32.527583] [INFO ] [MAIN ] Update Progress: 1987/2363 symbols completed. SRI took 4.1s. Estimated remaining: 11m 27s. Rate: 32.9 symbols/min [2025-09-05T19:00:32.663904] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-05T19:00:32.718308] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:32.756348] [INFO ] [MAIN ] SRFM: Update completed successfully. [2025-09-05T19:00:32.759338] [INFO ] [MAIN ] Update Progress: 1988/2363 symbols completed. SRFM took 9.6s. Estimated remaining: 11m 25s. Rate: 32.9 symbols/min [2025-09-05T19:00:32.856566] [INFO ] [MAIN ] SSB: Loaded 20535 existing records. [2025-09-05T19:00:33.048275] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:33.067053] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-05T19:00:33.150473] [INFO ] [MAIN ] SSB: Found 1 missing trading days. [2025-09-05T19:00:33.150771] [INFO ] [MAIN ] SSD: Loaded 10949 existing records. [2025-09-05T19:00:33.150903] [INFO ] [MAIN ] SSB: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:33.321562] [INFO ] [MAIN ] SSD: Found 1 missing trading days. [2025-09-05T19:00:33.321718] [INFO ] [MAIN ] SSD: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:33.463444] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-05T19:00:34.263494] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-05T19:00:34.449543] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T19:00:34.511438] [INFO ] [MAIN ] SSD: Adding 168 new records, updating 0 existing records. [2025-09-05T19:00:34.513959] [INFO ] [MAIN ] SSD: Combined dataset has 11117 total records. [2025-09-05T19:00:34.689153] [WARN ] [VALIDATOR ] SSD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:34.878170] [WARN ] [VALIDATOR ] SSD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:34.878388] [INFO ] [MAIN ] SSD: Combined data validation passed. [2025-09-05T19:00:34.949235] [INFO ] [MAIN ] SSD: Update completed successfully. [2025-09-05T19:00:34.950719] [INFO ] [MAIN ] Update Progress: 1989/2363 symbols completed. SSD took 2.2s. Estimated remaining: 11m 23s. Rate: 32.9 symbols/min [2025-09-05T19:00:35.068706] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-05T19:00:35.123783] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:35.153110] [INFO ] [MAIN ] SSL: Loaded 31090 existing records. [2025-09-05T19:00:35.343462] [INFO ] [MAIN ] SSL: Found 1 missing trading days. [2025-09-05T19:00:35.343623] [INFO ] [MAIN ] SSL: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:35.382803] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T19:00:35.514577] [INFO ] [MAIN ] SSB: Adding 352 new records, updating 0 existing records. [2025-09-05T19:00:35.517686] [INFO ] [MAIN ] SSB: Combined dataset has 20887 total records. [2025-09-05T19:00:35.697678] [WARN ] [VALIDATOR ] SSB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:35.868869] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-05T19:00:35.892759] [WARN ] [VALIDATOR ] SSB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:35.893004] [INFO ] [MAIN ] SSB: Combined data validation passed. [2025-09-05T19:00:35.988302] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T19:00:36.012687] [INFO ] [MAIN ] SRV: Adding 41 new records, updating 0 existing records. [2025-09-05T19:00:36.025004] [INFO ] [MAIN ] SRV: Combined dataset has 5757 total records. [2025-09-05T19:00:36.222412] [WARN ] [VALIDATOR ] SRV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:00:36.450738] [INFO ] [MAIN ] SSB: Update completed successfully. [2025-09-05T19:00:36.453934] [INFO ] [MAIN ] Update Progress: 1990/2363 symbols completed. SSB took 3.9s. Estimated remaining: 11m 21s. Rate: 32.9 symbols/min [2025-09-05T19:00:36.631695] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:36.632091] [WARN ] [MAIN ] SST: No existing data found, performing full refresh instead. [2025-09-05T19:00:36.633375] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-05T19:00:36.633594] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-05T19:00:36.633985] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-05T19:00:36.665161] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-05T19:00:37.000888] [INFO ] [REMOTE ] SST: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:00:37.006077] [WARN ] [VALIDATOR ] SRV: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:00:37.006276] [INFO ] [MAIN ] SRV: Combined data validation passed. [2025-09-05T19:00:37.044041] [INFO ] [MAIN ] SRV: Update completed successfully. [2025-09-05T19:00:37.045005] [INFO ] [MAIN ] Update Progress: 1991/2363 symbols completed. SRV took 5.1s. Estimated remaining: 11m 19s. Rate: 32.9 symbols/min [2025-09-05T19:00:37.152791] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-05T19:00:37.227321] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:37.239972] [INFO ] [MAIN ] SSTK: Loaded 11650 existing records. [2025-09-05T19:00:37.414073] [INFO ] [MAIN ] SSTK: Found 1 missing trading days. [2025-09-05T19:00:37.414308] [INFO ] [MAIN ] SSTK: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:37.463459] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-05T19:00:37.484433] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-05T19:00:37.612034] [INFO ] [MAIN ] SSL: Adding 320 new records, updating 0 existing records. [2025-09-05T19:00:37.615555] [INFO ] [MAIN ] SSL: Combined dataset has 31410 total records. [2025-09-05T19:00:37.797298] [WARN ] [VALIDATOR ] SSL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:00:38.001823] [WARN ] [VALIDATOR ] SSL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:00:38.002047] [INFO ] [MAIN ] SSL: Combined data validation passed. [2025-09-05T19:00:38.187413] [INFO ] [MAIN ] SSL: Update completed successfully. [2025-09-05T19:00:38.190984] [INFO ] [MAIN ] Update Progress: 1992/2363 symbols completed. SSL took 3.2s. Estimated remaining: 11m 17s. Rate: 32.9 symbols/min [2025-09-05T19:00:38.268750] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-05T19:00:38.372896] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:38.411389] [INFO ] [MAIN ] ST: Loaded 37473 existing records. [2025-09-05T19:00:38.592182] [INFO ] [MAIN ] ST: Found 1 missing trading days. [2025-09-05T19:00:38.592359] [INFO ] [MAIN ] ST: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:38.644803] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T19:00:38.721721] [INFO ] [MAIN ] SSTK: Adding 176 new records, updating 0 existing records. [2025-09-05T19:00:38.725090] [INFO ] [MAIN ] SSTK: Combined dataset has 11826 total records. [2025-09-05T19:00:38.929869] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-05T19:00:38.934451] [WARN ] [VALIDATOR ] SSTK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:39.068714] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-05T19:00:39.169190] [WARN ] [VALIDATOR ] SSTK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:39.169537] [INFO ] [MAIN ] SSTK: Combined data validation passed. [2025-09-05T19:00:39.257914] [INFO ] [MAIN ] SSTK: Update completed successfully. [2025-09-05T19:00:39.260680] [INFO ] [MAIN ] Update Progress: 1993/2363 symbols completed. SSTK took 2.2s. Estimated remaining: 11m 15s. Rate: 32.9 symbols/min [2025-09-05T19:00:39.439103] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:39.468560] [INFO ] [MAIN ] STAG: Loaded 23573 existing records. [2025-09-05T19:00:39.657585] [INFO ] [MAIN ] STAG: Found 1 missing trading days. [2025-09-05T19:00:39.657895] [INFO ] [MAIN ] STAG: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:39.863463] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-05T19:00:40.234224] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-05T19:00:40.658248] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T19:00:40.669686] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-05T19:00:40.826704] [INFO ] [MAIN ] ST: Adding 377 new records, updating 0 existing records. [2025-09-05T19:00:40.834180] [INFO ] [MAIN ] ST: Combined dataset has 37850 total records. [2025-09-05T19:00:41.023212] [WARN ] [VALIDATOR ] ST: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:00:41.236173] [WARN ] [VALIDATOR ] ST: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:00:41.236452] [INFO ] [MAIN ] ST: Combined data validation passed. [2025-09-05T19:00:41.468674] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-05T19:00:41.480193] [INFO ] [MAIN ] ST: Update completed successfully. [2025-09-05T19:00:41.486176] [INFO ] [MAIN ] Update Progress: 1994/2363 symbols completed. ST took 3.3s. Estimated remaining: 11m 13s. Rate: 32.9 symbols/min [2025-09-05T19:00:41.676564] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:41.693197] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-05T19:00:41.706362] [INFO ] [MAIN ] STC: Loaded 8661 existing records. [2025-09-05T19:00:41.882177] [INFO ] [MAIN ] STC: Found 1 missing trading days. [2025-09-05T19:00:41.882355] [INFO ] [MAIN ] STC: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:42.263525] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-05T19:00:43.059006] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T19:00:43.070925] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-05T19:00:43.185562] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T19:00:43.223245] [INFO ] [MAIN ] STAG: Adding 383 new records, updating 0 existing records. [2025-09-05T19:00:43.253596] [INFO ] [MAIN ] STC: Adding 130 new records, updating 0 existing records. [2025-09-05T19:00:43.257920] [INFO ] [MAIN ] STC: Combined dataset has 8791 total records. [2025-09-05T19:00:43.378351] [INFO ] [MAIN ] STAG: Combined dataset has 23956 total records. [2025-09-05T19:00:43.455074] [WARN ] [VALIDATOR ] STC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:43.562786] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-05T19:00:43.794849] [WARN ] [VALIDATOR ] STAG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:43.884799] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-05T19:00:44.047070] [WARN ] [VALIDATOR ] STC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:44.047163] [WARN ] [VALIDATOR ] STAG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:44.047411] [INFO ] [MAIN ] STC: Combined data validation passed. [2025-09-05T19:00:44.047523] [INFO ] [MAIN ] STAG: Combined data validation passed. [2025-09-05T19:00:44.207155] [INFO ] [MAIN ] STC: Update completed successfully. [2025-09-05T19:00:44.220304] [INFO ] [MAIN ] Update Progress: 1995/2363 symbols completed. STC took 2.7s. Estimated remaining: 11m 12s. Rate: 32.9 symbols/min [2025-09-05T19:00:44.363141] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-05T19:00:44.388473] [INFO ] [MAIN ] STAG: Update completed successfully. [2025-09-05T19:00:44.420480] [INFO ] [MAIN ] Update Progress: 1996/2363 symbols completed. STAG took 5.2s. Estimated remaining: 11m 9s. Rate: 32.9 symbols/min [2025-09-05T19:00:44.491701] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:44.624816] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:44.632485] [INFO ] [MAIN ] STE: Loaded 16584 existing records. [2025-09-05T19:00:44.664207] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-05T19:00:44.747021] [INFO ] [MAIN ] STEL: Loaded 10875 existing records. [2025-09-05T19:00:44.932764] [INFO ] [MAIN ] STE: Found 1 missing trading days. [2025-09-05T19:00:44.938674] [INFO ] [MAIN ] STE: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:45.005621] [INFO ] [MAIN ] STEL: Found 1 missing trading days. [2025-09-05T19:00:45.005812] [INFO ] [MAIN ] STEL: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:45.463465] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-05T19:00:45.667013] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-05T19:00:46.263470] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-05T19:00:46.668698] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T19:00:46.723409] [INFO ] [MAIN ] STEL: Adding 122 new records, updating 0 existing records. [2025-09-05T19:00:46.725772] [INFO ] [MAIN ] STEL: Combined dataset has 10997 total records. [2025-09-05T19:00:46.929997] [WARN ] [VALIDATOR ] STEL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:47.068544] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-05T19:00:47.145175] [WARN ] [VALIDATOR ] STEL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:47.145393] [INFO ] [MAIN ] STEL: Combined data validation passed. [2025-09-05T19:00:47.211878] [INFO ] [MAIN ] STEL: Update completed successfully. [2025-09-05T19:00:47.213353] [INFO ] [MAIN ] Update Progress: 1997/2363 symbols completed. STEL took 2.8s. Estimated remaining: 11m 8s. Rate: 32.9 symbols/min [2025-09-05T19:00:47.334852] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-05T19:00:47.863473] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-05T19:00:48.530139] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T19:00:48.628513] [INFO ] [MAIN ] STE: Adding 214 new records, updating 0 existing records. [2025-09-05T19:00:48.631279] [INFO ] [MAIN ] STE: Combined dataset has 16798 total records. [2025-09-05T19:00:48.668544] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-05T19:00:48.820167] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-05T19:00:48.844059] [WARN ] [VALIDATOR ] STE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:49.038111] [WARN ] [VALIDATOR ] STE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:49.038323] [INFO ] [MAIN ] STE: Combined data validation passed. [2025-09-05T19:00:49.158474] [INFO ] [MAIN ] STE: Update completed successfully. [2025-09-05T19:00:49.160624] [INFO ] [MAIN ] Update Progress: 1998/2363 symbols completed. STE took 4.9s. Estimated remaining: 11m 6s. Rate: 32.9 symbols/min [2025-09-05T19:00:49.350362] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T19:00:49.351101] [INFO ] [REMOTE ] SRL: Full fetch complete (1145 records). [2025-09-05T19:00:49.465318] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-05T19:00:49.752922] [WARN ] [VALIDATOR ] SRL: Missing days changed. Total missing: 4 New missing: 2025-09-04 All missing: 2025-05-30, 2025-06-03, 2025-08-05, 2025-09-04 [2025-09-05T19:00:49.753168] [INFO ] [MAIN ] SRL: Fetched primary data is valid. [2025-09-05T19:00:49.759343] [INFO ] [MAIN ] SRL: Full history saved. [2025-09-05T19:00:49.759424] [INFO ] [MAIN ] Update Progress: 1999/2363 symbols completed. SRL took 20.5s. Estimated remaining: 11m 4s. Rate: 32.9 symbols/min [2025-09-05T19:00:50.351815] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-05T19:00:50.354855] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-05T19:00:51.806884] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-05T19:00:51.813794] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-05T19:00:52.545521] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-05T19:00:52.549122] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-05T19:00:53.217729] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-05T19:00:53.220544] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-05T19:00:53.835556] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T19:00:53.836851] [INFO ] [REMOTE ] SST: Full fetch complete (13968 records). [2025-09-05T19:00:54.196207] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-05T19:00:54.258236] [INFO ] [MAIN ] SST: Full history saved. [2025-09-05T19:00:54.258407] [INFO ] [MAIN ] Update Progress: 2000/2363 symbols completed. SST took 17.8s. Estimated remaining: 11m 3s. Rate: 32.9 symbols/min [2025-09-05T19:00:54.832416] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:54.921886] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:54.950115] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:54.976676] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:54.985526] [INFO ] [MAIN ] STK: Loaded 4014 existing records. [2025-09-05T19:00:54.990916] [INFO ] [MAIN ] STG: Loaded 1795 existing records. [2025-09-05T19:00:54.991319] [INFO ] [MAIN ] STEW: Loaded 6750 existing records. [2025-09-05T19:00:55.255932] [INFO ] [MAIN ] STEM: Loaded 17215 existing records. [2025-09-05T19:00:55.541924] [INFO ] [MAIN ] STK: Found 1 missing trading days. [2025-09-05T19:00:55.610229] [INFO ] [MAIN ] STEW: Found 1 missing trading days. [2025-09-05T19:00:55.623618] [INFO ] [MAIN ] STK: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:55.629494] [INFO ] [MAIN ] STEW: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:55.653752] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-05T19:00:55.647715] [INFO ] [MAIN ] STG: Found 1 missing trading days. [2025-09-05T19:00:55.664435] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-05T19:00:55.659102] [INFO ] [MAIN ] STG: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:55.691003] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-05T19:00:55.725482] [INFO ] [MAIN ] STEM: Found 1 missing trading days. [2025-09-05T19:00:55.725662] [INFO ] [MAIN ] STEM: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:55.863534] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-05T19:00:56.192022] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T19:00:56.200404] [INFO ] [MAIN ] STG: Adding 16 new records, updating 0 existing records. [2025-09-05T19:00:56.201904] [INFO ] [MAIN ] STG: Combined dataset has 1811 total records. [2025-09-05T19:00:56.360792] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-05T19:00:56.429451] [INFO ] [MAIN ] STK: Adding 58 new records, updating 0 existing records. [2025-09-05T19:00:56.422159] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T19:00:56.433191] [WARN ] [VALIDATOR ] STG: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:00:56.480395] [INFO ] [MAIN ] STK: Combined dataset has 4072 total records. [2025-09-05T19:00:56.522589] [INFO ] [MAIN ] STEW: Adding 82 new records, updating 0 existing records. [2025-09-05T19:00:56.671146] [INFO ] [MAIN ] STEW: Combined dataset has 6832 total records. [2025-09-05T19:00:56.960112] [WARN ] [VALIDATOR ] STK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:57.073662] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T19:00:57.165501] [WARN ] [VALIDATOR ] STEW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:57.356494] [INFO ] [MAIN ] STEM: Adding 129 new records, updating 0 existing records. [2025-09-05T19:00:57.513570] [INFO ] [MAIN ] STEM: Combined dataset has 17344 total records. [2025-09-05T19:00:57.707976] [WARN ] [VALIDATOR ] STEM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:00:57.772324] [WARN ] [VALIDATOR ] STK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:57.772412] [WARN ] [VALIDATOR ] STEW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:57.782122] [INFO ] [MAIN ] STK: Combined data validation passed. [2025-09-05T19:00:57.796389] [INFO ] [MAIN ] STEW: Combined data validation passed. [2025-09-05T19:00:57.782016] [WARN ] [VALIDATOR ] STG: Missing days changed. Total missing: 54 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-22, 2025-04-30, 2025-05-20, 2025-05-23, 2025-06-17, 2025-06-25 [2025-09-05T19:00:57.818097] [INFO ] [MAIN ] STG: Combined data validation passed. [2025-09-05T19:00:57.945543] [INFO ] [MAIN ] STG: Update completed successfully. [2025-09-05T19:00:57.967698] [INFO ] [MAIN ] Update Progress: 2001/2363 symbols completed. STG took 3.7s. Estimated remaining: 11m 1s. Rate: 32.9 symbols/min [2025-09-05T19:00:58.042525] [INFO ] [MAIN ] STK: Update completed successfully. [2025-09-05T19:00:58.072396] [INFO ] [MAIN ] STEW: Update completed successfully. [2025-09-05T19:00:58.073569] [INFO ] [MAIN ] Update Progress: 2002/2363 symbols completed. STEW took 3.8s. Estimated remaining: 10m 59s. Rate: 32.9 symbols/min [2025-09-05T19:00:58.093013] [INFO ] [MAIN ] Update Progress: 2003/2363 symbols completed. STK took 3.8s. Estimated remaining: 10m 57s. Rate: 32.9 symbols/min [2025-09-05T19:00:58.361026] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:58.492721] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:58.539397] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:58.562702] [INFO ] [MAIN ] STLA: Loaded 25564 existing records. [2025-09-05T19:00:58.686599] [INFO ] [MAIN ] STN: Loaded 17475 existing records. [2025-09-05T19:00:58.763525] [INFO ] [MAIN ] STM: Loaded 25549 existing records. [2025-09-05T19:00:58.908829] [WARN ] [VALIDATOR ] STEM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:00:58.984198] [INFO ] [MAIN ] STEM: Combined data validation passed. [2025-09-05T19:00:58.975229] [INFO ] [MAIN ] STLA: Found 1 missing trading days. [2025-09-05T19:00:59.011431] [INFO ] [MAIN ] STLA: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:59.039690] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-05T19:00:59.217081] [INFO ] [MAIN ] STN: Found 1 missing trading days. [2025-09-05T19:00:59.258905] [INFO ] [MAIN ] STN: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:59.312085] [INFO ] [MAIN ] STEM: Update completed successfully. [2025-09-05T19:00:59.322872] [INFO ] [MAIN ] Update Progress: 2004/2363 symbols completed. STEM took 5.1s. Estimated remaining: 10m 55s. Rate: 32.9 symbols/min [2025-09-05T19:00:59.319240] [INFO ] [MAIN ] STM: Found 1 missing trading days. [2025-09-05T19:00:59.323696] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-05T19:00:59.324101] [INFO ] [MAIN ] STM: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:59.324802] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-05T19:00:59.516484] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:00:59.540468] [INFO ] [MAIN ] STNG: Loaded 21233 existing records. [2025-09-05T19:00:59.719943] [INFO ] [MAIN ] STNG: Found 1 missing trading days. [2025-09-05T19:00:59.720178] [INFO ] [MAIN ] STNG: Need to fetch 1 months: 2025-09 [2025-09-05T19:00:59.720453] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-05T19:01:00.431726] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T19:01:00.497235] [INFO ] [MAIN ] STN: Adding 161 new records, updating 0 existing records. [2025-09-05T19:01:00.499992] [INFO ] [MAIN ] STN: Combined dataset has 17636 total records. [2025-09-05T19:01:00.683025] [WARN ] [VALIDATOR ] STN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:01:00.873037] [WARN ] [VALIDATOR ] STN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:01:00.873248] [INFO ] [MAIN ] STN: Combined data validation passed. [2025-09-05T19:01:00.990714] [INFO ] [MAIN ] STN: Update completed successfully. [2025-09-05T19:01:00.992556] [INFO ] [MAIN ] Update Progress: 2005/2363 symbols completed. STN took 2.8s. Estimated remaining: 10m 53s. Rate: 32.9 symbols/min [2025-09-05T19:01:01.167007] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:01.175042] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-05T19:01:01.221417] [INFO ] [MAIN ] STRV: Loaded 4743 existing records. [2025-09-05T19:01:01.478255] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-05T19:01:01.485697] [INFO ] [MAIN ] STLA: Adding 388 new records, updating 0 existing records. [2025-09-05T19:01:01.706902] [INFO ] [MAIN ] STRV: Found 1 missing trading days. [2025-09-05T19:01:01.720121] [INFO ] [MAIN ] STLA: Combined dataset has 25952 total records. [2025-09-05T19:01:01.726625] [INFO ] [MAIN ] STRV: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:01.721184] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-05T19:01:01.733390] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-05T19:01:01.861732] [INFO ] [MAIN ] STNG: Adding 305 new records, updating 0 existing records. [2025-09-05T19:01:02.076565] [INFO ] [MAIN ] STNG: Combined dataset has 21538 total records. [2025-09-05T19:01:02.088750] [INFO ] [MAIN ] STM: Adding 390 new records, updating 0 existing records. [2025-09-05T19:01:02.257928] [WARN ] [VALIDATOR ] STLA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:02.265569] [INFO ] [MAIN ] STM: Combined dataset has 25939 total records. [2025-09-05T19:01:02.593798] [WARN ] [VALIDATOR ] STNG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:02.661261] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T19:01:02.784786] [WARN ] [VALIDATOR ] STM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:02.852190] [INFO ] [MAIN ] STRV: Adding 45 new records, updating 0 existing records. [2025-09-05T19:01:03.054912] [INFO ] [MAIN ] STRV: Combined dataset has 4788 total records. [2025-09-05T19:01:03.397111] [WARN ] [VALIDATOR ] STRV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:03.610675] [WARN ] [VALIDATOR ] STLA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:03.611124] [INFO ] [MAIN ] STLA: Combined data validation passed. [2025-09-05T19:01:03.610864] [WARN ] [VALIDATOR ] STNG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:03.610749] [WARN ] [VALIDATOR ] STM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:03.611709] [INFO ] [MAIN ] STM: Combined data validation passed. [2025-09-05T19:01:03.612020] [INFO ] [MAIN ] STNG: Combined data validation passed. [2025-09-05T19:01:04.017143] [INFO ] [MAIN ] STLA: Update completed successfully. [2025-09-05T19:01:04.023168] [INFO ] [MAIN ] Update Progress: 2006/2363 symbols completed. STLA took 6.0s. Estimated remaining: 10m 51s. Rate: 32.9 symbols/min [2025-09-05T19:01:04.136083] [WARN ] [VALIDATOR ] STRV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:04.138836] [INFO ] [MAIN ] STRV: Combined data validation passed. [2025-09-05T19:01:04.279784] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:04.291518] [INFO ] [MAIN ] STNG: Update completed successfully. [2025-09-05T19:01:04.295093] [INFO ] [MAIN ] Update Progress: 2007/2363 symbols completed. STNG took 5.0s. Estimated remaining: 10m 49s. Rate: 32.9 symbols/min [2025-09-05T19:01:04.425969] [INFO ] [MAIN ] STRV: Update completed successfully. [2025-09-05T19:01:04.437468] [INFO ] [MAIN ] Update Progress: 2008/2363 symbols completed. STRV took 3.4s. Estimated remaining: 10m 47s. Rate: 32.9 symbols/min [2025-09-05T19:01:04.536221] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:04.581046] [INFO ] [MAIN ] STT: Loaded 24106 existing records. [2025-09-05T19:01:04.580034] [INFO ] [MAIN ] STM: Update completed successfully. [2025-09-05T19:01:04.608723] [INFO ] [MAIN ] Update Progress: 2009/2363 symbols completed. STM took 6.5s. Estimated remaining: 10m 45s. Rate: 32.9 symbols/min [2025-09-05T19:01:04.813214] [INFO ] [MAIN ] STVN: Loaded 12935 existing records. [2025-09-05T19:01:04.867674] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:05.028730] [INFO ] [MAIN ] STT: Found 1 missing trading days. [2025-09-05T19:01:05.039858] [INFO ] [MAIN ] STT: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:05.051499] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-05T19:01:05.143575] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:05.229324] [INFO ] [MAIN ] STVN: Found 1 missing trading days. [2025-09-05T19:01:05.231165] [INFO ] [MAIN ] STXD: Loaded 474 existing records. [2025-09-05T19:01:05.232104] [INFO ] [MAIN ] STVN: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:05.268486] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-05T19:01:05.333464] [INFO ] [MAIN ] STWD: Loaded 24608 existing records. [2025-09-05T19:01:05.540976] [INFO ] [MAIN ] STXD: Found 1 missing trading days. [2025-09-05T19:01:05.575963] [INFO ] [MAIN ] STXD: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:05.597218] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-05T19:01:05.606541] [INFO ] [MAIN ] STWD: Found 1 missing trading days. [2025-09-05T19:01:05.606697] [INFO ] [MAIN ] STWD: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:05.606926] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-05T19:01:06.222726] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T19:01:06.225831] [INFO ] [MAIN ] STXD: Adding 2 new records, updating 0 existing records. [2025-09-05T19:01:06.226992] [INFO ] [MAIN ] STXD: Combined dataset has 476 total records. [2025-09-05T19:01:06.386402] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T19:01:06.434351] [WARN ] [VALIDATOR ] STXD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:06.662206] [INFO ] [MAIN ] STVN: Adding 211 new records, updating 0 existing records. [2025-09-05T19:01:06.714489] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-05T19:01:06.713487] [INFO ] [MAIN ] STVN: Combined dataset has 13146 total records. [2025-09-05T19:01:06.975105] [INFO ] [MAIN ] STT: Adding 388 new records, updating 0 existing records. [2025-09-05T19:01:07.043540] [WARN ] [VALIDATOR ] STVN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:07.114292] [INFO ] [MAIN ] STT: Combined dataset has 24494 total records. [2025-09-05T19:01:07.450538] [WARN ] [VALIDATOR ] STT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:07.452300] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-05T19:01:07.962927] [INFO ] [MAIN ] STWD: Adding 369 new records, updating 0 existing records. [2025-09-05T19:01:08.056634] [WARN ] [VALIDATOR ] STVN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:08.058268] [INFO ] [MAIN ] STWD: Combined dataset has 24977 total records. [2025-09-05T19:01:08.058145] [INFO ] [MAIN ] STVN: Combined data validation passed. [2025-09-05T19:01:08.056489] [WARN ] [VALIDATOR ] STXD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:08.060902] [INFO ] [MAIN ] STXD: Combined data validation passed. [2025-09-05T19:01:08.147520] [INFO ] [MAIN ] STXD: Update completed successfully. [2025-09-05T19:01:08.149000] [INFO ] [MAIN ] Update Progress: 2010/2363 symbols completed. STXD took 3.5s. Estimated remaining: 10m 44s. Rate: 32.9 symbols/min [2025-09-05T19:01:08.627339] [WARN ] [VALIDATOR ] STWD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:08.731600] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:08.759236] [INFO ] [MAIN ] STVN: Update completed successfully. [2025-09-05T19:01:08.791028] [INFO ] [MAIN ] STXE: Loaded 898 existing records. [2025-09-05T19:01:08.793487] [INFO ] [MAIN ] Update Progress: 2011/2363 symbols completed. STVN took 4.5s. Estimated remaining: 10m 42s. Rate: 32.9 symbols/min [2025-09-05T19:01:09.292729] [INFO ] [MAIN ] STXE: Found 1 missing trading days. [2025-09-05T19:01:09.314017] [INFO ] [MAIN ] STXE: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:09.321952] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-05T19:01:09.348402] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:09.351844] [WARN ] [VALIDATOR ] STT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:09.352316] [INFO ] [MAIN ] STT: Combined data validation passed. [2025-09-05T19:01:09.354891] [INFO ] [MAIN ] STXG: Loaded 885 existing records. [2025-09-05T19:01:09.641323] [INFO ] [MAIN ] STXG: Found 1 missing trading days. [2025-09-05T19:01:09.642790] [INFO ] [MAIN ] STXG: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:09.645372] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-05T19:01:09.661548] [WARN ] [VALIDATOR ] STWD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:09.663145] [INFO ] [MAIN ] STWD: Combined data validation passed. [2025-09-05T19:01:09.798726] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-05T19:01:09.804670] [INFO ] [MAIN ] STXE: Adding 7 new records, updating 0 existing records. [2025-09-05T19:01:09.807808] [INFO ] [MAIN ] STXE: Combined dataset has 905 total records. [2025-09-05T19:01:10.005454] [INFO ] [MAIN ] STT: Update completed successfully. [2025-09-05T19:01:10.038401] [INFO ] [MAIN ] Update Progress: 2012/2363 symbols completed. STT took 6.0s. Estimated remaining: 10m 40s. Rate: 32.9 symbols/min [2025-09-05T19:01:10.042596] [WARN ] [VALIDATOR ] STXE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:10.196514] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T19:01:10.252759] [INFO ] [MAIN ] STXG: Adding 9 new records, updating 0 existing records. [2025-09-05T19:01:10.373542] [INFO ] [MAIN ] STXG: Combined dataset has 894 total records. [2025-09-05T19:01:10.514933] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:10.621877] [INFO ] [MAIN ] STXK: Loaded 606 existing records. [2025-09-05T19:01:10.644668] [WARN ] [VALIDATOR ] STXG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:11.031543] [INFO ] [MAIN ] STXK: Found 1 missing trading days. [2025-09-05T19:01:11.033080] [INFO ] [MAIN ] STXK: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:11.035204] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-05T19:01:11.044322] [WARN ] [VALIDATOR ] STXE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:11.046004] [INFO ] [MAIN ] STXE: Combined data validation passed. [2025-09-05T19:01:11.055331] [INFO ] [MAIN ] STXE: Update completed successfully. [2025-09-05T19:01:11.055691] [INFO ] [MAIN ] Update Progress: 2013/2363 symbols completed. STXE took 2.9s. Estimated remaining: 10m 38s. Rate: 32.9 symbols/min [2025-09-05T19:01:11.053904] [INFO ] [MAIN ] STWD: Update completed successfully. [2025-09-05T19:01:11.059120] [INFO ] [MAIN ] Update Progress: 2014/2363 symbols completed. STWD took 6.6s. Estimated remaining: 10m 35s. Rate: 33.0 symbols/min [2025-09-05T19:01:11.400082] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:11.417198] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:11.420278] [INFO ] [MAIN ] STXM: Loaded 374 existing records. [2025-09-05T19:01:11.466432] [INFO ] [MAIN ] STXT: Loaded 1287 existing records. [2025-09-05T19:01:11.630711] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T19:01:11.675629] [INFO ] [MAIN ] STXK: Adding 9 new records, updating 0 existing records. [2025-09-05T19:01:11.708275] [INFO ] [MAIN ] STXM: Found 1 missing trading days. [2025-09-05T19:01:11.720724] [INFO ] [MAIN ] STXK: Combined dataset has 615 total records. [2025-09-05T19:01:11.720061] [INFO ] [MAIN ] STXM: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:11.738332] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-05T19:01:11.732959] [WARN ] [VALIDATOR ] STXG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:11.823414] [INFO ] [MAIN ] STXG: Combined data validation passed. [2025-09-05T19:01:11.870418] [INFO ] [MAIN ] STXT: Found 1 missing trading days. [2025-09-05T19:01:11.888860] [INFO ] [MAIN ] STXT: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:11.889114] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-05T19:01:11.936666] [INFO ] [MAIN ] STXG: Update completed successfully. [2025-09-05T19:01:11.954777] [INFO ] [MAIN ] Update Progress: 2015/2363 symbols completed. STXG took 3.1s. Estimated remaining: 10m 34s. Rate: 33.0 symbols/min [2025-09-05T19:01:11.975762] [WARN ] [VALIDATOR ] STXK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:12.340720] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-05T19:01:12.340573] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:12.345247] [INFO ] [MAIN ] STXM: Adding 11 new records, updating 0 existing records. [2025-09-05T19:01:12.347502] [INFO ] [MAIN ] STXM: Combined dataset has 385 total records. [2025-09-05T19:01:12.418425] [INFO ] [MAIN ] STXV: Loaded 687 existing records. [2025-09-05T19:01:12.512796] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T19:01:12.603300] [INFO ] [MAIN ] STXT: Adding 16 new records, updating 0 existing records. [2025-09-05T19:01:12.686444] [INFO ] [MAIN ] STXT: Combined dataset has 1303 total records. [2025-09-05T19:01:12.695920] [WARN ] [VALIDATOR ] STXM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:12.852694] [INFO ] [MAIN ] STXV: Found 1 missing trading days. [2025-09-05T19:01:12.873575] [INFO ] [MAIN ] STXV: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:12.908770] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-05T19:01:13.124705] [WARN ] [VALIDATOR ] STXT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:13.332731] [WARN ] [VALIDATOR ] STXT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:13.333900] [INFO ] [MAIN ] STXT: Combined data validation passed. [2025-09-05T19:01:13.332806] [WARN ] [VALIDATOR ] STXK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:13.334788] [INFO ] [MAIN ] STXK: Combined data validation passed. [2025-09-05T19:01:13.333713] [WARN ] [VALIDATOR ] STXM: Missing days changed. Total missing: 84 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-17 [2025-09-05T19:01:13.342405] [INFO ] [MAIN ] STXM: Combined data validation passed. [2025-09-05T19:01:13.347892] [INFO ] [MAIN ] STXK: Update completed successfully. [2025-09-05T19:01:13.351633] [INFO ] [MAIN ] Update Progress: 2016/2363 symbols completed. STXK took 3.3s. Estimated remaining: 10m 32s. Rate: 33.0 symbols/min [2025-09-05T19:01:13.352018] [INFO ] [MAIN ] STXM: Update completed successfully. [2025-09-05T19:01:13.352520] [INFO ] [MAIN ] STXT: Update completed successfully. [2025-09-05T19:01:13.352710] [INFO ] [MAIN ] Update Progress: 2017/2363 symbols completed. STXM took 2.3s. Estimated remaining: 10m 29s. Rate: 33.0 symbols/min [2025-09-05T19:01:13.410702] [INFO ] [MAIN ] Update Progress: 2018/2363 symbols completed. STXT took 2.3s. Estimated remaining: 10m 27s. Rate: 33.0 symbols/min [2025-09-05T19:01:13.429770] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T19:01:13.542275] [INFO ] [MAIN ] STXV: Adding 9 new records, updating 0 existing records. [2025-09-05T19:01:13.669678] [INFO ] [MAIN ] STXV: Combined dataset has 696 total records. [2025-09-05T19:01:13.905261] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:13.966708] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:13.998519] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:14.087789] [WARN ] [VALIDATOR ] STXV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:14.231172] [INFO ] [MAIN ] SU: Loaded 25470 existing records. [2025-09-05T19:01:14.387493] [INFO ] [MAIN ] SUI: Loaded 20791 existing records. [2025-09-05T19:01:14.403692] [INFO ] [MAIN ] STZ: Loaded 25029 existing records. [2025-09-05T19:01:14.667442] [INFO ] [MAIN ] SU: Found 1 missing trading days. [2025-09-05T19:01:14.681443] [INFO ] [MAIN ] SU: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:14.708044] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-05T19:01:14.862668] [INFO ] [MAIN ] SUI: Found 1 missing trading days. [2025-09-05T19:01:14.871261] [INFO ] [MAIN ] STZ: Found 1 missing trading days. [2025-09-05T19:01:14.871395] [INFO ] [MAIN ] SUI: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:14.871892] [INFO ] [MAIN ] STZ: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:14.871741] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-05T19:01:14.872873] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-05T19:01:14.891166] [WARN ] [VALIDATOR ] STXV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:14.891354] [INFO ] [MAIN ] STXV: Combined data validation passed. [2025-09-05T19:01:14.897192] [INFO ] [MAIN ] STXV: Update completed successfully. [2025-09-05T19:01:14.897482] [INFO ] [MAIN ] Update Progress: 2019/2363 symbols completed. STXV took 2.9s. Estimated remaining: 10m 25s. Rate: 33.0 symbols/min [2025-09-05T19:01:15.066087] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:15.089848] [INFO ] [MAIN ] SUN: Loaded 18688 existing records. [2025-09-05T19:01:15.265204] [INFO ] [MAIN ] SUN: Found 1 missing trading days. [2025-09-05T19:01:15.265385] [INFO ] [MAIN ] SUN: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:15.265605] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-05T19:01:16.415595] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-05T19:01:16.568186] [INFO ] [MAIN ] SU: Adding 386 new records, updating 0 existing records. [2025-09-05T19:01:16.578065] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-05T19:01:16.619137] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:01:16.672164] [INFO ] [MAIN ] SU: Combined dataset has 25856 total records. [2025-09-05T19:01:16.865022] [INFO ] [MAIN ] SUI: Adding 330 new records, updating 0 existing records. [2025-09-05T19:01:16.898605] [INFO ] [MAIN ] SUN: Adding 283 new records, updating 0 existing records. [2025-09-05T19:01:16.999453] [INFO ] [MAIN ] SUI: Combined dataset has 21121 total records. [2025-09-05T19:01:17.011768] [WARN ] [VALIDATOR ] SU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:17.046982] [INFO ] [MAIN ] SUN: Combined dataset has 18971 total records. [2025-09-05T19:01:17.067418] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-05T19:01:17.648921] [INFO ] [MAIN ] STZ: Adding 388 new records, updating 0 existing records. [2025-09-05T19:01:17.652665] [WARN ] [VALIDATOR ] SUI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:17.641136] [WARN ] [VALIDATOR ] SUN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:17.923554] [INFO ] [MAIN ] STZ: Combined dataset has 25417 total records. [2025-09-05T19:01:18.271390] [WARN ] [VALIDATOR ] STZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:18.477263] [WARN ] [VALIDATOR ] SU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:18.477348] [WARN ] [VALIDATOR ] SUI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:18.478200] [INFO ] [MAIN ] SU: Combined data validation passed. [2025-09-05T19:01:18.478364] [INFO ] [MAIN ] SUI: Combined data validation passed. [2025-09-05T19:01:18.478280] [WARN ] [VALIDATOR ] SUN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:18.479051] [INFO ] [MAIN ] SUN: Combined data validation passed. [2025-09-05T19:01:18.869862] [WARN ] [VALIDATOR ] STZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:18.871972] [INFO ] [MAIN ] STZ: Combined data validation passed. [2025-09-05T19:01:18.989833] [INFO ] [MAIN ] SU: Update completed successfully. [2025-09-05T19:01:19.007602] [INFO ] [MAIN ] SUI: Update completed successfully. [2025-09-05T19:01:19.012411] [INFO ] [MAIN ] Update Progress: 2020/2363 symbols completed. SUI took 5.6s. Estimated remaining: 10m 24s. Rate: 33.0 symbols/min [2025-09-05T19:01:19.015886] [INFO ] [MAIN ] Update Progress: 2021/2363 symbols completed. SU took 5.6s. Estimated remaining: 10m 22s. Rate: 33.0 symbols/min [2025-09-05T19:01:19.352367] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:19.375369] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:19.387165] [INFO ] [MAIN ] SUN: Update completed successfully. [2025-09-05T19:01:19.389294] [INFO ] [MAIN ] Update Progress: 2022/2363 symbols completed. SUN took 4.5s. Estimated remaining: 10m 20s. Rate: 33.0 symbols/min [2025-09-05T19:01:19.542242] [INFO ] [MAIN ] SUZ: Loaded 21635 existing records. [2025-09-05T19:01:19.592998] [INFO ] [MAIN ] SUPV: Loaded 22807 existing records. [2025-09-05T19:01:19.600759] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:19.941546] [INFO ] [MAIN ] SVV: Loaded 17317 existing records. [2025-09-05T19:01:19.940262] [INFO ] [MAIN ] SUPV: Found 1 missing trading days. [2025-09-05T19:01:20.010813] [INFO ] [MAIN ] SUPV: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:20.051267] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-05T19:01:20.010734] [INFO ] [MAIN ] SUZ: Found 1 missing trading days. [2025-09-05T19:01:20.061036] [INFO ] [MAIN ] SUZ: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:20.067723] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-05T19:01:20.134227] [INFO ] [MAIN ] STZ: Update completed successfully. [2025-09-05T19:01:20.141900] [INFO ] [MAIN ] Update Progress: 2023/2363 symbols completed. STZ took 6.8s. Estimated remaining: 10m 18s. Rate: 33.0 symbols/min [2025-09-05T19:01:20.235148] [INFO ] [MAIN ] SVV: Found 1 missing trading days. [2025-09-05T19:01:20.267601] [INFO ] [MAIN ] SVV: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:20.291774] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-05T19:01:20.365802] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:20.391395] [INFO ] [MAIN ] SW: Loaded 25293 existing records. [2025-09-05T19:01:20.567798] [INFO ] [MAIN ] SW: Found 1 missing trading days. [2025-09-05T19:01:20.567968] [INFO ] [MAIN ] SW: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:20.568364] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-05T19:01:21.668552] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T19:01:21.786756] [INFO ] [MAIN ] SVV: Adding 312 new records, updating 0 existing records. [2025-09-05T19:01:21.796195] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-05T19:01:21.841889] [INFO ] [MAIN ] SVV: Combined dataset has 17629 total records. [2025-09-05T19:01:21.998795] [INFO ] [MAIN ] SUZ: Adding 303 new records, updating 0 existing records. [2025-09-05T19:01:22.037237] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-05T19:01:22.203284] [INFO ] [MAIN ] SUZ: Combined dataset has 21938 total records. [2025-09-05T19:01:22.334056] [WARN ] [VALIDATOR ] SVV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:22.419266] [INFO ] [MAIN ] SUPV: Adding 386 new records, updating 0 existing records. [2025-09-05T19:01:22.557443] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-05T19:01:22.880023] [WARN ] [VALIDATOR ] SUZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:22.880298] [INFO ] [MAIN ] SUPV: Combined dataset has 23193 total records. [2025-09-05T19:01:22.984912] [INFO ] [MAIN ] SW: Adding 390 new records, updating 0 existing records. [2025-09-05T19:01:23.214041] [INFO ] [MAIN ] SW: Combined dataset has 25683 total records. [2025-09-05T19:01:23.357462] [WARN ] [VALIDATOR ] SUPV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:23.600401] [WARN ] [VALIDATOR ] SW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:23.894710] [WARN ] [VALIDATOR ] SUZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:23.896787] [INFO ] [MAIN ] SUZ: Combined data validation passed. [2025-09-05T19:01:23.896460] [WARN ] [VALIDATOR ] SVV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:23.898122] [INFO ] [MAIN ] SVV: Combined data validation passed. [2025-09-05T19:01:23.897982] [WARN ] [VALIDATOR ] SUPV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:23.896545] [WARN ] [VALIDATOR ] SW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:23.899303] [INFO ] [MAIN ] SW: Combined data validation passed. [2025-09-05T19:01:23.899604] [INFO ] [MAIN ] SUPV: Combined data validation passed. [2025-09-05T19:01:24.332552] [INFO ] [MAIN ] SVV: Update completed successfully. [2025-09-05T19:01:24.335426] [INFO ] [MAIN ] Update Progress: 2024/2363 symbols completed. SVV took 4.9s. Estimated remaining: 10m 16s. Rate: 33.0 symbols/min [2025-09-05T19:01:24.370151] [INFO ] [MAIN ] SUZ: Update completed successfully. [2025-09-05T19:01:24.400549] [INFO ] [MAIN ] Update Progress: 2025/2363 symbols completed. SUZ took 5.4s. Estimated remaining: 10m 14s. Rate: 33.0 symbols/min [2025-09-05T19:01:24.603028] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:24.743547] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:24.772559] [INFO ] [MAIN ] SUPV: Update completed successfully. [2025-09-05T19:01:24.775951] [INFO ] [MAIN ] Update Progress: 2026/2363 symbols completed. SUPV took 5.8s. Estimated remaining: 10m 12s. Rate: 33.0 symbols/min [2025-09-05T19:01:24.790545] [INFO ] [MAIN ] SWK: Loaded 24979 existing records. [2025-09-05T19:01:24.953962] [INFO ] [MAIN ] SW: Update completed successfully. [2025-09-05T19:01:25.003549] [INFO ] [MAIN ] SWX: Loaded 14995 existing records. [2025-09-05T19:01:25.019094] [INFO ] [MAIN ] Update Progress: 2027/2363 symbols completed. SW took 4.9s. Estimated remaining: 10m 10s. Rate: 33.0 symbols/min [2025-09-05T19:01:25.318516] [INFO ] [MAIN ] SWK: Found 1 missing trading days. [2025-09-05T19:01:25.259005] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:25.352609] [INFO ] [MAIN ] SWK: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:25.368105] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-05T19:01:25.485396] [INFO ] [MAIN ] SWZ: Loaded 2770 existing records. [2025-09-05T19:01:25.509505] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:25.544246] [INFO ] [MAIN ] SWX: Found 1 missing trading days. [2025-09-05T19:01:25.570026] [INFO ] [MAIN ] SWX: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:25.596421] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-05T19:01:25.703291] [INFO ] [MAIN ] SWZ: Found 1 missing trading days. [2025-09-05T19:01:25.710339] [INFO ] [MAIN ] SWZ: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:25.710595] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-05T19:01:25.711868] [INFO ] [MAIN ] SXC: Loaded 20219 existing records. [2025-09-05T19:01:25.884705] [INFO ] [MAIN ] SXC: Found 1 missing trading days. [2025-09-05T19:01:25.884852] [INFO ] [MAIN ] SXC: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:25.885070] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-05T19:01:26.600851] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T19:01:26.614900] [INFO ] [MAIN ] SWZ: Adding 31 new records, updating 0 existing records. [2025-09-05T19:01:26.616685] [INFO ] [MAIN ] SWZ: Combined dataset has 2801 total records. [2025-09-05T19:01:26.797511] [WARN ] [VALIDATOR ] SWZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:26.930897] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T19:01:27.084374] [INFO ] [MAIN ] SWX: Adding 211 new records, updating 0 existing records. [2025-09-05T19:01:27.098884] [INFO ] [MAIN ] SWX: Combined dataset has 15206 total records. [2025-09-05T19:01:27.100185] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-05T19:01:27.435390] [WARN ] [VALIDATOR ] SWX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:27.462188] [INFO ] [MAIN ] SWK: Adding 389 new records, updating 0 existing records. [2025-09-05T19:01:27.554401] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T19:01:27.687895] [INFO ] [MAIN ] SWK: Combined dataset has 25368 total records. [2025-09-05T19:01:27.850104] [INFO ] [MAIN ] SXC: Adding 305 new records, updating 0 existing records. [2025-09-05T19:01:27.981125] [WARN ] [VALIDATOR ] SWK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:27.992828] [INFO ] [MAIN ] SXC: Combined dataset has 20524 total records. [2025-09-05T19:01:28.003320] [WARN ] [VALIDATOR ] SWZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:28.031013] [INFO ] [MAIN ] SWZ: Combined data validation passed. [2025-09-05T19:01:28.177914] [INFO ] [MAIN ] SWZ: Update completed successfully. [2025-09-05T19:01:28.208622] [INFO ] [MAIN ] Update Progress: 2028/2363 symbols completed. SWZ took 3.4s. Estimated remaining: 10m 9s. Rate: 33.0 symbols/min [2025-09-05T19:01:28.192496] [WARN ] [VALIDATOR ] SWX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:28.296577] [INFO ] [MAIN ] SWX: Combined data validation passed. [2025-09-05T19:01:28.432076] [WARN ] [VALIDATOR ] SXC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:28.733320] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:28.827565] [INFO ] [MAIN ] SXI: Loaded 8796 existing records. [2025-09-05T19:01:29.018005] [INFO ] [MAIN ] SXI: Found 1 missing trading days. [2025-09-05T19:01:29.021777] [INFO ] [MAIN ] SXI: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:29.022309] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-05T19:01:29.036490] [INFO ] [MAIN ] SWX: Update completed successfully. [2025-09-05T19:01:29.038542] [INFO ] [MAIN ] Update Progress: 2029/2363 symbols completed. SWX took 4.6s. Estimated remaining: 10m 7s. Rate: 33.0 symbols/min [2025-09-05T19:01:29.079720] [WARN ] [VALIDATOR ] SXC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:29.079628] [WARN ] [VALIDATOR ] SWK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:29.097795] [INFO ] [MAIN ] SXC: Combined data validation passed. [2025-09-05T19:01:29.128213] [INFO ] [MAIN ] SWK: Combined data validation passed. [2025-09-05T19:01:29.387507] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:29.430334] [INFO ] [MAIN ] SXT: Loaded 13922 existing records. [2025-09-05T19:01:29.572451] [INFO ] [MAIN ] SXC: Update completed successfully. [2025-09-05T19:01:29.608084] [INFO ] [MAIN ] Update Progress: 2030/2363 symbols completed. SXC took 4.6s. Estimated remaining: 10m 5s. Rate: 33.0 symbols/min [2025-09-05T19:01:29.647296] [INFO ] [MAIN ] SXT: Found 1 missing trading days. [2025-09-05T19:01:29.703877] [INFO ] [MAIN ] SXT: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:29.744918] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-05T19:01:29.854501] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:29.858436] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T19:01:29.858489] [WARN ] [MAIN ] SYF: No existing data found, performing full refresh instead. [2025-09-05T19:01:29.875027] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-05T19:01:29.885923] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-05T19:01:29.887551] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-05T19:01:29.927429] [INFO ] [MAIN ] SWK: Update completed successfully. [2025-09-05T19:01:29.936383] [INFO ] [MAIN ] SXI: Adding 92 new records, updating 0 existing records. [2025-09-05T19:01:29.975062] [INFO ] [MAIN ] Update Progress: 2031/2363 symbols completed. SWK took 5.6s. Estimated remaining: 10m 3s. Rate: 33.1 symbols/min [2025-09-05T19:01:30.090095] [INFO ] [MAIN ] SXI: Combined dataset has 8888 total records. [2025-09-05T19:01:30.389566] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:30.593150] [WARN ] [VALIDATOR ] SXI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:01:30.634786] [INFO ] [REMOTE ] SYF: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:01:30.667619] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-05T19:01:30.703208] [INFO ] [MAIN ] SYK: Loaded 21753 existing records. [2025-09-05T19:01:31.022299] [INFO ] [MAIN ] SYK: Found 1 missing trading days. [2025-09-05T19:01:31.023215] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-05T19:01:31.023306] [INFO ] [MAIN ] SYK: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:31.025154] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-05T19:01:31.091998] [INFO ] [MAIN ] SXT: Adding 166 new records, updating 0 existing records. [2025-09-05T19:01:31.096823] [INFO ] [MAIN ] SXT: Combined dataset has 14088 total records. [2025-09-05T19:01:31.274827] [WARN ] [VALIDATOR ] SXT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:31.468582] [WARN ] [VALIDATOR ] SXT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:31.468678] [WARN ] [VALIDATOR ] SXI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:01:31.469014] [INFO ] [MAIN ] SXT: Combined data validation passed. [2025-09-05T19:01:31.468921] [INFO ] [MAIN ] SXI: Combined data validation passed. [2025-09-05T19:01:31.606782] [INFO ] [MAIN ] SXI: Update completed successfully. [2025-09-05T19:01:31.609795] [INFO ] [MAIN ] Update Progress: 2032/2363 symbols completed. SXI took 3.4s. Estimated remaining: 10m 1s. Rate: 33.1 symbols/min [2025-09-05T19:01:31.726740] [INFO ] [MAIN ] SXT: Update completed successfully. [2025-09-05T19:01:31.733208] [INFO ] [MAIN ] Update Progress: 2033/2363 symbols completed. SXT took 2.7s. Estimated remaining: 9m 59s. Rate: 33.1 symbols/min [2025-09-05T19:01:31.864595] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:31.969475] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:32.015392] [INFO ] [MAIN ] T: Loaded 25718 existing records. [2025-09-05T19:01:32.016533] [INFO ] [MAIN ] SYY: Loaded 40111 existing records. [2025-09-05T19:01:32.371591] [INFO ] [MAIN ] T: Found 1 missing trading days. [2025-09-05T19:01:32.381812] [INFO ] [MAIN ] SYY: Found 1 missing trading days. [2025-09-05T19:01:32.381904] [INFO ] [MAIN ] T: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:32.382003] [INFO ] [MAIN ] SYY: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:32.382343] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-05T19:01:32.382592] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-05T19:01:32.556823] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-05T19:01:32.567918] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-05T19:01:32.791334] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-05T19:01:32.937529] [INFO ] [MAIN ] SYK: Adding 333 new records, updating 0 existing records. [2025-09-05T19:01:32.940873] [INFO ] [MAIN ] SYK: Combined dataset has 22086 total records. [2025-09-05T19:01:33.118699] [WARN ] [VALIDATOR ] SYK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:33.332904] [WARN ] [VALIDATOR ] SYK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:33.333116] [INFO ] [MAIN ] SYK: Combined data validation passed. [2025-09-05T19:01:33.482076] [INFO ] [MAIN ] SYK: Update completed successfully. [2025-09-05T19:01:33.484746] [INFO ] [MAIN ] Update Progress: 2034/2363 symbols completed. SYK took 3.5s. Estimated remaining: 9m 57s. Rate: 33.1 symbols/min [2025-09-05T19:01:33.657239] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:33.678766] [INFO ] [MAIN ] TAC: Loaded 20533 existing records. [2025-09-05T19:01:33.852478] [INFO ] [MAIN ] TAC: Found 1 missing trading days. [2025-09-05T19:01:33.852624] [INFO ] [MAIN ] TAC: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:33.852861] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-05T19:01:34.079827] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-05T19:01:34.090024] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-05T19:01:34.216331] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-05T19:01:34.385283] [INFO ] [MAIN ] SYY: Adding 389 new records, updating 0 existing records. [2025-09-05T19:01:34.389619] [INFO ] [MAIN ] SYY: Combined dataset has 40500 total records. [2025-09-05T19:01:34.579122] [WARN ] [VALIDATOR ] SYY: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:01:34.749392] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-05T19:01:34.942663] [INFO ] [MAIN ] T: Adding 390 new records, updating 0 existing records. [2025-09-05T19:01:34.949981] [INFO ] [MAIN ] T: Combined dataset has 26108 total records. [2025-09-05T19:01:35.149440] [WARN ] [VALIDATOR ] T: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:35.264599] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-05T19:01:35.544085] [INFO ] [MAIN ] TAC: Adding 303 new records, updating 0 existing records. [2025-09-05T19:01:35.545096] [WARN ] [VALIDATOR ] SYY: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:01:35.545845] [INFO ] [MAIN ] SYY: Combined data validation passed. [2025-09-05T19:01:35.549826] [INFO ] [MAIN ] TAC: Combined dataset has 20836 total records. [2025-09-05T19:01:35.847177] [WARN ] [VALIDATOR ] TAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:36.120028] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-05T19:01:36.197176] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-05T19:01:36.243555] [WARN ] [VALIDATOR ] T: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:36.244447] [INFO ] [MAIN ] T: Combined data validation passed. [2025-09-05T19:01:36.243457] [WARN ] [VALIDATOR ] TAC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:36.246533] [INFO ] [MAIN ] TAC: Combined data validation passed. [2025-09-05T19:01:36.492551] [INFO ] [MAIN ] SYY: Update completed successfully. [2025-09-05T19:01:36.502751] [INFO ] [MAIN ] Update Progress: 2035/2363 symbols completed. SYY took 4.9s. Estimated remaining: 9m 55s. Rate: 33.1 symbols/min [2025-09-05T19:01:36.712968] [INFO ] [MAIN ] TAC: Update completed successfully. [2025-09-05T19:01:36.712870] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:36.715897] [INFO ] [MAIN ] Update Progress: 2036/2363 symbols completed. TAC took 3.2s. Estimated remaining: 9m 53s. Rate: 33.1 symbols/min [2025-09-05T19:01:36.915512] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:36.920673] [INFO ] [MAIN ] TAK: Loaded 24144 existing records. [2025-09-05T19:01:37.158461] [INFO ] [MAIN ] TAK: Found 1 missing trading days. [2025-09-05T19:01:37.160144] [INFO ] [MAIN ] TAK: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:37.160564] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-05T19:01:37.177801] [INFO ] [MAIN ] TAL: Loaded 39062 existing records. [2025-09-05T19:01:37.191716] [INFO ] [MAIN ] T: Update completed successfully. [2025-09-05T19:01:37.214627] [INFO ] [MAIN ] Update Progress: 2037/2363 symbols completed. T took 5.5s. Estimated remaining: 9m 51s. Rate: 33.1 symbols/min [2025-09-05T19:01:37.365266] [INFO ] [MAIN ] TAL: Found 1 missing trading days. [2025-09-05T19:01:37.365429] [INFO ] [MAIN ] TAL: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:37.365675] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-05T19:01:38.250524] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-05T19:01:38.262136] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-05T19:01:38.744875] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-05T19:01:38.887254] [INFO ] [MAIN ] TAK: Adding 356 new records, updating 0 existing records. [2025-09-05T19:01:38.890840] [INFO ] [MAIN ] TAK: Combined dataset has 24500 total records. [2025-09-05T19:01:39.075984] [WARN ] [VALIDATOR ] TAK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:39.158928] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-05T19:01:39.449553] [INFO ] [MAIN ] TAL: Adding 379 new records, updating 0 existing records. [2025-09-05T19:01:39.456067] [INFO ] [MAIN ] TAL: Combined dataset has 39441 total records. [2025-09-05T19:01:39.646947] [WARN ] [VALIDATOR ] TAL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:01:39.850800] [WARN ] [VALIDATOR ] TAK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:39.851326] [INFO ] [MAIN ] TAK: Combined data validation passed. [2025-09-05T19:01:39.856616] [WARN ] [VALIDATOR ] TAL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:01:39.857193] [INFO ] [MAIN ] TAL: Combined data validation passed. [2025-09-05T19:01:40.076819] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-05T19:01:40.092453] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-05T19:01:40.253495] [INFO ] [MAIN ] TAK: Update completed successfully. [2025-09-05T19:01:40.258429] [INFO ] [MAIN ] Update Progress: 2038/2363 symbols completed. TAK took 3.8s. Estimated remaining: 9m 49s. Rate: 33.1 symbols/min [2025-09-05T19:01:40.292043] [INFO ] [MAIN ] TAL: Update completed successfully. [2025-09-05T19:01:40.296878] [INFO ] [MAIN ] Update Progress: 2039/2363 symbols completed. TAL took 3.6s. Estimated remaining: 9m 47s. Rate: 33.1 symbols/min [2025-09-05T19:01:41.912871] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-05T19:01:41.924117] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-05T19:01:43.403581] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-05T19:01:43.415849] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-05T19:01:44.865615] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-05T19:01:44.877093] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-05T19:01:46.142296] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T19:01:46.145467] [INFO ] [REMOTE ] SYF: Full fetch complete (58133 records). [2025-09-05T19:01:46.539553] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-05T19:01:46.808804] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-05T19:01:46.809077] [INFO ] [MAIN ] Update Progress: 2040/2363 symbols completed. SYF took 17.2s. Estimated remaining: 9m 46s. Rate: 33.1 symbols/min [2025-09-05T19:01:47.370516] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:47.565218] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:47.568413] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:47.563445] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:47.600050] [INFO ] [MAIN ] TBB: Loaded 5394 existing records. [2025-09-05T19:01:47.606618] [INFO ] [MAIN ] TALO: Loaded 24613 existing records. [2025-09-05T19:01:47.726636] [INFO ] [MAIN ] TBBB: Loaded 16756 existing records. [2025-09-05T19:01:47.955860] [INFO ] [MAIN ] TAP: Loaded 25191 existing records. [2025-09-05T19:01:48.216753] [INFO ] [MAIN ] TALO: Found 1 missing trading days. [2025-09-05T19:01:48.241869] [INFO ] [MAIN ] TBB: Found 1 missing trading days. [2025-09-05T19:01:48.279674] [INFO ] [MAIN ] TBB: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:48.327426] [INFO ] [MAIN ] TALO: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:48.334222] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-05T19:01:48.334406] [INFO ] [MAIN ] TBBB: Found 1 missing trading days. [2025-09-05T19:01:48.334791] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-05T19:01:48.336827] [INFO ] [MAIN ] TBBB: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:48.359822] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-05T19:01:48.422361] [INFO ] [MAIN ] TAP: Found 1 missing trading days. [2025-09-05T19:01:48.422529] [INFO ] [MAIN ] TAP: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:48.422821] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-05T19:01:49.474750] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T19:01:49.507459] [INFO ] [MAIN ] TBB: Adding 55 new records, updating 0 existing records. [2025-09-05T19:01:49.509531] [INFO ] [MAIN ] TBB: Combined dataset has 5449 total records. [2025-09-05T19:01:49.709869] [WARN ] [VALIDATOR ] TBB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:49.878093] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T19:01:49.979303] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:01:50.058542] [INFO ] [MAIN ] TBBB: Adding 212 new records, updating 0 existing records. [2025-09-05T19:01:50.166620] [INFO ] [MAIN ] TBBB: Combined dataset has 16968 total records. [2025-09-05T19:01:50.202569] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-05T19:01:50.632689] [INFO ] [MAIN ] TAP: Adding 383 new records, updating 1151 existing records. [2025-09-05T19:01:50.685049] [WARN ] [VALIDATOR ] TBBB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:50.696273] [INFO ] [MAIN ] TALO: Adding 377 new records, updating 0 existing records. [2025-09-05T19:01:50.814380] [INFO ] [MAIN ] TAP: Combined dataset has 25574 total records. [2025-09-05T19:01:50.820224] [INFO ] [MAIN ] TALO: Combined dataset has 24990 total records. [2025-09-05T19:01:51.282673] [WARN ] [VALIDATOR ] TALO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:51.332403] [WARN ] [VALIDATOR ] TAP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:51.523066] [WARN ] [VALIDATOR ] TBB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:51.565472] [INFO ] [MAIN ] TBB: Combined data validation passed. [2025-09-05T19:01:51.786986] [INFO ] [MAIN ] TBB: Update completed successfully. [2025-09-05T19:01:51.790029] [INFO ] [MAIN ] Update Progress: 2041/2363 symbols completed. TBB took 5.0s. Estimated remaining: 9m 45s. Rate: 33.0 symbols/min [2025-09-05T19:01:51.799393] [WARN ] [VALIDATOR ] TBBB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:51.799464] [WARN ] [VALIDATOR ] TAP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:51.805560] [INFO ] [MAIN ] TAP: Combined data validation passed. [2025-09-05T19:01:51.805666] [WARN ] [VALIDATOR ] TALO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:51.824687] [INFO ] [MAIN ] TBBB: Combined data validation passed. [2025-09-05T19:01:51.835101] [INFO ] [MAIN ] TALO: Combined data validation passed. [2025-09-05T19:01:52.235808] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:52.273227] [INFO ] [MAIN ] TBBB: Update completed successfully. [2025-09-05T19:01:52.276007] [INFO ] [MAIN ] Update Progress: 2042/2363 symbols completed. TBBB took 5.5s. Estimated remaining: 9m 43s. Rate: 33.0 symbols/min [2025-09-05T19:01:52.369335] [INFO ] [MAIN ] TBI: Loaded 10032 existing records. [2025-09-05T19:01:52.609582] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:52.634109] [INFO ] [MAIN ] TAP: Update completed successfully. [2025-09-05T19:01:52.649624] [INFO ] [MAIN ] Update Progress: 2043/2363 symbols completed. TAP took 5.8s. Estimated remaining: 9m 41s. Rate: 33.1 symbols/min [2025-09-05T19:01:52.721867] [INFO ] [MAIN ] TBLU: Loaded 403 existing records. [2025-09-05T19:01:52.870117] [INFO ] [MAIN ] TBI: Found 1 missing trading days. [2025-09-05T19:01:52.893619] [INFO ] [MAIN ] TBI: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:52.893953] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-05T19:01:52.969863] [INFO ] [MAIN ] TALO: Update completed successfully. [2025-09-05T19:01:52.994620] [INFO ] [MAIN ] Update Progress: 2044/2363 symbols completed. TALO took 6.2s. Estimated remaining: 9m 39s. Rate: 33.1 symbols/min [2025-09-05T19:01:53.029773] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:53.129152] [INFO ] [MAIN ] TBLU: Found 1 missing trading days. [2025-09-05T19:01:53.156148] [INFO ] [MAIN ] TBLU: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:53.168018] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-05T19:01:53.174768] [INFO ] [MAIN ] TBN: Loaded 1559 existing records. [2025-09-05T19:01:53.385903] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:53.416401] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-05T19:01:53.434603] [INFO ] [MAIN ] TBN: Found 1 missing trading days. [2025-09-05T19:01:53.434856] [INFO ] [MAIN ] TBN: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:53.434822] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-05T19:01:53.435206] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-05T19:01:53.435087] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-05T19:01:53.435305] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-05T19:01:53.790856] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-05T19:01:53.794144] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:01:53.796429] [INFO ] [MAIN ] TBLU: Adding 1 new records, updating 0 existing records. [2025-09-05T19:01:53.796685] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-05T19:01:53.797853] [INFO ] [MAIN ] TBLU: Combined dataset has 404 total records. [2025-09-05T19:01:53.924208] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-05T19:01:53.974713] [INFO ] [MAIN ] TBN: Adding 17 new records, updating 0 existing records. [2025-09-05T19:01:53.973110] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T19:01:54.034499] [WARN ] [VALIDATOR ] TBLU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:54.112976] [INFO ] [MAIN ] TBN: Combined dataset has 1576 total records. [2025-09-05T19:01:54.124446] [INFO ] [MAIN ] TBI: Adding 95 new records, updating 0 existing records. [2025-09-05T19:01:54.258060] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-05T19:01:54.263777] [INFO ] [MAIN ] TBI: Combined dataset has 10127 total records. [2025-09-05T19:01:54.274946] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-05T19:01:54.557068] [WARN ] [VALIDATOR ] TBN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:54.637303] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-05T19:01:54.705971] [WARN ] [VALIDATOR ] TBI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:54.706222] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-05T19:01:55.051734] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-05T19:01:55.054934] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-05T19:01:55.056322] [WARN ] [VALIDATOR ] TBN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:55.055098] [WARN ] [VALIDATOR ] TBI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:55.057012] [INFO ] [MAIN ] TBN: Combined data validation passed. [2025-09-05T19:01:55.057252] [INFO ] [MAIN ] TBI: Combined data validation passed. [2025-09-05T19:01:55.057132] [WARN ] [VALIDATOR ] TBLU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:55.058363] [INFO ] [MAIN ] TBLU: Combined data validation passed. [2025-09-05T19:01:55.069071] [INFO ] [MAIN ] TBN: Update completed successfully. [2025-09-05T19:01:55.070079] [INFO ] [MAIN ] Update Progress: 2045/2363 symbols completed. TBN took 2.4s. Estimated remaining: 9m 37s. Rate: 33.1 symbols/min [2025-09-05T19:01:55.101143] [INFO ] [MAIN ] TBLU: Update completed successfully. [2025-09-05T19:01:55.116434] [INFO ] [MAIN ] Update Progress: 2046/2363 symbols completed. TBLU took 2.8s. Estimated remaining: 9m 35s. Rate: 33.1 symbols/min [2025-09-05T19:01:55.340051] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-05T19:01:55.378688] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-05T19:01:55.462912] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:55.499879] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:55.503393] [INFO ] [MAIN ] TBI: Update completed successfully. [2025-09-05T19:01:55.505222] [INFO ] [MAIN ] Update Progress: 2047/2363 symbols completed. TBI took 3.7s. Estimated remaining: 9m 33s. Rate: 33.1 symbols/min [2025-09-05T19:01:55.708155] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:55.710080] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-05T19:01:55.711310] [INFO ] [MAIN ] TD: Loaded 24838 existing records. [2025-09-05T19:01:55.711940] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-05T19:01:55.816175] [INFO ] [MAIN ] TDF: Loaded 2420 existing records. [2025-09-05T19:01:55.816916] [INFO ] [MAIN ] TDC: Loaded 34794 existing records. [2025-09-05T19:01:56.011311] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-05T19:01:56.055140] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-05T19:01:56.139594] [INFO ] [MAIN ] TD: Found 1 missing trading days. [2025-09-05T19:01:56.160056] [INFO ] [MAIN ] TD: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:56.180781] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-05T19:01:56.206154] [INFO ] [MAIN ] TDF: Found 1 missing trading days. [2025-09-05T19:01:56.238699] [INFO ] [MAIN ] TDF: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:56.253629] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-05T19:01:56.265260] [INFO ] [MAIN ] TDC: Found 1 missing trading days. [2025-09-05T19:01:56.265369] [INFO ] [MAIN ] TDC: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:56.265971] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-05T19:01:56.634489] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-05T19:01:56.634997] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-05T19:01:56.790088] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T19:01:56.808442] [INFO ] [MAIN ] TDF: Adding 65 new records, updating 0 existing records. [2025-09-05T19:01:56.809983] [INFO ] [MAIN ] TDF: Combined dataset has 2485 total records. [2025-09-05T19:01:57.037562] [WARN ] [VALIDATOR ] TDF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:57.224838] [WARN ] [VALIDATOR ] TDF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:57.225062] [INFO ] [MAIN ] TDF: Combined data validation passed. [2025-09-05T19:01:57.240845] [INFO ] [MAIN ] TDF: Update completed successfully. [2025-09-05T19:01:57.241288] [INFO ] [MAIN ] Update Progress: 2048/2363 symbols completed. TDF took 1.7s. Estimated remaining: 9m 31s. Rate: 33.1 symbols/min [2025-09-05T19:01:57.413872] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:57.417795] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-05T19:01:57.419617] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-05T19:01:57.429991] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T19:01:57.483145] [INFO ] [MAIN ] TDG: Loaded 9855 existing records. [2025-09-05T19:01:57.739582] [INFO ] [MAIN ] TDC: Adding 352 new records, updating 0 existing records. [2025-09-05T19:01:57.800439] [INFO ] [MAIN ] TDG: Found 1 missing trading days. [2025-09-05T19:01:57.800876] [INFO ] [MAIN ] TDG: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:57.801159] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-05T19:01:57.805918] [INFO ] [MAIN ] TDC: Combined dataset has 35146 total records. [2025-09-05T19:01:57.917729] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-05T19:01:57.929782] [INFO ] [REMOTE ] TCAI: Full fetch complete (530 records). [2025-09-05T19:01:57.962505] [FATAL] [VALIDATOR ] TCAI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T19:01:57.997767] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-05T19:01:58.002817] [WARN ] [VALIDATOR ] TDC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:01:57.999292] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T19:01:58.014318] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-05T19:01:58.039975] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-05T19:01:58.060160] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T19:01:58.091471] [INFO ] [MAIN ] Update Progress: 2049/2363 symbols completed. TCAI took 5.1s. Estimated remaining: 9m 29s. Rate: 33.1 symbols/min [2025-09-05T19:01:58.486210] [INFO ] [MAIN ] TD: Adding 378 new records, updating 0 existing records. [2025-09-05T19:01:58.549203] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:01:58.551883] [INFO ] [MAIN ] TD: Combined dataset has 25216 total records. [2025-09-05T19:01:58.753296] [INFO ] [MAIN ] TDOC: Loaded 25504 existing records. [2025-09-05T19:01:58.751938] [WARN ] [VALIDATOR ] TD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:01:59.067787] [INFO ] [MAIN ] TDOC: Found 1 missing trading days. [2025-09-05T19:01:59.090472] [INFO ] [MAIN ] TDOC: Need to fetch 1 months: 2025-09 [2025-09-05T19:01:59.099907] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-05T19:01:59.148543] [WARN ] [VALIDATOR ] TDC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:01:59.149209] [INFO ] [MAIN ] TDC: Combined data validation passed. [2025-09-05T19:01:59.267919] [WARN ] [VALIDATOR ] TD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:01:59.270084] [INFO ] [MAIN ] TD: Combined data validation passed. [2025-09-05T19:01:59.269742] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T19:01:59.494593] [INFO ] [MAIN ] TDG: Adding 213 new records, updating 0 existing records. [2025-09-05T19:01:59.571847] [INFO ] [MAIN ] TDC: Update completed successfully. [2025-09-05T19:01:59.576540] [INFO ] [MAIN ] Update Progress: 2050/2363 symbols completed. TDC took 4.4s. Estimated remaining: 9m 27s. Rate: 33.1 symbols/min [2025-09-05T19:01:59.610110] [INFO ] [MAIN ] TDG: Combined dataset has 10068 total records. [2025-09-05T19:01:59.777961] [INFO ] [MAIN ] TD: Update completed successfully. [2025-09-05T19:01:59.857315] [INFO ] [MAIN ] Update Progress: 2051/2363 symbols completed. TD took 4.8s. Estimated remaining: 9m 25s. Rate: 33.1 symbols/min [2025-09-05T19:01:59.912842] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:00.060125] [WARN ] [VALIDATOR ] TDG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:00.302368] [INFO ] [MAIN ] TDS: Loaded 20668 existing records. [2025-09-05T19:02:00.303282] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:00.583942] [INFO ] [MAIN ] TDS: Found 1 missing trading days. [2025-09-05T19:02:00.593727] [INFO ] [MAIN ] TDS: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:00.594296] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-05T19:02:00.614033] [INFO ] [MAIN ] TDW: Loaded 34253 existing records. [2025-09-05T19:02:00.801678] [INFO ] [MAIN ] TDW: Found 1 missing trading days. [2025-09-05T19:02:00.802341] [INFO ] [MAIN ] TDW: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:00.802898] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-05T19:02:00.808905] [WARN ] [VALIDATOR ] TDG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:00.809162] [INFO ] [MAIN ] TDG: Combined data validation passed. [2025-09-05T19:02:00.891819] [INFO ] [MAIN ] TDG: Update completed successfully. [2025-09-05T19:02:00.893494] [INFO ] [MAIN ] Update Progress: 2052/2363 symbols completed. TDG took 3.7s. Estimated remaining: 9m 23s. Rate: 33.1 symbols/min [2025-09-05T19:02:01.101563] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:01.118508] [INFO ] [MAIN ] TDY: Loaded 10767 existing records. [2025-09-05T19:02:01.286002] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-05T19:02:01.555534] [INFO ] [MAIN ] TDY: Found 1 missing trading days. [2025-09-05T19:02:01.576701] [INFO ] [MAIN ] TDY: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:01.577363] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-05T19:02:01.678958] [INFO ] [MAIN ] TDOC: Adding 383 new records, updating 0 existing records. [2025-09-05T19:02:01.684193] [INFO ] [MAIN ] TDOC: Combined dataset has 25887 total records. [2025-09-05T19:02:01.960550] [WARN ] [VALIDATOR ] TDOC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:02.143695] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-05T19:02:02.421822] [INFO ] [MAIN ] TDS: Adding 282 new records, updating 0 existing records. [2025-09-05T19:02:02.425135] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-05T19:02:02.542767] [INFO ] [MAIN ] TDS: Combined dataset has 20950 total records. [2025-09-05T19:02:02.603042] [INFO ] [MAIN ] TDW: Adding 324 new records, updating 0 existing records. [2025-09-05T19:02:02.736449] [INFO ] [MAIN ] TDW: Combined dataset has 34577 total records. [2025-09-05T19:02:02.782909] [WARN ] [VALIDATOR ] TDS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:02.817472] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T19:02:03.043785] [INFO ] [MAIN ] TDY: Adding 116 new records, updating 0 existing records. [2025-09-05T19:02:03.141698] [WARN ] [VALIDATOR ] TDW: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:03.228536] [INFO ] [MAIN ] TDY: Combined dataset has 10883 total records. [2025-09-05T19:02:03.583771] [WARN ] [VALIDATOR ] TDOC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:03.594454] [INFO ] [MAIN ] TDOC: Combined data validation passed. [2025-09-05T19:02:03.660327] [WARN ] [VALIDATOR ] TDY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:04.050525] [WARN ] [VALIDATOR ] TDW: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:04.051000] [INFO ] [MAIN ] TDW: Combined data validation passed. [2025-09-05T19:02:04.050696] [WARN ] [VALIDATOR ] TDS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:04.051966] [INFO ] [MAIN ] TDS: Combined data validation passed. [2025-09-05T19:02:04.056468] [WARN ] [VALIDATOR ] TDY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:04.060341] [INFO ] [MAIN ] TDOC: Update completed successfully. [2025-09-05T19:02:04.060531] [INFO ] [MAIN ] TDY: Combined data validation passed. [2025-09-05T19:02:04.064815] [INFO ] [MAIN ] Update Progress: 2053/2363 symbols completed. TDOC took 5.9s. Estimated remaining: 9m 22s. Rate: 33.1 symbols/min [2025-09-05T19:02:04.517183] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:04.537090] [INFO ] [MAIN ] TDY: Update completed successfully. [2025-09-05T19:02:04.543766] [INFO ] [MAIN ] Update Progress: 2054/2363 symbols completed. TDY took 3.7s. Estimated remaining: 9m 20s. Rate: 33.1 symbols/min [2025-09-05T19:02:04.823059] [INFO ] [MAIN ] TE: Loaded 33313 existing records. [2025-09-05T19:02:04.904807] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:04.920213] [INFO ] [MAIN ] TDS: Update completed successfully. [2025-09-05T19:02:04.943669] [INFO ] [MAIN ] TDW: Update completed successfully. [2025-09-05T19:02:04.958378] [INFO ] [MAIN ] Update Progress: 2055/2363 symbols completed. TDS took 5.4s. Estimated remaining: 9m 18s. Rate: 33.1 symbols/min [2025-09-05T19:02:04.985197] [INFO ] [MAIN ] Update Progress: 2056/2363 symbols completed. TDW took 5.0s. Estimated remaining: 9m 16s. Rate: 33.2 symbols/min [2025-09-05T19:02:05.074992] [INFO ] [MAIN ] TEAF: Loaded 5385 existing records. [2025-09-05T19:02:05.484479] [INFO ] [MAIN ] TE: Found 1 missing trading days. [2025-09-05T19:02:05.542890] [INFO ] [MAIN ] TE: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:05.563815] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:05.590664] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-05T19:02:05.650801] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:05.653816] [INFO ] [MAIN ] TEAF: Found 1 missing trading days. [2025-09-05T19:02:05.654217] [INFO ] [MAIN ] TEAF: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:05.654923] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-05T19:02:05.672023] [INFO ] [MAIN ] TEF: Loaded 16687 existing records. [2025-09-05T19:02:05.877413] [INFO ] [MAIN ] TEF: Found 1 missing trading days. [2025-09-05T19:02:05.892599] [INFO ] [MAIN ] TEF: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:05.892904] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-05T19:02:05.895539] [INFO ] [MAIN ] TECK: Loaded 40206 existing records. [2025-09-05T19:02:06.084980] [INFO ] [MAIN ] TECK: Found 1 missing trading days. [2025-09-05T19:02:06.085124] [INFO ] [MAIN ] TECK: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:06.085363] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-05T19:02:06.260418] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-05T19:02:06.281966] [INFO ] [MAIN ] TEAF: Adding 32 new records, updating 0 existing records. [2025-09-05T19:02:06.283815] [INFO ] [MAIN ] TEAF: Combined dataset has 5417 total records. [2025-09-05T19:02:06.469466] [WARN ] [VALIDATOR ] TEAF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:06.664518] [WARN ] [VALIDATOR ] TEAF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:06.664775] [INFO ] [MAIN ] TEAF: Combined data validation passed. [2025-09-05T19:02:06.706820] [INFO ] [MAIN ] TEAF: Update completed successfully. [2025-09-05T19:02:06.707778] [INFO ] [MAIN ] Update Progress: 2057/2363 symbols completed. TEAF took 2.2s. Estimated remaining: 9m 14s. Rate: 33.2 symbols/min [2025-09-05T19:02:06.899455] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:06.909671] [INFO ] [MAIN ] TEI: Loaded 9789 existing records. [2025-09-05T19:02:07.087721] [INFO ] [MAIN ] TEI: Found 1 missing trading days. [2025-09-05T19:02:07.093506] [INFO ] [MAIN ] TEI: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:07.094513] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T19:02:07.094259] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-05T19:02:07.212037] [INFO ] [MAIN ] TEF: Adding 301 new records, updating 0 existing records. [2025-09-05T19:02:07.219392] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-05T19:02:07.286337] [INFO ] [MAIN ] TEF: Combined dataset has 16988 total records. [2025-09-05T19:02:07.481128] [INFO ] [MAIN ] TE: Adding 364 new records, updating 0 existing records. [2025-09-05T19:02:07.569623] [WARN ] [VALIDATOR ] TEF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:07.671708] [INFO ] [MAIN ] TE: Combined dataset has 33677 total records. [2025-09-05T19:02:07.830534] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-05T19:02:08.045028] [WARN ] [VALIDATOR ] TE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:08.230992] [INFO ] [MAIN ] TECK: Adding 390 new records, updating 0 existing records. [2025-09-05T19:02:08.242140] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T19:02:08.391147] [INFO ] [MAIN ] TEI: Adding 188 new records, updating 0 existing records. [2025-09-05T19:02:08.397835] [INFO ] [MAIN ] TEI: Combined dataset has 9977 total records. [2025-09-05T19:02:08.397609] [INFO ] [MAIN ] TECK: Combined dataset has 40596 total records. [2025-09-05T19:02:08.741577] [WARN ] [VALIDATOR ] TEI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:08.785813] [WARN ] [VALIDATOR ] TECK: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:09.231700] [WARN ] [VALIDATOR ] TE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:09.231798] [WARN ] [VALIDATOR ] TEF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:09.234669] [INFO ] [MAIN ] TE: Combined data validation passed. [2025-09-05T19:02:09.234567] [INFO ] [MAIN ] TEF: Combined data validation passed. [2025-09-05T19:02:09.436955] [WARN ] [VALIDATOR ] TEI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:09.437738] [INFO ] [MAIN ] TEI: Combined data validation passed. [2025-09-05T19:02:09.436197] [WARN ] [VALIDATOR ] TECK: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:09.438207] [INFO ] [MAIN ] TECK: Combined data validation passed. [2025-09-05T19:02:09.617010] [INFO ] [MAIN ] TEI: Update completed successfully. [2025-09-05T19:02:09.619622] [INFO ] [MAIN ] Update Progress: 2058/2363 symbols completed. TEI took 2.9s. Estimated remaining: 9m 12s. Rate: 33.1 symbols/min [2025-09-05T19:02:09.844791] [INFO ] [MAIN ] TEF: Update completed successfully. [2025-09-05T19:02:09.844192] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:09.847910] [INFO ] [MAIN ] Update Progress: 2059/2363 symbols completed. TEF took 4.8s. Estimated remaining: 9m 10s. Rate: 33.2 symbols/min [2025-09-05T19:02:10.198340] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:10.200940] [INFO ] [MAIN ] TEL: Loaded 24440 existing records. [2025-09-05T19:02:10.337288] [INFO ] [MAIN ] TEN: Loaded 14768 existing records. [2025-09-05T19:02:10.476838] [INFO ] [MAIN ] TEL: Found 1 missing trading days. [2025-09-05T19:02:10.498875] [INFO ] [MAIN ] TEL: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:10.509854] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-05T19:02:10.624173] [INFO ] [MAIN ] TEN: Found 1 missing trading days. [2025-09-05T19:02:10.625520] [INFO ] [MAIN ] TEN: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:10.625843] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-05T19:02:10.639061] [INFO ] [MAIN ] TECK: Update completed successfully. [2025-09-05T19:02:10.644592] [INFO ] [MAIN ] TE: Update completed successfully. [2025-09-05T19:02:10.644467] [INFO ] [MAIN ] Update Progress: 2060/2363 symbols completed. TECK took 5.7s. Estimated remaining: 9m 8s. Rate: 33.2 symbols/min [2025-09-05T19:02:10.649656] [INFO ] [MAIN ] Update Progress: 2061/2363 symbols completed. TE took 6.6s. Estimated remaining: 9m 6s. Rate: 33.2 symbols/min [2025-09-05T19:02:11.004995] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:11.003595] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:11.035662] [INFO ] [MAIN ] TEO: Loaded 16237 existing records. [2025-09-05T19:02:11.157789] [INFO ] [MAIN ] TEVA: Loaded 25569 existing records. [2025-09-05T19:02:11.341923] [INFO ] [MAIN ] TEO: Found 1 missing trading days. [2025-09-05T19:02:11.362468] [INFO ] [MAIN ] TEO: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:11.362777] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-05T19:02:11.413808] [INFO ] [MAIN ] TEVA: Found 1 missing trading days. [2025-09-05T19:02:11.413986] [INFO ] [MAIN ] TEVA: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:11.414578] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-05T19:02:11.853596] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T19:02:11.963827] [INFO ] [MAIN ] TEN: Adding 279 new records, updating 0 existing records. [2025-09-05T19:02:11.967533] [INFO ] [MAIN ] TEN: Combined dataset has 15047 total records. [2025-09-05T19:02:12.165012] [WARN ] [VALIDATOR ] TEN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:12.367628] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T19:02:12.472015] [INFO ] [MAIN ] TEO: Adding 178 new records, updating 0 existing records. [2025-09-05T19:02:12.476696] [INFO ] [MAIN ] TEO: Combined dataset has 16415 total records. [2025-09-05T19:02:12.667818] [WARN ] [VALIDATOR ] TEO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:12.874987] [WARN ] [VALIDATOR ] TEO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:12.875090] [WARN ] [VALIDATOR ] TEN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:12.875382] [INFO ] [MAIN ] TEO: Combined data validation passed. [2025-09-05T19:02:12.875312] [INFO ] [MAIN ] TEN: Combined data validation passed. [2025-09-05T19:02:13.068001] [INFO ] [MAIN ] TEN: Update completed successfully. [2025-09-05T19:02:13.071398] [INFO ] [MAIN ] Update Progress: 2062/2363 symbols completed. TEN took 3.2s. Estimated remaining: 9m 4s. Rate: 33.2 symbols/min [2025-09-05T19:02:13.158255] [INFO ] [MAIN ] TEO: Update completed successfully. [2025-09-05T19:02:13.183119] [INFO ] [MAIN ] Update Progress: 2063/2363 symbols completed. TEO took 2.5s. Estimated remaining: 9m 2s. Rate: 33.2 symbols/min [2025-09-05T19:02:13.325359] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:13.440937] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:13.456529] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-05T19:02:13.541890] [INFO ] [MAIN ] TEX: Loaded 20838 existing records. [2025-09-05T19:02:13.760478] [INFO ] [MAIN ] TFC: Loaded 25587 existing records. [2025-09-05T19:02:13.857577] [INFO ] [MAIN ] TEVA: Adding 390 new records, updating 0 existing records. [2025-09-05T19:02:13.972589] [INFO ] [MAIN ] TEX: Found 1 missing trading days. [2025-09-05T19:02:13.974628] [INFO ] [MAIN ] TEX: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:14.001390] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-05T19:02:14.058538] [INFO ] [MAIN ] TFC: Found 1 missing trading days. [2025-09-05T19:02:14.058823] [INFO ] [MAIN ] TFC: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:14.059331] [INFO ] [MAIN ] TEVA: Combined dataset has 25959 total records. [2025-09-05T19:02:14.059228] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-05T19:02:14.259737] [WARN ] [VALIDATOR ] TEVA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:14.458677] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (3.95 seconds). [2025-09-05T19:02:14.635719] [INFO ] [MAIN ] TEL: Adding 337 new records, updating 0 existing records. [2025-09-05T19:02:14.645571] [INFO ] [MAIN ] TEL: Combined dataset has 24777 total records. [2025-09-05T19:02:14.840173] [WARN ] [VALIDATOR ] TEL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:15.053965] [WARN ] [VALIDATOR ] TEVA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:15.055059] [INFO ] [MAIN ] TEVA: Combined data validation passed. [2025-09-05T19:02:15.060518] [WARN ] [VALIDATOR ] TEL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:15.060882] [INFO ] [MAIN ] TEL: Combined data validation passed. [2025-09-05T19:02:15.342791] [INFO ] [MAIN ] TEL: Update completed successfully. [2025-09-05T19:02:15.346185] [INFO ] [MAIN ] Update Progress: 2064/2363 symbols completed. TEL took 5.7s. Estimated remaining: 9m 1s. Rate: 33.2 symbols/min [2025-09-05T19:02:15.537020] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:15.558950] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:02:15.581303] [INFO ] [MAIN ] TFII: Loaded 15175 existing records. [2025-09-05T19:02:15.916131] [INFO ] [MAIN ] TFII: Found 1 missing trading days. [2025-09-05T19:02:15.920823] [INFO ] [MAIN ] TEX: Adding 357 new records, updating 0 existing records. [2025-09-05T19:02:15.921561] [INFO ] [MAIN ] TFII: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:15.923681] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-05T19:02:15.940044] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T19:02:15.983559] [INFO ] [MAIN ] TEX: Combined dataset has 21195 total records. [2025-09-05T19:02:16.295756] [WARN ] [VALIDATOR ] TEX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:16.302136] [INFO ] [MAIN ] TEVA: Update completed successfully. [2025-09-05T19:02:16.343183] [INFO ] [MAIN ] Update Progress: 2065/2363 symbols completed. TEVA took 5.7s. Estimated remaining: 8m 59s. Rate: 33.2 symbols/min [2025-09-05T19:02:16.477148] [INFO ] [MAIN ] TFC: Adding 390 new records, updating 0 existing records. [2025-09-05T19:02:16.730178] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:16.734145] [INFO ] [MAIN ] TFC: Combined dataset has 25977 total records. [2025-09-05T19:02:16.852587] [INFO ] [MAIN ] TFIN: Loaded 17825 existing records. [2025-09-05T19:02:16.975230] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-05T19:02:16.978937] [WARN ] [VALIDATOR ] TFC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:17.225911] [INFO ] [MAIN ] TFII: Adding 228 new records, updating 0 existing records. [2025-09-05T19:02:17.340917] [INFO ] [MAIN ] TFIN: Found 1 missing trading days. [2025-09-05T19:02:17.352251] [INFO ] [MAIN ] TFIN: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:17.384677] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-05T19:02:17.425496] [INFO ] [MAIN ] TFII: Combined dataset has 15403 total records. [2025-09-05T19:02:17.620196] [WARN ] [VALIDATOR ] TFII: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:17.812960] [WARN ] [VALIDATOR ] TEX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:17.814335] [INFO ] [MAIN ] TEX: Combined data validation passed. [2025-09-05T19:02:17.936121] [WARN ] [VALIDATOR ] TFII: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:17.937103] [INFO ] [MAIN ] TFII: Combined data validation passed. [2025-09-05T19:02:17.936596] [WARN ] [VALIDATOR ] TFC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:17.937746] [INFO ] [MAIN ] TFC: Combined data validation passed. [2025-09-05T19:02:18.174132] [INFO ] [MAIN ] TFII: Update completed successfully. [2025-09-05T19:02:18.177342] [INFO ] [MAIN ] Update Progress: 2066/2363 symbols completed. TFII took 2.8s. Estimated remaining: 8m 57s. Rate: 33.2 symbols/min [2025-09-05T19:02:18.274205] [INFO ] [MAIN ] TEX: Update completed successfully. [2025-09-05T19:02:18.325512] [INFO ] [MAIN ] Update Progress: 2067/2363 symbols completed. TEX took 5.3s. Estimated remaining: 8m 55s. Rate: 33.2 symbols/min [2025-09-05T19:02:18.518685] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:18.511686] [INFO ] [MAIN ] TFC: Update completed successfully. [2025-09-05T19:02:18.541304] [INFO ] [MAIN ] Update Progress: 2068/2363 symbols completed. TFC took 5.3s. Estimated remaining: 8m 53s. Rate: 33.2 symbols/min [2025-09-05T19:02:18.683799] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:18.748930] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T19:02:18.780324] [INFO ] [MAIN ] TFPM: Loaded 18321 existing records. [2025-09-05T19:02:18.983934] [INFO ] [MAIN ] TFIN: Adding 163 new records, updating 0 existing records. [2025-09-05T19:02:19.047223] [INFO ] [MAIN ] TFX: Loaded 16601 existing records. [2025-09-05T19:02:19.059942] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:19.202814] [INFO ] [MAIN ] TFIN: Combined dataset has 17988 total records. [2025-09-05T19:02:19.220763] [INFO ] [MAIN ] TFPM: Found 1 missing trading days. [2025-09-05T19:02:19.229878] [INFO ] [MAIN ] TG: Loaded 4665 existing records. [2025-09-05T19:02:19.229924] [INFO ] [MAIN ] TFPM: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:19.251205] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-05T19:02:19.581221] [INFO ] [MAIN ] TFX: Found 1 missing trading days. [2025-09-05T19:02:19.617607] [INFO ] [MAIN ] TFX: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:19.677089] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-05T19:02:19.695761] [INFO ] [MAIN ] TG: Found 1 missing trading days. [2025-09-05T19:02:19.737364] [WARN ] [VALIDATOR ] TFIN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:19.715793] [INFO ] [MAIN ] TG: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:19.737739] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-05T19:02:19.939541] [WARN ] [VALIDATOR ] TFIN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:19.939792] [INFO ] [MAIN ] TFIN: Combined data validation passed. [2025-09-05T19:02:20.050674] [INFO ] [MAIN ] TFIN: Update completed successfully. [2025-09-05T19:02:20.052565] [INFO ] [MAIN ] Update Progress: 2069/2363 symbols completed. TFIN took 3.7s. Estimated remaining: 8m 51s. Rate: 33.2 symbols/min [2025-09-05T19:02:20.224726] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:20.233331] [INFO ] [MAIN ] TGE: Loaded 6749 existing records. [2025-09-05T19:02:20.408090] [INFO ] [MAIN ] TGE: Found 1 missing trading days. [2025-09-05T19:02:20.408283] [INFO ] [MAIN ] TGE: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:20.408500] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-05T19:02:20.636298] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T19:02:20.665834] [INFO ] [MAIN ] TG: Adding 71 new records, updating 0 existing records. [2025-09-05T19:02:20.667588] [INFO ] [MAIN ] TG: Combined dataset has 4736 total records. [2025-09-05T19:02:20.853205] [WARN ] [VALIDATOR ] TG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:21.044394] [WARN ] [VALIDATOR ] TG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:21.044598] [INFO ] [MAIN ] TG: Combined data validation passed. [2025-09-05T19:02:21.074541] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T19:02:21.098580] [INFO ] [MAIN ] TG: Update completed successfully. [2025-09-05T19:02:21.115435] [INFO ] [MAIN ] TGE: Adding 86 new records, updating 0 existing records. [2025-09-05T19:02:21.116336] [INFO ] [MAIN ] Update Progress: 2070/2363 symbols completed. TG took 2.6s. Estimated remaining: 8m 49s. Rate: 33.2 symbols/min [2025-09-05T19:02:21.156607] [INFO ] [MAIN ] TGE: Combined dataset has 6835 total records. [2025-09-05T19:02:21.217054] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T19:02:21.178492] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-05T19:02:21.622389] [INFO ] [MAIN ] TFPM: Adding 334 new records, updating 0 existing records. [2025-09-05T19:02:21.765960] [INFO ] [MAIN ] TFX: Adding 272 new records, updating 0 existing records. [2025-09-05T19:02:21.763207] [WARN ] [VALIDATOR ] TGE: Not fatal, but first date in data (2025-06-05) does not match expected start date (2025-01-31) [2025-09-05T19:02:21.745972] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:21.839864] [INFO ] [MAIN ] TFPM: Combined dataset has 18655 total records. [2025-09-05T19:02:21.945215] [INFO ] [MAIN ] TFX: Combined dataset has 16873 total records. [2025-09-05T19:02:22.014196] [INFO ] [MAIN ] TGLS: Loaded 12594 existing records. [2025-09-05T19:02:22.461773] [WARN ] [VALIDATOR ] TFPM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:22.540896] [INFO ] [MAIN ] TGLS: Found 1 missing trading days. [2025-09-05T19:02:22.576338] [WARN ] [VALIDATOR ] TFX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:22.607036] [INFO ] [MAIN ] TGLS: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:22.632507] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-05T19:02:23.040288] [WARN ] [VALIDATOR ] TGE: Missing days changed. Total missing: 86 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04 [2025-09-05T19:02:23.041481] [INFO ] [MAIN ] TGE: Combined data validation passed. [2025-09-05T19:02:23.067793] [WARN ] [VALIDATOR ] TFPM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:23.067120] [WARN ] [VALIDATOR ] TFX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:23.084560] [INFO ] [MAIN ] TFPM: Combined data validation passed. [2025-09-05T19:02:23.086372] [INFO ] [MAIN ] TFX: Combined data validation passed. [2025-09-05T19:02:23.224054] [INFO ] [MAIN ] TGE: Update completed successfully. [2025-09-05T19:02:23.242918] [INFO ] [MAIN ] Update Progress: 2071/2363 symbols completed. TGE took 3.2s. Estimated remaining: 8m 47s. Rate: 33.2 symbols/min [2025-09-05T19:02:23.386175] [INFO ] [MAIN ] TFPM: Update completed successfully. [2025-09-05T19:02:23.408223] [INFO ] [MAIN ] Update Progress: 2072/2363 symbols completed. TFPM took 5.2s. Estimated remaining: 8m 45s. Rate: 33.2 symbols/min [2025-09-05T19:02:23.551451] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:23.624300] [INFO ] [MAIN ] TFX: Update completed successfully. [2025-09-05T19:02:23.658937] [INFO ] [MAIN ] Update Progress: 2073/2363 symbols completed. TFX took 5.3s. Estimated remaining: 8m 43s. Rate: 33.3 symbols/min [2025-09-05T19:02:23.728416] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:23.787236] [INFO ] [MAIN ] TGNA: Loaded 23091 existing records. [2025-09-05T19:02:23.838084] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-05T19:02:24.105484] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:24.101986] [INFO ] [MAIN ] TGLS: Adding 155 new records, updating 0 existing records. [2025-09-05T19:02:24.101500] [INFO ] [MAIN ] TGS: Loaded 15204 existing records. [2025-09-05T19:02:24.239958] [INFO ] [MAIN ] TGNA: Found 1 missing trading days. [2025-09-05T19:02:24.265212] [INFO ] [MAIN ] TGNA: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:24.288550] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-05T19:02:24.293269] [INFO ] [MAIN ] TGLS: Combined dataset has 12749 total records. [2025-09-05T19:02:24.455246] [INFO ] [MAIN ] TGS: Found 1 missing trading days. [2025-09-05T19:02:24.502550] [INFO ] [MAIN ] TGS: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:24.503155] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-05T19:02:24.502484] [INFO ] [MAIN ] TGT: Loaded 25698 existing records. [2025-09-05T19:02:24.703053] [WARN ] [VALIDATOR ] TGLS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:24.889096] [INFO ] [MAIN ] TGT: Found 1 missing trading days. [2025-09-05T19:02:24.889322] [INFO ] [MAIN ] TGT: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:24.895252] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-05T19:02:25.000580] [WARN ] [VALIDATOR ] TGLS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:25.001219] [INFO ] [MAIN ] TGLS: Combined data validation passed. [2025-09-05T19:02:25.106469] [INFO ] [MAIN ] TGLS: Update completed successfully. [2025-09-05T19:02:25.108482] [INFO ] [MAIN ] Update Progress: 2074/2363 symbols completed. TGLS took 4.0s. Estimated remaining: 8m 41s. Rate: 33.3 symbols/min [2025-09-05T19:02:25.290275] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:25.316025] [INFO ] [MAIN ] THC: Loaded 22568 existing records. [2025-09-05T19:02:25.496005] [INFO ] [MAIN ] THC: Found 1 missing trading days. [2025-09-05T19:02:25.496171] [INFO ] [MAIN ] THC: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:25.496395] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-05T19:02:25.887077] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-05T19:02:25.924774] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T19:02:26.162013] [INFO ] [MAIN ] TGS: Adding 302 new records, updating 0 existing records. [2025-09-05T19:02:26.264305] [INFO ] [MAIN ] TGNA: Adding 379 new records, updating 1095 existing records. [2025-09-05T19:02:26.264594] [INFO ] [MAIN ] TGS: Combined dataset has 15506 total records. [2025-09-05T19:02:26.426734] [INFO ] [MAIN ] TGNA: Combined dataset has 23470 total records. [2025-09-05T19:02:26.490015] [WARN ] [VALIDATOR ] TGS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:26.782990] [WARN ] [VALIDATOR ] TGNA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:26.967093] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T19:02:27.097563] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-05T19:02:27.272917] [INFO ] [MAIN ] THC: Adding 336 new records, updating 0 existing records. [2025-09-05T19:02:27.371987] [INFO ] [MAIN ] THC: Combined dataset has 22904 total records. [2025-09-05T19:02:27.382850] [INFO ] [MAIN ] TGT: Adding 390 new records, updating 0 existing records. [2025-09-05T19:02:27.513681] [INFO ] [MAIN ] TGT: Combined dataset has 26088 total records. [2025-09-05T19:02:27.670373] [WARN ] [VALIDATOR ] TGS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:27.674658] [WARN ] [VALIDATOR ] THC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:27.690392] [WARN ] [VALIDATOR ] TGNA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:27.716786] [INFO ] [MAIN ] TGNA: Combined data validation passed. [2025-09-05T19:02:27.701081] [INFO ] [MAIN ] TGS: Combined data validation passed. [2025-09-05T19:02:27.998175] [WARN ] [VALIDATOR ] TGT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:28.328525] [INFO ] [MAIN ] TGS: Update completed successfully. [2025-09-05T19:02:28.347359] [INFO ] [MAIN ] Update Progress: 2075/2363 symbols completed. TGS took 4.9s. Estimated remaining: 8m 40s. Rate: 33.2 symbols/min [2025-09-05T19:02:28.659814] [WARN ] [VALIDATOR ] TGT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:28.667928] [WARN ] [VALIDATOR ] THC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:28.669675] [INFO ] [MAIN ] THC: Combined data validation passed. [2025-09-05T19:02:28.668247] [INFO ] [MAIN ] TGT: Combined data validation passed. [2025-09-05T19:02:28.699320] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:28.703779] [INFO ] [MAIN ] TGNA: Update completed successfully. [2025-09-05T19:02:28.708084] [INFO ] [MAIN ] Update Progress: 2076/2363 symbols completed. TGNA took 5.4s. Estimated remaining: 8m 38s. Rate: 33.3 symbols/min [2025-09-05T19:02:28.704438] [WARN ] [MAIN ] THG: No existing data found, performing full refresh instead. [2025-09-05T19:02:28.896726] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-05T19:02:28.912379] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-05T19:02:28.959834] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-05T19:02:29.225560] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:29.241571] [WARN ] [MAIN ] THIR: No existing data found, performing full refresh instead. [2025-09-05T19:02:29.244897] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-05T19:02:29.245740] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-05T19:02:29.261932] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-05T19:02:29.931690] [INFO ] [MAIN ] THC: Update completed successfully. [2025-09-05T19:02:29.956738] [INFO ] [REMOTE ] THG: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:02:29.964881] [INFO ] [MAIN ] Update Progress: 2077/2363 symbols completed. THC took 4.9s. Estimated remaining: 8m 36s. Rate: 33.3 symbols/min [2025-09-05T19:02:30.006055] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-05T19:02:30.040255] [INFO ] [REMOTE ] THIR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:02:30.042969] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-05T19:02:30.047696] [INFO ] [MAIN ] TGT: Update completed successfully. [2025-09-05T19:02:30.050447] [INFO ] [MAIN ] Update Progress: 2078/2363 symbols completed. TGT took 6.4s. Estimated remaining: 8m 34s. Rate: 33.3 symbols/min [2025-09-05T19:02:30.353403] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-05T19:02:30.354610] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-05T19:02:30.695628] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-05T19:02:30.697074] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-05T19:02:31.260164] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-05T19:02:31.261270] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-05T19:02:31.407666] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-05T19:02:31.412173] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-05T19:02:31.719004] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-05T19:02:31.720195] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-05T19:02:32.288786] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-05T19:02:32.290220] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-05T19:02:32.706143] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-05T19:02:32.711463] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-05T19:02:32.955380] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-05T19:02:32.956853] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-05T19:02:33.644425] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-05T19:02:33.645929] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-05T19:02:33.948824] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-05T19:02:33.954325] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-05T19:02:34.066000] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-05T19:02:34.067526] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-05T19:02:34.741328] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T19:02:34.742155] [INFO ] [REMOTE ] THIR: Full fetch complete (2174 records). [2025-09-05T19:02:35.105561] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-05T19:02:35.117012] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-05T19:02:35.117131] [INFO ] [MAIN ] Update Progress: 2079/2363 symbols completed. THIR took 6.3s. Estimated remaining: 8m 32s. Rate: 33.3 symbols/min [2025-09-05T19:02:35.317758] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-05T19:02:35.324228] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-05T19:02:36.137337] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-05T19:02:36.142222] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-05T19:02:37.201063] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-05T19:02:37.206189] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-05T19:02:38.044717] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-05T19:02:38.050984] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-05T19:02:39.223178] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-05T19:02:39.228015] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-05T19:02:40.087772] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T19:02:40.089390] [INFO ] [REMOTE ] THG: Full fetch complete (24568 records). [2025-09-05T19:02:40.459166] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-05T19:02:40.571059] [INFO ] [MAIN ] THG: Full history saved. [2025-09-05T19:02:40.571220] [INFO ] [MAIN ] Update Progress: 2080/2363 symbols completed. THG took 12.2s. Estimated remaining: 8m 31s. Rate: 33.2 symbols/min [2025-09-05T19:02:41.154855] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:41.257118] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:41.265089] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:41.291608] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:41.299890] [INFO ] [MAIN ] THLV: Loaded 1160 existing records. [2025-09-05T19:02:41.355603] [INFO ] [MAIN ] THR: Loaded 9107 existing records. [2025-09-05T19:02:41.411400] [INFO ] [MAIN ] THQ: Loaded 13447 existing records. [2025-09-05T19:02:41.444902] [INFO ] [MAIN ] THO: Loaded 19705 existing records. [2025-09-05T19:02:41.794508] [INFO ] [MAIN ] THLV: Found 1 missing trading days. [2025-09-05T19:02:41.862424] [INFO ] [MAIN ] THLV: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:41.894292] [INFO ] [MAIN ] THR: Found 1 missing trading days. [2025-09-05T19:02:41.900025] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-05T19:02:41.920698] [INFO ] [MAIN ] THR: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:41.947104] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-05T19:02:42.050567] [INFO ] [MAIN ] THQ: Found 1 missing trading days. [2025-09-05T19:02:42.061391] [INFO ] [MAIN ] THQ: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:42.073329] [INFO ] [MAIN ] THO: Found 1 missing trading days. [2025-09-05T19:02:42.073981] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-05T19:02:42.074178] [INFO ] [MAIN ] THO: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:42.075228] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-05T19:02:42.491036] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T19:02:42.496547] [INFO ] [MAIN ] THLV: Adding 7 new records, updating 0 existing records. [2025-09-05T19:02:42.498009] [INFO ] [MAIN ] THLV: Combined dataset has 1167 total records. [2025-09-05T19:02:42.677125] [WARN ] [VALIDATOR ] THLV: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:42.874248] [WARN ] [VALIDATOR ] THLV: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:42.874459] [INFO ] [MAIN ] THLV: Combined data validation passed. [2025-09-05T19:02:42.883333] [INFO ] [MAIN ] THLV: Update completed successfully. [2025-09-05T19:02:42.883664] [INFO ] [MAIN ] Update Progress: 2081/2363 symbols completed. THLV took 2.3s. Estimated remaining: 8m 29s. Rate: 33.2 symbols/min [2025-09-05T19:02:43.064024] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:43.093943] [INFO ] [MAIN ] THS: Loaded 28735 existing records. [2025-09-05T19:02:43.227613] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T19:02:43.317374] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T19:02:43.316117] [INFO ] [MAIN ] THS: Found 1 missing trading days. [2025-09-05T19:02:43.344130] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T19:02:43.405619] [INFO ] [MAIN ] THS: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:43.472538] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-05T19:02:43.524276] [INFO ] [MAIN ] THO: Adding 305 new records, updating 0 existing records. [2025-09-05T19:02:43.559134] [INFO ] [MAIN ] THQ: Adding 147 new records, updating 0 existing records. [2025-09-05T19:02:43.574757] [INFO ] [MAIN ] THR: Adding 173 new records, updating 0 existing records. [2025-09-05T19:02:43.580027] [INFO ] [MAIN ] THO: Combined dataset has 20010 total records. [2025-09-05T19:02:43.579956] [INFO ] [MAIN ] THR: Combined dataset has 9280 total records. [2025-09-05T19:02:43.580132] [INFO ] [MAIN ] THQ: Combined dataset has 13594 total records. [2025-09-05T19:02:44.057632] [WARN ] [VALIDATOR ] THO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:44.111682] [WARN ] [VALIDATOR ] THR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:44.224996] [WARN ] [VALIDATOR ] THQ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:44.765682] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T19:02:44.918391] [INFO ] [MAIN ] THS: Adding 299 new records, updating 0 existing records. [2025-09-05T19:02:44.928584] [INFO ] [MAIN ] THS: Combined dataset has 29034 total records. [2025-09-05T19:02:44.978292] [WARN ] [VALIDATOR ] THR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:44.983828] [WARN ] [VALIDATOR ] THQ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:44.984304] [INFO ] [MAIN ] THR: Combined data validation passed. [2025-09-05T19:02:44.989834] [INFO ] [MAIN ] THQ: Combined data validation passed. [2025-09-05T19:02:44.989534] [WARN ] [VALIDATOR ] THO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:45.027888] [INFO ] [MAIN ] THO: Combined data validation passed. [2025-09-05T19:02:45.304955] [WARN ] [VALIDATOR ] THS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:45.596465] [INFO ] [MAIN ] THR: Update completed successfully. [2025-09-05T19:02:45.598076] [INFO ] [MAIN ] Update Progress: 2082/2363 symbols completed. THR took 5.0s. Estimated remaining: 8m 28s. Rate: 33.2 symbols/min [2025-09-05T19:02:45.651609] [INFO ] [MAIN ] THO: Update completed successfully. [2025-09-05T19:02:45.665732] [INFO ] [MAIN ] Update Progress: 2083/2363 symbols completed. THO took 5.1s. Estimated remaining: 8m 26s. Rate: 33.2 symbols/min [2025-09-05T19:02:45.855612] [INFO ] [MAIN ] THQ: Update completed successfully. [2025-09-05T19:02:45.862594] [INFO ] [MAIN ] Update Progress: 2084/2363 symbols completed. THQ took 5.3s. Estimated remaining: 8m 24s. Rate: 33.2 symbols/min [2025-09-05T19:02:45.938697] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:46.000865] [WARN ] [MAIN ] THW: No existing data found, performing full refresh instead. [2025-09-05T19:02:46.037744] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-05T19:02:46.104906] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:46.115590] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-05T19:02:46.143130] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-05T19:02:46.328702] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:46.410666] [INFO ] [MAIN ] TIC: Loaded 22781 existing records. [2025-09-05T19:02:46.669939] [INFO ] [MAIN ] TIMB: Loaded 27780 existing records. [2025-09-05T19:02:46.805169] [INFO ] [REMOTE ] THW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:02:46.811082] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-05T19:02:46.978245] [INFO ] [MAIN ] TIC: Found 1 missing trading days. [2025-09-05T19:02:46.999296] [INFO ] [MAIN ] TIC: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:47.048206] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-05T19:02:47.060007] [INFO ] [MAIN ] TIMB: Found 1 missing trading days. [2025-09-05T19:02:47.060615] [INFO ] [MAIN ] TIMB: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:47.062293] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-05T19:02:47.065082] [WARN ] [VALIDATOR ] THS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:47.065277] [INFO ] [MAIN ] THS: Combined data validation passed. [2025-09-05T19:02:47.253965] [INFO ] [MAIN ] THS: Update completed successfully. [2025-09-05T19:02:47.257913] [INFO ] [MAIN ] Update Progress: 2085/2363 symbols completed. THS took 4.4s. Estimated remaining: 8m 22s. Rate: 33.2 symbols/min [2025-09-05T19:02:47.435822] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:47.439065] [INFO ] [MAIN ] TISI: Loaded 1222 existing records. [2025-09-05T19:02:47.613301] [INFO ] [MAIN ] TISI: Found 1 missing trading days. [2025-09-05T19:02:47.613467] [INFO ] [MAIN ] TISI: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:47.613705] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-05T19:02:48.131817] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-05T19:02:48.139161] [INFO ] [MAIN ] TISI: Adding 16 new records, updating 0 existing records. [2025-09-05T19:02:48.141162] [INFO ] [MAIN ] TISI: Combined dataset has 1238 total records. [2025-09-05T19:02:48.356313] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T19:02:48.391477] [WARN ] [VALIDATOR ] TISI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:48.602395] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-05T19:02:48.605906] [INFO ] [MAIN ] TIMB: Adding 250 new records, updating 0 existing records. [2025-09-05T19:02:48.624091] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-05T19:02:48.730561] [INFO ] [MAIN ] TIMB: Combined dataset has 28030 total records. [2025-09-05T19:02:48.900974] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-05T19:02:48.938707] [WARN ] [VALIDATOR ] TIMB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:02:49.207270] [INFO ] [MAIN ] TIC: Adding 338 new records, updating 0 existing records. [2025-09-05T19:02:49.274341] [INFO ] [MAIN ] TIC: Combined dataset has 23119 total records. [2025-09-05T19:02:49.470250] [WARN ] [VALIDATOR ] TIC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:49.596414] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-05T19:02:49.613096] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-05T19:02:49.702938] [WARN ] [VALIDATOR ] TIMB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:02:49.704070] [INFO ] [MAIN ] TIMB: Combined data validation passed. [2025-09-05T19:02:49.703254] [WARN ] [VALIDATOR ] TISI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:49.704942] [INFO ] [MAIN ] TISI: Combined data validation passed. [2025-09-05T19:02:49.715468] [INFO ] [MAIN ] TISI: Update completed successfully. [2025-09-05T19:02:49.715961] [INFO ] [MAIN ] Update Progress: 2086/2363 symbols completed. TISI took 2.5s. Estimated remaining: 8m 20s. Rate: 33.2 symbols/min [2025-09-05T19:02:49.993151] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:50.020009] [INFO ] [MAIN ] TIXT: Loaded 16718 existing records. [2025-09-05T19:02:50.204836] [INFO ] [MAIN ] TIXT: Found 1 missing trading days. [2025-09-05T19:02:50.205717] [INFO ] [MAIN ] TIXT: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:50.206072] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-05T19:02:50.216266] [WARN ] [VALIDATOR ] TIC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:50.222176] [INFO ] [MAIN ] TIC: Combined data validation passed. [2025-09-05T19:02:50.387324] [INFO ] [MAIN ] TIMB: Update completed successfully. [2025-09-05T19:02:50.391360] [INFO ] [MAIN ] Update Progress: 2087/2363 symbols completed. TIMB took 4.5s. Estimated remaining: 8m 18s. Rate: 33.2 symbols/min [2025-09-05T19:02:50.606510] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:50.640148] [INFO ] [MAIN ] TIC: Update completed successfully. [2025-09-05T19:02:50.643186] [INFO ] [MAIN ] Update Progress: 2088/2363 symbols completed. TIC took 5.0s. Estimated remaining: 8m 16s. Rate: 33.3 symbols/min [2025-09-05T19:02:50.846133] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:50.848184] [INFO ] [MAIN ] TJX: Loaded 25603 existing records. [2025-09-05T19:02:50.846817] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-05T19:02:50.927861] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-05T19:02:51.045328] [INFO ] [MAIN ] TJX: Found 1 missing trading days. [2025-09-05T19:02:51.045594] [INFO ] [MAIN ] TJX: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:51.045954] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-05T19:02:51.054901] [INFO ] [MAIN ] TK: Loaded 18698 existing records. [2025-09-05T19:02:51.265806] [INFO ] [MAIN ] TK: Found 1 missing trading days. [2025-09-05T19:02:51.265973] [INFO ] [MAIN ] TK: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:51.266194] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-05T19:02:51.352826] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T19:02:51.484561] [INFO ] [MAIN ] TIXT: Adding 387 new records, updating 0 existing records. [2025-09-05T19:02:51.488203] [INFO ] [MAIN ] TIXT: Combined dataset has 17105 total records. [2025-09-05T19:02:51.670133] [WARN ] [VALIDATOR ] TIXT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:51.847866] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-05T19:02:51.891820] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-05T19:02:51.911412] [WARN ] [VALIDATOR ] TIXT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:51.911620] [INFO ] [MAIN ] TIXT: Combined data validation passed. [2025-09-05T19:02:52.015256] [INFO ] [MAIN ] TIXT: Update completed successfully. [2025-09-05T19:02:52.017630] [INFO ] [MAIN ] Update Progress: 2089/2363 symbols completed. TIXT took 2.3s. Estimated remaining: 8m 14s. Rate: 33.3 symbols/min [2025-09-05T19:02:52.191477] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:52.211829] [INFO ] [MAIN ] TKC: Loaded 18000 existing records. [2025-09-05T19:02:52.396805] [INFO ] [MAIN ] TKC: Found 1 missing trading days. [2025-09-05T19:02:52.396981] [INFO ] [MAIN ] TKC: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:52.397405] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-05T19:02:52.403092] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T19:02:52.499656] [INFO ] [MAIN ] TK: Adding 268 new records, updating 0 existing records. [2025-09-05T19:02:52.503465] [INFO ] [MAIN ] TK: Combined dataset has 18966 total records. [2025-09-05T19:02:52.680298] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-05T19:02:52.700294] [WARN ] [VALIDATOR ] TK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:53.058019] [INFO ] [MAIN ] TJX: Adding 390 new records, updating 0 existing records. [2025-09-05T19:02:53.073953] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-05T19:02:53.082206] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-05T19:02:53.087744] [INFO ] [MAIN ] TJX: Combined dataset has 25993 total records. [2025-09-05T19:02:53.279461] [WARN ] [VALIDATOR ] TJX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:53.480456] [WARN ] [VALIDATOR ] TK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:53.481297] [INFO ] [MAIN ] TK: Combined data validation passed. [2025-09-05T19:02:53.576699] [WARN ] [VALIDATOR ] TJX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:53.578035] [INFO ] [MAIN ] TJX: Combined data validation passed. [2025-09-05T19:02:53.589277] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-05T19:02:53.837358] [INFO ] [MAIN ] TK: Update completed successfully. [2025-09-05T19:02:53.860529] [INFO ] [MAIN ] Update Progress: 2090/2363 symbols completed. TK took 3.2s. Estimated remaining: 8m 12s. Rate: 33.3 symbols/min [2025-09-05T19:02:53.910015] [INFO ] [MAIN ] TKC: Adding 281 new records, updating 0 existing records. [2025-09-05T19:02:54.020670] [INFO ] [MAIN ] TKC: Combined dataset has 18281 total records. [2025-09-05T19:02:54.234558] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:54.391435] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-05T19:02:54.415795] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-05T19:02:54.443577] [INFO ] [MAIN ] TJX: Update completed successfully. [2025-09-05T19:02:54.513226] [WARN ] [VALIDATOR ] TKC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:54.514039] [INFO ] [MAIN ] Update Progress: 2091/2363 symbols completed. TJX took 4.1s. Estimated remaining: 8m 10s. Rate: 33.3 symbols/min [2025-09-05T19:02:54.627900] [INFO ] [MAIN ] TKO: Loaded 19782 existing records. [2025-09-05T19:02:55.339938] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:55.370787] [INFO ] [MAIN ] TKO: Found 1 missing trading days. [2025-09-05T19:02:55.372230] [INFO ] [MAIN ] TKO: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:55.372800] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-05T19:02:55.402472] [INFO ] [MAIN ] TKR: Loaded 17825 existing records. [2025-09-05T19:02:55.628998] [INFO ] [MAIN ] TKR: Found 1 missing trading days. [2025-09-05T19:02:55.629582] [INFO ] [MAIN ] TKR: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:55.629995] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-05T19:02:55.632812] [WARN ] [VALIDATOR ] TKC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:55.632940] [INFO ] [MAIN ] TKC: Combined data validation passed. [2025-09-05T19:02:55.754082] [INFO ] [MAIN ] TKC: Update completed successfully. [2025-09-05T19:02:55.756246] [INFO ] [MAIN ] Update Progress: 2092/2363 symbols completed. TKC took 3.7s. Estimated remaining: 8m 9s. Rate: 33.3 symbols/min [2025-09-05T19:02:55.983530] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:56.012785] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-05T19:02:56.022386] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-05T19:02:56.040240] [INFO ] [MAIN ] TLK: Loaded 18668 existing records. [2025-09-05T19:02:56.228361] [INFO ] [MAIN ] TLK: Found 1 missing trading days. [2025-09-05T19:02:56.228512] [INFO ] [MAIN ] TLK: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:56.228756] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-05T19:02:56.724421] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:02:56.855554] [INFO ] [MAIN ] TKO: Adding 326 new records, updating 0 existing records. [2025-09-05T19:02:56.876416] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-05T19:02:56.883723] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-05T19:02:56.884947] [INFO ] [MAIN ] TKO: Combined dataset has 20108 total records. [2025-09-05T19:02:57.047918] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T19:02:57.079283] [WARN ] [VALIDATOR ] TKO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:57.299186] [INFO ] [MAIN ] TKR: Adding 244 new records, updating 0 existing records. [2025-09-05T19:02:57.316518] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T19:02:57.483787] [INFO ] [MAIN ] TKR: Combined dataset has 18069 total records. [2025-09-05T19:02:57.495601] [INFO ] [MAIN ] TLK: Adding 215 new records, updating 0 existing records. [2025-09-05T19:02:57.602972] [INFO ] [MAIN ] TLK: Combined dataset has 18883 total records. [2025-09-05T19:02:57.761766] [WARN ] [VALIDATOR ] TKR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:57.979115] [WARN ] [VALIDATOR ] TLK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:02:58.005411] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T19:02:58.141785] [INFO ] [REMOTE ] THW: Full fetch complete (21013 records). [2025-09-05T19:02:58.383806] [WARN ] [VALIDATOR ] TKO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:58.426015] [INFO ] [MAIN ] TKO: Combined data validation passed. [2025-09-05T19:02:58.764701] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-05T19:02:58.796856] [INFO ] [MAIN ] TKO: Update completed successfully. [2025-09-05T19:02:58.799980] [INFO ] [MAIN ] Update Progress: 2093/2363 symbols completed. TKO took 4.9s. Estimated remaining: 8m 7s. Rate: 33.3 symbols/min [2025-09-05T19:02:59.019038] [WARN ] [VALIDATOR ] TKR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:59.013115] [WARN ] [VALIDATOR ] TLK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:02:59.024926] [INFO ] [MAIN ] TKR: Combined data validation passed. [2025-09-05T19:02:59.050993] [INFO ] [MAIN ] TLK: Combined data validation passed. [2025-09-05T19:02:59.086796] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:02:59.255261] [INFO ] [MAIN ] TLYS: Loaded 9516 existing records. [2025-09-05T19:02:59.515941] [INFO ] [MAIN ] TLYS: Found 1 missing trading days. [2025-09-05T19:02:59.516027] [INFO ] [MAIN ] TLK: Update completed successfully. [2025-09-05T19:02:59.519735] [INFO ] [MAIN ] TLYS: Need to fetch 1 months: 2025-09 [2025-09-05T19:02:59.524098] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-05T19:02:59.521421] [INFO ] [MAIN ] Update Progress: 2094/2363 symbols completed. TLK took 3.8s. Estimated remaining: 8m 5s. Rate: 33.3 symbols/min [2025-09-05T19:02:59.586544] [INFO ] [MAIN ] THW: Full history saved. [2025-09-05T19:02:59.592087] [INFO ] [MAIN ] Update Progress: 2095/2363 symbols completed. THW took 14.0s. Estimated remaining: 8m 3s. Rate: 33.3 symbols/min [2025-09-05T19:02:59.600624] [INFO ] [MAIN ] TKR: Update completed successfully. [2025-09-05T19:02:59.731124] [INFO ] [MAIN ] Update Progress: 2096/2363 symbols completed. TKR took 5.2s. Estimated remaining: 8m 1s. Rate: 33.3 symbols/min [2025-09-05T19:02:59.965831] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:00.107031] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:00.197254] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:00.240808] [INFO ] [MAIN ] TME: Loaded 25416 existing records. [2025-09-05T19:03:00.283020] [INFO ] [MAIN ] TM: Loaded 28635 existing records. [2025-09-05T19:03:00.433106] [INFO ] [MAIN ] TMHC: Loaded 21769 existing records. [2025-09-05T19:03:00.635875] [INFO ] [MAIN ] TME: Found 1 missing trading days. [2025-09-05T19:03:00.710235] [INFO ] [MAIN ] TME: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:00.743879] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-05T19:03:00.746807] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T19:03:00.769923] [INFO ] [MAIN ] TM: Found 1 missing trading days. [2025-09-05T19:03:00.796715] [INFO ] [MAIN ] TM: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:00.833079] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-05T19:03:00.906856] [INFO ] [MAIN ] TLYS: Adding 178 new records, updating 0 existing records. [2025-09-05T19:03:00.903858] [INFO ] [MAIN ] TMHC: Found 1 missing trading days. [2025-09-05T19:03:00.907542] [INFO ] [MAIN ] TMHC: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:00.907974] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-05T19:03:00.910710] [INFO ] [MAIN ] TLYS: Combined dataset has 9694 total records. [2025-09-05T19:03:01.096819] [WARN ] [VALIDATOR ] TLYS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:01.306502] [WARN ] [VALIDATOR ] TLYS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:01.306735] [INFO ] [MAIN ] TLYS: Combined data validation passed. [2025-09-05T19:03:01.365860] [INFO ] [MAIN ] TLYS: Update completed successfully. [2025-09-05T19:03:01.367010] [INFO ] [MAIN ] Update Progress: 2097/2363 symbols completed. TLYS took 2.6s. Estimated remaining: 7m 59s. Rate: 33.3 symbols/min [2025-09-05T19:03:01.542691] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:01.569476] [INFO ] [MAIN ] TMO: Loaded 24971 existing records. [2025-09-05T19:03:01.760028] [INFO ] [MAIN ] TMO: Found 1 missing trading days. [2025-09-05T19:03:01.760248] [INFO ] [MAIN ] TMO: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:01.760633] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-05T19:03:02.010206] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T19:03:02.148117] [INFO ] [MAIN ] TMHC: Adding 364 new records, updating 0 existing records. [2025-09-05T19:03:02.157204] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T19:03:02.227281] [INFO ] [MAIN ] TMHC: Combined dataset has 22133 total records. [2025-09-05T19:03:02.370011] [INFO ] [MAIN ] TM: Adding 220 new records, updating 0 existing records. [2025-09-05T19:03:02.496588] [WARN ] [VALIDATOR ] TMHC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:02.570404] [INFO ] [MAIN ] TM: Combined dataset has 28855 total records. [2025-09-05T19:03:02.811002] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-05T19:03:02.958154] [WARN ] [VALIDATOR ] TM: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:03.176706] [INFO ] [MAIN ] TME: Adding 388 new records, updating 0 existing records. [2025-09-05T19:03:03.271376] [INFO ] [MAIN ] TME: Combined dataset has 25804 total records. [2025-09-05T19:03:03.465025] [WARN ] [VALIDATOR ] TME: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:03.584006] [WARN ] [VALIDATOR ] TMHC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:03.584064] [WARN ] [VALIDATOR ] TM: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:03.637923] [INFO ] [MAIN ] TM: Combined data validation passed. [2025-09-05T19:03:03.637708] [INFO ] [MAIN ] TMHC: Combined data validation passed. [2025-09-05T19:03:03.823686] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-05T19:03:04.037874] [INFO ] [MAIN ] TMO: Adding 370 new records, updating 0 existing records. [2025-09-05T19:03:04.072898] [INFO ] [MAIN ] TMHC: Update completed successfully. [2025-09-05T19:03:04.079136] [INFO ] [MAIN ] TMO: Combined dataset has 25341 total records. [2025-09-05T19:03:04.081931] [INFO ] [MAIN ] Update Progress: 2098/2363 symbols completed. TMHC took 4.3s. Estimated remaining: 7m 57s. Rate: 33.3 symbols/min [2025-09-05T19:03:04.304996] [INFO ] [MAIN ] TM: Update completed successfully. [2025-09-05T19:03:04.332192] [INFO ] [MAIN ] Update Progress: 2099/2363 symbols completed. TM took 4.8s. Estimated remaining: 7m 55s. Rate: 33.3 symbols/min [2025-09-05T19:03:04.571362] [WARN ] [VALIDATOR ] TMO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:04.567987] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:04.869292] [INFO ] [MAIN ] TNC: Loaded 6667 existing records. [2025-09-05T19:03:04.878875] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:04.993085] [WARN ] [VALIDATOR ] TME: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:05.004354] [INFO ] [MAIN ] TNET: Loaded 13659 existing records. [2025-09-05T19:03:05.004688] [INFO ] [MAIN ] TME: Combined data validation passed. [2025-09-05T19:03:05.227163] [INFO ] [MAIN ] TNC: Found 1 missing trading days. [2025-09-05T19:03:05.276083] [INFO ] [MAIN ] TNC: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:05.284960] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-05T19:03:05.374045] [INFO ] [MAIN ] TNET: Found 1 missing trading days. [2025-09-05T19:03:05.382454] [INFO ] [MAIN ] TNET: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:05.384185] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-05T19:03:05.403058] [WARN ] [VALIDATOR ] TMO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:05.404397] [INFO ] [MAIN ] TMO: Combined data validation passed. [2025-09-05T19:03:05.546620] [INFO ] [MAIN ] TME: Update completed successfully. [2025-09-05T19:03:05.550386] [INFO ] [MAIN ] Update Progress: 2100/2363 symbols completed. TME took 6.0s. Estimated remaining: 7m 54s. Rate: 33.3 symbols/min [2025-09-05T19:03:05.749366] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:05.757710] [INFO ] [MAIN ] TNGY: Loaded 2600 existing records. [2025-09-05T19:03:05.962793] [INFO ] [MAIN ] TNGY: Found 1 missing trading days. [2025-09-05T19:03:05.966751] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-05T19:03:05.968372] [INFO ] [MAIN ] TNGY: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:05.977737] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-05T19:03:06.012508] [INFO ] [MAIN ] TNC: Adding 137 new records, updating 0 existing records. [2025-09-05T19:03:06.018577] [INFO ] [MAIN ] TNC: Combined dataset has 6804 total records. [2025-09-05T19:03:06.233285] [WARN ] [VALIDATOR ] TNC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:06.329111] [INFO ] [MAIN ] TMO: Update completed successfully. [2025-09-05T19:03:06.354205] [INFO ] [MAIN ] Update Progress: 2101/2363 symbols completed. TMO took 5.0s. Estimated remaining: 7m 52s. Rate: 33.3 symbols/min [2025-09-05T19:03:06.551765] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T19:03:06.663509] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:06.710940] [INFO ] [MAIN ] TNET: Adding 150 new records, updating 0 existing records. [2025-09-05T19:03:06.722891] [INFO ] [MAIN ] TNET: Combined dataset has 13809 total records. [2025-09-05T19:03:06.740693] [INFO ] [MAIN ] TNK: Loaded 16142 existing records. [2025-09-05T19:03:07.063374] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T19:03:07.144591] [INFO ] [MAIN ] TNK: Found 1 missing trading days. [2025-09-05T19:03:07.179269] [INFO ] [MAIN ] TNK: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:07.187719] [WARN ] [VALIDATOR ] TNET: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:07.197477] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-05T19:03:07.197230] [INFO ] [MAIN ] TNGY: Adding 62 new records, updating 0 existing records. [2025-09-05T19:03:07.280786] [INFO ] [MAIN ] TNGY: Combined dataset has 2662 total records. [2025-09-05T19:03:07.564713] [WARN ] [VALIDATOR ] TNC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:07.565173] [INFO ] [MAIN ] TNC: Combined data validation passed. [2025-09-05T19:03:07.573049] [WARN ] [VALIDATOR ] TNGY: Not fatal, but first date in data (2025-06-16) does not match expected start date (2025-01-31) [2025-09-05T19:03:07.729053] [INFO ] [MAIN ] TNC: Update completed successfully. [2025-09-05T19:03:07.735888] [INFO ] [MAIN ] Update Progress: 2102/2363 symbols completed. TNC took 3.7s. Estimated remaining: 7m 50s. Rate: 33.3 symbols/min [2025-09-05T19:03:07.995703] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:08.021505] [WARN ] [VALIDATOR ] TNET: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:08.021405] [WARN ] [VALIDATOR ] TNGY: Missing days changed. Total missing: 93 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10, 2025-06-11, 2025-06-12, 2025-06-13 [2025-09-05T19:03:08.028776] [INFO ] [MAIN ] TNET: Combined data validation passed. [2025-09-05T19:03:08.029423] [INFO ] [MAIN ] TNL: Loaded 19625 existing records. [2025-09-05T19:03:08.028685] [INFO ] [MAIN ] TNGY: Combined data validation passed. [2025-09-05T19:03:08.258236] [INFO ] [MAIN ] TNET: Update completed successfully. [2025-09-05T19:03:08.266342] [INFO ] [MAIN ] Update Progress: 2103/2363 symbols completed. TNET took 3.9s. Estimated remaining: 7m 48s. Rate: 33.3 symbols/min [2025-09-05T19:03:08.277028] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T19:03:08.316109] [INFO ] [MAIN ] TNGY: Update completed successfully. [2025-09-05T19:03:08.344527] [INFO ] [MAIN ] Update Progress: 2104/2363 symbols completed. TNGY took 2.8s. Estimated remaining: 7m 46s. Rate: 33.4 symbols/min [2025-09-05T19:03:08.441210] [INFO ] [MAIN ] TNL: Found 1 missing trading days. [2025-09-05T19:03:08.491076] [INFO ] [MAIN ] TNL: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:08.527180] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-05T19:03:08.614044] [INFO ] [MAIN ] TNK: Adding 289 new records, updating 0 existing records. [2025-09-05T19:03:08.731914] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:08.774392] [INFO ] [MAIN ] TNK: Combined dataset has 16431 total records. [2025-09-05T19:03:08.827902] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:08.998623] [WARN ] [VALIDATOR ] TNK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:09.051734] [INFO ] [MAIN ] TOL: Loaded 38282 existing records. [2025-09-05T19:03:09.218634] [INFO ] [MAIN ] TOST: Loaded 25613 existing records. [2025-09-05T19:03:09.493674] [INFO ] [MAIN ] TOL: Found 1 missing trading days. [2025-09-05T19:03:09.514424] [INFO ] [MAIN ] TOL: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:09.534316] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-05T19:03:09.573679] [INFO ] [MAIN ] TOST: Found 1 missing trading days. [2025-09-05T19:03:09.574316] [INFO ] [MAIN ] TOST: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:09.579016] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-05T19:03:09.591831] [WARN ] [VALIDATOR ] TNK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:09.592063] [INFO ] [MAIN ] TNK: Combined data validation passed. [2025-09-05T19:03:09.695907] [INFO ] [MAIN ] TNK: Update completed successfully. [2025-09-05T19:03:09.697756] [INFO ] [MAIN ] Update Progress: 2105/2363 symbols completed. TNK took 3.3s. Estimated remaining: 7m 44s. Rate: 33.4 symbols/min [2025-09-05T19:03:09.868375] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:09.874460] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:03:10.000474] [INFO ] [MAIN ] TPB: Loaded 19049 existing records. [2025-09-05T19:03:10.000029] [INFO ] [MAIN ] TNL: Adding 293 new records, updating 0 existing records. [2025-09-05T19:03:10.143271] [INFO ] [MAIN ] TNL: Combined dataset has 19918 total records. [2025-09-05T19:03:10.178553] [INFO ] [MAIN ] TPB: Found 1 missing trading days. [2025-09-05T19:03:10.220921] [INFO ] [MAIN ] TPB: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:10.247130] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-05T19:03:10.356180] [WARN ] [VALIDATOR ] TNL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:10.546714] [WARN ] [VALIDATOR ] TNL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:10.546940] [INFO ] [MAIN ] TNL: Combined data validation passed. [2025-09-05T19:03:10.672058] [INFO ] [MAIN ] TNL: Update completed successfully. [2025-09-05T19:03:10.674132] [INFO ] [MAIN ] Update Progress: 2106/2363 symbols completed. TNL took 2.9s. Estimated remaining: 7m 42s. Rate: 33.4 symbols/min [2025-09-05T19:03:10.850658] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:10.870125] [INFO ] [MAIN ] TPC: Loaded 19216 existing records. [2025-09-05T19:03:11.045527] [INFO ] [MAIN ] TPC: Found 1 missing trading days. [2025-09-05T19:03:11.045700] [INFO ] [MAIN ] TPC: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:11.045939] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-05T19:03:11.401074] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T19:03:11.495291] [INFO ] [MAIN ] TPB: Adding 175 new records, updating 0 existing records. [2025-09-05T19:03:11.505751] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-05T19:03:11.537030] [INFO ] [MAIN ] TPB: Combined dataset has 19224 total records. [2025-09-05T19:03:11.854501] [WARN ] [VALIDATOR ] TPB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:11.903019] [INFO ] [MAIN ] TOL: Adding 390 new records, updating 0 existing records. [2025-09-05T19:03:11.939463] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-05T19:03:12.167285] [INFO ] [MAIN ] TOL: Combined dataset has 38672 total records. [2025-09-05T19:03:12.346456] [INFO ] [MAIN ] TOST: Adding 390 new records, updating 0 existing records. [2025-09-05T19:03:12.493508] [WARN ] [VALIDATOR ] TOL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:12.524118] [INFO ] [MAIN ] TOST: Combined dataset has 26003 total records. [2025-09-05T19:03:12.860957] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-05T19:03:12.860630] [WARN ] [VALIDATOR ] TOST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:13.113509] [INFO ] [MAIN ] TPC: Adding 310 new records, updating 0 existing records. [2025-09-05T19:03:13.173788] [INFO ] [MAIN ] TPC: Combined dataset has 19526 total records. [2025-09-05T19:03:13.364183] [WARN ] [VALIDATOR ] TPC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:13.566743] [WARN ] [VALIDATOR ] TOL: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:13.566818] [WARN ] [VALIDATOR ] TPB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:13.567285] [INFO ] [MAIN ] TPB: Combined data validation passed. [2025-09-05T19:03:13.567813] [WARN ] [VALIDATOR ] TOST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:13.567491] [INFO ] [MAIN ] TOL: Combined data validation passed. [2025-09-05T19:03:13.568104] [INFO ] [MAIN ] TOST: Combined data validation passed. [2025-09-05T19:03:13.947153] [INFO ] [MAIN ] TPB: Update completed successfully. [2025-09-05T19:03:13.958726] [INFO ] [MAIN ] Update Progress: 2107/2363 symbols completed. TPB took 4.3s. Estimated remaining: 7m 41s. Rate: 33.4 symbols/min [2025-09-05T19:03:14.097094] [INFO ] [MAIN ] TOST: Update completed successfully. [2025-09-05T19:03:14.105333] [INFO ] [MAIN ] Update Progress: 2108/2363 symbols completed. TOST took 5.7s. Estimated remaining: 7m 39s. Rate: 33.4 symbols/min [2025-09-05T19:03:14.248018] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:14.527422] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:14.543550] [INFO ] [MAIN ] TPH: Loaded 34074 existing records. [2025-09-05T19:03:14.579416] [INFO ] [MAIN ] TPL: Loaded 6431 existing records. [2025-09-05T19:03:14.864221] [INFO ] [MAIN ] TPH: Found 1 missing trading days. [2025-09-05T19:03:14.875883] [INFO ] [MAIN ] TPH: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:14.931254] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-05T19:03:14.936937] [INFO ] [MAIN ] TPL: Found 1 missing trading days. [2025-09-05T19:03:14.938176] [INFO ] [MAIN ] TPL: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:14.939701] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-05T19:03:14.946890] [INFO ] [MAIN ] TOL: Update completed successfully. [2025-09-05T19:03:14.947277] [WARN ] [VALIDATOR ] TPC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:14.947469] [INFO ] [MAIN ] TPC: Combined data validation passed. [2025-09-05T19:03:14.951849] [INFO ] [MAIN ] Update Progress: 2109/2363 symbols completed. TOL took 6.7s. Estimated remaining: 7m 37s. Rate: 33.4 symbols/min [2025-09-05T19:03:15.228297] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:15.275202] [INFO ] [MAIN ] TPC: Update completed successfully. [2025-09-05T19:03:15.275113] [INFO ] [MAIN ] TPR: Loaded 25499 existing records. [2025-09-05T19:03:15.277542] [INFO ] [MAIN ] Update Progress: 2110/2363 symbols completed. TPC took 4.6s. Estimated remaining: 7m 35s. Rate: 33.4 symbols/min [2025-09-05T19:03:15.613392] [INFO ] [MAIN ] TPR: Found 1 missing trading days. [2025-09-05T19:03:15.620366] [INFO ] [MAIN ] TPR: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:15.620958] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-05T19:03:15.641895] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:15.654992] [INFO ] [MAIN ] TPVG: Loaded 12509 existing records. [2025-09-05T19:03:15.833544] [INFO ] [MAIN ] TPVG: Found 1 missing trading days. [2025-09-05T19:03:15.836618] [INFO ] [MAIN ] TPVG: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:15.837091] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-05T19:03:15.836848] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-05T19:03:15.872247] [INFO ] [MAIN ] TPL: Adding 91 new records, updating 0 existing records. [2025-09-05T19:03:15.875334] [INFO ] [MAIN ] TPL: Combined dataset has 6522 total records. [2025-09-05T19:03:16.053091] [WARN ] [VALIDATOR ] TPL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:16.210240] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-05T19:03:16.375531] [INFO ] [MAIN ] TPH: Adding 318 new records, updating 0 existing records. [2025-09-05T19:03:16.381044] [INFO ] [MAIN ] TPH: Combined dataset has 34392 total records. [2025-09-05T19:03:16.563508] [WARN ] [VALIDATOR ] TPH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:16.778210] [WARN ] [VALIDATOR ] TPL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:16.778515] [INFO ] [MAIN ] TPL: Combined data validation passed. [2025-09-05T19:03:16.778317] [WARN ] [VALIDATOR ] TPH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:16.779488] [INFO ] [MAIN ] TPH: Combined data validation passed. [2025-09-05T19:03:16.922979] [INFO ] [MAIN ] TPL: Update completed successfully. [2025-09-05T19:03:16.950005] [INFO ] [MAIN ] Update Progress: 2111/2363 symbols completed. TPL took 2.8s. Estimated remaining: 7m 33s. Rate: 33.4 symbols/min [2025-09-05T19:03:17.099271] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-05T19:03:17.285997] [INFO ] [MAIN ] TPVG: Adding 201 new records, updating 0 existing records. [2025-09-05T19:03:17.308142] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:17.287893] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T19:03:17.365672] [INFO ] [MAIN ] TPVG: Combined dataset has 12710 total records. [2025-09-05T19:03:17.406934] [INFO ] [MAIN ] TPYP: Loaded 3577 existing records. [2025-09-05T19:03:17.854872] [WARN ] [VALIDATOR ] TPVG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:17.928774] [INFO ] [MAIN ] TPH: Update completed successfully. [2025-09-05T19:03:17.997961] [INFO ] [MAIN ] Update Progress: 2112/2363 symbols completed. TPH took 4.0s. Estimated remaining: 7m 31s. Rate: 33.4 symbols/min [2025-09-05T19:03:18.065845] [INFO ] [MAIN ] TPYP: Found 1 missing trading days. [2025-09-05T19:03:18.072317] [INFO ] [MAIN ] TPR: Adding 386 new records, updating 1169 existing records. [2025-09-05T19:03:18.072687] [INFO ] [MAIN ] TPYP: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:18.092820] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-05T19:03:18.305360] [INFO ] [MAIN ] TPR: Combined dataset has 25885 total records. [2025-09-05T19:03:18.371219] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:18.478044] [INFO ] [MAIN ] TPZ: Loaded 3634 existing records. [2025-09-05T19:03:18.613633] [WARN ] [VALIDATOR ] TPR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:18.854539] [INFO ] [MAIN ] TPZ: Found 1 missing trading days. [2025-09-05T19:03:18.905921] [INFO ] [MAIN ] TPZ: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:18.913367] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-05T19:03:18.931603] [WARN ] [VALIDATOR ] TPR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:18.931697] [WARN ] [VALIDATOR ] TPVG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:18.932008] [INFO ] [MAIN ] TPR: Combined data validation passed. [2025-09-05T19:03:18.931885] [INFO ] [MAIN ] TPVG: Combined data validation passed. [2025-09-05T19:03:19.077852] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-05T19:03:19.107937] [INFO ] [MAIN ] TPYP: Adding 59 new records, updating 0 existing records. [2025-09-05T19:03:19.127307] [INFO ] [MAIN ] TPYP: Combined dataset has 3636 total records. [2025-09-05T19:03:19.233312] [INFO ] [MAIN ] TPVG: Update completed successfully. [2025-09-05T19:03:19.248870] [INFO ] [MAIN ] Update Progress: 2113/2363 symbols completed. TPVG took 3.9s. Estimated remaining: 7m 29s. Rate: 33.4 symbols/min [2025-09-05T19:03:19.401125] [WARN ] [VALIDATOR ] TPYP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:19.460725] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-05T19:03:19.524511] [INFO ] [MAIN ] TPZ: Adding 15 new records, updating 0 existing records. [2025-09-05T19:03:19.663213] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:19.663988] [INFO ] [MAIN ] TPZ: Combined dataset has 3649 total records. [2025-09-05T19:03:19.823865] [INFO ] [MAIN ] TPR: Update completed successfully. [2025-09-05T19:03:19.843586] [INFO ] [MAIN ] TR: Loaded 9818 existing records. [2025-09-05T19:03:19.860976] [INFO ] [MAIN ] Update Progress: 2114/2363 symbols completed. TPR took 4.9s. Estimated remaining: 7m 27s. Rate: 33.4 symbols/min [2025-09-05T19:03:20.074901] [WARN ] [VALIDATOR ] TPZ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:20.392515] [INFO ] [MAIN ] TR: Found 1 missing trading days. [2025-09-05T19:03:20.403512] [INFO ] [MAIN ] TR: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:20.414044] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-05T19:03:20.421032] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:20.479115] [INFO ] [MAIN ] TRAK: Loaded 4526 existing records. [2025-09-05T19:03:20.658891] [INFO ] [MAIN ] TRAK: Found 1 missing trading days. [2025-09-05T19:03:20.659376] [INFO ] [MAIN ] TRAK: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:20.661805] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-05T19:03:20.673909] [WARN ] [VALIDATOR ] TPYP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:20.674201] [INFO ] [MAIN ] TPYP: Combined data validation passed. [2025-09-05T19:03:20.673975] [WARN ] [VALIDATOR ] TPZ: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:20.674515] [INFO ] [MAIN ] TPZ: Combined data validation passed. [2025-09-05T19:03:20.717241] [INFO ] [MAIN ] TPZ: Update completed successfully. [2025-09-05T19:03:20.719000] [INFO ] [MAIN ] Update Progress: 2115/2363 symbols completed. TPZ took 2.6s. Estimated remaining: 7m 25s. Rate: 33.4 symbols/min [2025-09-05T19:03:20.785579] [INFO ] [MAIN ] TPYP: Update completed successfully. [2025-09-05T19:03:20.802497] [INFO ] [MAIN ] Update Progress: 2116/2363 symbols completed. TPYP took 3.8s. Estimated remaining: 7m 23s. Rate: 33.4 symbols/min [2025-09-05T19:03:21.006911] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:21.061147] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:21.069893] [INFO ] [MAIN ] TRC: Loaded 6970 existing records. [2025-09-05T19:03:21.190861] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T19:03:21.240273] [INFO ] [MAIN ] TREX: Loaded 23779 existing records. [2025-09-05T19:03:21.314480] [INFO ] [MAIN ] TRC: Found 1 missing trading days. [2025-09-05T19:03:21.310070] [INFO ] [MAIN ] TR: Adding 130 new records, updating 0 existing records. [2025-09-05T19:03:21.334430] [INFO ] [MAIN ] TRC: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:21.348673] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-05T19:03:21.382335] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-05T19:03:21.449298] [INFO ] [MAIN ] TRAK: Adding 101 new records, updating 0 existing records. [2025-09-05T19:03:21.465836] [INFO ] [MAIN ] TR: Combined dataset has 9948 total records. [2025-09-05T19:03:21.593330] [INFO ] [MAIN ] TREX: Found 1 missing trading days. [2025-09-05T19:03:21.615502] [INFO ] [MAIN ] TRAK: Combined dataset has 4627 total records. [2025-09-05T19:03:21.615561] [INFO ] [MAIN ] TREX: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:21.646019] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-05T19:03:21.811489] [WARN ] [VALIDATOR ] TR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:21.988871] [WARN ] [VALIDATOR ] TRAK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:22.263820] [WARN ] [VALIDATOR ] TRAK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:22.263902] [WARN ] [VALIDATOR ] TR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:22.264298] [INFO ] [MAIN ] TRAK: Combined data validation passed. [2025-09-05T19:03:22.264197] [INFO ] [MAIN ] TR: Combined data validation passed. [2025-09-05T19:03:22.343783] [INFO ] [MAIN ] TRAK: Update completed successfully. [2025-09-05T19:03:22.345348] [INFO ] [MAIN ] Update Progress: 2117/2363 symbols completed. TRAK took 2.5s. Estimated remaining: 7m 21s. Rate: 33.4 symbols/min [2025-09-05T19:03:22.355085] [INFO ] [MAIN ] TR: Update completed successfully. [2025-09-05T19:03:22.356239] [INFO ] [MAIN ] Update Progress: 2118/2363 symbols completed. TR took 3.1s. Estimated remaining: 7m 19s. Rate: 33.5 symbols/min [2025-09-05T19:03:22.442167] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-05T19:03:22.483782] [INFO ] [MAIN ] TRC: Adding 134 new records, updating 0 existing records. [2025-09-05T19:03:22.486007] [INFO ] [MAIN ] TRC: Combined dataset has 7104 total records. [2025-09-05T19:03:22.663039] [WARN ] [VALIDATOR ] TRC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:22.854597] [WARN ] [VALIDATOR ] TRC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:22.854848] [INFO ] [MAIN ] TRC: Combined data validation passed. [2025-09-05T19:03:22.898689] [INFO ] [MAIN ] TRC: Update completed successfully. [2025-09-05T19:03:22.899719] [INFO ] [MAIN ] Update Progress: 2119/2363 symbols completed. TRC took 2.2s. Estimated remaining: 7m 17s. Rate: 33.5 symbols/min [2025-09-05T19:03:23.181557] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T19:03:23.325903] [INFO ] [MAIN ] TREX: Adding 362 new records, updating 0 existing records. [2025-09-05T19:03:23.329813] [INFO ] [MAIN ] TREX: Combined dataset has 24141 total records. [2025-09-05T19:03:23.513486] [WARN ] [VALIDATOR ] TREX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:23.703601] [WARN ] [VALIDATOR ] TREX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:23.703871] [INFO ] [MAIN ] TREX: Combined data validation passed. [2025-09-05T19:03:23.853866] [INFO ] [MAIN ] TREX: Update completed successfully. [2025-09-05T19:03:23.856578] [INFO ] [MAIN ] Update Progress: 2120/2363 symbols completed. TREX took 3.0s. Estimated remaining: 7m 16s. Rate: 33.5 symbols/min [2025-09-05T19:03:24.498529] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:24.608015] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:24.588214] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:24.609758] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:24.610625] [WARN ] [MAIN ] TRN: No existing data found, performing full refresh instead. [2025-09-05T19:03:24.611706] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-05T19:03:24.611804] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-05T19:03:24.612044] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-05T19:03:24.772052] [INFO ] [MAIN ] TROX: Loaded 24682 existing records. [2025-09-05T19:03:24.792691] [INFO ] [MAIN ] TRNO: Loaded 20999 existing records. [2025-09-05T19:03:24.996573] [INFO ] [MAIN ] TRGP: Loaded 23966 existing records. [2025-09-05T19:03:25.490267] [INFO ] [REMOTE ] TRN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:03:25.543876] [INFO ] [MAIN ] TROX: Found 1 missing trading days. [2025-09-05T19:03:25.549836] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-05T19:03:25.577140] [INFO ] [MAIN ] TROX: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:25.582389] [INFO ] [MAIN ] TRNO: Found 1 missing trading days. [2025-09-05T19:03:25.591903] [INFO ] [MAIN ] TRNO: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:25.590533] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-05T19:03:25.593087] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-05T19:03:25.599510] [INFO ] [MAIN ] TRGP: Found 1 missing trading days. [2025-09-05T19:03:25.600588] [INFO ] [MAIN ] TRGP: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:25.600836] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-05T19:03:26.930441] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-05T19:03:26.937773] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-05T19:03:27.013758] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T19:03:27.131244] [INFO ] [MAIN ] TRNO: Adding 342 new records, updating 0 existing records. [2025-09-05T19:03:27.134731] [INFO ] [MAIN ] TRNO: Combined dataset has 21341 total records. [2025-09-05T19:03:27.255736] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T19:03:27.358262] [WARN ] [VALIDATOR ] TRNO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:27.376848] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-05T19:03:27.777032] [INFO ] [MAIN ] TROX: Adding 388 new records, updating 0 existing records. [2025-09-05T19:03:27.820553] [INFO ] [MAIN ] TRGP: Adding 369 new records, updating 0 existing records. [2025-09-05T19:03:27.827853] [INFO ] [MAIN ] TROX: Combined dataset has 25070 total records. [2025-09-05T19:03:27.840097] [INFO ] [MAIN ] TRGP: Combined dataset has 24335 total records. [2025-09-05T19:03:28.117773] [WARN ] [VALIDATOR ] TROX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:28.258141] [WARN ] [VALIDATOR ] TRGP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:28.659007] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-05T19:03:28.671526] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-05T19:03:28.677544] [WARN ] [VALIDATOR ] TRGP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:28.677779] [WARN ] [VALIDATOR ] TRNO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:28.678027] [INFO ] [MAIN ] TRNO: Combined data validation passed. [2025-09-05T19:03:28.678395] [INFO ] [MAIN ] TRGP: Combined data validation passed. [2025-09-05T19:03:28.679286] [WARN ] [VALIDATOR ] TROX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:28.679549] [INFO ] [MAIN ] TROX: Combined data validation passed. [2025-09-05T19:03:29.097966] [INFO ] [MAIN ] TRGP: Update completed successfully. [2025-09-05T19:03:29.101865] [INFO ] [MAIN ] TRNO: Update completed successfully. [2025-09-05T19:03:29.101734] [INFO ] [MAIN ] Update Progress: 2121/2363 symbols completed. TRGP took 5.2s. Estimated remaining: 7m 14s. Rate: 33.4 symbols/min [2025-09-05T19:03:29.116666] [INFO ] [MAIN ] Update Progress: 2122/2363 symbols completed. TRNO took 5.2s. Estimated remaining: 7m 12s. Rate: 33.5 symbols/min [2025-09-05T19:03:29.430943] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:29.454664] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:29.506183] [INFO ] [MAIN ] TRTX: Loaded 16910 existing records. [2025-09-05T19:03:29.634946] [INFO ] [MAIN ] TRP: Loaded 24823 existing records. [2025-09-05T19:03:29.733035] [INFO ] [MAIN ] TRTX: Found 1 missing trading days. [2025-09-05T19:03:29.739938] [INFO ] [MAIN ] TRTX: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:29.747230] [INFO ] [MAIN ] TROX: Update completed successfully. [2025-09-05T19:03:29.758030] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-05T19:03:29.771838] [INFO ] [MAIN ] Update Progress: 2123/2363 symbols completed. TROX took 5.9s. Estimated remaining: 7m 10s. Rate: 33.5 symbols/min [2025-09-05T19:03:30.036851] [INFO ] [MAIN ] TRP: Found 1 missing trading days. [2025-09-05T19:03:30.056668] [INFO ] [MAIN ] TRP: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:30.077719] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-05T19:03:30.080099] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:30.109773] [INFO ] [MAIN ] TRU: Loaded 24147 existing records. [2025-09-05T19:03:30.281965] [INFO ] [MAIN ] TRU: Found 1 missing trading days. [2025-09-05T19:03:30.282109] [INFO ] [MAIN ] TRU: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:30.282311] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-05T19:03:30.379936] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-05T19:03:30.387945] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-05T19:03:30.830970] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T19:03:30.929432] [INFO ] [MAIN ] TRTX: Adding 353 new records, updating 0 existing records. [2025-09-05T19:03:30.932155] [INFO ] [MAIN ] TRTX: Combined dataset has 17263 total records. [2025-09-05T19:03:31.114829] [WARN ] [VALIDATOR ] TRTX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:31.315906] [WARN ] [VALIDATOR ] TRTX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:31.316137] [INFO ] [MAIN ] TRTX: Combined data validation passed. [2025-09-05T19:03:31.425611] [INFO ] [MAIN ] TRTX: Update completed successfully. [2025-09-05T19:03:31.427422] [INFO ] [MAIN ] Update Progress: 2124/2363 symbols completed. TRTX took 2.3s. Estimated remaining: 7m 8s. Rate: 33.5 symbols/min [2025-09-05T19:03:31.596703] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:31.608216] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T19:03:31.731484] [INFO ] [MAIN ] TRV: Loaded 23054 existing records. [2025-09-05T19:03:31.775000] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-05T19:03:31.848747] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-05T19:03:31.885434] [INFO ] [MAIN ] TRU: Adding 384 new records, updating 0 existing records. [2025-09-05T19:03:31.909158] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-05T19:03:32.072690] [INFO ] [MAIN ] TRV: Found 1 missing trading days. [2025-09-05T19:03:32.098516] [INFO ] [MAIN ] TRV: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:32.109173] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-05T19:03:32.103811] [INFO ] [MAIN ] TRU: Combined dataset has 24531 total records. [2025-09-05T19:03:32.196720] [INFO ] [MAIN ] TRP: Adding 374 new records, updating 0 existing records. [2025-09-05T19:03:32.334493] [WARN ] [VALIDATOR ] TRU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:32.432341] [INFO ] [MAIN ] TRP: Combined dataset has 25197 total records. [2025-09-05T19:03:32.691173] [WARN ] [VALIDATOR ] TRP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:32.890773] [WARN ] [VALIDATOR ] TRU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:32.890858] [WARN ] [VALIDATOR ] TRP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:32.891181] [INFO ] [MAIN ] TRP: Combined data validation passed. [2025-09-05T19:03:32.891298] [INFO ] [MAIN ] TRU: Combined data validation passed. [2025-09-05T19:03:33.211942] [INFO ] [MAIN ] TRU: Update completed successfully. [2025-09-05T19:03:33.216067] [INFO ] [MAIN ] TRP: Update completed successfully. [2025-09-05T19:03:33.215950] [INFO ] [MAIN ] Update Progress: 2125/2363 symbols completed. TRU took 3.4s. Estimated remaining: 7m 7s. Rate: 33.5 symbols/min [2025-09-05T19:03:33.219823] [INFO ] [MAIN ] Update Progress: 2126/2363 symbols completed. TRP took 4.1s. Estimated remaining: 7m 5s. Rate: 33.5 symbols/min [2025-09-05T19:03:33.576613] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:33.588084] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-05T19:03:33.587147] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:33.754940] [INFO ] [MAIN ] TSE: Loaded 13896 existing records. [2025-09-05T19:03:33.754142] [INFO ] [MAIN ] TRV: Adding 320 new records, updating 0 existing records. [2025-09-05T19:03:33.809449] [INFO ] [MAIN ] TS: Loaded 24510 existing records. [2025-09-05T19:03:33.976234] [INFO ] [MAIN ] TRV: Combined dataset has 23374 total records. [2025-09-05T19:03:34.188223] [INFO ] [MAIN ] TSE: Found 1 missing trading days. [2025-09-05T19:03:34.236927] [INFO ] [MAIN ] TS: Found 1 missing trading days. [2025-09-05T19:03:34.249033] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-05T19:03:34.249120] [INFO ] [MAIN ] TSE: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:34.249164] [INFO ] [MAIN ] TS: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:34.265920] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-05T19:03:34.266617] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-05T19:03:34.268757] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-05T19:03:34.352821] [WARN ] [VALIDATOR ] TRV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:34.541331] [WARN ] [VALIDATOR ] TRV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:34.541551] [INFO ] [MAIN ] TRV: Combined data validation passed. [2025-09-05T19:03:34.686946] [INFO ] [MAIN ] TRV: Update completed successfully. [2025-09-05T19:03:34.690095] [INFO ] [MAIN ] Update Progress: 2127/2363 symbols completed. TRV took 3.3s. Estimated remaining: 7m 3s. Rate: 33.5 symbols/min [2025-09-05T19:03:34.856833] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:34.861890] [INFO ] [MAIN ] TSI: Loaded 3947 existing records. [2025-09-05T19:03:35.028141] [INFO ] [MAIN ] TSI: Found 1 missing trading days. [2025-09-05T19:03:35.028323] [INFO ] [MAIN ] TSI: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:35.028526] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-05T19:03:35.349413] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T19:03:35.407137] [INFO ] [MAIN ] TSE: Adding 137 new records, updating 0 existing records. [2025-09-05T19:03:35.409519] [INFO ] [MAIN ] TSE: Combined dataset has 14033 total records. [2025-09-05T19:03:35.587312] [WARN ] [VALIDATOR ] TSE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:35.687821] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-05T19:03:35.729056] [INFO ] [MAIN ] TSI: Adding 64 new records, updating 0 existing records. [2025-09-05T19:03:35.784787] [INFO ] [MAIN ] TSI: Combined dataset has 4011 total records. [2025-09-05T19:03:35.989810] [WARN ] [VALIDATOR ] TSI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:36.048465] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-05T19:03:36.086788] [WARN ] [VALIDATOR ] TSE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:36.138255] [INFO ] [MAIN ] TSE: Combined data validation passed. [2025-09-05T19:03:36.368218] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-05T19:03:36.453232] [INFO ] [MAIN ] TS: Adding 390 new records, updating 0 existing records. [2025-09-05T19:03:36.455572] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-05T19:03:36.476903] [INFO ] [MAIN ] TSE: Update completed successfully. [2025-09-05T19:03:36.482999] [INFO ] [MAIN ] Update Progress: 2128/2363 symbols completed. TSE took 3.2s. Estimated remaining: 7m 1s. Rate: 33.5 symbols/min [2025-09-05T19:03:36.519037] [INFO ] [MAIN ] TS: Combined dataset has 24900 total records. [2025-09-05T19:03:36.819479] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:36.885758] [WARN ] [VALIDATOR ] TS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:37.013839] [INFO ] [MAIN ] TSLX: Loaded 16518 existing records. [2025-09-05T19:03:37.294970] [INFO ] [MAIN ] TSLX: Found 1 missing trading days. [2025-09-05T19:03:37.295623] [INFO ] [MAIN ] TSLX: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:37.296121] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-05T19:03:37.304685] [WARN ] [VALIDATOR ] TSI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:37.305375] [INFO ] [MAIN ] TSI: Combined data validation passed. [2025-09-05T19:03:37.333486] [INFO ] [MAIN ] TSI: Update completed successfully. [2025-09-05T19:03:37.334937] [INFO ] [MAIN ] Update Progress: 2129/2363 symbols completed. TSI took 2.6s. Estimated remaining: 6m 59s. Rate: 33.5 symbols/min [2025-09-05T19:03:37.522004] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:37.525439] [WARN ] [VALIDATOR ] TS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:37.526296] [INFO ] [MAIN ] TS: Combined data validation passed. [2025-09-05T19:03:37.700579] [INFO ] [MAIN ] TSM: Loaded 25739 existing records. [2025-09-05T19:03:37.700760] [INFO ] [MAIN ] TS: Update completed successfully. [2025-09-05T19:03:37.704774] [INFO ] [MAIN ] Update Progress: 2130/2363 symbols completed. TS took 4.5s. Estimated remaining: 6m 57s. Rate: 33.5 symbols/min [2025-09-05T19:03:38.064031] [INFO ] [MAIN ] TSM: Found 1 missing trading days. [2025-09-05T19:03:38.083681] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:38.105514] [INFO ] [MAIN ] TSM: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:38.111071] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-05T19:03:38.109372] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-05T19:03:38.121980] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-05T19:03:38.146896] [INFO ] [MAIN ] TSN: Loaded 25371 existing records. [2025-09-05T19:03:38.328072] [INFO ] [MAIN ] TSN: Found 1 missing trading days. [2025-09-05T19:03:38.328226] [INFO ] [MAIN ] TSN: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:38.328461] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-05T19:03:38.391428] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-05T19:03:38.471874] [INFO ] [MAIN ] TSLX: Adding 218 new records, updating 0 existing records. [2025-09-05T19:03:38.475211] [INFO ] [MAIN ] TSLX: Combined dataset has 16736 total records. [2025-09-05T19:03:38.662283] [WARN ] [VALIDATOR ] TSLX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:38.948802] [WARN ] [VALIDATOR ] TSLX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:38.949132] [INFO ] [MAIN ] TSLX: Combined data validation passed. [2025-09-05T19:03:39.062157] [INFO ] [MAIN ] TSLX: Update completed successfully. [2025-09-05T19:03:39.064834] [INFO ] [MAIN ] Update Progress: 2131/2363 symbols completed. TSLX took 2.6s. Estimated remaining: 6m 55s. Rate: 33.5 symbols/min [2025-09-05T19:03:39.249481] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:39.259751] [INFO ] [MAIN ] TSQ: Loaded 6233 existing records. [2025-09-05T19:03:39.437637] [INFO ] [MAIN ] TSQ: Found 1 missing trading days. [2025-09-05T19:03:39.437940] [INFO ] [MAIN ] TSQ: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:39.438183] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-05T19:03:39.708702] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-05T19:03:39.723446] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-05T19:03:39.730234] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T19:03:39.901833] [INFO ] [MAIN ] TSN: Adding 390 new records, updating 0 existing records. [2025-09-05T19:03:39.905529] [INFO ] [MAIN ] TSN: Combined dataset has 25761 total records. [2025-09-05T19:03:40.110216] [WARN ] [VALIDATOR ] TSN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:40.226309] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T19:03:40.321238] [INFO ] [MAIN ] TSQ: Adding 42 new records, updating 0 existing records. [2025-09-05T19:03:40.358853] [INFO ] [MAIN ] TSQ: Combined dataset has 6275 total records. [2025-09-05T19:03:40.549940] [WARN ] [VALIDATOR ] TSQ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:40.734327] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-05T19:03:40.917845] [INFO ] [MAIN ] TSM: Adding 390 new records, updating 0 existing records. [2025-09-05T19:03:40.929406] [INFO ] [MAIN ] TSM: Combined dataset has 26129 total records. [2025-09-05T19:03:40.945778] [WARN ] [VALIDATOR ] TSN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:40.945844] [WARN ] [VALIDATOR ] TSQ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:40.989357] [INFO ] [MAIN ] TSN: Combined data validation passed. [2025-09-05T19:03:40.998123] [INFO ] [MAIN ] TSQ: Combined data validation passed. [2025-09-05T19:03:41.203704] [WARN ] [VALIDATOR ] TSM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:41.354201] [INFO ] [MAIN ] TSQ: Update completed successfully. [2025-09-05T19:03:41.363004] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-05T19:03:41.389510] [INFO ] [MAIN ] Update Progress: 2132/2363 symbols completed. TSQ took 2.3s. Estimated remaining: 6m 54s. Rate: 33.5 symbols/min [2025-09-05T19:03:41.446198] [INFO ] [REMOTE ] TRN: Full fetch complete (40826 records). [2025-09-05T19:03:41.794438] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:41.951529] [INFO ] [MAIN ] TSN: Update completed successfully. [2025-09-05T19:03:41.985826] [INFO ] [MAIN ] Update Progress: 2133/2363 symbols completed. TSN took 4.3s. Estimated remaining: 6m 52s. Rate: 33.5 symbols/min [2025-09-05T19:03:41.992542] [INFO ] [MAIN ] TT: Loaded 21931 existing records. [2025-09-05T19:03:42.404190] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-05T19:03:42.403984] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:42.472410] [INFO ] [MAIN ] TT: Found 1 missing trading days. [2025-09-05T19:03:42.473656] [INFO ] [MAIN ] TT: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:42.474464] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-05T19:03:42.483988] [WARN ] [VALIDATOR ] TSM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:42.543634] [INFO ] [MAIN ] TTAM: Loaded 14408 existing records. [2025-09-05T19:03:42.542773] [INFO ] [MAIN ] TSM: Combined data validation passed. [2025-09-05T19:03:42.848472] [INFO ] [MAIN ] TTAM: Found 1 missing trading days. [2025-09-05T19:03:42.851093] [INFO ] [MAIN ] TTAM: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:42.851994] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-05T19:03:42.938977] [INFO ] [MAIN ] TSM: Update completed successfully. [2025-09-05T19:03:42.942244] [INFO ] [MAIN ] Update Progress: 2134/2363 symbols completed. TSM took 5.6s. Estimated remaining: 6m 50s. Rate: 33.5 symbols/min [2025-09-05T19:03:43.118383] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:43.176536] [INFO ] [MAIN ] TTC: Loaded 19799 existing records. [2025-09-05T19:03:43.342536] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-05T19:03:43.363089] [INFO ] [MAIN ] Update Progress: 2135/2363 symbols completed. TRN took 19.5s. Estimated remaining: 6m 48s. Rate: 33.5 symbols/min [2025-09-05T19:03:43.369873] [INFO ] [MAIN ] TTC: Found 1 missing trading days. [2025-09-05T19:03:43.369974] [INFO ] [MAIN ] TTC: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:43.370307] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-05T19:03:43.539575] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:43.562402] [INFO ] [MAIN ] TTE: Loaded 24617 existing records. [2025-09-05T19:03:43.735189] [INFO ] [MAIN ] TTE: Found 1 missing trading days. [2025-09-05T19:03:43.735309] [INFO ] [MAIN ] TTE: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:43.735512] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-05T19:03:43.936786] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-05T19:03:44.028338] [INFO ] [MAIN ] TTAM: Adding 262 new records, updating 0 existing records. [2025-09-05T19:03:44.037534] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:03:44.072949] [INFO ] [MAIN ] TTAM: Combined dataset has 14670 total records. [2025-09-05T19:03:44.394590] [WARN ] [VALIDATOR ] TTAM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:44.582000] [INFO ] [MAIN ] TT: Adding 320 new records, updating 1081 existing records. [2025-09-05T19:03:44.666687] [INFO ] [MAIN ] TT: Combined dataset has 22251 total records. [2025-09-05T19:03:44.848712] [WARN ] [VALIDATOR ] TT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:44.936676] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-05T19:03:45.183999] [INFO ] [MAIN ] TTC: Adding 355 new records, updating 0 existing records. [2025-09-05T19:03:45.191861] [INFO ] [MAIN ] TTC: Combined dataset has 20154 total records. [2025-09-05T19:03:45.331840] [WARN ] [VALIDATOR ] TTAM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:45.357210] [WARN ] [VALIDATOR ] TT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:45.384983] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-05T19:03:45.394257] [INFO ] [MAIN ] TT: Combined data validation passed. [2025-09-05T19:03:45.418674] [WARN ] [VALIDATOR ] TTC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:45.385587] [INFO ] [MAIN ] TTAM: Combined data validation passed. [2025-09-05T19:03:45.818353] [INFO ] [MAIN ] TTE: Adding 372 new records, updating 0 existing records. [2025-09-05T19:03:45.903930] [INFO ] [MAIN ] TTE: Combined dataset has 24989 total records. [2025-09-05T19:03:46.038239] [INFO ] [MAIN ] TTAM: Update completed successfully. [2025-09-05T19:03:46.056124] [INFO ] [MAIN ] Update Progress: 2136/2363 symbols completed. TTAM took 4.1s. Estimated remaining: 6m 46s. Rate: 33.5 symbols/min [2025-09-05T19:03:46.195364] [WARN ] [VALIDATOR ] TTE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:46.441632] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:46.544977] [WARN ] [VALIDATOR ] TTC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:46.545364] [INFO ] [MAIN ] TTC: Combined data validation passed. [2025-09-05T19:03:46.549446] [INFO ] [MAIN ] TT: Update completed successfully. [2025-09-05T19:03:46.552722] [INFO ] [MAIN ] Update Progress: 2137/2363 symbols completed. TT took 5.1s. Estimated remaining: 6m 44s. Rate: 33.5 symbols/min [2025-09-05T19:03:46.696582] [INFO ] [MAIN ] TTI: Loaded 21886 existing records. [2025-09-05T19:03:46.896121] [INFO ] [MAIN ] TTC: Update completed successfully. [2025-09-05T19:03:46.904196] [INFO ] [MAIN ] Update Progress: 2138/2363 symbols completed. TTC took 4.0s. Estimated remaining: 6m 42s. Rate: 33.6 symbols/min [2025-09-05T19:03:47.136624] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:47.162127] [INFO ] [MAIN ] TTI: Found 1 missing trading days. [2025-09-05T19:03:47.167411] [INFO ] [MAIN ] TTI: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:47.167798] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-05T19:03:47.248882] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:47.258531] [WARN ] [VALIDATOR ] TTE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:47.258869] [INFO ] [MAIN ] TTE: Combined data validation passed. [2025-09-05T19:03:47.270020] [INFO ] [MAIN ] TU: Loaded 23490 existing records. [2025-09-05T19:03:47.488370] [INFO ] [MAIN ] TUYA: Loaded 21679 existing records. [2025-09-05T19:03:47.721568] [INFO ] [MAIN ] TU: Found 1 missing trading days. [2025-09-05T19:03:47.722209] [INFO ] [MAIN ] TU: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:47.748945] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-05T19:03:47.927075] [INFO ] [MAIN ] TUYA: Found 1 missing trading days. [2025-09-05T19:03:47.931848] [INFO ] [MAIN ] TUYA: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:47.934357] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-05T19:03:47.940970] [INFO ] [MAIN ] TTE: Update completed successfully. [2025-09-05T19:03:47.945363] [INFO ] [MAIN ] Update Progress: 2139/2363 symbols completed. TTE took 4.6s. Estimated remaining: 6m 40s. Rate: 33.6 symbols/min [2025-09-05T19:03:48.217002] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:48.242941] [INFO ] [MAIN ] TV: Loaded 19261 existing records. [2025-09-05T19:03:48.428329] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-05T19:03:48.550362] [INFO ] [MAIN ] TV: Found 1 missing trading days. [2025-09-05T19:03:48.566289] [INFO ] [MAIN ] TV: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:48.592827] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-05T19:03:48.670699] [INFO ] [MAIN ] TTI: Adding 295 new records, updating 0 existing records. [2025-09-05T19:03:48.675361] [INFO ] [MAIN ] TTI: Combined dataset has 22181 total records. [2025-09-05T19:03:48.898106] [WARN ] [VALIDATOR ] TTI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:49.124904] [WARN ] [VALIDATOR ] TTI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:49.125117] [INFO ] [MAIN ] TTI: Combined data validation passed. [2025-09-05T19:03:49.268498] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T19:03:49.271430] [INFO ] [MAIN ] TTI: Update completed successfully. [2025-09-05T19:03:49.298277] [INFO ] [MAIN ] Update Progress: 2140/2363 symbols completed. TTI took 3.2s. Estimated remaining: 6m 39s. Rate: 33.6 symbols/min [2025-09-05T19:03:49.584964] [INFO ] [MAIN ] TUYA: Adding 364 new records, updating 0 existing records. [2025-09-05T19:03:49.612420] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:49.627494] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T19:03:49.630085] [INFO ] [MAIN ] TVC: Loaded 2532 existing records. [2025-09-05T19:03:49.722856] [INFO ] [MAIN ] TUYA: Combined dataset has 22043 total records. [2025-09-05T19:03:50.042667] [INFO ] [MAIN ] TVC: Found 1 missing trading days. [2025-09-05T19:03:50.065397] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T19:03:50.073781] [INFO ] [MAIN ] TU: Adding 352 new records, updating 0 existing records. [2025-09-05T19:03:50.118466] [INFO ] [MAIN ] TVC: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:50.128507] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-05T19:03:50.268457] [WARN ] [VALIDATOR ] TUYA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:50.323832] [INFO ] [MAIN ] TV: Adding 364 new records, updating 0 existing records. [2025-09-05T19:03:50.339671] [INFO ] [MAIN ] TU: Combined dataset has 23842 total records. [2025-09-05T19:03:50.570835] [INFO ] [MAIN ] TV: Combined dataset has 19625 total records. [2025-09-05T19:03:50.686388] [WARN ] [VALIDATOR ] TU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:50.910508] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-05T19:03:50.977425] [INFO ] [MAIN ] TVC: Adding 32 new records, updating 0 existing records. [2025-09-05T19:03:51.085608] [WARN ] [VALIDATOR ] TV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:51.111797] [INFO ] [MAIN ] TVC: Combined dataset has 2564 total records. [2025-09-05T19:03:51.486300] [WARN ] [VALIDATOR ] TVC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:51.746202] [WARN ] [VALIDATOR ] TUYA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:51.746042] [WARN ] [VALIDATOR ] TU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:51.746511] [INFO ] [MAIN ] TUYA: Combined data validation passed. [2025-09-05T19:03:51.747429] [INFO ] [MAIN ] TU: Combined data validation passed. [2025-09-05T19:03:51.861854] [WARN ] [VALIDATOR ] TV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:51.871246] [WARN ] [VALIDATOR ] TVC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:51.880154] [INFO ] [MAIN ] TVC: Combined data validation passed. [2025-09-05T19:03:51.880014] [INFO ] [MAIN ] TV: Combined data validation passed. [2025-09-05T19:03:52.041909] [INFO ] [MAIN ] TVC: Update completed successfully. [2025-09-05T19:03:52.044130] [INFO ] [MAIN ] Update Progress: 2141/2363 symbols completed. TVC took 2.7s. Estimated remaining: 6m 37s. Rate: 33.6 symbols/min [2025-09-05T19:03:52.262919] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:52.280632] [INFO ] [MAIN ] TVE: Loaded 1953 existing records. [2025-09-05T19:03:52.440665] [INFO ] [MAIN ] TU: Update completed successfully. [2025-09-05T19:03:52.457980] [INFO ] [MAIN ] Update Progress: 2142/2363 symbols completed. TU took 5.9s. Estimated remaining: 6m 35s. Rate: 33.6 symbols/min [2025-09-05T19:03:52.592155] [INFO ] [MAIN ] TVE: Found 1 missing trading days. [2025-09-05T19:03:52.607851] [INFO ] [MAIN ] TVE: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:52.613480] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-05T19:03:52.708728] [INFO ] [MAIN ] TV: Update completed successfully. [2025-09-05T19:03:52.728950] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:52.733010] [INFO ] [MAIN ] Update Progress: 2143/2363 symbols completed. TV took 4.8s. Estimated remaining: 6m 33s. Rate: 33.6 symbols/min [2025-09-05T19:03:52.733167] [INFO ] [MAIN ] TUYA: Update completed successfully. [2025-09-05T19:03:52.750877] [INFO ] [MAIN ] Update Progress: 2144/2363 symbols completed. TUYA took 5.8s. Estimated remaining: 6m 31s. Rate: 33.6 symbols/min [2025-09-05T19:03:53.102587] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:53.108635] [INFO ] [MAIN ] TWI: Loaded 25673 existing records. [2025-09-05T19:03:53.115278] [WARN ] [MAIN ] TWN: No existing data found, performing full refresh instead. [2025-09-05T19:03:53.173933] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:53.218824] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-05T19:03:53.239051] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-05T19:03:53.239422] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-05T19:03:53.348689] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-05T19:03:53.398298] [INFO ] [MAIN ] TWI: Found 1 missing trading days. [2025-09-05T19:03:53.415758] [INFO ] [MAIN ] TVE: Adding 13 new records, updating 0 existing records. [2025-09-05T19:03:53.412535] [INFO ] [MAIN ] TWI: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:53.428637] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-05T19:03:53.449885] [INFO ] [MAIN ] TVE: Combined dataset has 1966 total records. [2025-09-05T19:03:53.739307] [INFO ] [MAIN ] TWLO: Loaded 39707 existing records. [2025-09-05T19:03:53.873706] [WARN ] [VALIDATOR ] TVE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:54.135728] [INFO ] [REMOTE ] TWN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:03:54.182001] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-05T19:03:54.283206] [INFO ] [MAIN ] TWLO: Found 1 missing trading days. [2025-09-05T19:03:54.285164] [INFO ] [MAIN ] TWLO: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:54.290527] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-05T19:03:54.309612] [WARN ] [VALIDATOR ] TVE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:54.309862] [INFO ] [MAIN ] TVE: Combined data validation passed. [2025-09-05T19:03:54.325014] [INFO ] [MAIN ] TVE: Update completed successfully. [2025-09-05T19:03:54.325526] [INFO ] [MAIN ] Update Progress: 2145/2363 symbols completed. TVE took 2.3s. Estimated remaining: 6m 29s. Rate: 33.6 symbols/min [2025-09-05T19:03:54.430606] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T19:03:54.568392] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:54.599829] [INFO ] [MAIN ] TWI: Adding 167 new records, updating 0 existing records. [2025-09-05T19:03:54.605023] [INFO ] [MAIN ] TWI: Combined dataset has 25840 total records. [2025-09-05T19:03:54.743372] [INFO ] [MAIN ] TWO: Loaded 23360 existing records. [2025-09-05T19:03:54.868220] [WARN ] [VALIDATOR ] TWI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:55.011875] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-05T19:03:55.039079] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-05T19:03:55.164081] [INFO ] [MAIN ] TWO: Found 1 missing trading days. [2025-09-05T19:03:55.171531] [INFO ] [MAIN ] TWO: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:55.171864] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-05T19:03:55.183837] [WARN ] [VALIDATOR ] TWI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:55.184068] [INFO ] [MAIN ] TWI: Combined data validation passed. [2025-09-05T19:03:55.346059] [INFO ] [MAIN ] TWI: Update completed successfully. [2025-09-05T19:03:55.349424] [INFO ] [MAIN ] Update Progress: 2146/2363 symbols completed. TWI took 2.9s. Estimated remaining: 6m 27s. Rate: 33.6 symbols/min [2025-09-05T19:03:55.527690] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:55.527860] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-05T19:03:55.527989] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-05T19:03:55.528053] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-05T19:03:55.528105] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-05T19:03:55.916929] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:03:55.917392] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-05T19:03:55.923721] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-05T19:03:55.925723] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-05T19:03:55.940177] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-05T19:03:56.107972] [INFO ] [MAIN ] TWLO: Adding 387 new records, updating 0 existing records. [2025-09-05T19:03:56.116708] [INFO ] [MAIN ] TWLO: Combined dataset has 40094 total records. [2025-09-05T19:03:56.183450] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-05T19:03:56.212065] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-05T19:03:56.302977] [WARN ] [VALIDATOR ] TWLO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:03:56.464003] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-05T19:03:56.504497] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-05T19:03:56.511716] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-05T19:03:56.513915] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-05T19:03:56.529919] [WARN ] [VALIDATOR ] TWLO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:03:56.530175] [INFO ] [MAIN ] TWLO: Combined data validation passed. [2025-09-05T19:03:56.642726] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T19:03:56.816053] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-05T19:03:56.826807] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-05T19:03:56.910225] [INFO ] [MAIN ] TWO: Adding 356 new records, updating 0 existing records. [2025-09-05T19:03:56.919177] [INFO ] [MAIN ] TWO: Combined dataset has 23716 total records. [2025-09-05T19:03:57.101476] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-05T19:03:57.118225] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-05T19:03:57.125356] [WARN ] [VALIDATOR ] TWO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:57.212380] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-05T19:03:57.243777] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-05T19:03:57.347397] [INFO ] [MAIN ] TWLO: Update completed successfully. [2025-09-05T19:03:57.351897] [INFO ] [MAIN ] Update Progress: 2147/2363 symbols completed. TWLO took 4.6s. Estimated remaining: 6m 26s. Rate: 33.6 symbols/min [2025-09-05T19:03:57.527095] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:57.543322] [INFO ] [MAIN ] TX: Loaded 11316 existing records. [2025-09-05T19:03:57.574916] [WARN ] [VALIDATOR ] TWO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:57.623314] [INFO ] [MAIN ] TWO: Combined data validation passed. [2025-09-05T19:03:57.818162] [INFO ] [MAIN ] TX: Found 1 missing trading days. [2025-09-05T19:03:57.827173] [INFO ] [MAIN ] TX: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:57.831130] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-05T19:03:57.882683] [INFO ] [MAIN ] TWO: Update completed successfully. [2025-09-05T19:03:57.885685] [INFO ] [MAIN ] Update Progress: 2148/2363 symbols completed. TWO took 3.6s. Estimated remaining: 6m 24s. Rate: 33.6 symbols/min [2025-09-05T19:03:58.017451] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-05T19:03:58.067246] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-05T19:03:58.070535] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:58.092331] [INFO ] [MAIN ] TXNM: Loaded 20816 existing records. [2025-09-05T19:03:58.241968] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-05T19:03:58.271959] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-05T19:03:58.279283] [INFO ] [MAIN ] TXNM: Found 1 missing trading days. [2025-09-05T19:03:58.280069] [INFO ] [MAIN ] TXNM: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:58.280303] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-05T19:03:58.427019] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-05T19:03:58.428299] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-05T19:03:58.679638] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-05T19:03:58.681239] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-05T19:03:58.768486] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T19:03:58.826296] [INFO ] [MAIN ] TX: Adding 133 new records, updating 0 existing records. [2025-09-05T19:03:58.829980] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-05T19:03:58.832252] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-05T19:03:58.833912] [INFO ] [MAIN ] TX: Combined dataset has 11449 total records. [2025-09-05T19:03:59.013098] [WARN ] [VALIDATOR ] TX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:03:59.119618] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-05T19:03:59.136471] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-05T19:03:59.214279] [WARN ] [VALIDATOR ] TX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:03:59.214521] [INFO ] [MAIN ] TX: Combined data validation passed. [2025-09-05T19:03:59.292020] [INFO ] [MAIN ] TX: Update completed successfully. [2025-09-05T19:03:59.293987] [INFO ] [MAIN ] Update Progress: 2149/2363 symbols completed. TX took 1.9s. Estimated remaining: 6m 22s. Rate: 33.6 symbols/min [2025-09-05T19:03:59.403188] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-05T19:03:59.425122] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-05T19:03:59.483954] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:03:59.496282] [INFO ] [MAIN ] TXO: Loaded 10062 existing records. [2025-09-05T19:03:59.632011] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:03:59.692173] [INFO ] [MAIN ] TXO: Found 1 missing trading days. [2025-09-05T19:03:59.705977] [INFO ] [MAIN ] TXO: Need to fetch 1 months: 2025-09 [2025-09-05T19:03:59.721940] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-05T19:03:59.733590] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-05T19:03:59.747410] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-05T19:03:59.805991] [INFO ] [MAIN ] TXNM: Adding 284 new records, updating 0 existing records. [2025-09-05T19:03:59.809010] [INFO ] [MAIN ] TXNM: Combined dataset has 21100 total records. [2025-09-05T19:03:59.988735] [WARN ] [VALIDATOR ] TXNM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:00.071570] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T19:04:00.093872] [INFO ] [REMOTE ] TWN: Full fetch complete (3840 records). [2025-09-05T19:04:00.460809] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T19:04:00.472116] [INFO ] [REMOTE ] TWOD: Full fetch complete (3919 records). [2025-09-05T19:04:00.613465] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-05T19:04:00.692616] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-05T19:04:00.740808] [INFO ] [MAIN ] Update Progress: 2150/2363 symbols completed. TWN took 8.0s. Estimated remaining: 6m 20s. Rate: 33.6 symbols/min [2025-09-05T19:04:00.746429] [WARN ] [VALIDATOR ] TWOD: Not fatal, but first date in data (2025-05-16) does not match expected start date (2025-01-31) [2025-09-05T19:04:00.851355] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T19:04:01.000598] [INFO ] [MAIN ] TXO: Adding 121 new records, updating 0 existing records. [2025-09-05T19:04:01.161897] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:01.163294] [WARN ] [MAIN ] TXT: No existing data found, performing full refresh instead. [2025-09-05T19:04:01.164282] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-05T19:04:01.164595] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-05T19:04:01.163830] [INFO ] [MAIN ] TXO: Combined dataset has 10183 total records. [2025-09-05T19:04:01.166523] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-05T19:04:01.389825] [WARN ] [VALIDATOR ] TXNM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:01.409869] [INFO ] [MAIN ] TXNM: Combined data validation passed. [2025-09-05T19:04:01.616749] [WARN ] [VALIDATOR ] TXO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:01.943232] [WARN ] [VALIDATOR ] TWOD: Missing days changed. Total missing: 73 No longer missing: 2025-01-29, 2025-01-30, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15 [2025-09-05T19:04:01.985361] [INFO ] [MAIN ] TWOD: Fetched primary data is valid. [2025-09-05T19:04:02.016201] [INFO ] [REMOTE ] TXT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:04:02.036391] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-05T19:04:02.100526] [INFO ] [MAIN ] TWOD: Full history saved. [2025-09-05T19:04:02.100990] [INFO ] [MAIN ] Update Progress: 2151/2363 symbols completed. TWOD took 6.8s. Estimated remaining: 6m 18s. Rate: 33.6 symbols/min [2025-09-05T19:04:02.092288] [INFO ] [MAIN ] TXNM: Update completed successfully. [2025-09-05T19:04:02.104581] [INFO ] [MAIN ] Update Progress: 2152/2363 symbols completed. TXNM took 4.2s. Estimated remaining: 6m 16s. Rate: 33.6 symbols/min [2025-09-05T19:04:02.369789] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:02.389225] [WARN ] [MAIN ] TY: No existing data found, performing full refresh instead. [2025-09-05T19:04:02.401823] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-05T19:04:02.422835] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-05T19:04:02.473036] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:02.473704] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-05T19:04:02.592407] [INFO ] [MAIN ] TYG: Loaded 6878 existing records. [2025-09-05T19:04:02.739863] [WARN ] [VALIDATOR ] TXO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:02.761489] [INFO ] [MAIN ] TXO: Combined data validation passed. [2025-09-05T19:04:02.971144] [INFO ] [MAIN ] TYG: Found 1 missing trading days. [2025-09-05T19:04:03.008744] [INFO ] [MAIN ] TYG: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:03.030157] [INFO ] [MAIN ] TXO: Update completed successfully. [2025-09-05T19:04:03.047420] [INFO ] [MAIN ] Update Progress: 2153/2363 symbols completed. TXO took 3.8s. Estimated remaining: 6m 14s. Rate: 33.6 symbols/min [2025-09-05T19:04:03.048012] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-05T19:04:03.156194] [INFO ] [REMOTE ] TY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:04:03.190254] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-05T19:04:03.291953] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:03.303158] [INFO ] [MAIN ] TYL: Loaded 10428 existing records. [2025-09-05T19:04:03.475780] [INFO ] [MAIN ] TYL: Found 1 missing trading days. [2025-09-05T19:04:03.475976] [INFO ] [MAIN ] TYL: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:03.476209] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-05T19:04:03.819184] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-05T19:04:03.821961] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-05T19:04:03.866466] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-05T19:04:03.876260] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-05T19:04:04.015822] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-05T19:04:04.051300] [INFO ] [MAIN ] TYG: Adding 99 new records, updating 0 existing records. [2025-09-05T19:04:04.053019] [INFO ] [MAIN ] TYG: Combined dataset has 6977 total records. [2025-09-05T19:04:04.227410] [WARN ] [VALIDATOR ] TYG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:04.415392] [WARN ] [VALIDATOR ] TYG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:04.415591] [INFO ] [MAIN ] TYG: Combined data validation passed. [2025-09-05T19:04:04.461594] [INFO ] [MAIN ] TYG: Update completed successfully. [2025-09-05T19:04:04.462807] [INFO ] [MAIN ] Update Progress: 2154/2363 symbols completed. TYG took 2.3s. Estimated remaining: 6m 13s. Rate: 33.7 symbols/min [2025-09-05T19:04:04.641436] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:04.646016] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T19:04:04.702282] [INFO ] [MAIN ] TYL: Adding 115 new records, updating 0 existing records. [2025-09-05T19:04:04.705296] [INFO ] [MAIN ] TYL: Combined dataset has 10543 total records. [2025-09-05T19:04:04.912853] [WARN ] [VALIDATOR ] TYL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:04.975456] [INFO ] [MAIN ] U: Loaded 40539 existing records. [2025-09-05T19:04:05.025531] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-05T19:04:05.075838] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-05T19:04:05.303990] [INFO ] [MAIN ] U: Found 1 missing trading days. [2025-09-05T19:04:05.304323] [INFO ] [MAIN ] U: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:05.304723] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-05T19:04:05.316146] [WARN ] [VALIDATOR ] TYL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:05.316345] [INFO ] [MAIN ] TYL: Combined data validation passed. [2025-09-05T19:04:05.381763] [INFO ] [MAIN ] TYL: Update completed successfully. [2025-09-05T19:04:05.383223] [INFO ] [MAIN ] Update Progress: 2155/2363 symbols completed. TYL took 2.3s. Estimated remaining: 6m 11s. Rate: 33.7 symbols/min [2025-09-05T19:04:05.600809] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:05.637383] [INFO ] [MAIN ] UA: Loaded 37620 existing records. [2025-09-05T19:04:05.854405] [INFO ] [MAIN ] UA: Found 1 missing trading days. [2025-09-05T19:04:05.860568] [INFO ] [MAIN ] UA: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:05.860919] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-05T19:04:05.866132] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-05T19:04:05.876237] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-05T19:04:06.102563] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-05T19:04:06.105036] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-05T19:04:06.912699] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-05T19:04:06.915496] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-05T19:04:07.116812] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-05T19:04:07.278061] [INFO ] [MAIN ] U: Adding 390 new records, updating 0 existing records. [2025-09-05T19:04:07.282093] [INFO ] [MAIN ] U: Combined dataset has 40929 total records. [2025-09-05T19:04:07.480861] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-05T19:04:07.485690] [WARN ] [VALIDATOR ] U: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:07.508691] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-05T19:04:07.605964] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-05T19:04:07.886909] [INFO ] [MAIN ] UA: Adding 385 new records, updating 0 existing records. [2025-09-05T19:04:07.917287] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-05T19:04:07.931584] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-05T19:04:07.934465] [INFO ] [MAIN ] UA: Combined dataset has 38005 total records. [2025-09-05T19:04:08.070950] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-05T19:04:08.119170] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-05T19:04:08.140416] [WARN ] [VALIDATOR ] UA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:08.345888] [WARN ] [VALIDATOR ] U: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:08.346565] [INFO ] [MAIN ] U: Combined data validation passed. [2025-09-05T19:04:08.352133] [WARN ] [VALIDATOR ] UA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:08.352529] [INFO ] [MAIN ] UA: Combined data validation passed. [2025-09-05T19:04:08.792178] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-05T19:04:08.798952] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-05T19:04:08.823248] [INFO ] [MAIN ] U: Update completed successfully. [2025-09-05T19:04:08.831846] [INFO ] [MAIN ] Update Progress: 2156/2363 symbols completed. U took 4.4s. Estimated remaining: 6m 9s. Rate: 33.6 symbols/min [2025-09-05T19:04:09.018427] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:09.031598] [INFO ] [MAIN ] UA: Update completed successfully. [2025-09-05T19:04:09.036945] [INFO ] [MAIN ] Update Progress: 2157/2363 symbols completed. UA took 3.7s. Estimated remaining: 6m 7s. Rate: 33.7 symbols/min [2025-09-05T19:04:09.059962] [INFO ] [MAIN ] UAA: Loaded 25474 existing records. [2025-09-05T19:04:09.254802] [INFO ] [MAIN ] UAA: Found 1 missing trading days. [2025-09-05T19:04:09.255585] [INFO ] [MAIN ] UAA: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:09.256031] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-05T19:04:09.578810] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-05T19:04:09.581040] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-05T19:04:09.856397] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-05T19:04:09.873608] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-05T19:04:10.286336] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T19:04:10.287330] [INFO ] [REMOTE ] TY: Full fetch complete (8613 records). [2025-09-05T19:04:10.646788] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-05T19:04:10.682448] [INFO ] [MAIN ] TY: Full history saved. [2025-09-05T19:04:10.682576] [INFO ] [MAIN ] Update Progress: 2158/2363 symbols completed. TY took 8.6s. Estimated remaining: 6m 5s. Rate: 33.7 symbols/min [2025-09-05T19:04:11.082477] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-05T19:04:11.232469] [INFO ] [MAIN ] UAA: Adding 390 new records, updating 0 existing records. [2025-09-05T19:04:11.236123] [INFO ] [MAIN ] UAA: Combined dataset has 25864 total records. [2025-09-05T19:04:11.423475] [WARN ] [VALIDATOR ] UAA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:11.626238] [WARN ] [VALIDATOR ] UAA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:11.626464] [INFO ] [MAIN ] UAA: Combined data validation passed. [2025-09-05T19:04:11.781401] [INFO ] [MAIN ] UAA: Update completed successfully. [2025-09-05T19:04:11.784840] [INFO ] [MAIN ] Update Progress: 2159/2363 symbols completed. UAA took 3.0s. Estimated remaining: 6m 4s. Rate: 33.7 symbols/min [2025-09-05T19:04:11.818888] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-05T19:04:11.829486] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-05T19:04:13.337135] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-05T19:04:13.347634] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-05T19:04:14.943665] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-05T19:04:14.954966] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-05T19:04:16.610690] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-05T19:04:16.621614] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-05T19:04:17.678393] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-05T19:04:17.682263] [INFO ] [REMOTE ] TXT: Full fetch complete (54430 records). [2025-09-05T19:04:18.052339] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-05T19:04:18.288322] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-05T19:04:18.288470] [INFO ] [MAIN ] Update Progress: 2160/2363 symbols completed. TXT took 17.5s. Estimated remaining: 6m 2s. Rate: 33.6 symbols/min [2025-09-05T19:04:18.878572] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:18.920621] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:18.934402] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:18.950182] [WARN ] [MAIN ] UAN: No existing data found, performing full refresh instead. [2025-09-05T19:04:18.978439] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-05T19:04:18.996977] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:18.997217] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-05T19:04:18.997369] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-05T19:04:19.170176] [INFO ] [MAIN ] UCB: Loaded 17849 existing records. [2025-09-05T19:04:19.267064] [INFO ] [MAIN ] UBS: Loaded 24743 existing records. [2025-09-05T19:04:19.405868] [INFO ] [MAIN ] UBER: Loaded 25726 existing records. [2025-09-05T19:04:19.745468] [INFO ] [REMOTE ] UAN: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:04:19.783706] [INFO ] [MAIN ] UCB: Found 1 missing trading days. [2025-09-05T19:04:19.789165] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-05T19:04:19.840689] [INFO ] [MAIN ] UCB: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:19.880241] [INFO ] [MAIN ] UBS: Found 1 missing trading days. [2025-09-05T19:04:19.881701] [INFO ] [MAIN ] UBS: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:19.887594] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-05T19:04:19.887361] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-05T19:04:19.963962] [INFO ] [MAIN ] UBER: Found 1 missing trading days. [2025-09-05T19:04:19.964124] [INFO ] [MAIN ] UBER: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:19.964457] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-05T19:04:20.777885] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T19:04:20.867502] [INFO ] [MAIN ] UCB: Adding 243 new records, updating 0 existing records. [2025-09-05T19:04:20.873511] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-05T19:04:20.876164] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-05T19:04:20.877951] [INFO ] [MAIN ] UCB: Combined dataset has 18092 total records. [2025-09-05T19:04:21.058863] [WARN ] [VALIDATOR ] UCB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:21.250187] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T19:04:21.404316] [INFO ] [MAIN ] UBS: Adding 381 new records, updating 0 existing records. [2025-09-05T19:04:21.409746] [INFO ] [MAIN ] UBS: Combined dataset has 25124 total records. [2025-09-05T19:04:21.516608] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-05T19:04:21.524000] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-05T19:04:21.598601] [WARN ] [VALIDATOR ] UBS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:21.809893] [WARN ] [VALIDATOR ] UCB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:21.811478] [INFO ] [MAIN ] UCB: Combined data validation passed. [2025-09-05T19:04:21.885223] [WARN ] [VALIDATOR ] UBS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:21.909631] [INFO ] [MAIN ] UBS: Combined data validation passed. [2025-09-05T19:04:22.042599] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-05T19:04:22.054222] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-05T19:04:22.058193] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-05T19:04:22.091875] [INFO ] [MAIN ] UCB: Update completed successfully. [2025-09-05T19:04:22.104503] [INFO ] [MAIN ] Update Progress: 2161/2363 symbols completed. UCB took 3.8s. Estimated remaining: 6m 1s. Rate: 33.6 symbols/min [2025-09-05T19:04:22.405976] [INFO ] [MAIN ] UBER: Adding 390 new records, updating 0 existing records. [2025-09-05T19:04:22.440247] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:22.445867] [INFO ] [MAIN ] UBS: Update completed successfully. [2025-09-05T19:04:22.448969] [INFO ] [MAIN ] Update Progress: 2162/2363 symbols completed. UBS took 4.2s. Estimated remaining: 5m 59s. Rate: 33.6 symbols/min [2025-09-05T19:04:22.455213] [INFO ] [MAIN ] UBER: Combined dataset has 26116 total records. [2025-09-05T19:04:22.798397] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:22.825767] [WARN ] [VALIDATOR ] UBER: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:22.827856] [INFO ] [MAIN ] UDR: Loaded 24803 existing records. [2025-09-05T19:04:23.044384] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-05T19:04:23.074996] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-05T19:04:23.142682] [INFO ] [MAIN ] UE: Loaded 20782 existing records. [2025-09-05T19:04:23.331606] [INFO ] [MAIN ] UDR: Found 1 missing trading days. [2025-09-05T19:04:23.347050] [INFO ] [MAIN ] UDR: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:23.347409] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-05T19:04:23.435894] [INFO ] [MAIN ] UE: Found 1 missing trading days. [2025-09-05T19:04:23.437085] [INFO ] [MAIN ] UE: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:23.438365] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-05T19:04:23.443621] [WARN ] [VALIDATOR ] UBER: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:23.443868] [INFO ] [MAIN ] UBER: Combined data validation passed. [2025-09-05T19:04:23.613819] [INFO ] [MAIN ] UBER: Update completed successfully. [2025-09-05T19:04:23.616814] [INFO ] [MAIN ] Update Progress: 2163/2363 symbols completed. UBER took 5.3s. Estimated remaining: 5m 57s. Rate: 33.6 symbols/min [2025-09-05T19:04:23.790506] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:23.794957] [INFO ] [MAIN ] UFI: Loaded 2974 existing records. [2025-09-05T19:04:23.963025] [INFO ] [MAIN ] UFI: Found 1 missing trading days. [2025-09-05T19:04:23.963190] [INFO ] [MAIN ] UFI: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:23.963400] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-05T19:04:24.047780] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-05T19:04:24.050037] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-05T19:04:24.589783] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-05T19:04:24.591699] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-05T19:04:24.763115] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-05T19:04:24.774893] [INFO ] [MAIN ] UFI: Adding 32 new records, updating 0 existing records. [2025-09-05T19:04:24.776280] [INFO ] [MAIN ] UFI: Combined dataset has 3006 total records. [2025-09-05T19:04:24.948904] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-05T19:04:24.971057] [WARN ] [VALIDATOR ] UFI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:25.197598] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-05T19:04:25.215395] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-05T19:04:25.249242] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-05T19:04:25.310306] [INFO ] [MAIN ] UDR: Adding 388 new records, updating 0 existing records. [2025-09-05T19:04:25.443268] [INFO ] [MAIN ] UE: Adding 293 new records, updating 0 existing records. [2025-09-05T19:04:25.447316] [INFO ] [MAIN ] UDR: Combined dataset has 25191 total records. [2025-09-05T19:04:25.469554] [INFO ] [MAIN ] UE: Combined dataset has 21075 total records. [2025-09-05T19:04:25.771678] [WARN ] [VALIDATOR ] UDR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:25.858758] [WARN ] [VALIDATOR ] UE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:26.196233] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-05T19:04:26.226018] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-05T19:04:26.247007] [WARN ] [VALIDATOR ] UFI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:26.255407] [INFO ] [MAIN ] UFI: Combined data validation passed. [2025-09-05T19:04:26.254301] [WARN ] [VALIDATOR ] UE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:26.255171] [WARN ] [VALIDATOR ] UDR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:26.256299] [INFO ] [MAIN ] UDR: Combined data validation passed. [2025-09-05T19:04:26.256678] [INFO ] [MAIN ] UE: Combined data validation passed. [2025-09-05T19:04:26.424153] [INFO ] [MAIN ] UFI: Update completed successfully. [2025-09-05T19:04:26.481441] [INFO ] [MAIN ] Update Progress: 2164/2363 symbols completed. UFI took 2.9s. Estimated remaining: 5m 55s. Rate: 33.6 symbols/min [2025-09-05T19:04:26.560700] [INFO ] [MAIN ] UE: Update completed successfully. [2025-09-05T19:04:26.573882] [INFO ] [MAIN ] Update Progress: 2165/2363 symbols completed. UE took 4.1s. Estimated remaining: 5m 53s. Rate: 33.6 symbols/min [2025-09-05T19:04:26.931411] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-05T19:04:26.949565] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:26.933385] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:26.950738] [INFO ] [REMOTE ] UAN: Full fetch complete (6054 records). [2025-09-05T19:04:27.031152] [INFO ] [MAIN ] UDR: Update completed successfully. [2025-09-05T19:04:27.044580] [INFO ] [MAIN ] Update Progress: 2166/2363 symbols completed. UDR took 4.9s. Estimated remaining: 5m 51s. Rate: 33.6 symbols/min [2025-09-05T19:04:27.385424] [INFO ] [MAIN ] UGP: Loaded 20296 existing records. [2025-09-05T19:04:27.488182] [INFO ] [MAIN ] UGI: Loaded 38039 existing records. [2025-09-05T19:04:27.535450] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:27.798406] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-05T19:04:27.952065] [INFO ] [MAIN ] UGI: Found 1 missing trading days. [2025-09-05T19:04:27.952186] [INFO ] [MAIN ] UHAL: Loaded 8183 existing records. [2025-09-05T19:04:27.968895] [INFO ] [MAIN ] UGI: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:27.958175] [INFO ] [MAIN ] UGP: Found 1 missing trading days. [2025-09-05T19:04:27.987424] [INFO ] [MAIN ] UGP: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:28.008497] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-05T19:04:27.987334] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-05T19:04:28.161183] [INFO ] [MAIN ] UHAL: Found 1 missing trading days. [2025-09-05T19:04:28.161842] [INFO ] [MAIN ] UHAL: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:28.162449] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-05T19:04:28.166025] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-05T19:04:28.166158] [INFO ] [MAIN ] Update Progress: 2167/2363 symbols completed. UAN took 9.9s. Estimated remaining: 5m 50s. Rate: 33.6 symbols/min [2025-09-05T19:04:28.346741] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:28.367240] [INFO ] [MAIN ] UHS: Loaded 19493 existing records. [2025-09-05T19:04:28.536464] [INFO ] [MAIN ] UHS: Found 1 missing trading days. [2025-09-05T19:04:28.536638] [INFO ] [MAIN ] UHS: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:28.536896] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-05T19:04:28.970638] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-05T19:04:29.037475] [INFO ] [MAIN ] UHAL: Adding 157 new records, updating 0 existing records. [2025-09-05T19:04:29.039740] [INFO ] [MAIN ] UHAL: Combined dataset has 8340 total records. [2025-09-05T19:04:29.216392] [WARN ] [VALIDATOR ] UHAL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:29.405154] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T19:04:29.512506] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T19:04:29.570506] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:04:29.732585] [INFO ] [MAIN ] UGI: Adding 367 new records, updating 0 existing records. [2025-09-05T19:04:29.756764] [INFO ] [MAIN ] UHS: Adding 273 new records, updating 0 existing records. [2025-09-05T19:04:29.844640] [INFO ] [MAIN ] UGP: Adding 356 new records, updating 0 existing records. [2025-09-05T19:04:29.846176] [INFO ] [MAIN ] UHS: Combined dataset has 19766 total records. [2025-09-05T19:04:29.848025] [INFO ] [MAIN ] UGI: Combined dataset has 38406 total records. [2025-09-05T19:04:30.024431] [INFO ] [MAIN ] UGP: Combined dataset has 20652 total records. [2025-09-05T19:04:30.204053] [WARN ] [VALIDATOR ] UHS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:30.425715] [WARN ] [VALIDATOR ] UGI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:30.739845] [WARN ] [VALIDATOR ] UGP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:31.012849] [WARN ] [VALIDATOR ] UHAL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:31.023153] [INFO ] [MAIN ] UHAL: Combined data validation passed. [2025-09-05T19:04:31.078840] [INFO ] [MAIN ] UHAL: Update completed successfully. [2025-09-05T19:04:31.081284] [INFO ] [MAIN ] Update Progress: 2168/2363 symbols completed. UHAL took 4.0s. Estimated remaining: 5m 48s. Rate: 33.6 symbols/min [2025-09-05T19:04:31.264039] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:31.281706] [INFO ] [MAIN ] UHT: Loaded 7327 existing records. [2025-09-05T19:04:31.292800] [WARN ] [VALIDATOR ] UGI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:31.292968] [WARN ] [VALIDATOR ] UGP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:31.292895] [WARN ] [VALIDATOR ] UHS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:31.349518] [INFO ] [MAIN ] UGI: Combined data validation passed. [2025-09-05T19:04:31.360068] [INFO ] [MAIN ] UHS: Combined data validation passed. [2025-09-05T19:04:31.344237] [INFO ] [MAIN ] UGP: Combined data validation passed. [2025-09-05T19:04:31.622853] [INFO ] [MAIN ] UHS: Update completed successfully. [2025-09-05T19:04:31.718265] [INFO ] [MAIN ] UHT: Found 1 missing trading days. [2025-09-05T19:04:31.699479] [INFO ] [MAIN ] Update Progress: 2169/2363 symbols completed. UHS took 3.5s. Estimated remaining: 5m 46s. Rate: 33.6 symbols/min [2025-09-05T19:04:31.773529] [INFO ] [MAIN ] UHT: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:31.797558] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-05T19:04:31.837577] [INFO ] [MAIN ] UGP: Update completed successfully. [2025-09-05T19:04:31.866055] [INFO ] [MAIN ] Update Progress: 2170/2363 symbols completed. UGP took 5.3s. Estimated remaining: 5m 44s. Rate: 33.7 symbols/min [2025-09-05T19:04:32.138583] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:32.257703] [INFO ] [MAIN ] UI: Loaded 6497 existing records. [2025-09-05T19:04:32.268804] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:32.571067] [INFO ] [MAIN ] UI: Found 1 missing trading days. [2025-09-05T19:04:32.573362] [INFO ] [MAIN ] UI: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:32.576294] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-05T19:04:32.575142] [INFO ] [MAIN ] UIS: Loaded 28274 existing records. [2025-09-05T19:04:32.744501] [INFO ] [MAIN ] UGI: Update completed successfully. [2025-09-05T19:04:32.763113] [INFO ] [MAIN ] Update Progress: 2171/2363 symbols completed. UGI took 6.3s. Estimated remaining: 5m 42s. Rate: 33.7 symbols/min [2025-09-05T19:04:32.804470] [INFO ] [MAIN ] UIS: Found 1 missing trading days. [2025-09-05T19:04:32.837686] [INFO ] [MAIN ] UIS: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:32.825473] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T19:04:32.860114] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-05T19:04:32.932275] [INFO ] [MAIN ] UHT: Adding 92 new records, updating 0 existing records. [2025-09-05T19:04:33.004609] [INFO ] [MAIN ] UHT: Combined dataset has 7419 total records. [2025-09-05T19:04:33.007546] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:33.190534] [WARN ] [VALIDATOR ] UHT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:33.378118] [INFO ] [MAIN ] UL: Loaded 39927 existing records. [2025-09-05T19:04:33.555847] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-05T19:04:33.624322] [INFO ] [MAIN ] UL: Found 1 missing trading days. [2025-09-05T19:04:33.651187] [INFO ] [MAIN ] UI: Adding 101 new records, updating 0 existing records. [2025-09-05T19:04:33.647001] [INFO ] [MAIN ] UL: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:33.656183] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-05T19:04:33.659503] [INFO ] [MAIN ] UI: Combined dataset has 6598 total records. [2025-09-05T19:04:33.861134] [WARN ] [VALIDATOR ] UI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:34.046742] [WARN ] [VALIDATOR ] UHT: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:34.047229] [INFO ] [MAIN ] UHT: Combined data validation passed. [2025-09-05T19:04:34.099323] [INFO ] [MAIN ] UHT: Update completed successfully. [2025-09-05T19:04:34.101030] [INFO ] [MAIN ] Update Progress: 2172/2363 symbols completed. UHT took 3.0s. Estimated remaining: 5m 40s. Rate: 33.7 symbols/min [2025-09-05T19:04:34.278169] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:34.280498] [WARN ] [VALIDATOR ] UI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:34.280657] [INFO ] [MAIN ] UI: Combined data validation passed. [2025-09-05T19:04:34.335930] [INFO ] [MAIN ] UI: Update completed successfully. [2025-09-05T19:04:34.336985] [INFO ] [MAIN ] Update Progress: 2173/2363 symbols completed. UI took 2.5s. Estimated remaining: 5m 38s. Rate: 33.7 symbols/min [2025-09-05T19:04:34.381925] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T19:04:34.480495] [INFO ] [MAIN ] ULS: Loaded 30044 existing records. [2025-09-05T19:04:34.673974] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:34.789749] [INFO ] [MAIN ] UIS: Adding 231 new records, updating 0 existing records. [2025-09-05T19:04:34.865410] [INFO ] [MAIN ] ULS: Found 1 missing trading days. [2025-09-05T19:04:34.866193] [INFO ] [MAIN ] ULS: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:34.866550] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-05T19:04:34.870870] [INFO ] [MAIN ] UIS: Combined dataset has 28505 total records. [2025-09-05T19:04:35.085147] [WARN ] [VALIDATOR ] UIS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:35.086872] [INFO ] [MAIN ] UMC: Loaded 39695 existing records. [2025-09-05T19:04:35.473302] [INFO ] [MAIN ] UMC: Found 1 missing trading days. [2025-09-05T19:04:35.474695] [INFO ] [MAIN ] UMC: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:35.474959] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-05T19:04:35.496768] [WARN ] [VALIDATOR ] UIS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:35.497872] [INFO ] [MAIN ] UIS: Combined data validation passed. [2025-09-05T19:04:35.497722] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-05T19:04:35.788468] [INFO ] [MAIN ] UL: Adding 389 new records, updating 0 existing records. [2025-09-05T19:04:35.841340] [INFO ] [MAIN ] UL: Combined dataset has 40316 total records. [2025-09-05T19:04:35.844141] [INFO ] [MAIN ] UIS: Update completed successfully. [2025-09-05T19:04:35.911029] [INFO ] [MAIN ] Update Progress: 2174/2363 symbols completed. UIS took 4.0s. Estimated remaining: 5m 37s. Rate: 33.7 symbols/min [2025-09-05T19:04:36.087274] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T19:04:36.174404] [WARN ] [VALIDATOR ] UL: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:36.348225] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:36.467667] [INFO ] [MAIN ] ULS: Adding 230 new records, updating 0 existing records. [2025-09-05T19:04:36.501992] [INFO ] [MAIN ] UMH: Loaded 15573 existing records. [2025-09-05T19:04:36.625240] [INFO ] [MAIN ] ULS: Combined dataset has 30274 total records. [2025-09-05T19:04:36.852307] [INFO ] [MAIN ] UMH: Found 1 missing trading days. [2025-09-05T19:04:36.863977] [INFO ] [MAIN ] UMH: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:36.865169] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-05T19:04:36.954043] [WARN ] [VALIDATOR ] ULS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:37.035854] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:04:37.345232] [INFO ] [MAIN ] UMC: Adding 377 new records, updating 0 existing records. [2025-09-05T19:04:37.355800] [INFO ] [MAIN ] UMC: Combined dataset has 40072 total records. [2025-09-05T19:04:37.523789] [WARN ] [VALIDATOR ] ULS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:37.523923] [WARN ] [VALIDATOR ] UL: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:37.539454] [INFO ] [MAIN ] ULS: Combined data validation passed. [2025-09-05T19:04:37.539737] [INFO ] [MAIN ] UL: Combined data validation passed. [2025-09-05T19:04:37.560461] [WARN ] [VALIDATOR ] UMC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:38.195104] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T19:04:38.332301] [INFO ] [MAIN ] UMH: Adding 311 new records, updating 0 existing records. [2025-09-05T19:04:38.337827] [WARN ] [VALIDATOR ] UMC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:38.352390] [INFO ] [MAIN ] UMC: Combined data validation passed. [2025-09-05T19:04:38.353753] [INFO ] [MAIN ] UL: Update completed successfully. [2025-09-05T19:04:38.359383] [INFO ] [MAIN ] Update Progress: 2175/2363 symbols completed. UL took 5.6s. Estimated remaining: 5m 35s. Rate: 33.7 symbols/min [2025-09-05T19:04:38.419811] [INFO ] [MAIN ] ULS: Update completed successfully. [2025-09-05T19:04:38.434305] [INFO ] [MAIN ] UMH: Combined dataset has 15884 total records. [2025-09-05T19:04:38.443287] [INFO ] [MAIN ] Update Progress: 2176/2363 symbols completed. ULS took 4.3s. Estimated remaining: 5m 33s. Rate: 33.7 symbols/min [2025-09-05T19:04:38.847427] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:39.011144] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:39.019297] [WARN ] [VALIDATOR ] UMH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:39.023100] [INFO ] [MAIN ] UNF: Loaded 5412 existing records. [2025-09-05T19:04:39.465887] [INFO ] [MAIN ] UNF: Found 1 missing trading days. [2025-09-05T19:04:39.485695] [INFO ] [MAIN ] UNF: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:39.502558] [INFO ] [MAIN ] UNFI: Loaded 31611 existing records. [2025-09-05T19:04:39.510136] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-05T19:04:39.709315] [INFO ] [MAIN ] UNFI: Found 1 missing trading days. [2025-09-05T19:04:39.710631] [INFO ] [MAIN ] UNFI: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:39.711551] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-05T19:04:39.726757] [INFO ] [MAIN ] UMC: Update completed successfully. [2025-09-05T19:04:39.730826] [INFO ] [MAIN ] Update Progress: 2177/2363 symbols completed. UMC took 5.4s. Estimated remaining: 5m 31s. Rate: 33.7 symbols/min [2025-09-05T19:04:39.903149] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:39.909460] [WARN ] [VALIDATOR ] UMH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:39.909711] [INFO ] [MAIN ] UMH: Combined data validation passed. [2025-09-05T19:04:40.031491] [INFO ] [MAIN ] UMH: Update completed successfully. [2025-09-05T19:04:40.033952] [INFO ] [MAIN ] Update Progress: 2178/2363 symbols completed. UMH took 4.1s. Estimated remaining: 5m 29s. Rate: 33.7 symbols/min [2025-09-05T19:04:40.066679] [INFO ] [MAIN ] UNH: Loaded 40559 existing records. [2025-09-05T19:04:40.146819] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T19:04:40.277178] [INFO ] [MAIN ] UNF: Adding 67 new records, updating 116 existing records. [2025-09-05T19:04:40.368966] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:40.426553] [INFO ] [MAIN ] UNF: Combined dataset has 5479 total records. [2025-09-05T19:04:40.441422] [INFO ] [MAIN ] UNH: Found 1 missing trading days. [2025-09-05T19:04:40.441694] [INFO ] [MAIN ] UNH: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:40.453370] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-05T19:04:40.690704] [WARN ] [VALIDATOR ] UNF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:40.691413] [INFO ] [MAIN ] UNM: Loaded 23027 existing records. [2025-09-05T19:04:40.966482] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T19:04:41.067744] [INFO ] [MAIN ] UNM: Found 1 missing trading days. [2025-09-05T19:04:41.091987] [INFO ] [MAIN ] UNM: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:41.092441] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-05T19:04:41.185544] [INFO ] [MAIN ] UNFI: Adding 304 new records, updating 0 existing records. [2025-09-05T19:04:41.194685] [INFO ] [MAIN ] UNFI: Combined dataset has 31915 total records. [2025-09-05T19:04:41.377423] [WARN ] [VALIDATOR ] UNFI: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:41.601266] [WARN ] [VALIDATOR ] UNF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:41.601915] [INFO ] [MAIN ] UNF: Combined data validation passed. [2025-09-05T19:04:41.639284] [INFO ] [MAIN ] UNF: Update completed successfully. [2025-09-05T19:04:41.640628] [INFO ] [MAIN ] Update Progress: 2179/2363 symbols completed. UNF took 3.3s. Estimated remaining: 5m 27s. Rate: 33.7 symbols/min [2025-09-05T19:04:41.818283] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:41.820496] [WARN ] [VALIDATOR ] UNFI: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:41.821231] [INFO ] [MAIN ] UNFI: Combined data validation passed. [2025-09-05T19:04:41.825385] [INFO ] [MAIN ] UNMA: Loaded 1843 existing records. [2025-09-05T19:04:42.105313] [INFO ] [MAIN ] UNMA: Found 1 missing trading days. [2025-09-05T19:04:42.109913] [INFO ] [MAIN ] UNMA: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:42.113225] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-05T19:04:42.189805] [INFO ] [MAIN ] UNFI: Update completed successfully. [2025-09-05T19:04:42.193228] [INFO ] [MAIN ] Update Progress: 2180/2363 symbols completed. UNFI took 3.7s. Estimated remaining: 5m 26s. Rate: 33.7 symbols/min [2025-09-05T19:04:42.352702] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-05T19:04:42.380499] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:42.540585] [INFO ] [MAIN ] UNM: Adding 367 new records, updating 0 existing records. [2025-09-05T19:04:42.544215] [INFO ] [MAIN ] UNM: Combined dataset has 23394 total records. [2025-09-05T19:04:42.659799] [INFO ] [MAIN ] UNP: Loaded 40167 existing records. [2025-09-05T19:04:42.641885] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T19:04:42.725887] [INFO ] [MAIN ] UNMA: Adding 38 new records, updating 0 existing records. [2025-09-05T19:04:42.857599] [WARN ] [VALIDATOR ] UNM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:42.875768] [INFO ] [MAIN ] UNMA: Combined dataset has 1881 total records. [2025-09-05T19:04:43.126253] [INFO ] [MAIN ] UNP: Found 1 missing trading days. [2025-09-05T19:04:43.175354] [INFO ] [MAIN ] UNP: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:43.197052] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-05T19:04:43.335287] [WARN ] [VALIDATOR ] UNMA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:43.418968] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-05T19:04:43.731960] [INFO ] [MAIN ] UNH: Adding 390 new records, updating 0 existing records. [2025-09-05T19:04:43.734182] [WARN ] [VALIDATOR ] UNM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:43.734744] [INFO ] [MAIN ] UNM: Combined data validation passed. [2025-09-05T19:04:43.858782] [INFO ] [MAIN ] UNH: Combined dataset has 40949 total records. [2025-09-05T19:04:44.067495] [WARN ] [VALIDATOR ] UNH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:44.302700] [INFO ] [MAIN ] UNM: Update completed successfully. [2025-09-05T19:04:44.305989] [INFO ] [MAIN ] Update Progress: 2181/2363 symbols completed. UNM took 4.3s. Estimated remaining: 5m 24s. Rate: 33.7 symbols/min [2025-09-05T19:04:44.401661] [WARN ] [VALIDATOR ] UNMA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:44.413460] [INFO ] [MAIN ] UNMA: Combined data validation passed. [2025-09-05T19:04:44.483558] [INFO ] [MAIN ] UNMA: Update completed successfully. [2025-09-05T19:04:44.502159] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:44.502768] [INFO ] [MAIN ] Update Progress: 2182/2363 symbols completed. UNMA took 2.9s. Estimated remaining: 5m 22s. Rate: 33.7 symbols/min [2025-09-05T19:04:44.699431] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:44.701951] [INFO ] [MAIN ] UP: Loaded 20385 existing records. [2025-09-05T19:04:44.899071] [INFO ] [MAIN ] UP: Found 1 missing trading days. [2025-09-05T19:04:44.907806] [INFO ] [MAIN ] UP: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:44.909112] [INFO ] [MAIN ] UPS: Loaded 25652 existing records. [2025-09-05T19:04:44.908443] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-05T19:04:45.067523] [WARN ] [VALIDATOR ] UNH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:45.083971] [INFO ] [MAIN ] UNH: Combined data validation passed. [2025-09-05T19:04:45.093061] [INFO ] [MAIN ] UPS: Found 1 missing trading days. [2025-09-05T19:04:45.093327] [INFO ] [MAIN ] UPS: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:45.093618] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-05T19:04:45.361510] [INFO ] [MAIN ] UNH: Update completed successfully. [2025-09-05T19:04:45.366048] [INFO ] [MAIN ] Update Progress: 2183/2363 symbols completed. UNH took 5.6s. Estimated remaining: 5m 20s. Rate: 33.7 symbols/min [2025-09-05T19:04:45.534917] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:45.551383] [INFO ] [MAIN ] URI: Loaded 16331 existing records. [2025-09-05T19:04:45.722148] [INFO ] [MAIN ] URI: Found 1 missing trading days. [2025-09-05T19:04:45.722311] [INFO ] [MAIN ] URI: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:45.722529] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-05T19:04:46.342628] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T19:04:46.494496] [INFO ] [MAIN ] UP: Adding 390 new records, updating 0 existing records. [2025-09-05T19:04:46.498965] [INFO ] [MAIN ] UP: Combined dataset has 20775 total records. [2025-09-05T19:04:46.697529] [WARN ] [VALIDATOR ] UP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:46.859067] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (3.66 seconds). [2025-09-05T19:04:47.045423] [INFO ] [MAIN ] UNP: Adding 0 new records, updating 0 existing records. [2025-09-05T19:04:47.050782] [INFO ] [MAIN ] UNP: Combined dataset has 40167 total records. [2025-09-05T19:04:47.059478] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-05T19:04:47.059837] [FATAL] [VALIDATOR ] UNP: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T19:04:47.088549] [FATAL] [MAIN ] UNP: Combined data validation failed. [2025-09-05T19:04:47.088771] [WARN ] [MAIN ] UNP: Deleting existing primary and derivative data due to validation failure. [2025-09-05T19:04:47.088830] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-05T19:04:47.094767] [INFO ] [LOCAL ] UNP: Starting deletion of derivative data. [2025-09-05T19:04:47.139391] [INFO ] [MAIN ] Update Progress: 2184/2363 symbols completed. UNP took 4.9s. Estimated remaining: 5m 18s. Rate: 33.7 symbols/min [2025-09-05T19:04:47.156917] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T19:04:47.293448] [INFO ] [MAIN ] UPS: Adding 390 new records, updating 0 existing records. [2025-09-05T19:04:47.418101] [INFO ] [MAIN ] URI: Adding 273 new records, updating 0 existing records. [2025-09-05T19:04:47.491572] [INFO ] [MAIN ] URI: Combined dataset has 16604 total records. [2025-09-05T19:04:47.508502] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:47.508959] [INFO ] [MAIN ] UPS: Combined dataset has 26042 total records. [2025-09-05T19:04:47.679840] [WARN ] [VALIDATOR ] UP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:47.740750] [INFO ] [MAIN ] UP: Combined data validation passed. [2025-09-05T19:04:47.740369] [INFO ] [MAIN ] USA: Loaded 17158 existing records. [2025-09-05T19:04:47.973997] [WARN ] [VALIDATOR ] URI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:47.980127] [WARN ] [VALIDATOR ] UPS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:48.410761] [INFO ] [MAIN ] USA: Found 1 missing trading days. [2025-09-05T19:04:48.470626] [INFO ] [MAIN ] USA: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:48.502678] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-05T19:04:48.586377] [INFO ] [MAIN ] UP: Update completed successfully. [2025-09-05T19:04:48.590057] [INFO ] [MAIN ] Update Progress: 2185/2363 symbols completed. UP took 4.3s. Estimated remaining: 5m 16s. Rate: 33.7 symbols/min [2025-09-05T19:04:48.608365] [WARN ] [VALIDATOR ] URI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:48.629103] [INFO ] [MAIN ] URI: Combined data validation passed. [2025-09-05T19:04:48.628767] [WARN ] [VALIDATOR ] UPS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:48.647910] [INFO ] [MAIN ] UPS: Combined data validation passed. [2025-09-05T19:04:48.981500] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:49.045702] [INFO ] [MAIN ] USAC: Loaded 9156 existing records. [2025-09-05T19:04:49.058487] [INFO ] [MAIN ] UPS: Update completed successfully. [2025-09-05T19:04:49.081337] [INFO ] [MAIN ] Update Progress: 2186/2363 symbols completed. UPS took 4.6s. Estimated remaining: 5m 15s. Rate: 33.8 symbols/min [2025-09-05T19:04:49.340037] [INFO ] [MAIN ] USAC: Found 1 missing trading days. [2025-09-05T19:04:49.357020] [INFO ] [MAIN ] USAC: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:49.362420] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-05T19:04:49.410789] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:49.416941] [INFO ] [MAIN ] URI: Update completed successfully. [2025-09-05T19:04:49.419135] [INFO ] [MAIN ] Update Progress: 2187/2363 symbols completed. URI took 4.1s. Estimated remaining: 5m 13s. Rate: 33.8 symbols/min [2025-09-05T19:04:49.599770] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:49.617559] [INFO ] [MAIN ] USB: Loaded 40428 existing records. [2025-09-05T19:04:49.736498] [INFO ] [MAIN ] USFD: Loaded 24427 existing records. [2025-09-05T19:04:49.917478] [INFO ] [MAIN ] USB: Found 1 missing trading days. [2025-09-05T19:04:49.928947] [INFO ] [MAIN ] USB: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:49.939527] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-05T19:04:50.004631] [INFO ] [MAIN ] USFD: Found 1 missing trading days. [2025-09-05T19:04:50.004933] [INFO ] [MAIN ] USFD: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:50.005592] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-05T19:04:50.044902] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-05T19:04:50.151724] [INFO ] [MAIN ] USA: Adding 247 new records, updating 0 existing records. [2025-09-05T19:04:50.154852] [INFO ] [MAIN ] USA: Combined dataset has 17405 total records. [2025-09-05T19:04:50.332874] [WARN ] [VALIDATOR ] USA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:50.367408] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T19:04:50.514605] [INFO ] [MAIN ] USAC: Adding 191 new records, updating 0 existing records. [2025-09-05T19:04:50.579742] [INFO ] [MAIN ] USAC: Combined dataset has 9347 total records. [2025-09-05T19:04:50.766486] [WARN ] [VALIDATOR ] USAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:50.995325] [WARN ] [VALIDATOR ] USA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:50.995475] [WARN ] [VALIDATOR ] USAC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:50.995928] [INFO ] [MAIN ] USA: Combined data validation passed. [2025-09-05T19:04:50.996587] [INFO ] [MAIN ] USAC: Combined data validation passed. [2025-09-05T19:04:51.110054] [INFO ] [MAIN ] USAC: Update completed successfully. [2025-09-05T19:04:51.136093] [INFO ] [MAIN ] Update Progress: 2188/2363 symbols completed. USAC took 2.5s. Estimated remaining: 5m 11s. Rate: 33.8 symbols/min [2025-09-05T19:04:51.281796] [INFO ] [MAIN ] USA: Update completed successfully. [2025-09-05T19:04:51.295243] [INFO ] [MAIN ] Update Progress: 2189/2363 symbols completed. USA took 4.1s. Estimated remaining: 5m 9s. Rate: 33.8 symbols/min [2025-09-05T19:04:51.436120] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:51.492504] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-05T19:04:51.683489] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:51.706125] [INFO ] [MAIN ] USNA: Loaded 13530 existing records. [2025-09-05T19:04:51.813859] [INFO ] [MAIN ] USFD: Adding 357 new records, updating 0 existing records. [2025-09-05T19:04:51.871532] [INFO ] [MAIN ] USPH: Loaded 8675 existing records. [2025-09-05T19:04:51.948022] [INFO ] [MAIN ] USFD: Combined dataset has 24784 total records. [2025-09-05T19:04:52.076691] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-05T19:04:52.198477] [INFO ] [MAIN ] USNA: Found 1 missing trading days. [2025-09-05T19:04:52.245133] [INFO ] [MAIN ] USNA: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:52.283799] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-05T19:04:52.466746] [INFO ] [MAIN ] USPH: Found 1 missing trading days. [2025-09-05T19:04:52.507672] [INFO ] [MAIN ] USPH: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:52.519263] [WARN ] [VALIDATOR ] USFD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:52.535267] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-05T19:04:52.578076] [INFO ] [MAIN ] USB: Adding 390 new records, updating 0 existing records. [2025-09-05T19:04:52.754741] [INFO ] [MAIN ] USB: Combined dataset has 40818 total records. [2025-09-05T19:04:52.937745] [WARN ] [VALIDATOR ] USB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:53.238379] [WARN ] [VALIDATOR ] USFD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:53.238506] [WARN ] [VALIDATOR ] USB: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:53.239005] [INFO ] [MAIN ] USFD: Combined data validation passed. [2025-09-05T19:04:53.239194] [INFO ] [MAIN ] USB: Combined data validation passed. [2025-09-05T19:04:53.354319] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T19:04:53.422971] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T19:04:53.514625] [INFO ] [MAIN ] USNA: Adding 164 new records, updating 0 existing records. [2025-09-05T19:04:53.552570] [INFO ] [MAIN ] USPH: Adding 125 new records, updating 0 existing records. [2025-09-05T19:04:53.570783] [INFO ] [MAIN ] USNA: Combined dataset has 13694 total records. [2025-09-05T19:04:53.659764] [INFO ] [MAIN ] USPH: Combined dataset has 8800 total records. [2025-09-05T19:04:53.994304] [INFO ] [MAIN ] USFD: Update completed successfully. [2025-09-05T19:04:54.093848] [INFO ] [MAIN ] Update Progress: 2190/2363 symbols completed. USFD took 4.7s. Estimated remaining: 5m 7s. Rate: 33.8 symbols/min [2025-09-05T19:04:54.089759] [WARN ] [VALIDATOR ] USNA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:54.395302] [WARN ] [VALIDATOR ] USPH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:54.682593] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:54.790584] [INFO ] [MAIN ] UTF: Loaded 12259 existing records. [2025-09-05T19:04:54.983660] [INFO ] [MAIN ] USB: Update completed successfully. [2025-09-05T19:04:55.009189] [INFO ] [MAIN ] UTF: Found 1 missing trading days. [2025-09-05T19:04:55.009950] [INFO ] [MAIN ] UTF: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:55.014049] [INFO ] [MAIN ] Update Progress: 2191/2363 symbols completed. USB took 5.9s. Estimated remaining: 5m 5s. Rate: 33.8 symbols/min [2025-09-05T19:04:55.051364] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-05T19:04:55.198926] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:55.201392] [WARN ] [VALIDATOR ] USNA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:55.201806] [INFO ] [MAIN ] USNA: Combined data validation passed. [2025-09-05T19:04:55.201463] [WARN ] [VALIDATOR ] USPH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:55.202670] [INFO ] [MAIN ] USPH: Combined data validation passed. [2025-09-05T19:04:55.335482] [INFO ] [MAIN ] UTI: Loaded 18643 existing records. [2025-09-05T19:04:55.421278] [INFO ] [MAIN ] USNA: Update completed successfully. [2025-09-05T19:04:55.434004] [INFO ] [MAIN ] Update Progress: 2192/2363 symbols completed. USNA took 4.3s. Estimated remaining: 5m 4s. Rate: 33.8 symbols/min [2025-09-05T19:04:55.595598] [INFO ] [MAIN ] USPH: Update completed successfully. [2025-09-05T19:04:55.640518] [INFO ] [MAIN ] Update Progress: 2193/2363 symbols completed. USPH took 4.3s. Estimated remaining: 5m 2s. Rate: 33.8 symbols/min [2025-09-05T19:04:55.644227] [INFO ] [MAIN ] UTI: Found 1 missing trading days. [2025-09-05T19:04:55.671274] [INFO ] [MAIN ] UTI: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:55.700982] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-05T19:04:55.783240] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:55.875282] [INFO ] [MAIN ] UTL: Loaded 5654 existing records. [2025-09-05T19:04:55.929887] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:56.074209] [INFO ] [MAIN ] UTL: Found 1 missing trading days. [2025-09-05T19:04:56.074478] [INFO ] [MAIN ] UTL: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:56.074785] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-05T19:04:56.101894] [INFO ] [MAIN ] UTZ: Loaded 34053 existing records. [2025-09-05T19:04:56.227679] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T19:04:56.355756] [INFO ] [MAIN ] UTZ: Found 1 missing trading days. [2025-09-05T19:04:56.366112] [INFO ] [MAIN ] UTZ: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:56.371467] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-05T19:04:56.376920] [INFO ] [MAIN ] UTF: Adding 164 new records, updating 0 existing records. [2025-09-05T19:04:56.380170] [INFO ] [MAIN ] UTF: Combined dataset has 12423 total records. [2025-09-05T19:04:56.557507] [WARN ] [VALIDATOR ] UTF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:56.751069] [WARN ] [VALIDATOR ] UTF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:56.751294] [INFO ] [MAIN ] UTF: Combined data validation passed. [2025-09-05T19:04:56.834630] [INFO ] [MAIN ] UTF: Update completed successfully. [2025-09-05T19:04:56.836011] [INFO ] [MAIN ] Update Progress: 2194/2363 symbols completed. UTF took 2.7s. Estimated remaining: 4m 60s. Rate: 33.8 symbols/min [2025-09-05T19:04:56.941231] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T19:04:57.052958] [INFO ] [MAIN ] UTL: Adding 88 new records, updating 0 existing records. [2025-09-05T19:04:57.056616] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:57.059533] [INFO ] [MAIN ] UTL: Combined dataset has 5742 total records. [2025-09-05T19:04:57.187615] [INFO ] [MAIN ] UVE: Loaded 11111 existing records. [2025-09-05T19:04:57.228766] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T19:04:57.280634] [WARN ] [VALIDATOR ] UTL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:57.605177] [INFO ] [MAIN ] UTI: Adding 284 new records, updating 0 existing records. [2025-09-05T19:04:57.732561] [INFO ] [MAIN ] UVE: Found 1 missing trading days. [2025-09-05T19:04:57.741551] [INFO ] [MAIN ] UVE: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:57.742140] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-05T19:04:57.750508] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T19:04:57.761277] [INFO ] [MAIN ] UTI: Combined dataset has 18927 total records. [2025-09-05T19:04:58.007595] [INFO ] [MAIN ] UTZ: Adding 286 new records, updating 0 existing records. [2025-09-05T19:04:58.066684] [WARN ] [VALIDATOR ] UTI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:58.186253] [INFO ] [MAIN ] UTZ: Combined dataset has 34339 total records. [2025-09-05T19:04:58.440910] [WARN ] [VALIDATOR ] UTZ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:04:58.636815] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-05T19:04:58.659738] [WARN ] [VALIDATOR ] UTL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:58.659815] [WARN ] [VALIDATOR ] UTI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:58.675468] [INFO ] [MAIN ] UTL: Combined data validation passed. [2025-09-05T19:04:58.675836] [INFO ] [MAIN ] UTI: Combined data validation passed. [2025-09-05T19:04:58.821038] [INFO ] [MAIN ] UVE: Adding 162 new records, updating 0 existing records. [2025-09-05T19:04:58.835201] [INFO ] [MAIN ] UVE: Combined dataset has 11273 total records. [2025-09-05T19:04:58.849437] [INFO ] [MAIN ] UTL: Update completed successfully. [2025-09-05T19:04:58.869552] [INFO ] [MAIN ] Update Progress: 2195/2363 symbols completed. UTL took 3.4s. Estimated remaining: 4m 58s. Rate: 33.8 symbols/min [2025-09-05T19:04:59.140010] [WARN ] [VALIDATOR ] UVE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:04:59.243001] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:59.340983] [INFO ] [MAIN ] UVV: Loaded 11463 existing records. [2025-09-05T19:04:59.588836] [INFO ] [MAIN ] UVV: Found 1 missing trading days. [2025-09-05T19:04:59.589751] [INFO ] [MAIN ] UVV: Need to fetch 1 months: 2025-09 [2025-09-05T19:04:59.593775] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-05T19:04:59.595239] [INFO ] [MAIN ] UTI: Update completed successfully. [2025-09-05T19:04:59.597838] [INFO ] [MAIN ] Update Progress: 2196/2363 symbols completed. UTI took 4.6s. Estimated remaining: 4m 56s. Rate: 33.8 symbols/min [2025-09-05T19:04:59.776699] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:04:59.782746] [WARN ] [VALIDATOR ] UTZ: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:04:59.785537] [INFO ] [MAIN ] UTZ: Combined data validation passed. [2025-09-05T19:04:59.788672] [WARN ] [VALIDATOR ] UVE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:04:59.789207] [INFO ] [MAIN ] UVE: Combined data validation passed. [2025-09-05T19:04:59.952025] [INFO ] [MAIN ] UWMC: Loaded 25335 existing records. [2025-09-05T19:05:00.172463] [INFO ] [MAIN ] UWMC: Found 1 missing trading days. [2025-09-05T19:05:00.176572] [INFO ] [MAIN ] UWMC: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:00.179451] [INFO ] [MAIN ] UVE: Update completed successfully. [2025-09-05T19:05:00.183061] [INFO ] [MAIN ] Update Progress: 2197/2363 symbols completed. UVE took 3.3s. Estimated remaining: 4m 54s. Rate: 33.8 symbols/min [2025-09-05T19:05:00.183490] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-05T19:05:00.272088] [INFO ] [MAIN ] UTZ: Update completed successfully. [2025-09-05T19:05:00.276174] [INFO ] [MAIN ] Update Progress: 2198/2363 symbols completed. UTZ took 4.6s. Estimated remaining: 4m 52s. Rate: 33.8 symbols/min [2025-09-05T19:05:00.633518] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T19:05:00.694175] [INFO ] [MAIN ] UVV: Adding 214 new records, updating 0 existing records. [2025-09-05T19:05:00.697756] [INFO ] [MAIN ] UVV: Combined dataset has 11677 total records. [2025-09-05T19:05:00.877527] [WARN ] [VALIDATOR ] UVV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:01.076931] [WARN ] [VALIDATOR ] UVV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:01.077188] [INFO ] [MAIN ] UVV: Combined data validation passed. [2025-09-05T19:05:01.151388] [INFO ] [MAIN ] UVV: Update completed successfully. [2025-09-05T19:05:01.152863] [INFO ] [MAIN ] Update Progress: 2199/2363 symbols completed. UVV took 2.3s. Estimated remaining: 4m 51s. Rate: 33.9 symbols/min [2025-09-05T19:05:01.733124] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-05T19:05:01.896903] [INFO ] [MAIN ] UWMC: Adding 390 new records, updating 0 existing records. [2025-09-05T19:05:01.901830] [INFO ] [MAIN ] UWMC: Combined dataset has 25725 total records. [2025-09-05T19:05:02.108924] [WARN ] [VALIDATOR ] UWMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:02.315491] [WARN ] [VALIDATOR ] UWMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:02.315758] [INFO ] [MAIN ] UWMC: Combined data validation passed. [2025-09-05T19:05:02.484784] [INFO ] [MAIN ] UWMC: Update completed successfully. [2025-09-05T19:05:02.490012] [INFO ] [MAIN ] Update Progress: 2200/2363 symbols completed. UWMC took 2.9s. Estimated remaining: 4m 49s. Rate: 33.9 symbols/min [2025-09-05T19:05:03.151396] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:03.209884] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:03.256854] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:03.299083] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:03.310745] [INFO ] [MAIN ] UZD: Loaded 3329 existing records. [2025-09-05T19:05:03.346664] [INFO ] [MAIN ] UZF: Loaded 4851 existing records. [2025-09-05T19:05:03.427898] [INFO ] [MAIN ] UZE: Loaded 3916 existing records. [2025-09-05T19:05:03.840108] [INFO ] [MAIN ] V: Loaded 25690 existing records. [2025-09-05T19:05:04.003563] [INFO ] [MAIN ] UZD: Found 1 missing trading days. [2025-09-05T19:05:04.033227] [INFO ] [MAIN ] UZD: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:04.142406] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-05T19:05:04.263382] [INFO ] [MAIN ] UZF: Found 1 missing trading days. [2025-09-05T19:05:04.292460] [INFO ] [MAIN ] UZE: Found 1 missing trading days. [2025-09-05T19:05:04.315589] [INFO ] [MAIN ] UZE: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:04.315783] [INFO ] [MAIN ] UZF: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:04.317155] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-05T19:05:04.316509] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-05T19:05:04.418505] [INFO ] [MAIN ] V: Found 1 missing trading days. [2025-09-05T19:05:04.418682] [INFO ] [MAIN ] V: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:04.418930] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-05T19:05:04.961582] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-05T19:05:04.981584] [INFO ] [MAIN ] UZF: Adding 41 new records, updating 0 existing records. [2025-09-05T19:05:04.983098] [INFO ] [MAIN ] UZF: Combined dataset has 4892 total records. [2025-09-05T19:05:05.060619] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T19:05:05.104559] [INFO ] [MAIN ] UZD: Adding 28 new records, updating 0 existing records. [2025-09-05T19:05:05.184057] [INFO ] [MAIN ] UZD: Combined dataset has 3357 total records. [2025-09-05T19:05:05.188839] [WARN ] [VALIDATOR ] UZF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:05:05.249909] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T19:05:05.414978] [INFO ] [MAIN ] UZE: Adding 94 new records, updating 0 existing records. [2025-09-05T19:05:05.486809] [INFO ] [MAIN ] UZE: Combined dataset has 4010 total records. [2025-09-05T19:05:05.540005] [WARN ] [VALIDATOR ] UZD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:05.898613] [WARN ] [VALIDATOR ] UZE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:06.184146] [WARN ] [VALIDATOR ] UZE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:06.184659] [WARN ] [VALIDATOR ] UZD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:06.184902] [INFO ] [MAIN ] UZE: Combined data validation passed. [2025-09-05T19:05:06.184600] [WARN ] [VALIDATOR ] UZF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:05:06.185021] [INFO ] [MAIN ] UZD: Combined data validation passed. [2025-09-05T19:05:06.185135] [INFO ] [MAIN ] UZF: Combined data validation passed. [2025-09-05T19:05:06.260399] [INFO ] [MAIN ] UZD: Update completed successfully. [2025-09-05T19:05:06.262535] [INFO ] [MAIN ] UZF: Update completed successfully. [2025-09-05T19:05:06.261908] [INFO ] [MAIN ] Update Progress: 2201/2363 symbols completed. UZD took 3.8s. Estimated remaining: 4m 47s. Rate: 33.8 symbols/min [2025-09-05T19:05:06.264001] [INFO ] [MAIN ] UZE: Update completed successfully. [2025-09-05T19:05:06.263867] [INFO ] [MAIN ] Update Progress: 2202/2363 symbols completed. UZF took 3.8s. Estimated remaining: 4m 45s. Rate: 33.9 symbols/min [2025-09-05T19:05:06.264755] [INFO ] [MAIN ] Update Progress: 2203/2363 symbols completed. UZE took 3.8s. Estimated remaining: 4m 43s. Rate: 33.9 symbols/min [2025-09-05T19:05:06.749192] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:06.782891] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-05T19:05:06.885555] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:06.892963] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:07.033602] [INFO ] [MAIN ] V: Adding 390 new records, updating 0 existing records. [2025-09-05T19:05:07.044425] [INFO ] [MAIN ] VAC: Loaded 15598 existing records. [2025-09-05T19:05:07.072957] [INFO ] [MAIN ] VAL: Loaded 23785 existing records. [2025-09-05T19:05:07.107948] [INFO ] [MAIN ] VALE: Loaded 25624 existing records. [2025-09-05T19:05:07.289443] [INFO ] [MAIN ] V: Combined dataset has 26080 total records. [2025-09-05T19:05:07.600319] [INFO ] [MAIN ] VAC: Found 1 missing trading days. [2025-09-05T19:05:07.673699] [INFO ] [MAIN ] VAC: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:07.806249] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-05T19:05:07.799662] [INFO ] [MAIN ] VALE: Found 1 missing trading days. [2025-09-05T19:05:07.805788] [INFO ] [MAIN ] VAL: Found 1 missing trading days. [2025-09-05T19:05:07.807765] [INFO ] [MAIN ] VALE: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:07.818900] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-05T19:05:07.818966] [INFO ] [MAIN ] VAL: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:07.852015] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-05T19:05:07.892707] [WARN ] [VALIDATOR ] V: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:08.090327] [WARN ] [VALIDATOR ] V: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:08.090536] [INFO ] [MAIN ] V: Combined data validation passed. [2025-09-05T19:05:08.267687] [INFO ] [MAIN ] V: Update completed successfully. [2025-09-05T19:05:08.270990] [INFO ] [MAIN ] Update Progress: 2204/2363 symbols completed. V took 5.8s. Estimated remaining: 4m 42s. Rate: 33.9 symbols/min [2025-09-05T19:05:08.442871] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:08.446697] [INFO ] [MAIN ] VATE: Loaded 2033 existing records. [2025-09-05T19:05:08.621522] [INFO ] [MAIN ] VATE: Found 1 missing trading days. [2025-09-05T19:05:08.621719] [INFO ] [MAIN ] VATE: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:08.621939] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-05T19:05:09.101603] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T19:05:09.187200] [INFO ] [MAIN ] VAC: Adding 195 new records, updating 0 existing records. [2025-09-05T19:05:09.190398] [INFO ] [MAIN ] VAC: Combined dataset has 15793 total records. [2025-09-05T19:05:09.371237] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-05T19:05:09.374626] [WARN ] [VALIDATOR ] VAC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:09.403255] [INFO ] [MAIN ] VATE: Adding 14 new records, updating 0 existing records. [2025-09-05T19:05:09.464398] [INFO ] [MAIN ] VATE: Combined dataset has 2047 total records. [2025-09-05T19:05:09.635462] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-05T19:05:09.860105] [WARN ] [VALIDATOR ] VATE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:09.941059] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-05T19:05:09.966484] [INFO ] [MAIN ] VAL: Adding 370 new records, updating 0 existing records. [2025-09-05T19:05:10.218249] [INFO ] [MAIN ] VAL: Combined dataset has 24155 total records. [2025-09-05T19:05:10.239767] [INFO ] [MAIN ] VALE: Adding 390 new records, updating 0 existing records. [2025-09-05T19:05:10.427330] [WARN ] [VALIDATOR ] VAL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:10.399614] [INFO ] [MAIN ] VALE: Combined dataset has 26014 total records. [2025-09-05T19:05:10.644578] [WARN ] [VALIDATOR ] VATE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:10.686478] [INFO ] [MAIN ] VATE: Combined data validation passed. [2025-09-05T19:05:10.640442] [WARN ] [VALIDATOR ] VAC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:10.781526] [WARN ] [VALIDATOR ] VALE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:10.796697] [INFO ] [MAIN ] VAC: Combined data validation passed. [2025-09-05T19:05:10.954426] [INFO ] [MAIN ] VATE: Update completed successfully. [2025-09-05T19:05:10.971418] [INFO ] [MAIN ] Update Progress: 2205/2363 symbols completed. VATE took 2.7s. Estimated remaining: 4m 40s. Rate: 33.9 symbols/min [2025-09-05T19:05:11.269395] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:11.283465] [INFO ] [MAIN ] VBF: Loaded 3736 existing records. [2025-09-05T19:05:11.356763] [WARN ] [VALIDATOR ] VAL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:11.363532] [INFO ] [MAIN ] VAL: Combined data validation passed. [2025-09-05T19:05:11.396195] [INFO ] [MAIN ] VAC: Update completed successfully. [2025-09-05T19:05:11.398449] [INFO ] [MAIN ] Update Progress: 2206/2363 symbols completed. VAC took 5.1s. Estimated remaining: 4m 38s. Rate: 33.9 symbols/min [2025-09-05T19:05:11.673360] [INFO ] [MAIN ] VBF: Found 1 missing trading days. [2025-09-05T19:05:11.684939] [INFO ] [MAIN ] VBF: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:11.714807] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-05T19:05:11.756885] [WARN ] [VALIDATOR ] VALE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:11.759701] [INFO ] [MAIN ] VALE: Combined data validation passed. [2025-09-05T19:05:11.781079] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:11.890585] [INFO ] [MAIN ] VCV: Loaded 7026 existing records. [2025-09-05T19:05:12.056891] [INFO ] [MAIN ] VAL: Update completed successfully. [2025-09-05T19:05:12.065657] [INFO ] [MAIN ] Update Progress: 2207/2363 symbols completed. VAL took 5.8s. Estimated remaining: 4m 36s. Rate: 33.9 symbols/min [2025-09-05T19:05:12.228994] [INFO ] [MAIN ] VCV: Found 1 missing trading days. [2025-09-05T19:05:12.259206] [INFO ] [MAIN ] VCV: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:12.272437] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-05T19:05:12.325329] [INFO ] [MAIN ] VALE: Update completed successfully. [2025-09-05T19:05:12.351359] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:12.354220] [INFO ] [MAIN ] Update Progress: 2208/2363 symbols completed. VALE took 6.1s. Estimated remaining: 4m 34s. Rate: 33.9 symbols/min [2025-09-05T19:05:12.538827] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:12.540827] [INFO ] [MAIN ] VEEV: Loaded 22472 existing records. [2025-09-05T19:05:12.648758] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T19:05:12.676416] [INFO ] [MAIN ] VBF: Adding 45 new records, updating 0 existing records. [2025-09-05T19:05:12.667450] [INFO ] [MAIN ] VEL: Loaded 5738 existing records. [2025-09-05T19:05:12.805060] [INFO ] [MAIN ] VBF: Combined dataset has 3781 total records. [2025-09-05T19:05:12.818844] [INFO ] [MAIN ] VEEV: Found 1 missing trading days. [2025-09-05T19:05:12.854921] [INFO ] [MAIN ] VEEV: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:12.945546] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-05T19:05:13.039404] [INFO ] [MAIN ] VEL: Found 1 missing trading days. [2025-09-05T19:05:13.040473] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T19:05:13.050928] [INFO ] [MAIN ] VEL: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:13.123879] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-05T19:05:13.133445] [INFO ] [MAIN ] VCV: Adding 94 new records, updating 0 existing records. [2025-09-05T19:05:13.156479] [WARN ] [VALIDATOR ] VBF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:13.238728] [INFO ] [MAIN ] VCV: Combined dataset has 7120 total records. [2025-09-05T19:05:13.521131] [WARN ] [VALIDATOR ] VCV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:13.732276] [WARN ] [VALIDATOR ] VBF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:13.732347] [WARN ] [VALIDATOR ] VCV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:13.732591] [INFO ] [MAIN ] VBF: Combined data validation passed. [2025-09-05T19:05:13.732939] [INFO ] [MAIN ] VCV: Combined data validation passed. [2025-09-05T19:05:13.798914] [INFO ] [MAIN ] VCV: Update completed successfully. [2025-09-05T19:05:13.801612] [INFO ] [MAIN ] Update Progress: 2209/2363 symbols completed. VCV took 2.4s. Estimated remaining: 4m 33s. Rate: 33.9 symbols/min [2025-09-05T19:05:13.835468] [INFO ] [MAIN ] VBF: Update completed successfully. [2025-09-05T19:05:13.872984] [INFO ] [MAIN ] Update Progress: 2210/2363 symbols completed. VBF took 2.9s. Estimated remaining: 4m 31s. Rate: 33.9 symbols/min [2025-09-05T19:05:14.034594] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T19:05:14.092376] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:14.152185] [INFO ] [MAIN ] VEL: Adding 120 new records, updating 0 existing records. [2025-09-05T19:05:14.213888] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:14.215185] [INFO ] [MAIN ] VEL: Combined dataset has 5858 total records. [2025-09-05T19:05:14.391109] [INFO ] [MAIN ] VET: Loaded 20447 existing records. [2025-09-05T19:05:14.456863] [WARN ] [VALIDATOR ] VEL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:14.556511] [INFO ] [MAIN ] VFC: Loaded 25553 existing records. [2025-09-05T19:05:14.843765] [INFO ] [MAIN ] VET: Found 1 missing trading days. [2025-09-05T19:05:14.911025] [INFO ] [MAIN ] VET: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:14.939615] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-05T19:05:15.022334] [INFO ] [MAIN ] VFC: Found 1 missing trading days. [2025-09-05T19:05:15.026951] [INFO ] [MAIN ] VFC: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:15.029344] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-05T19:05:15.028512] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-05T19:05:15.174449] [INFO ] [MAIN ] VEEV: Adding 368 new records, updating 0 existing records. [2025-09-05T19:05:15.179240] [INFO ] [MAIN ] VEEV: Combined dataset has 22840 total records. [2025-09-05T19:05:15.372695] [WARN ] [VALIDATOR ] VEEV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:15.568123] [WARN ] [VALIDATOR ] VEL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:15.569157] [INFO ] [MAIN ] VEL: Combined data validation passed. [2025-09-05T19:05:15.625370] [WARN ] [VALIDATOR ] VEEV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:15.625573] [INFO ] [MAIN ] VEEV: Combined data validation passed. [2025-09-05T19:05:15.625943] [INFO ] [MAIN ] VEL: Update completed successfully. [2025-09-05T19:05:15.627990] [INFO ] [MAIN ] Update Progress: 2211/2363 symbols completed. VEL took 3.3s. Estimated remaining: 4m 29s. Rate: 33.9 symbols/min [2025-09-05T19:05:15.979887] [INFO ] [MAIN ] VEEV: Update completed successfully. [2025-09-05T19:05:15.987028] [INFO ] [MAIN ] Update Progress: 2212/2363 symbols completed. VEEV took 3.9s. Estimated remaining: 4m 27s. Rate: 33.9 symbols/min [2025-09-05T19:05:15.984353] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:16.180546] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:16.194722] [INFO ] [MAIN ] VGI: Loaded 2375 existing records. [2025-09-05T19:05:16.260077] [INFO ] [MAIN ] VG: Loaded 25473 existing records. [2025-09-05T19:05:16.471162] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T19:05:16.532618] [INFO ] [MAIN ] VGI: Found 1 missing trading days. [2025-09-05T19:05:16.576967] [INFO ] [MAIN ] VGI: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:16.655164] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-05T19:05:16.667101] [INFO ] [MAIN ] VG: Found 1 missing trading days. [2025-09-05T19:05:16.700952] [INFO ] [MAIN ] VG: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:16.711563] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-05T19:05:16.721808] [INFO ] [MAIN ] VET: Adding 318 new records, updating 0 existing records. [2025-09-05T19:05:16.725560] [INFO ] [MAIN ] VET: Combined dataset has 20765 total records. [2025-09-05T19:05:16.915611] [WARN ] [VALIDATOR ] VET: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:16.912392] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T19:05:17.264923] [INFO ] [MAIN ] VFC: Adding 390 new records, updating 0 existing records. [2025-09-05T19:05:17.270286] [INFO ] [MAIN ] VFC: Combined dataset has 25943 total records. [2025-09-05T19:05:17.383443] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T19:05:17.469668] [INFO ] [MAIN ] VGI: Adding 213 new records, updating 0 existing records. [2025-09-05T19:05:17.500923] [WARN ] [VALIDATOR ] VFC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:17.571447] [INFO ] [MAIN ] VGI: Combined dataset has 2588 total records. [2025-09-05T19:05:17.879841] [WARN ] [VALIDATOR ] VGI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:18.075387] [WARN ] [VALIDATOR ] VET: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:18.076917] [INFO ] [MAIN ] VET: Combined data validation passed. [2025-09-05T19:05:18.085085] [WARN ] [VALIDATOR ] VGI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:18.135157] [INFO ] [MAIN ] VGI: Combined data validation passed. [2025-09-05T19:05:18.135047] [WARN ] [VALIDATOR ] VFC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:18.176279] [INFO ] [MAIN ] VFC: Combined data validation passed. [2025-09-05T19:05:18.207272] [INFO ] [MAIN ] VGI: Update completed successfully. [2025-09-05T19:05:18.208471] [INFO ] [MAIN ] Update Progress: 2213/2363 symbols completed. VGI took 2.2s. Estimated remaining: 4m 25s. Rate: 33.9 symbols/min [2025-09-05T19:05:18.519333] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:18.521995] [INFO ] [MAIN ] VET: Update completed successfully. [2025-09-05T19:05:18.526266] [INFO ] [MAIN ] Update Progress: 2214/2363 symbols completed. VET took 4.7s. Estimated remaining: 4m 23s. Rate: 33.9 symbols/min [2025-09-05T19:05:18.605356] [INFO ] [MAIN ] VGM: Loaded 9456 existing records. [2025-09-05T19:05:18.847515] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:18.855884] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-05T19:05:18.949941] [INFO ] [MAIN ] VGM: Found 1 missing trading days. [2025-09-05T19:05:18.976269] [INFO ] [MAIN ] VGM: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:18.979186] [INFO ] [MAIN ] VHC: Loaded 1639 existing records. [2025-09-05T19:05:18.979535] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-05T19:05:19.070577] [INFO ] [MAIN ] VFC: Update completed successfully. [2025-09-05T19:05:19.118556] [INFO ] [MAIN ] Update Progress: 2215/2363 symbols completed. VFC took 5.2s. Estimated remaining: 4m 22s. Rate: 33.9 symbols/min [2025-09-05T19:05:19.317623] [INFO ] [MAIN ] VG: Adding 390 new records, updating 0 existing records. [2025-09-05T19:05:19.401566] [INFO ] [MAIN ] VHC: Found 1 missing trading days. [2025-09-05T19:05:19.456054] [INFO ] [MAIN ] VHC: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:19.474999] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:19.475527] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-05T19:05:19.477970] [INFO ] [MAIN ] VG: Combined dataset has 25863 total records. [2025-09-05T19:05:19.479975] [INFO ] [MAIN ] VHI: Loaded 1437 existing records. [2025-09-05T19:05:19.828771] [INFO ] [MAIN ] VHI: Found 1 missing trading days. [2025-09-05T19:05:19.833236] [INFO ] [MAIN ] VHI: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:19.833176] [WARN ] [VALIDATOR ] VG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:19.833534] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-05T19:05:20.022164] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-05T19:05:20.057379] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-05T19:05:20.148509] [INFO ] [MAIN ] VHC: Adding 38 new records, updating 0 existing records. [2025-09-05T19:05:20.170488] [INFO ] [MAIN ] VGM: Adding 183 new records, updating 0 existing records. [2025-09-05T19:05:20.171236] [INFO ] [MAIN ] VHC: Combined dataset has 1677 total records. [2025-09-05T19:05:20.239956] [INFO ] [MAIN ] VGM: Combined dataset has 9639 total records. [2025-09-05T19:05:20.464514] [WARN ] [VALIDATOR ] VHC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:20.483095] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-05T19:05:20.602172] [INFO ] [MAIN ] VHI: Adding 14 new records, updating 63 existing records. [2025-09-05T19:05:20.625344] [WARN ] [VALIDATOR ] VGM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:20.704067] [INFO ] [MAIN ] VHI: Combined dataset has 1451 total records. [2025-09-05T19:05:21.146698] [WARN ] [VALIDATOR ] VHI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:21.338812] [WARN ] [VALIDATOR ] VG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:21.339336] [INFO ] [MAIN ] VG: Combined data validation passed. [2025-09-05T19:05:21.472503] [WARN ] [VALIDATOR ] VHI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:21.475001] [INFO ] [MAIN ] VHI: Combined data validation passed. [2025-09-05T19:05:21.474453] [WARN ] [VALIDATOR ] VHC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:21.478968] [INFO ] [MAIN ] VHC: Combined data validation passed. [2025-09-05T19:05:21.473837] [WARN ] [VALIDATOR ] VGM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:21.480037] [INFO ] [MAIN ] VGM: Combined data validation passed. [2025-09-05T19:05:21.524477] [INFO ] [MAIN ] VHC: Update completed successfully. [2025-09-05T19:05:21.542977] [INFO ] [MAIN ] VHI: Update completed successfully. [2025-09-05T19:05:21.530413] [INFO ] [MAIN ] Update Progress: 2216/2363 symbols completed. VHC took 3.0s. Estimated remaining: 4m 20s. Rate: 33.9 symbols/min [2025-09-05T19:05:21.545521] [INFO ] [MAIN ] Update Progress: 2217/2363 symbols completed. VHI took 2.4s. Estimated remaining: 4m 18s. Rate: 34.0 symbols/min [2025-09-05T19:05:21.842968] [INFO ] [MAIN ] VGM: Update completed successfully. [2025-09-05T19:05:21.894001] [INFO ] [MAIN ] Update Progress: 2218/2363 symbols completed. VGM took 3.7s. Estimated remaining: 4m 16s. Rate: 34.0 symbols/min [2025-09-05T19:05:21.952891] [INFO ] [MAIN ] VG: Update completed successfully. [2025-09-05T19:05:21.952825] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:21.947785] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:21.966620] [INFO ] [MAIN ] Update Progress: 2219/2363 symbols completed. VG took 6.3s. Estimated remaining: 4m 14s. Rate: 34.0 symbols/min [2025-09-05T19:05:22.300109] [INFO ] [MAIN ] VIK: Loaded 25179 existing records. [2025-09-05T19:05:22.306387] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:22.358575] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:22.399991] [WARN ] [MAIN ] VIRT: No existing data found, performing full refresh instead. [2025-09-05T19:05:22.406472] [INFO ] [MAIN ] VICI: Loaded 25587 existing records. [2025-09-05T19:05:22.422675] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-05T19:05:22.452939] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-05T19:05:22.459582] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-05T19:05:22.771418] [INFO ] [MAIN ] VIK: Found 1 missing trading days. [2025-09-05T19:05:22.772945] [INFO ] [MAIN ] VIPS: Loaded 24021 existing records. [2025-09-05T19:05:22.804058] [INFO ] [MAIN ] VIK: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:22.855538] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-05T19:05:22.991483] [INFO ] [MAIN ] VICI: Found 1 missing trading days. [2025-09-05T19:05:23.083534] [INFO ] [MAIN ] VICI: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:23.135089] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-05T19:05:23.286776] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:05:23.294435] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-05T19:05:23.294144] [INFO ] [MAIN ] VIPS: Found 1 missing trading days. [2025-09-05T19:05:23.295283] [INFO ] [MAIN ] VIPS: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:23.295541] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-05T19:05:24.418368] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:05:24.576250] [INFO ] [MAIN ] VIK: Adding 384 new records, updating 0 existing records. [2025-09-05T19:05:24.579523] [INFO ] [MAIN ] VIK: Combined dataset has 25563 total records. [2025-09-05T19:05:24.769087] [WARN ] [VALIDATOR ] VIK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:24.884964] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T19:05:25.102361] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-05T19:05:25.127494] [INFO ] [MAIN ] VIPS: Adding 353 new records, updating 0 existing records. [2025-09-05T19:05:25.288244] [INFO ] [MAIN ] VICI: Adding 390 new records, updating 0 existing records. [2025-09-05T19:05:25.293024] [INFO ] [MAIN ] VIPS: Combined dataset has 24374 total records. [2025-09-05T19:05:25.400634] [INFO ] [MAIN ] VICI: Combined dataset has 25977 total records. [2025-09-05T19:05:25.425727] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-05T19:05:25.464673] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-05T19:05:25.484444] [WARN ] [VALIDATOR ] VIK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:25.498538] [INFO ] [MAIN ] VIK: Combined data validation passed. [2025-09-05T19:05:25.679965] [WARN ] [VALIDATOR ] VIPS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:25.891019] [WARN ] [VALIDATOR ] VICI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:26.265498] [INFO ] [MAIN ] VIK: Update completed successfully. [2025-09-05T19:05:26.270555] [INFO ] [MAIN ] Update Progress: 2220/2363 symbols completed. VIK took 4.7s. Estimated remaining: 4m 13s. Rate: 34.0 symbols/min [2025-09-05T19:05:26.344482] [WARN ] [VALIDATOR ] VIPS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:26.344850] [WARN ] [VALIDATOR ] VICI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:26.364577] [INFO ] [MAIN ] VIPS: Combined data validation passed. [2025-09-05T19:05:26.359369] [INFO ] [MAIN ] VICI: Combined data validation passed. [2025-09-05T19:05:26.586007] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:26.734786] [INFO ] [MAIN ] VICI: Update completed successfully. [2025-09-05T19:05:26.738809] [INFO ] [MAIN ] Update Progress: 2221/2363 symbols completed. VICI took 5.2s. Estimated remaining: 4m 11s. Rate: 34.0 symbols/min [2025-09-05T19:05:26.820079] [INFO ] [MAIN ] VIST: Loaded 21432 existing records. [2025-09-05T19:05:27.034543] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:27.117964] [INFO ] [MAIN ] VIST: Found 1 missing trading days. [2025-09-05T19:05:27.119010] [INFO ] [MAIN ] VIST: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:27.125599] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-05T19:05:27.140697] [INFO ] [MAIN ] VIV: Loaded 22178 existing records. [2025-09-05T19:05:27.379059] [INFO ] [MAIN ] VIV: Found 1 missing trading days. [2025-09-05T19:05:27.381414] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-05T19:05:27.381767] [INFO ] [MAIN ] VIV: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:27.391874] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-05T19:05:27.394848] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-05T19:05:27.395681] [INFO ] [MAIN ] VIPS: Update completed successfully. [2025-09-05T19:05:27.398330] [INFO ] [MAIN ] Update Progress: 2222/2363 symbols completed. VIPS took 5.4s. Estimated remaining: 4m 9s. Rate: 34.0 symbols/min [2025-09-05T19:05:27.570892] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:27.580413] [INFO ] [MAIN ] VKQ: Loaded 8678 existing records. [2025-09-05T19:05:27.753374] [INFO ] [MAIN ] VKQ: Found 1 missing trading days. [2025-09-05T19:05:27.753508] [INFO ] [MAIN ] VKQ: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:27.753730] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-05T19:05:28.596583] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T19:05:28.717366] [INFO ] [MAIN ] VIV: Adding 298 new records, updating 0 existing records. [2025-09-05T19:05:28.720388] [INFO ] [MAIN ] VIV: Combined dataset has 22476 total records. [2025-09-05T19:05:28.897508] [WARN ] [VALIDATOR ] VIV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:28.912868] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T19:05:28.913415] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-05T19:05:29.100022] [INFO ] [MAIN ] VKQ: Adding 248 new records, updating 0 existing records. [2025-09-05T19:05:29.251706] [INFO ] [MAIN ] VIST: Adding 378 new records, updating 0 existing records. [2025-09-05T19:05:29.262830] [INFO ] [MAIN ] VKQ: Combined dataset has 8926 total records. [2025-09-05T19:05:29.452966] [INFO ] [MAIN ] VIST: Combined dataset has 21810 total records. [2025-09-05T19:05:29.481714] [WARN ] [VALIDATOR ] VKQ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:29.822143] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-05T19:05:29.832767] [WARN ] [VALIDATOR ] VIST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:29.936797] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-05T19:05:30.125858] [WARN ] [VALIDATOR ] VIV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:30.125967] [WARN ] [VALIDATOR ] VKQ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:30.126023] [WARN ] [VALIDATOR ] VIST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:30.126258] [INFO ] [MAIN ] VIV: Combined data validation passed. [2025-09-05T19:05:30.126468] [INFO ] [MAIN ] VKQ: Combined data validation passed. [2025-09-05T19:05:30.126379] [INFO ] [MAIN ] VIST: Combined data validation passed. [2025-09-05T19:05:30.394114] [INFO ] [MAIN ] VKQ: Update completed successfully. [2025-09-05T19:05:30.417774] [INFO ] [MAIN ] VIST: Update completed successfully. [2025-09-05T19:05:30.415975] [INFO ] [MAIN ] Update Progress: 2223/2363 symbols completed. VKQ took 3.0s. Estimated remaining: 4m 7s. Rate: 34.0 symbols/min [2025-09-05T19:05:30.424750] [INFO ] [MAIN ] Update Progress: 2224/2363 symbols completed. VIST took 4.2s. Estimated remaining: 4m 5s. Rate: 34.0 symbols/min [2025-09-05T19:05:30.787709] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:30.790467] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:30.796210] [INFO ] [MAIN ] VIV: Update completed successfully. [2025-09-05T19:05:30.799023] [INFO ] [MAIN ] Update Progress: 2225/2363 symbols completed. VIV took 4.1s. Estimated remaining: 4m 4s. Rate: 34.0 symbols/min [2025-09-05T19:05:30.931941] [INFO ] [MAIN ] VLN: Loaded 15427 existing records. [2025-09-05T19:05:30.943509] [INFO ] [MAIN ] VLO: Loaded 25262 existing records. [2025-09-05T19:05:31.128403] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:31.347497] [INFO ] [MAIN ] VLN: Found 1 missing trading days. [2025-09-05T19:05:31.353193] [INFO ] [MAIN ] VLN: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:31.377456] [INFO ] [MAIN ] VLO: Found 1 missing trading days. [2025-09-05T19:05:31.378445] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-05T19:05:31.378712] [INFO ] [MAIN ] VLO: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:31.379937] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-05T19:05:31.390880] [INFO ] [MAIN ] VLRS: Loaded 30629 existing records. [2025-09-05T19:05:31.570561] [INFO ] [MAIN ] VLRS: Found 1 missing trading days. [2025-09-05T19:05:31.570747] [INFO ] [MAIN ] VLRS: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:31.571000] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-05T19:05:31.672702] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-05T19:05:31.683724] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-05T19:05:32.405424] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-05T19:05:32.501114] [INFO ] [MAIN ] VLRS: Adding 227 new records, updating 0 existing records. [2025-09-05T19:05:32.504401] [INFO ] [MAIN ] VLRS: Combined dataset has 30856 total records. [2025-09-05T19:05:32.686746] [WARN ] [VALIDATOR ] VLRS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:05:32.885227] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-05T19:05:32.967821] [INFO ] [MAIN ] VLN: Adding 210 new records, updating 0 existing records. [2025-09-05T19:05:33.014511] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-05T19:05:33.028548] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-05T19:05:33.044026] [INFO ] [MAIN ] VLN: Combined dataset has 15637 total records. [2025-09-05T19:05:33.127716] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-05T19:05:33.267762] [WARN ] [VALIDATOR ] VLRS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:05:33.283992] [INFO ] [MAIN ] VLRS: Combined data validation passed. [2025-09-05T19:05:33.290067] [INFO ] [MAIN ] VLO: Adding 388 new records, updating 0 existing records. [2025-09-05T19:05:33.370123] [WARN ] [VALIDATOR ] VLN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:33.519405] [INFO ] [MAIN ] VLO: Combined dataset has 25650 total records. [2025-09-05T19:05:33.829746] [WARN ] [VALIDATOR ] VLO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:34.106439] [INFO ] [MAIN ] VLRS: Update completed successfully. [2025-09-05T19:05:34.110870] [INFO ] [MAIN ] Update Progress: 2226/2363 symbols completed. VLRS took 3.3s. Estimated remaining: 4m 2s. Rate: 34.0 symbols/min [2025-09-05T19:05:34.291888] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:34.301597] [INFO ] [MAIN ] VLT: Loaded 1883 existing records. [2025-09-05T19:05:34.301840] [WARN ] [VALIDATOR ] VLO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:34.301703] [WARN ] [VALIDATOR ] VLN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:34.370115] [INFO ] [MAIN ] VLO: Combined data validation passed. [2025-09-05T19:05:34.382589] [INFO ] [MAIN ] VLN: Combined data validation passed. [2025-09-05T19:05:34.686125] [INFO ] [MAIN ] VLT: Found 1 missing trading days. [2025-09-05T19:05:34.689518] [INFO ] [MAIN ] VLT: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:34.689964] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-05T19:05:34.808124] [INFO ] [MAIN ] VLN: Update completed successfully. [2025-09-05T19:05:34.807609] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-05T19:05:34.811532] [INFO ] [MAIN ] Update Progress: 2227/2363 symbols completed. VLN took 4.4s. Estimated remaining: 4m 0s. Rate: 34.0 symbols/min [2025-09-05T19:05:34.869466] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-05T19:05:34.869173] [INFO ] [MAIN ] VLO: Update completed successfully. [2025-09-05T19:05:34.910887] [INFO ] [MAIN ] Update Progress: 2228/2363 symbols completed. VLO took 4.5s. Estimated remaining: 3m 58s. Rate: 34.0 symbols/min [2025-09-05T19:05:35.109034] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:35.114423] [WARN ] [MAIN ] VLTO: No existing data found, performing full refresh instead. [2025-09-05T19:05:35.135569] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-05T19:05:35.162981] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-05T19:05:35.169763] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-05T19:05:35.193571] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:35.283380] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-05T19:05:35.306073] [INFO ] [MAIN ] VLT: Adding 32 new records, updating 0 existing records. [2025-09-05T19:05:35.323966] [INFO ] [MAIN ] VLT: Combined dataset has 1915 total records. [2025-09-05T19:05:35.547428] [INFO ] [MAIN ] VMC: Loaded 20232 existing records. [2025-09-05T19:05:35.883414] [WARN ] [VALIDATOR ] VLT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:35.915637] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:05:35.958301] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-05T19:05:36.077155] [INFO ] [MAIN ] VMC: Found 1 missing trading days. [2025-09-05T19:05:36.088191] [INFO ] [MAIN ] VMC: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:36.088481] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-05T19:05:36.178626] [WARN ] [VALIDATOR ] VLT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:36.178847] [INFO ] [MAIN ] VLT: Combined data validation passed. [2025-09-05T19:05:36.192274] [INFO ] [MAIN ] VLT: Update completed successfully. [2025-09-05T19:05:36.192712] [INFO ] [MAIN ] Update Progress: 2229/2363 symbols completed. VLT took 2.1s. Estimated remaining: 3m 56s. Rate: 34.0 symbols/min [2025-09-05T19:05:36.363186] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:36.363348] [WARN ] [MAIN ] VMI: No existing data found, performing full refresh instead. [2025-09-05T19:05:36.363478] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-05T19:05:36.363517] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-05T19:05:36.363562] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-05T19:05:36.723067] [INFO ] [REMOTE ] VMI: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:05:36.723517] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-05T19:05:36.756078] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-05T19:05:36.766536] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-05T19:05:37.276668] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-05T19:05:37.286068] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-05T19:05:37.310679] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T19:05:37.426841] [INFO ] [MAIN ] VMC: Adding 318 new records, updating 0 existing records. [2025-09-05T19:05:37.429890] [INFO ] [MAIN ] VMC: Combined dataset has 20550 total records. [2025-09-05T19:05:37.612076] [WARN ] [VALIDATOR ] VMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:37.808769] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-05T19:05:37.811856] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-05T19:05:37.824398] [WARN ] [VALIDATOR ] VMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:37.824569] [INFO ] [MAIN ] VMC: Combined data validation passed. [2025-09-05T19:05:37.962290] [INFO ] [MAIN ] VMC: Update completed successfully. [2025-09-05T19:05:37.964675] [INFO ] [MAIN ] Update Progress: 2230/2363 symbols completed. VMC took 3.0s. Estimated remaining: 3m 55s. Rate: 34.0 symbols/min [2025-09-05T19:05:38.136389] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:38.165238] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-05T19:05:38.177231] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-05T19:05:38.182019] [INFO ] [MAIN ] VMO: Loaded 9760 existing records. [2025-09-05T19:05:38.355188] [INFO ] [MAIN ] VMO: Found 1 missing trading days. [2025-09-05T19:05:38.355318] [INFO ] [MAIN ] VMO: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:38.355580] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-05T19:05:38.538541] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-05T19:05:38.547746] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-05T19:05:38.760313] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-05T19:05:38.763414] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-05T19:05:39.300186] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-05T19:05:39.304392] [INFO ] [REMOTE ] VIRT: Full fetch complete (51034 records). [2025-09-05T19:05:39.429392] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-05T19:05:39.714540] [INFO ] [MAIN ] VMO: Adding 250 new records, updating 0 existing records. [2025-09-05T19:05:39.793956] [INFO ] [MAIN ] VMO: Combined dataset has 10010 total records. [2025-09-05T19:05:39.847380] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-05T19:05:39.985637] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-05T19:05:40.085157] [WARN ] [VALIDATOR ] VMO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:40.115198] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-05T19:05:40.466136] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-05T19:05:40.481211] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-05T19:05:40.492420] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-05T19:05:40.492669] [INFO ] [MAIN ] Update Progress: 2231/2363 symbols completed. VIRT took 18.5s. Estimated remaining: 3m 53s. Rate: 34.0 symbols/min [2025-09-05T19:05:40.665604] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:40.667141] [WARN ] [VALIDATOR ] VMO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:40.668568] [INFO ] [MAIN ] VMO: Combined data validation passed. [2025-09-05T19:05:40.672757] [INFO ] [MAIN ] VNCE: Loaded 3728 existing records. [2025-09-05T19:05:40.920027] [INFO ] [MAIN ] VNCE: Found 1 missing trading days. [2025-09-05T19:05:40.921928] [INFO ] [MAIN ] VNCE: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:40.922168] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-05T19:05:40.922299] [INFO ] [MAIN ] VMO: Update completed successfully. [2025-09-05T19:05:40.924621] [INFO ] [MAIN ] Update Progress: 2232/2363 symbols completed. VMO took 3.0s. Estimated remaining: 3m 51s. Rate: 34.0 symbols/min [2025-09-05T19:05:41.094601] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:41.134084] [INFO ] [MAIN ] VNO: Loaded 36862 existing records. [2025-09-05T19:05:41.321227] [INFO ] [MAIN ] VNO: Found 1 missing trading days. [2025-09-05T19:05:41.321401] [INFO ] [MAIN ] VNO: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:41.321672] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-05T19:05:41.334346] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-05T19:05:41.338959] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-05T19:05:41.456537] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-05T19:05:41.467789] [INFO ] [MAIN ] VNCE: Adding 34 new records, updating 0 existing records. [2025-09-05T19:05:41.469187] [INFO ] [MAIN ] VNCE: Combined dataset has 3762 total records. [2025-09-05T19:05:41.643996] [WARN ] [VALIDATOR ] VNCE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:05:41.850251] [WARN ] [VALIDATOR ] VNCE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:05:41.850537] [INFO ] [MAIN ] VNCE: Combined data validation passed. [2025-09-05T19:05:41.875917] [INFO ] [MAIN ] VNCE: Update completed successfully. [2025-09-05T19:05:41.876706] [INFO ] [MAIN ] Update Progress: 2233/2363 symbols completed. VNCE took 1.4s. Estimated remaining: 3m 49s. Rate: 34.0 symbols/min [2025-09-05T19:05:42.045996] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:42.046183] [WARN ] [MAIN ] VNT: No existing data found, performing full refresh instead. [2025-09-05T19:05:42.046359] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-05T19:05:42.046425] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-05T19:05:42.046495] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-05T19:05:42.402455] [INFO ] [REMOTE ] VNT: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:05:42.402858] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-05T19:05:42.413847] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-05T19:05:42.417356] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-05T19:05:42.451399] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-05T19:05:42.461852] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-05T19:05:42.539281] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T19:05:42.703848] [INFO ] [MAIN ] VNO: Adding 382 new records, updating 0 existing records. [2025-09-05T19:05:42.711551] [INFO ] [MAIN ] VNO: Combined dataset has 37244 total records. [2025-09-05T19:05:42.892530] [WARN ] [VALIDATOR ] VNO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:05:43.097546] [WARN ] [VALIDATOR ] VNO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:05:43.097778] [INFO ] [MAIN ] VNO: Combined data validation passed. [2025-09-05T19:05:43.333983] [INFO ] [MAIN ] VNO: Update completed successfully. [2025-09-05T19:05:43.338970] [INFO ] [MAIN ] Update Progress: 2234/2363 symbols completed. VNO took 2.4s. Estimated remaining: 3m 47s. Rate: 34.0 symbols/min [2025-09-05T19:05:43.515130] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:43.530065] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-05T19:05:43.536932] [INFO ] [MAIN ] VOC: Loaded 4492 existing records. [2025-09-05T19:05:43.568283] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-05T19:05:43.717186] [INFO ] [MAIN ] VOC: Found 1 missing trading days. [2025-09-05T19:05:43.717389] [INFO ] [MAIN ] VOC: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:43.717732] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-05T19:05:43.781129] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-05T19:05:43.790384] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-05T19:05:44.113074] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-05T19:05:44.123561] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-05T19:05:44.350358] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-05T19:05:44.372325] [INFO ] [MAIN ] VOC: Adding 59 new records, updating 0 existing records. [2025-09-05T19:05:44.374118] [INFO ] [MAIN ] VOC: Combined dataset has 4551 total records. [2025-09-05T19:05:44.558747] [WARN ] [VALIDATOR ] VOC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:44.759533] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-05T19:05:44.764197] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-05T19:05:44.775773] [WARN ] [VALIDATOR ] VOC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:44.775992] [INFO ] [MAIN ] VOC: Combined data validation passed. [2025-09-05T19:05:44.804663] [INFO ] [MAIN ] VOC: Update completed successfully. [2025-09-05T19:05:44.805371] [INFO ] [MAIN ] Update Progress: 2235/2363 symbols completed. VOC took 1.5s. Estimated remaining: 3m 46s. Rate: 34.0 symbols/min [2025-09-05T19:05:44.983696] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:45.004237] [INFO ] [MAIN ] VOYA: Loaded 19862 existing records. [2025-09-05T19:05:45.186500] [INFO ] [MAIN ] VOYA: Found 1 missing trading days. [2025-09-05T19:05:45.186656] [INFO ] [MAIN ] VOYA: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:45.186901] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-05T19:05:45.342668] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-05T19:05:45.351567] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-05T19:05:45.594826] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-05T19:05:45.604176] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-05T19:05:45.990439] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-05T19:05:45.994426] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-05T19:05:46.621594] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-05T19:05:46.631337] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-05T19:05:46.661117] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T19:05:46.783123] [INFO ] [MAIN ] VOYA: Adding 353 new records, updating 0 existing records. [2025-09-05T19:05:46.786110] [INFO ] [MAIN ] VOYA: Combined dataset has 20215 total records. [2025-09-05T19:05:46.967256] [WARN ] [VALIDATOR ] VOYA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:47.013383] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-05T19:05:47.052514] [INFO ] [REMOTE ] VMI: Full fetch complete (16504 records). [2025-09-05T19:05:47.534841] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-05T19:05:47.616006] [WARN ] [VALIDATOR ] VOYA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:47.617749] [INFO ] [MAIN ] VOYA: Combined data validation passed. [2025-09-05T19:05:47.623683] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-05T19:05:47.623820] [INFO ] [MAIN ] Update Progress: 2236/2363 symbols completed. VMI took 11.4s. Estimated remaining: 3m 44s. Rate: 34.0 symbols/min [2025-09-05T19:05:47.909142] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:47.948291] [INFO ] [MAIN ] VOYA: Update completed successfully. [2025-09-05T19:05:47.962771] [INFO ] [MAIN ] Update Progress: 2237/2363 symbols completed. VOYA took 3.2s. Estimated remaining: 3m 42s. Rate: 34.0 symbols/min [2025-09-05T19:05:47.969607] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-05T19:05:47.980091] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-05T19:05:47.987336] [INFO ] [MAIN ] VOYG: Loaded 19583 existing records. [2025-09-05T19:05:48.162274] [INFO ] [MAIN ] VOYG: Found 1 missing trading days. [2025-09-05T19:05:48.162418] [INFO ] [MAIN ] VOYG: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:48.162704] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-05T19:05:48.417204] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-05T19:05:48.427276] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-05T19:05:49.316058] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-05T19:05:49.326059] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-05T19:05:49.801214] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-05T19:05:49.810501] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-05T19:05:49.829267] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T19:05:49.962532] [INFO ] [MAIN ] VOYG: Adding 333 new records, updating 0 existing records. [2025-09-05T19:05:49.965502] [INFO ] [MAIN ] VOYG: Combined dataset has 19916 total records. [2025-09-05T19:05:50.143747] [WARN ] [VALIDATOR ] VOYG: Not fatal, but first date in data (2025-06-11) does not match expected start date (2025-01-31) [2025-09-05T19:05:50.334795] [WARN ] [VALIDATOR ] VOYG: Missing days changed. Total missing: 90 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30, 2025-06-02, 2025-06-03, 2025-06-04, 2025-06-05, 2025-06-06, 2025-06-09, 2025-06-10 [2025-09-05T19:05:50.335037] [INFO ] [MAIN ] VOYG: Combined data validation passed. [2025-09-05T19:05:50.465787] [INFO ] [MAIN ] VOYG: Update completed successfully. [2025-09-05T19:05:50.467659] [INFO ] [MAIN ] Update Progress: 2238/2363 symbols completed. VOYG took 2.8s. Estimated remaining: 3m 40s. Rate: 34.0 symbols/min [2025-09-05T19:05:50.739611] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-05T19:05:50.743728] [INFO ] [REMOTE ] VLTO: Full fetch complete (50283 records). [2025-09-05T19:05:51.172729] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-05T19:05:51.299327] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-05T19:05:51.312014] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-05T19:05:51.439815] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-05T19:05:51.439973] [INFO ] [MAIN ] Update Progress: 2239/2363 symbols completed. VLTO took 16.6s. Estimated remaining: 3m 39s. Rate: 34.0 symbols/min [2025-09-05T19:05:52.862330] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-05T19:05:52.872442] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-05T19:05:54.244287] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-05T19:05:54.256916] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-05T19:05:55.420219] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-05T19:05:55.422786] [INFO ] [REMOTE ] VNT: Full fetch complete (48456 records). [2025-09-05T19:05:55.792133] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-05T19:05:55.999613] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-05T19:05:55.999772] [INFO ] [MAIN ] Update Progress: 2240/2363 symbols completed. VNT took 14.1s. Estimated remaining: 3m 37s. Rate: 34.0 symbols/min [2025-09-05T19:05:56.826122] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:56.829414] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:56.833596] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:56.858102] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:56.872079] [INFO ] [MAIN ] VPV: Loaded 2113 existing records. [2025-09-05T19:05:56.883436] [INFO ] [MAIN ] VPG: Loaded 7667 existing records. [2025-09-05T19:05:57.151096] [INFO ] [MAIN ] VRE: Loaded 25845 existing records. [2025-09-05T19:05:57.351476] [INFO ] [MAIN ] VRT: Loaded 40494 existing records. [2025-09-05T19:05:57.689943] [INFO ] [MAIN ] VPV: Found 1 missing trading days. [2025-09-05T19:05:57.687716] [INFO ] [MAIN ] VPG: Found 1 missing trading days. [2025-09-05T19:05:57.705624] [INFO ] [MAIN ] VPV: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:57.716011] [INFO ] [MAIN ] VPG: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:57.732892] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-05T19:05:57.727007] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-05T19:05:57.936664] [INFO ] [MAIN ] VRE: Found 1 missing trading days. [2025-09-05T19:05:57.954227] [INFO ] [MAIN ] VRE: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:57.964444] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-05T19:05:57.967161] [INFO ] [MAIN ] VRT: Found 1 missing trading days. [2025-09-05T19:05:57.967326] [INFO ] [MAIN ] VRT: Need to fetch 1 months: 2025-09 [2025-09-05T19:05:57.968404] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-05T19:05:58.554555] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-05T19:05:58.570422] [INFO ] [MAIN ] VPV: Adding 34 new records, updating 0 existing records. [2025-09-05T19:05:58.571798] [INFO ] [MAIN ] VPV: Combined dataset has 2147 total records. [2025-09-05T19:05:58.749627] [WARN ] [VALIDATOR ] VPV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:58.856831] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-05T19:05:58.959724] [INFO ] [MAIN ] VPG: Adding 77 new records, updating 0 existing records. [2025-09-05T19:05:58.983504] [INFO ] [MAIN ] VPG: Combined dataset has 7744 total records. [2025-09-05T19:05:59.165844] [WARN ] [VALIDATOR ] VPG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:05:59.380340] [WARN ] [VALIDATOR ] VPG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:59.381058] [INFO ] [MAIN ] VPG: Combined data validation passed. [2025-09-05T19:05:59.380244] [WARN ] [VALIDATOR ] VPV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:05:59.381419] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T19:05:59.391590] [INFO ] [MAIN ] VPV: Combined data validation passed. [2025-09-05T19:05:59.509120] [INFO ] [MAIN ] VPV: Update completed successfully. [2025-09-05T19:05:59.522206] [INFO ] [MAIN ] Update Progress: 2241/2363 symbols completed. VPV took 3.5s. Estimated remaining: 3m 35s. Rate: 34.0 symbols/min [2025-09-05T19:05:59.645148] [INFO ] [MAIN ] VRE: Adding 342 new records, updating 0 existing records. [2025-09-05T19:05:59.689828] [INFO ] [MAIN ] VPG: Update completed successfully. [2025-09-05T19:05:59.757499] [INFO ] [MAIN ] Update Progress: 2242/2363 symbols completed. VPG took 3.8s. Estimated remaining: 3m 34s. Rate: 34.0 symbols/min [2025-09-05T19:05:59.756618] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:05:59.813328] [INFO ] [MAIN ] VRE: Combined dataset has 26187 total records. [2025-09-05T19:05:59.973716] [INFO ] [MAIN ] VRTS: Loaded 5736 existing records. [2025-09-05T19:06:00.054349] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:00.210944] [WARN ] [VALIDATOR ] VRE: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:00.419904] [INFO ] [MAIN ] VRTS: Found 1 missing trading days. [2025-09-05T19:06:00.426065] [INFO ] [MAIN ] VRTS: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:00.449467] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-05T19:06:00.511688] [INFO ] [MAIN ] VSCO: Loaded 25130 existing records. [2025-09-05T19:06:00.514338] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-05T19:06:00.830494] [INFO ] [MAIN ] VSCO: Found 1 missing trading days. [2025-09-05T19:06:00.851264] [INFO ] [MAIN ] VSCO: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:00.857056] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-05T19:06:00.883895] [INFO ] [MAIN ] VRT: Adding 390 new records, updating 0 existing records. [2025-09-05T19:06:00.891725] [INFO ] [MAIN ] VRT: Combined dataset has 40884 total records. [2025-09-05T19:06:01.009087] [WARN ] [VALIDATOR ] VRE: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:01.019617] [INFO ] [MAIN ] VRE: Combined data validation passed. [2025-09-05T19:06:01.077219] [WARN ] [VALIDATOR ] VRT: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:01.314620] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T19:06:01.390362] [INFO ] [MAIN ] VRTS: Adding 56 new records, updating 0 existing records. [2025-09-05T19:06:01.399146] [INFO ] [MAIN ] VRTS: Combined dataset has 5792 total records. [2025-09-05T19:06:01.623631] [WARN ] [VALIDATOR ] VRTS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:01.824799] [INFO ] [MAIN ] VRE: Update completed successfully. [2025-09-05T19:06:01.843553] [INFO ] [MAIN ] Update Progress: 2243/2363 symbols completed. VRE took 5.8s. Estimated remaining: 3m 32s. Rate: 34.0 symbols/min [2025-09-05T19:06:02.105937] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:02.124392] [WARN ] [VALIDATOR ] VRT: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:02.124307] [WARN ] [VALIDATOR ] VRTS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:02.130898] [INFO ] [MAIN ] VRTS: Combined data validation passed. [2025-09-05T19:06:02.130766] [INFO ] [MAIN ] VRT: Combined data validation passed. [2025-09-05T19:06:02.249998] [INFO ] [MAIN ] VSH: Loaded 22924 existing records. [2025-09-05T19:06:02.367275] [INFO ] [MAIN ] VRTS: Update completed successfully. [2025-09-05T19:06:02.379499] [INFO ] [MAIN ] Update Progress: 2244/2363 symbols completed. VRTS took 2.9s. Estimated remaining: 3m 30s. Rate: 34.0 symbols/min [2025-09-05T19:06:02.590366] [INFO ] [MAIN ] VSH: Found 1 missing trading days. [2025-09-05T19:06:02.683698] [INFO ] [MAIN ] VSH: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:02.684151] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-05T19:06:02.732845] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-05T19:06:02.832860] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:02.972423] [INFO ] [MAIN ] VSCO: Adding 390 new records, updating 0 existing records. [2025-09-05T19:06:02.996389] [INFO ] [MAIN ] VSCO: Combined dataset has 25520 total records. [2025-09-05T19:06:03.034213] [INFO ] [MAIN ] VST: Loaded 40468 existing records. [2025-09-05T19:06:03.354256] [WARN ] [VALIDATOR ] VSCO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:03.419304] [INFO ] [MAIN ] VST: Found 1 missing trading days. [2025-09-05T19:06:03.435915] [INFO ] [MAIN ] VST: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:03.455376] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-05T19:06:03.531947] [INFO ] [MAIN ] VRT: Update completed successfully. [2025-09-05T19:06:03.570261] [INFO ] [MAIN ] Update Progress: 2245/2363 symbols completed. VRT took 7.6s. Estimated remaining: 3m 28s. Rate: 34.0 symbols/min [2025-09-05T19:06:03.784869] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:03.806780] [WARN ] [VALIDATOR ] VSCO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:03.807087] [INFO ] [MAIN ] VSCO: Combined data validation passed. [2025-09-05T19:06:03.918445] [INFO ] [MAIN ] VSTS: Loaded 36850 existing records. [2025-09-05T19:06:04.082122] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T19:06:04.195249] [INFO ] [MAIN ] VSTS: Found 1 missing trading days. [2025-09-05T19:06:04.197024] [INFO ] [MAIN ] VSTS: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:04.202945] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-05T19:06:04.318732] [INFO ] [MAIN ] VSCO: Update completed successfully. [2025-09-05T19:06:04.334002] [INFO ] [MAIN ] Update Progress: 2246/2363 symbols completed. VSCO took 4.6s. Estimated remaining: 3m 26s. Rate: 34.0 symbols/min [2025-09-05T19:06:04.331249] [INFO ] [MAIN ] VSH: Adding 328 new records, updating 0 existing records. [2025-09-05T19:06:04.496785] [INFO ] [MAIN ] VSH: Combined dataset has 23252 total records. [2025-09-05T19:06:04.515021] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:04.708856] [WARN ] [VALIDATOR ] VSH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:04.825040] [INFO ] [MAIN ] VTEX: Loaded 32545 existing records. [2025-09-05T19:06:05.113804] [INFO ] [MAIN ] VTEX: Found 1 missing trading days. [2025-09-05T19:06:05.114142] [INFO ] [MAIN ] VTEX: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:05.114427] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-05T19:06:05.122885] [WARN ] [VALIDATOR ] VSH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:05.123111] [INFO ] [MAIN ] VSH: Combined data validation passed. [2025-09-05T19:06:05.262854] [INFO ] [MAIN ] VSH: Update completed successfully. [2025-09-05T19:06:05.265399] [INFO ] [MAIN ] Update Progress: 2247/2363 symbols completed. VSH took 3.4s. Estimated remaining: 3m 25s. Rate: 34.0 symbols/min [2025-09-05T19:06:05.439381] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:05.463113] [INFO ] [MAIN ] VTLE: Loaded 23363 existing records. [2025-09-05T19:06:05.639501] [INFO ] [MAIN ] VTLE: Found 1 missing trading days. [2025-09-05T19:06:05.639630] [INFO ] [MAIN ] VTLE: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:05.639867] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-05T19:06:05.660700] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T19:06:05.805064] [INFO ] [MAIN ] VSTS: Adding 354 new records, updating 0 existing records. [2025-09-05T19:06:05.809044] [INFO ] [MAIN ] VSTS: Combined dataset has 37204 total records. [2025-09-05T19:06:05.985377] [WARN ] [VALIDATOR ] VSTS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:06.185560] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-05T19:06:06.352884] [INFO ] [MAIN ] VST: Adding 390 new records, updating 0 existing records. [2025-09-05T19:06:06.360703] [INFO ] [MAIN ] VST: Combined dataset has 40858 total records. [2025-09-05T19:06:06.539001] [WARN ] [VALIDATOR ] VST: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:06.710856] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-05T19:06:06.727530] [WARN ] [VALIDATOR ] VSTS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:06.739717] [INFO ] [MAIN ] VSTS: Combined data validation passed. [2025-09-05T19:06:06.966105] [INFO ] [MAIN ] VTEX: Adding 310 new records, updating 0 existing records. [2025-09-05T19:06:07.088345] [INFO ] [MAIN ] VTEX: Combined dataset has 32855 total records. [2025-09-05T19:06:07.199186] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:06:07.357511] [INFO ] [MAIN ] VSTS: Update completed successfully. [2025-09-05T19:06:07.415164] [INFO ] [MAIN ] Update Progress: 2248/2363 symbols completed. VSTS took 3.8s. Estimated remaining: 3m 23s. Rate: 34.0 symbols/min [2025-09-05T19:06:07.465120] [WARN ] [VALIDATOR ] VTEX: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:07.616289] [INFO ] [MAIN ] VTLE: Adding 367 new records, updating 0 existing records. [2025-09-05T19:06:07.657596] [WARN ] [VALIDATOR ] VST: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:07.724235] [INFO ] [MAIN ] VST: Combined data validation passed. [2025-09-05T19:06:07.866967] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:07.874692] [INFO ] [MAIN ] VTLE: Combined dataset has 23730 total records. [2025-09-05T19:06:07.874803] [WARN ] [MAIN ] VTMX: No existing data found, performing full refresh instead. [2025-09-05T19:06:07.893790] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-05T19:06:07.984809] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-05T19:06:08.004539] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-05T19:06:08.484912] [WARN ] [VALIDATOR ] VTLE: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:08.929156] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:06:08.953501] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-05T19:06:08.983500] [WARN ] [VALIDATOR ] VTEX: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:08.985275] [INFO ] [MAIN ] VTEX: Combined data validation passed. [2025-09-05T19:06:09.106010] [WARN ] [VALIDATOR ] VTLE: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:09.110362] [INFO ] [MAIN ] VTLE: Combined data validation passed. [2025-09-05T19:06:09.221101] [INFO ] [MAIN ] VST: Update completed successfully. [2025-09-05T19:06:09.228401] [INFO ] [MAIN ] Update Progress: 2249/2363 symbols completed. VST took 6.8s. Estimated remaining: 3m 21s. Rate: 34.0 symbols/min [2025-09-05T19:06:09.491512] [INFO ] [MAIN ] VTEX: Update completed successfully. [2025-09-05T19:06:09.534754] [INFO ] [MAIN ] Update Progress: 2250/2363 symbols completed. VTEX took 5.2s. Estimated remaining: 3m 19s. Rate: 34.0 symbols/min [2025-09-05T19:06:09.556101] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:09.567140] [INFO ] [MAIN ] VTLE: Update completed successfully. [2025-09-05T19:06:09.595347] [INFO ] [MAIN ] Update Progress: 2251/2363 symbols completed. VTLE took 4.3s. Estimated remaining: 3m 17s. Rate: 34.1 symbols/min [2025-09-05T19:06:09.671561] [INFO ] [MAIN ] VTN: Loaded 4990 existing records. [2025-09-05T19:06:09.927902] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:10.082432] [INFO ] [MAIN ] VTN: Found 1 missing trading days. [2025-09-05T19:06:10.101415] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:10.100599] [INFO ] [MAIN ] VTN: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:10.105437] [INFO ] [MAIN ] VTOL: Loaded 9438 existing records. [2025-09-05T19:06:10.117219] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-05T19:06:10.187726] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-05T19:06:10.230895] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-05T19:06:10.318064] [INFO ] [MAIN ] VTOL: Found 1 missing trading days. [2025-09-05T19:06:10.325716] [INFO ] [MAIN ] VTOL: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:10.325984] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-05T19:06:10.327359] [INFO ] [MAIN ] VTR: Loaded 25137 existing records. [2025-09-05T19:06:10.509683] [INFO ] [MAIN ] VTR: Found 1 missing trading days. [2025-09-05T19:06:10.509835] [INFO ] [MAIN ] VTR: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:10.510090] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-05T19:06:10.954213] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T19:06:10.975021] [INFO ] [MAIN ] VTN: Adding 54 new records, updating 0 existing records. [2025-09-05T19:06:10.976667] [INFO ] [MAIN ] VTN: Combined dataset has 5044 total records. [2025-09-05T19:06:11.159479] [WARN ] [VALIDATOR ] VTN: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:11.361537] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-05T19:06:11.367236] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-05T19:06:11.379605] [WARN ] [VALIDATOR ] VTN: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:11.379875] [INFO ] [MAIN ] VTN: Combined data validation passed. [2025-09-05T19:06:11.413318] [INFO ] [MAIN ] VTN: Update completed successfully. [2025-09-05T19:06:11.414105] [INFO ] [MAIN ] Update Progress: 2252/2363 symbols completed. VTN took 2.2s. Estimated remaining: 3m 16s. Rate: 34.1 symbols/min [2025-09-05T19:06:11.524486] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-05T19:06:11.631745] [INFO ] [MAIN ] VTOL: Adding 129 new records, updating 0 existing records. [2025-09-05T19:06:11.648736] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:11.652073] [INFO ] [MAIN ] VTOL: Combined dataset has 9567 total records. [2025-09-05T19:06:11.768980] [INFO ] [MAIN ] VTS: Loaded 14154 existing records. [2025-09-05T19:06:11.969583] [WARN ] [VALIDATOR ] VTOL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:12.088847] [INFO ] [MAIN ] VTS: Found 1 missing trading days. [2025-09-05T19:06:12.117014] [INFO ] [MAIN ] VTS: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:12.130163] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-05T19:06:12.168336] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-05T19:06:12.402894] [INFO ] [MAIN ] VTR: Adding 385 new records, updating 0 existing records. [2025-09-05T19:06:12.408786] [INFO ] [MAIN ] VTR: Combined dataset has 25522 total records. [2025-09-05T19:06:12.610521] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-05T19:06:12.615760] [WARN ] [VALIDATOR ] VTR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:12.644669] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-05T19:06:12.817180] [WARN ] [VALIDATOR ] VTOL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:12.817370] [INFO ] [MAIN ] VTOL: Combined data validation passed. [2025-09-05T19:06:12.906994] [INFO ] [MAIN ] VTOL: Update completed successfully. [2025-09-05T19:06:12.908322] [INFO ] [MAIN ] Update Progress: 2253/2363 symbols completed. VTOL took 3.4s. Estimated remaining: 3m 14s. Rate: 34.1 symbols/min [2025-09-05T19:06:13.080625] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:13.080939] [WARN ] [MAIN ] VVR: No existing data found, performing full refresh instead. [2025-09-05T19:06:13.081500] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-05T19:06:13.081658] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-05T19:06:13.081780] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-05T19:06:13.450210] [INFO ] [REMOTE ] VVR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:06:13.450874] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-05T19:06:13.457849] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-05T19:06:13.553370] [INFO ] [MAIN ] VTS: Adding 218 new records, updating 0 existing records. [2025-09-05T19:06:13.556798] [INFO ] [MAIN ] VTS: Combined dataset has 14372 total records. [2025-09-05T19:06:13.735583] [WARN ] [VALIDATOR ] VTS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:13.846327] [WARN ] [VALIDATOR ] VTR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:13.882090] [INFO ] [MAIN ] VTR: Combined data validation passed. [2025-09-05T19:06:14.002278] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-05T19:06:14.034873] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-05T19:06:14.120414] [INFO ] [MAIN ] VTR: Update completed successfully. [2025-09-05T19:06:14.123774] [INFO ] [MAIN ] Update Progress: 2254/2363 symbols completed. VTR took 4.5s. Estimated remaining: 3m 12s. Rate: 34.1 symbols/min [2025-09-05T19:06:14.168373] [WARN ] [VALIDATOR ] VTS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:14.230438] [INFO ] [MAIN ] VTS: Combined data validation passed. [2025-09-05T19:06:14.351029] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:14.376904] [WARN ] [MAIN ] VVV: No existing data found, performing full refresh instead. [2025-09-05T19:06:14.387731] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-05T19:06:14.391321] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-05T19:06:14.392760] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-05T19:06:14.503376] [INFO ] [MAIN ] VTS: Update completed successfully. [2025-09-05T19:06:14.521116] [INFO ] [MAIN ] Update Progress: 2255/2363 symbols completed. VTS took 3.1s. Estimated remaining: 3m 10s. Rate: 34.1 symbols/min [2025-09-05T19:06:14.898623] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:14.949040] [INFO ] [REMOTE ] VVV: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:06:14.949712] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-05T19:06:14.976927] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-05T19:06:14.984872] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-05T19:06:14.989398] [INFO ] [MAIN ] VVX: Loaded 11530 existing records. [2025-09-05T19:06:15.166054] [INFO ] [MAIN ] VVX: Found 1 missing trading days. [2025-09-05T19:06:15.166222] [INFO ] [MAIN ] VVX: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:15.166442] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-05T19:06:15.322328] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-05T19:06:15.327185] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-05T19:06:16.350666] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-05T19:06:16.360383] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-05T19:06:16.385224] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-05T19:06:16.389761] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-05T19:06:16.551953] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-05T19:06:16.622414] [INFO ] [MAIN ] VVX: Adding 254 new records, updating 0 existing records. [2025-09-05T19:06:16.641512] [INFO ] [MAIN ] VVX: Combined dataset has 11784 total records. [2025-09-05T19:06:16.690503] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-05T19:06:16.735422] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-05T19:06:16.839072] [WARN ] [VALIDATOR ] VVX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:17.032854] [WARN ] [VALIDATOR ] VVX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:17.033078] [INFO ] [MAIN ] VVX: Combined data validation passed. [2025-09-05T19:06:17.111224] [INFO ] [MAIN ] VVX: Update completed successfully. [2025-09-05T19:06:17.112831] [INFO ] [MAIN ] Update Progress: 2256/2363 symbols completed. VVX took 2.6s. Estimated remaining: 3m 8s. Rate: 34.1 symbols/min [2025-09-05T19:06:17.286746] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:17.310510] [INFO ] [MAIN ] VYX: Loaded 23108 existing records. [2025-09-05T19:06:17.497955] [INFO ] [MAIN ] VYX: Found 1 missing trading days. [2025-09-05T19:06:17.498170] [INFO ] [MAIN ] VYX: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:17.498410] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-05T19:06:17.518903] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-05T19:06:17.525675] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-05T19:06:17.908468] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-05T19:06:17.918288] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-05T19:06:18.136179] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-05T19:06:18.143116] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-05T19:06:18.407187] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-05T19:06:18.410387] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-05T19:06:18.815183] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-05T19:06:18.953542] [INFO ] [MAIN ] VYX: Adding 367 new records, updating 0 existing records. [2025-09-05T19:06:18.956945] [INFO ] [MAIN ] VYX: Combined dataset has 23475 total records. [2025-09-05T19:06:19.139058] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-05T19:06:19.144983] [WARN ] [VALIDATOR ] VYX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:19.177175] [INFO ] [REMOTE ] VTMX: Full fetch complete (19820 records). [2025-09-05T19:06:19.710284] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-05T19:06:19.733914] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-05T19:06:19.743274] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-05T19:06:19.840945] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-05T19:06:19.860838] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-05T19:06:19.876066] [WARN ] [VALIDATOR ] VYX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:19.876869] [INFO ] [MAIN ] VYX: Combined data validation passed. [2025-09-05T19:06:19.986188] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-05T19:06:19.989874] [INFO ] [MAIN ] Update Progress: 2257/2363 symbols completed. VTMX took 12.5s. Estimated remaining: 3m 7s. Rate: 34.1 symbols/min [2025-09-05T19:06:20.195728] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:20.207921] [INFO ] [MAIN ] VYX: Update completed successfully. [2025-09-05T19:06:20.211240] [INFO ] [MAIN ] Update Progress: 2258/2363 symbols completed. VYX took 3.1s. Estimated remaining: 3m 5s. Rate: 34.1 symbols/min [2025-09-05T19:06:20.397472] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:20.410939] [INFO ] [MAIN ] VZ: Loaded 40531 existing records. [2025-09-05T19:06:20.647451] [INFO ] [MAIN ] VZ: Found 1 missing trading days. [2025-09-05T19:06:20.647808] [INFO ] [MAIN ] VZ: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:20.649412] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-05T19:06:20.648929] [INFO ] [MAIN ] W: Loaded 25515 existing records. [2025-09-05T19:06:20.827366] [INFO ] [MAIN ] W: Found 1 missing trading days. [2025-09-05T19:06:20.827507] [INFO ] [MAIN ] W: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:20.827727] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-05T19:06:21.091299] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-05T19:06:21.098679] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-05T19:06:21.697386] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-05T19:06:21.708511] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-05T19:06:21.956962] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-05T19:06:21.963669] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-05T19:06:22.545790] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-05T19:06:22.699533] [INFO ] [MAIN ] W: Adding 390 new records, updating 0 existing records. [2025-09-05T19:06:22.703889] [INFO ] [MAIN ] W: Combined dataset has 25905 total records. [2025-09-05T19:06:22.882609] [WARN ] [VALIDATOR ] W: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:23.097971] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-05T19:06:23.265865] [INFO ] [MAIN ] VZ: Adding 390 new records, updating 0 existing records. [2025-09-05T19:06:23.281267] [INFO ] [MAIN ] VZ: Combined dataset has 40921 total records. [2025-09-05T19:06:23.281432] [WARN ] [VALIDATOR ] W: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:23.281811] [INFO ] [MAIN ] W: Combined data validation passed. [2025-09-05T19:06:23.521100] [WARN ] [VALIDATOR ] VZ: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:23.689878] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-05T19:06:23.702819] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-05T19:06:23.862771] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-05T19:06:23.878624] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-05T19:06:23.932274] [INFO ] [MAIN ] W: Update completed successfully. [2025-09-05T19:06:23.939171] [INFO ] [MAIN ] Update Progress: 2259/2363 symbols completed. W took 3.7s. Estimated remaining: 3m 3s. Rate: 34.1 symbols/min [2025-09-05T19:06:24.115557] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:24.116885] [WARN ] [VALIDATOR ] VZ: Missing days changed. Total missing: 45 No longer missing: 2025-01-28, 2025-01-29, 2025-01-30, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:24.117114] [INFO ] [MAIN ] VZ: Combined data validation passed. [2025-09-05T19:06:24.271769] [INFO ] [MAIN ] WAB: Loaded 33073 existing records. [2025-09-05T19:06:24.460051] [INFO ] [MAIN ] WAB: Found 1 missing trading days. [2025-09-05T19:06:24.461113] [INFO ] [MAIN ] WAB: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:24.461836] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-05T19:06:24.614421] [INFO ] [MAIN ] VZ: Update completed successfully. [2025-09-05T19:06:24.620449] [INFO ] [MAIN ] Update Progress: 2260/2363 symbols completed. VZ took 4.6s. Estimated remaining: 3m 1s. Rate: 34.1 symbols/min [2025-09-05T19:06:24.799895] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:24.800089] [WARN ] [MAIN ] WAL: No existing data found, performing full refresh instead. [2025-09-05T19:06:24.800417] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-05T19:06:24.800482] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-05T19:06:24.800538] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-05T19:06:25.214669] [INFO ] [REMOTE ] WAL: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:06:25.215195] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-05T19:06:25.235067] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-05T19:06:25.242533] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-05T19:06:25.551154] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-05T19:06:25.561963] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-05T19:06:25.962069] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-05T19:06:26.111000] [INFO ] [MAIN ] WAB: Adding 371 new records, updating 0 existing records. [2025-09-05T19:06:26.115189] [INFO ] [MAIN ] WAB: Combined dataset has 33444 total records. [2025-09-05T19:06:26.249116] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T19:06:26.283248] [INFO ] [REMOTE ] VVR: Full fetch complete (33045 records). [2025-09-05T19:06:26.302298] [WARN ] [VALIDATOR ] WAB: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:26.878726] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-05T19:06:26.985851] [WARN ] [VALIDATOR ] WAB: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:27.000174] [INFO ] [MAIN ] WAB: Combined data validation passed. [2025-09-05T19:06:27.009360] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-05T19:06:27.048323] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-05T19:06:27.055560] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-05T19:06:27.168306] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-05T19:06:27.230112] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-05T19:06:27.230739] [INFO ] [MAIN ] Update Progress: 2261/2363 symbols completed. VVR took 14.3s. Estimated remaining: 2m 60s. Rate: 34.1 symbols/min [2025-09-05T19:06:27.447393] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:27.495882] [INFO ] [MAIN ] WAT: Loaded 17268 existing records. [2025-09-05T19:06:27.679822] [INFO ] [MAIN ] WAT: Found 1 missing trading days. [2025-09-05T19:06:27.681363] [INFO ] [MAIN ] WAT: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:27.682761] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-05T19:06:27.691966] [INFO ] [MAIN ] WAB: Update completed successfully. [2025-09-05T19:06:27.697586] [INFO ] [MAIN ] Update Progress: 2262/2363 symbols completed. WAB took 3.8s. Estimated remaining: 2m 58s. Rate: 34.1 symbols/min [2025-09-05T19:06:27.874580] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:27.900986] [INFO ] [MAIN ] WBS: Loaded 23262 existing records. [2025-09-05T19:06:28.086316] [INFO ] [MAIN ] WBS: Found 1 missing trading days. [2025-09-05T19:06:28.086512] [INFO ] [MAIN ] WBS: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:28.086764] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-05T19:06:28.775745] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-05T19:06:28.785595] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-05T19:06:29.049199] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-05T19:06:29.050462] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T19:06:29.083508] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-05T19:06:29.178072] [INFO ] [MAIN ] WAT: Adding 232 new records, updating 0 existing records. [2025-09-05T19:06:29.181057] [INFO ] [MAIN ] WAT: Combined dataset has 17500 total records. [2025-09-05T19:06:29.375356] [WARN ] [VALIDATOR ] WAT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:29.578612] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-05T19:06:29.755058] [INFO ] [MAIN ] WBS: Adding 380 new records, updating 0 existing records. [2025-09-05T19:06:29.765394] [INFO ] [MAIN ] WBS: Combined dataset has 23642 total records. [2025-09-05T19:06:29.857591] [WARN ] [VALIDATOR ] WAT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:29.883247] [INFO ] [MAIN ] WAT: Combined data validation passed. [2025-09-05T19:06:30.020053] [WARN ] [VALIDATOR ] WBS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:30.218664] [INFO ] [MAIN ] WAT: Update completed successfully. [2025-09-05T19:06:30.277223] [INFO ] [MAIN ] Update Progress: 2263/2363 symbols completed. WAT took 3.0s. Estimated remaining: 2m 56s. Rate: 34.1 symbols/min [2025-09-05T19:06:30.491926] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:30.536209] [INFO ] [MAIN ] WBX: Loaded 4363 existing records. [2025-09-05T19:06:30.575551] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-05T19:06:30.650554] [WARN ] [VALIDATOR ] WBS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:30.644038] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-05T19:06:30.667812] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-05T19:06:30.666965] [INFO ] [MAIN ] WBS: Combined data validation passed. [2025-09-05T19:06:30.689300] [INFO ] [REMOTE ] VVV: Full fetch complete (54543 records). [2025-09-05T19:06:30.865128] [INFO ] [MAIN ] WBX: Found 1 missing trading days. [2025-09-05T19:06:30.913599] [INFO ] [MAIN ] WBX: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:30.937383] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-05T19:06:31.269243] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-05T19:06:31.429679] [INFO ] [MAIN ] WBS: Update completed successfully. [2025-09-05T19:06:31.435217] [INFO ] [MAIN ] Update Progress: 2264/2363 symbols completed. WBS took 3.7s. Estimated remaining: 2m 54s. Rate: 34.1 symbols/min [2025-09-05T19:06:31.619540] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:31.729175] [INFO ] [MAIN ] WCC: Loaded 18185 existing records. [2025-09-05T19:06:31.800727] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-05T19:06:31.856249] [INFO ] [MAIN ] WBX: Adding 20 new records, updating 0 existing records. [2025-09-05T19:06:31.937117] [INFO ] [MAIN ] WCC: Found 1 missing trading days. [2025-09-05T19:06:31.938824] [INFO ] [MAIN ] WCC: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:31.939802] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-05T19:06:31.938432] [INFO ] [MAIN ] WBX: Combined dataset has 4383 total records. [2025-09-05T19:06:32.159433] [WARN ] [VALIDATOR ] WBX: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:32.232140] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-05T19:06:32.249622] [INFO ] [MAIN ] Update Progress: 2265/2363 symbols completed. VVV took 18.1s. Estimated remaining: 2m 53s. Rate: 34.1 symbols/min [2025-09-05T19:06:32.528709] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:32.592905] [INFO ] [MAIN ] WCN: Loaded 22543 existing records. [2025-09-05T19:06:32.676465] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-05T19:06:32.726434] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-05T19:06:32.731688] [WARN ] [VALIDATOR ] WBX: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:32.743916] [INFO ] [MAIN ] WBX: Combined data validation passed. [2025-09-05T19:06:32.793516] [INFO ] [MAIN ] WCN: Found 1 missing trading days. [2025-09-05T19:06:32.793940] [INFO ] [MAIN ] WCN: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:32.794266] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-05T19:06:32.819859] [INFO ] [MAIN ] WBX: Update completed successfully. [2025-09-05T19:06:32.820570] [INFO ] [MAIN ] Update Progress: 2266/2363 symbols completed. WBX took 2.5s. Estimated remaining: 2m 51s. Rate: 34.1 symbols/min [2025-09-05T19:06:32.988812] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:33.007211] [INFO ] [MAIN ] WD: Loaded 17761 existing records. [2025-09-05T19:06:33.178783] [INFO ] [MAIN ] WD: Found 1 missing trading days. [2025-09-05T19:06:33.179006] [INFO ] [MAIN ] WD: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:33.179229] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-05T19:06:33.311526] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T19:06:33.415672] [INFO ] [MAIN ] WCC: Adding 313 new records, updating 0 existing records. [2025-09-05T19:06:33.418983] [INFO ] [MAIN ] WCC: Combined dataset has 18498 total records. [2025-09-05T19:06:33.594512] [WARN ] [VALIDATOR ] WCC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:33.784198] [WARN ] [VALIDATOR ] WCC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:33.784416] [INFO ] [MAIN ] WCC: Combined data validation passed. [2025-09-05T19:06:33.905842] [INFO ] [MAIN ] WCC: Update completed successfully. [2025-09-05T19:06:33.907784] [INFO ] [MAIN ] Update Progress: 2267/2363 symbols completed. WCC took 2.5s. Estimated remaining: 2m 49s. Rate: 34.1 symbols/min [2025-09-05T19:06:34.022286] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-05T19:06:34.139001] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:34.150999] [INFO ] [MAIN ] WD: Adding 219 new records, updating 0 existing records. [2025-09-05T19:06:34.161093] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T19:06:34.191171] [INFO ] [MAIN ] WD: Combined dataset has 17980 total records. [2025-09-05T19:06:34.334316] [INFO ] [MAIN ] WDH: Loaded 11137 existing records. [2025-09-05T19:06:34.535715] [INFO ] [MAIN ] WCN: Adding 358 new records, updating 0 existing records. [2025-09-05T19:06:34.598125] [WARN ] [VALIDATOR ] WD: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:34.712887] [INFO ] [MAIN ] WDH: Found 1 missing trading days. [2025-09-05T19:06:34.718618] [INFO ] [MAIN ] WCN: Combined dataset has 22901 total records. [2025-09-05T19:06:34.718545] [INFO ] [MAIN ] WDH: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:34.767274] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-05T19:06:35.095316] [WARN ] [VALIDATOR ] WCN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:35.101478] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-05T19:06:35.191208] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-05T19:06:35.349538] [WARN ] [VALIDATOR ] WD: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:35.350002] [INFO ] [MAIN ] WD: Combined data validation passed. [2025-09-05T19:06:35.349662] [WARN ] [VALIDATOR ] WCN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:35.350226] [INFO ] [MAIN ] WCN: Combined data validation passed. [2025-09-05T19:06:35.561110] [INFO ] [MAIN ] WD: Update completed successfully. [2025-09-05T19:06:35.573913] [INFO ] [MAIN ] Update Progress: 2268/2363 symbols completed. WD took 2.8s. Estimated remaining: 2m 47s. Rate: 34.1 symbols/min [2025-09-05T19:06:35.736668] [INFO ] [MAIN ] WCN: Update completed successfully. [2025-09-05T19:06:35.760279] [INFO ] [MAIN ] Update Progress: 2269/2363 symbols completed. WCN took 3.5s. Estimated remaining: 2m 45s. Rate: 34.1 symbols/min [2025-09-05T19:06:35.839892] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:35.912708] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T19:06:36.061953] [INFO ] [MAIN ] WDI: Loaded 9841 existing records. [2025-09-05T19:06:36.051447] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:36.097509] [INFO ] [MAIN ] WDH: Adding 260 new records, updating 0 existing records. [2025-09-05T19:06:36.173359] [INFO ] [MAIN ] WDH: Combined dataset has 11397 total records. [2025-09-05T19:06:36.346657] [INFO ] [MAIN ] WDI: Found 1 missing trading days. [2025-09-05T19:06:36.364994] [INFO ] [MAIN ] WDI: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:36.365611] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-05T19:06:36.456916] [WARN ] [VALIDATOR ] WDH: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:36.503426] [INFO ] [MAIN ] WDS: Loaded 32415 existing records. [2025-09-05T19:06:36.828879] [INFO ] [MAIN ] WDS: Found 1 missing trading days. [2025-09-05T19:06:36.843148] [INFO ] [MAIN ] WDS: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:36.853492] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-05T19:06:36.854112] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-05T19:06:36.864681] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-05T19:06:36.875554] [WARN ] [VALIDATOR ] WDH: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:36.875821] [INFO ] [MAIN ] WDH: Combined data validation passed. [2025-09-05T19:06:36.942287] [INFO ] [MAIN ] WDH: Update completed successfully. [2025-09-05T19:06:36.943784] [INFO ] [MAIN ] Update Progress: 2270/2363 symbols completed. WDH took 3.0s. Estimated remaining: 2m 44s. Rate: 34.1 symbols/min [2025-09-05T19:06:37.115450] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:37.123078] [INFO ] [MAIN ] WEA: Loaded 5987 existing records. [2025-09-05T19:06:37.298370] [INFO ] [MAIN ] WEA: Found 1 missing trading days. [2025-09-05T19:06:37.298589] [INFO ] [MAIN ] WEA: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:37.298827] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-05T19:06:37.318174] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-05T19:06:37.359530] [INFO ] [MAIN ] WDI: Adding 129 new records, updating 0 existing records. [2025-09-05T19:06:37.361467] [INFO ] [MAIN ] WDI: Combined dataset has 9970 total records. [2025-09-05T19:06:37.536605] [WARN ] [VALIDATOR ] WDI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:37.723473] [WARN ] [VALIDATOR ] WDI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:37.723689] [INFO ] [MAIN ] WDI: Combined data validation passed. [2025-09-05T19:06:37.787754] [INFO ] [MAIN ] WDI: Update completed successfully. [2025-09-05T19:06:37.789138] [INFO ] [MAIN ] Update Progress: 2271/2363 symbols completed. WDI took 2.2s. Estimated remaining: 2m 42s. Rate: 34.1 symbols/min [2025-09-05T19:06:37.958454] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:37.973674] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-05T19:06:37.998751] [INFO ] [MAIN ] WEA: Adding 63 new records, updating 0 existing records. [2025-09-05T19:06:38.006024] [INFO ] [MAIN ] WEAV: Loaded 19924 existing records. [2025-09-05T19:06:38.104434] [INFO ] [MAIN ] WEA: Combined dataset has 6050 total records. [2025-09-05T19:06:38.215951] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-05T19:06:38.265034] [INFO ] [MAIN ] WEAV: Found 1 missing trading days. [2025-09-05T19:06:38.306704] [INFO ] [MAIN ] WEAV: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:38.325072] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-05T19:06:38.548914] [INFO ] [MAIN ] WDS: Adding 314 new records, updating 0 existing records. [2025-09-05T19:06:38.543957] [WARN ] [VALIDATOR ] WEA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:38.699592] [INFO ] [MAIN ] WDS: Combined dataset has 32729 total records. [2025-09-05T19:06:38.920062] [WARN ] [VALIDATOR ] WDS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:39.056029] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-05T19:06:39.152183] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-05T19:06:39.185091] [WARN ] [VALIDATOR ] WDS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:39.184993] [WARN ] [VALIDATOR ] WEA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:39.185696] [INFO ] [MAIN ] WDS: Combined data validation passed. [2025-09-05T19:06:39.185555] [INFO ] [MAIN ] WEA: Combined data validation passed. [2025-09-05T19:06:39.319299] [INFO ] [MAIN ] WEA: Update completed successfully. [2025-09-05T19:06:39.321939] [INFO ] [MAIN ] Update Progress: 2272/2363 symbols completed. WEA took 2.4s. Estimated remaining: 2m 40s. Rate: 34.1 symbols/min [2025-09-05T19:06:39.511841] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:39.640833] [INFO ] [MAIN ] WEC: Loaded 39302 existing records. [2025-09-05T19:06:39.744401] [INFO ] [MAIN ] WDS: Update completed successfully. [2025-09-05T19:06:39.750880] [INFO ] [MAIN ] Update Progress: 2273/2363 symbols completed. WDS took 4.0s. Estimated remaining: 2m 38s. Rate: 34.1 symbols/min [2025-09-05T19:06:39.938679] [INFO ] [MAIN ] WEC: Found 1 missing trading days. [2025-09-05T19:06:39.954794] [INFO ] [MAIN ] WEC: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:40.003314] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-05T19:06:40.003581] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-05T19:06:40.022246] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:40.143327] [INFO ] [MAIN ] WEAV: Adding 288 new records, updating 0 existing records. [2025-09-05T19:06:40.146612] [INFO ] [MAIN ] WEAV: Combined dataset has 20212 total records. [2025-09-05T19:06:40.255490] [INFO ] [MAIN ] WELL: Loaded 24773 existing records. [2025-09-05T19:06:40.439419] [WARN ] [VALIDATOR ] WEAV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:40.623352] [INFO ] [MAIN ] WELL: Found 1 missing trading days. [2025-09-05T19:06:40.633931] [INFO ] [MAIN ] WELL: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:40.654817] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-05T19:06:40.743215] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-05T19:06:40.753836] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-05T19:06:40.761548] [WARN ] [VALIDATOR ] WEAV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:40.761785] [INFO ] [MAIN ] WEAV: Combined data validation passed. [2025-09-05T19:06:40.879510] [INFO ] [MAIN ] WEAV: Update completed successfully. [2025-09-05T19:06:40.882037] [INFO ] [MAIN ] Update Progress: 2274/2363 symbols completed. WEAV took 3.1s. Estimated remaining: 2m 36s. Rate: 34.1 symbols/min [2025-09-05T19:06:41.050149] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:41.050298] [WARN ] [MAIN ] WES: No existing data found, performing full refresh instead. [2025-09-05T19:06:41.050419] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-05T19:06:41.050462] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-05T19:06:41.050506] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-05T19:06:41.402324] [INFO ] [REMOTE ] WES: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:06:41.402618] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-05T19:06:41.701559] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-05T19:06:41.868790] [INFO ] [MAIN ] WEC: Adding 378 new records, updating 0 existing records. [2025-09-05T19:06:41.874851] [INFO ] [MAIN ] WEC: Combined dataset has 39680 total records. [2025-09-05T19:06:42.062840] [WARN ] [VALIDATOR ] WEC: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:42.071703] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T19:06:42.341480] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T19:06:42.414829] [INFO ] [REMOTE ] WAL: Full fetch complete (49505 records). [2025-09-05T19:06:42.482091] [INFO ] [MAIN ] WELL: Adding 389 new records, updating 0 existing records. [2025-09-05T19:06:42.638672] [INFO ] [MAIN ] WELL: Combined dataset has 25162 total records. [2025-09-05T19:06:43.008900] [WARN ] [VALIDATOR ] WELL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:06:43.143463] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-05T19:06:43.196376] [WARN ] [VALIDATOR ] WEC: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:43.197211] [INFO ] [MAIN ] WEC: Combined data validation passed. [2025-09-05T19:06:43.657103] [INFO ] [MAIN ] WEC: Update completed successfully. [2025-09-05T19:06:43.662127] [INFO ] [MAIN ] Update Progress: 2275/2363 symbols completed. WEC took 4.3s. Estimated remaining: 2m 35s. Rate: 34.1 symbols/min [2025-09-05T19:06:43.856939] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-05T19:06:43.845994] [WARN ] [VALIDATOR ] WELL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:06:43.872262] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-05T19:06:43.891112] [INFO ] [MAIN ] WELL: Combined data validation passed. [2025-09-05T19:06:43.899844] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:43.902443] [WARN ] [MAIN ] WEX: No existing data found, performing full refresh instead. [2025-09-05T19:06:43.904028] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-05T19:06:43.906218] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-05T19:06:43.973372] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-05T19:06:44.234569] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-05T19:06:44.248402] [INFO ] [MAIN ] Update Progress: 2276/2363 symbols completed. WAL took 19.6s. Estimated remaining: 2m 33s. Rate: 34.1 symbols/min [2025-09-05T19:06:44.597734] [INFO ] [MAIN ] WELL: Update completed successfully. [2025-09-05T19:06:44.615873] [INFO ] [MAIN ] Update Progress: 2277/2363 symbols completed. WELL took 4.9s. Estimated remaining: 2m 31s. Rate: 34.1 symbols/min [2025-09-05T19:06:44.744339] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:44.749279] [INFO ] [REMOTE ] WEX: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:06:44.749595] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-05T19:06:44.760026] [INFO ] [MAIN ] WF: Loaded 8510 existing records. [2025-09-05T19:06:44.931199] [INFO ] [MAIN ] WF: Found 1 missing trading days. [2025-09-05T19:06:44.931360] [INFO ] [MAIN ] WF: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:44.931599] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-05T19:06:45.468401] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-05T19:06:45.501550] [INFO ] [MAIN ] WF: Adding 89 new records, updating 0 existing records. [2025-09-05T19:06:45.504473] [INFO ] [MAIN ] WF: Combined dataset has 8599 total records. [2025-09-05T19:06:45.686508] [WARN ] [VALIDATOR ] WF: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:06:45.837617] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-05T19:06:45.902707] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-05T19:06:45.917518] [WARN ] [VALIDATOR ] WF: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:06:45.917743] [INFO ] [MAIN ] WF: Combined data validation passed. [2025-09-05T19:06:45.970735] [INFO ] [MAIN ] WF: Update completed successfully. [2025-09-05T19:06:45.971779] [INFO ] [MAIN ] Update Progress: 2278/2363 symbols completed. WF took 1.7s. Estimated remaining: 2m 29s. Rate: 34.2 symbols/min [2025-09-05T19:06:46.406331] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-05T19:06:46.414493] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-05T19:06:47.391868] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-05T19:06:47.402098] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-05T19:06:48.040627] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-05T19:06:48.048588] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-05T19:06:49.303975] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-05T19:06:49.314246] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-05T19:06:49.854113] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-05T19:06:49.864193] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-05T19:06:51.205329] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-05T19:06:51.221624] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-05T19:06:51.606394] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-05T19:06:51.615336] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-05T19:06:52.955687] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-05T19:06:52.963109] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-05T19:06:52.997927] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-05T19:06:53.007635] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-05T19:06:54.401412] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-05T19:06:54.413216] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-05T19:06:54.680481] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-05T19:06:54.690599] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-05T19:06:55.559414] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-05T19:06:55.566957] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-05T19:06:56.115872] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-05T19:06:56.127723] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-05T19:06:56.723667] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-05T19:06:56.730699] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-05T19:06:57.425167] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-05T19:06:57.427793] [INFO ] [REMOTE ] WES: Full fetch complete (52385 records). [2025-09-05T19:06:57.805551] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-05T19:06:58.039359] [INFO ] [MAIN ] WES: Full history saved. [2025-09-05T19:06:58.039522] [INFO ] [MAIN ] Update Progress: 2279/2363 symbols completed. WES took 17.2s. Estimated remaining: 2m 28s. Rate: 34.1 symbols/min [2025-09-05T19:06:58.160213] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-05T19:06:58.162369] [INFO ] [REMOTE ] WEX: Full fetch complete (39819 records). [2025-09-05T19:06:58.527040] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-05T19:06:58.684537] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-05T19:06:58.684703] [INFO ] [MAIN ] Update Progress: 2280/2363 symbols completed. WEX took 15.0s. Estimated remaining: 2m 26s. Rate: 34.1 symbols/min [2025-09-05T19:06:59.254932] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:59.305333] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:59.313321] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:59.381958] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:06:59.388028] [INFO ] [MAIN ] WFG: Loaded 11983 existing records. [2025-09-05T19:06:59.527449] [INFO ] [MAIN ] WFC: Loaded 25670 existing records. [2025-09-05T19:06:59.539158] [INFO ] [MAIN ] WH: Loaded 21592 existing records. [2025-09-05T19:06:59.730672] [INFO ] [MAIN ] WGO: Loaded 18411 existing records. [2025-09-05T19:06:59.720855] [INFO ] [MAIN ] WFG: Found 1 missing trading days. [2025-09-05T19:06:59.759004] [INFO ] [MAIN ] WFG: Need to fetch 1 months: 2025-09 [2025-09-05T19:06:59.774698] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-05T19:07:00.046963] [INFO ] [MAIN ] WH: Found 1 missing trading days. [2025-09-05T19:07:00.047594] [INFO ] [MAIN ] WH: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:00.058956] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-05T19:07:00.110851] [INFO ] [MAIN ] WFC: Found 1 missing trading days. [2025-09-05T19:07:00.135738] [INFO ] [MAIN ] WFC: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:00.158663] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-05T19:07:00.158407] [INFO ] [MAIN ] WGO: Found 1 missing trading days. [2025-09-05T19:07:00.158771] [INFO ] [MAIN ] WGO: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:00.159762] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-05T19:07:01.015939] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T19:07:01.091566] [INFO ] [MAIN ] WFG: Adding 245 new records, updating 0 existing records. [2025-09-05T19:07:01.094425] [INFO ] [MAIN ] WFG: Combined dataset has 12228 total records. [2025-09-05T19:07:01.279019] [WARN ] [VALIDATOR ] WFG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:01.386108] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T19:07:01.463592] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-05T19:07:01.615342] [INFO ] [MAIN ] WGO: Adding 251 new records, updating 0 existing records. [2025-09-05T19:07:01.693411] [INFO ] [MAIN ] WH: Adding 360 new records, updating 0 existing records. [2025-09-05T19:07:01.696812] [INFO ] [MAIN ] WGO: Combined dataset has 18662 total records. [2025-09-05T19:07:01.754702] [INFO ] [MAIN ] WH: Combined dataset has 21952 total records. [2025-09-05T19:07:02.005734] [WARN ] [VALIDATOR ] WGO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:02.113768] [WARN ] [VALIDATOR ] WH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:02.437748] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-05T19:07:02.640772] [INFO ] [MAIN ] WFC: Adding 390 new records, updating 0 existing records. [2025-09-05T19:07:02.659269] [INFO ] [MAIN ] WFC: Combined dataset has 26060 total records. [2025-09-05T19:07:02.695310] [WARN ] [VALIDATOR ] WGO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:02.695401] [WARN ] [VALIDATOR ] WFG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:02.695202] [WARN ] [VALIDATOR ] WH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:02.695674] [INFO ] [MAIN ] WGO: Combined data validation passed. [2025-09-05T19:07:02.696117] [INFO ] [MAIN ] WFG: Combined data validation passed. [2025-09-05T19:07:02.695820] [INFO ] [MAIN ] WH: Combined data validation passed. [2025-09-05T19:07:03.103062] [WARN ] [VALIDATOR ] WFC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:03.337124] [INFO ] [MAIN ] WGO: Update completed successfully. [2025-09-05T19:07:03.349405] [INFO ] [MAIN ] Update Progress: 2281/2363 symbols completed. WGO took 4.7s. Estimated remaining: 2m 24s. Rate: 34.0 symbols/min [2025-09-05T19:07:03.458844] [INFO ] [MAIN ] WFG: Update completed successfully. [2025-09-05T19:07:03.470913] [INFO ] [MAIN ] Update Progress: 2282/2363 symbols completed. WFG took 4.8s. Estimated remaining: 2m 23s. Rate: 34.1 symbols/min [2025-09-05T19:07:03.619631] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:03.647672] [INFO ] [MAIN ] WH: Update completed successfully. [2025-09-05T19:07:03.667345] [INFO ] [MAIN ] Update Progress: 2283/2363 symbols completed. WH took 5.0s. Estimated remaining: 2m 21s. Rate: 34.1 symbols/min [2025-09-05T19:07:03.863249] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:03.872802] [INFO ] [MAIN ] WHD: Loaded 18471 existing records. [2025-09-05T19:07:03.986519] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:03.991904] [INFO ] [MAIN ] WHG: Loaded 1782 existing records. [2025-09-05T19:07:04.292876] [INFO ] [MAIN ] WHD: Found 1 missing trading days. [2025-09-05T19:07:04.314340] [INFO ] [MAIN ] WHD: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:04.362103] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-05T19:07:04.389079] [INFO ] [MAIN ] WHG: Found 1 missing trading days. [2025-09-05T19:07:04.390653] [INFO ] [MAIN ] WHR: Loaded 23364 existing records. [2025-09-05T19:07:04.412975] [INFO ] [MAIN ] WHG: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:04.429216] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-05T19:07:04.588904] [INFO ] [MAIN ] WHR: Found 1 missing trading days. [2025-09-05T19:07:04.589355] [INFO ] [MAIN ] WHR: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:04.589895] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-05T19:07:04.592177] [WARN ] [VALIDATOR ] WFC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:04.592480] [INFO ] [MAIN ] WFC: Combined data validation passed. [2025-09-05T19:07:04.773148] [INFO ] [MAIN ] WFC: Update completed successfully. [2025-09-05T19:07:04.777625] [INFO ] [MAIN ] Update Progress: 2284/2363 symbols completed. WFC took 6.1s. Estimated remaining: 2m 19s. Rate: 34.1 symbols/min [2025-09-05T19:07:04.950407] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:04.956323] [INFO ] [MAIN ] WIA: Loaded 3591 existing records. [2025-09-05T19:07:05.129520] [INFO ] [MAIN ] WIA: Found 1 missing trading days. [2025-09-05T19:07:05.129701] [INFO ] [MAIN ] WIA: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:05.129931] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-05T19:07:05.297139] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T19:07:05.306159] [INFO ] [MAIN ] WHG: Adding 11 new records, updating 0 existing records. [2025-09-05T19:07:05.307708] [INFO ] [MAIN ] WHG: Combined dataset has 1793 total records. [2025-09-05T19:07:05.491564] [WARN ] [VALIDATOR ] WHG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:05.632070] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-05T19:07:05.815276] [INFO ] [MAIN ] WHD: Adding 330 new records, updating 0 existing records. [2025-09-05T19:07:05.823007] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T19:07:05.845577] [INFO ] [MAIN ] WIA: Adding 71 new records, updating 0 existing records. [2025-09-05T19:07:05.848939] [INFO ] [MAIN ] WHD: Combined dataset has 18801 total records. [2025-09-05T19:07:05.850051] [INFO ] [MAIN ] WIA: Combined dataset has 3662 total records. [2025-09-05T19:07:06.152808] [WARN ] [VALIDATOR ] WIA: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:07:06.290871] [WARN ] [VALIDATOR ] WHD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:06.486911] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-05T19:07:06.663732] [WARN ] [VALIDATOR ] WHG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:06.699932] [INFO ] [MAIN ] WHG: Combined data validation passed. [2025-09-05T19:07:06.755244] [INFO ] [MAIN ] WHR: Adding 367 new records, updating 0 existing records. [2025-09-05T19:07:06.774936] [INFO ] [MAIN ] WHG: Update completed successfully. [2025-09-05T19:07:06.776685] [INFO ] [MAIN ] Update Progress: 2285/2363 symbols completed. WHG took 3.3s. Estimated remaining: 2m 17s. Rate: 34.1 symbols/min [2025-09-05T19:07:06.873778] [INFO ] [MAIN ] WHR: Combined dataset has 23731 total records. [2025-09-05T19:07:07.050570] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:07.149495] [WARN ] [VALIDATOR ] WHR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:07.153484] [INFO ] [MAIN ] WINN: Loaded 4995 existing records. [2025-09-05T19:07:07.462007] [WARN ] [VALIDATOR ] WIA: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:07:07.511137] [INFO ] [MAIN ] WINN: Found 1 missing trading days. [2025-09-05T19:07:07.509126] [WARN ] [VALIDATOR ] WHD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:07.520858] [INFO ] [MAIN ] WINN: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:07.521133] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-05T19:07:07.522292] [INFO ] [MAIN ] WHD: Combined data validation passed. [2025-09-05T19:07:07.522409] [INFO ] [MAIN ] WIA: Combined data validation passed. [2025-09-05T19:07:07.628967] [INFO ] [MAIN ] WIA: Update completed successfully. [2025-09-05T19:07:07.633414] [INFO ] [MAIN ] Update Progress: 2286/2363 symbols completed. WIA took 2.9s. Estimated remaining: 2m 16s. Rate: 34.1 symbols/min [2025-09-05T19:07:07.823460] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:07.860230] [INFO ] [MAIN ] WIT: Loaded 25106 existing records. [2025-09-05T19:07:07.860315] [INFO ] [MAIN ] WHD: Update completed successfully. [2025-09-05T19:07:07.898678] [INFO ] [MAIN ] Update Progress: 2287/2363 symbols completed. WHD took 4.5s. Estimated remaining: 2m 14s. Rate: 34.1 symbols/min [2025-09-05T19:07:08.172731] [INFO ] [MAIN ] WIT: Found 1 missing trading days. [2025-09-05T19:07:08.204783] [INFO ] [MAIN ] WIT: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:08.230474] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-05T19:07:08.233443] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:08.235415] [WARN ] [VALIDATOR ] WHR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:08.235616] [INFO ] [MAIN ] WHR: Combined data validation passed. [2025-09-05T19:07:08.245998] [INFO ] [MAIN ] WIW: Loaded 9919 existing records. [2025-09-05T19:07:08.433365] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-05T19:07:08.483933] [INFO ] [MAIN ] WINN: Adding 61 new records, updating 0 existing records. [2025-09-05T19:07:08.580271] [INFO ] [MAIN ] WINN: Combined dataset has 5056 total records. [2025-09-05T19:07:08.607254] [INFO ] [MAIN ] WIW: Found 1 missing trading days. [2025-09-05T19:07:08.608502] [INFO ] [MAIN ] WIW: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:08.641243] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-05T19:07:08.724292] [INFO ] [MAIN ] WHR: Update completed successfully. [2025-09-05T19:07:08.742746] [INFO ] [MAIN ] Update Progress: 2288/2363 symbols completed. WHR took 5.1s. Estimated remaining: 2m 12s. Rate: 34.1 symbols/min [2025-09-05T19:07:08.801749] [WARN ] [VALIDATOR ] WINN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:09.152985] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:09.222190] [INFO ] [MAIN ] WK: Loaded 17325 existing records. [2025-09-05T19:07:09.397731] [INFO ] [MAIN ] WK: Found 1 missing trading days. [2025-09-05T19:07:09.397950] [INFO ] [MAIN ] WK: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:09.398198] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-05T19:07:09.406862] [WARN ] [VALIDATOR ] WINN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:09.407210] [INFO ] [MAIN ] WINN: Combined data validation passed. [2025-09-05T19:07:09.440351] [INFO ] [MAIN ] WINN: Update completed successfully. [2025-09-05T19:07:09.441209] [INFO ] [MAIN ] Update Progress: 2289/2363 symbols completed. WINN took 2.7s. Estimated remaining: 2m 10s. Rate: 34.1 symbols/min [2025-09-05T19:07:09.611600] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:09.629636] [INFO ] [MAIN ] WKC: Loaded 16149 existing records. [2025-09-05T19:07:09.748498] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T19:07:09.835374] [INFO ] [MAIN ] WKC: Found 1 missing trading days. [2025-09-05T19:07:09.852349] [INFO ] [MAIN ] WKC: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:09.864246] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-05T19:07:09.858748] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-05T19:07:09.930114] [INFO ] [MAIN ] WIW: Adding 115 new records, updating 0 existing records. [2025-09-05T19:07:10.012462] [INFO ] [MAIN ] WIW: Combined dataset has 10034 total records. [2025-09-05T19:07:10.093318] [INFO ] [MAIN ] WIT: Adding 388 new records, updating 0 existing records. [2025-09-05T19:07:10.189934] [INFO ] [MAIN ] WIT: Combined dataset has 25494 total records. [2025-09-05T19:07:10.321791] [WARN ] [VALIDATOR ] WIW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:10.533749] [WARN ] [VALIDATOR ] WIT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:10.805779] [WARN ] [VALIDATOR ] WIT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:10.805851] [WARN ] [VALIDATOR ] WIW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:10.806050] [INFO ] [MAIN ] WIT: Combined data validation passed. [2025-09-05T19:07:10.806173] [INFO ] [MAIN ] WIW: Combined data validation passed. [2025-09-05T19:07:10.970358] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-05T19:07:11.000629] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-05T19:07:11.015295] [INFO ] [MAIN ] WIW: Update completed successfully. [2025-09-05T19:07:11.074959] [INFO ] [MAIN ] Update Progress: 2290/2363 symbols completed. WIW took 3.1s. Estimated remaining: 2m 8s. Rate: 34.1 symbols/min [2025-09-05T19:07:11.230196] [INFO ] [MAIN ] WKC: Adding 320 new records, updating 0 existing records. [2025-09-05T19:07:11.290361] [INFO ] [MAIN ] WK: Adding 278 new records, updating 0 existing records. [2025-09-05T19:07:11.405061] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:11.405160] [INFO ] [MAIN ] WK: Combined dataset has 17603 total records. [2025-09-05T19:07:11.428326] [INFO ] [MAIN ] WKC: Combined dataset has 16469 total records. [2025-09-05T19:07:11.628196] [INFO ] [MAIN ] WIT: Update completed successfully. [2025-09-05T19:07:11.655737] [INFO ] [MAIN ] Update Progress: 2291/2363 symbols completed. WIT took 4.0s. Estimated remaining: 2m 7s. Rate: 34.1 symbols/min [2025-09-05T19:07:11.730153] [INFO ] [MAIN ] WLK: Loaded 22336 existing records. [2025-09-05T19:07:11.788794] [WARN ] [VALIDATOR ] WK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:11.983487] [WARN ] [VALIDATOR ] WKC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:12.340841] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:12.506345] [INFO ] [MAIN ] WLK: Found 1 missing trading days. [2025-09-05T19:07:12.574924] [INFO ] [MAIN ] WLK: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:12.609796] [INFO ] [MAIN ] WLKP: Loaded 3219 existing records. [2025-09-05T19:07:12.610321] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-05T19:07:12.803724] [INFO ] [MAIN ] WLKP: Found 1 missing trading days. [2025-09-05T19:07:12.804686] [INFO ] [MAIN ] WLKP: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:12.805692] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-05T19:07:12.814938] [WARN ] [VALIDATOR ] WKC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:12.814994] [WARN ] [VALIDATOR ] WK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:12.815204] [INFO ] [MAIN ] WKC: Combined data validation passed. [2025-09-05T19:07:12.815376] [INFO ] [MAIN ] WK: Combined data validation passed. [2025-09-05T19:07:13.014854] [INFO ] [MAIN ] WK: Update completed successfully. [2025-09-05T19:07:13.021265] [INFO ] [MAIN ] Update Progress: 2292/2363 symbols completed. WK took 4.2s. Estimated remaining: 2m 5s. Rate: 34.1 symbols/min [2025-09-05T19:07:13.021365] [INFO ] [MAIN ] WKC: Update completed successfully. [2025-09-05T19:07:13.023986] [INFO ] [MAIN ] Update Progress: 2293/2363 symbols completed. WKC took 3.6s. Estimated remaining: 2m 3s. Rate: 34.1 symbols/min [2025-09-05T19:07:13.349495] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:13.365836] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:13.366028] [WARN ] [MAIN ] WLY: No existing data found, performing full refresh instead. [2025-09-05T19:07:13.366339] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-05T19:07:13.366613] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-05T19:07:13.366751] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-05T19:07:13.368188] [INFO ] [MAIN ] WLTG: Loaded 620 existing records. [2025-09-05T19:07:13.733309] [INFO ] [MAIN ] WLTG: Found 1 missing trading days. [2025-09-05T19:07:13.733446] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-05T19:07:13.765334] [INFO ] [MAIN ] WLTG: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:13.828879] [INFO ] [MAIN ] WLKP: Adding 46 new records, updating 0 existing records. [2025-09-05T19:07:13.845307] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-05T19:07:13.906388] [INFO ] [MAIN ] WLKP: Combined dataset has 3265 total records. [2025-09-05T19:07:13.934116] [INFO ] [REMOTE ] WLY: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:07:13.934743] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-05T19:07:14.121964] [WARN ] [VALIDATOR ] WLKP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:14.305673] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-05T19:07:14.295196] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-05T19:07:14.324187] [INFO ] [MAIN ] WLTG: Adding 9 new records, updating 0 existing records. [2025-09-05T19:07:14.349212] [INFO ] [MAIN ] WLTG: Combined dataset has 629 total records. [2025-09-05T19:07:14.571240] [INFO ] [MAIN ] WLK: Adding 340 new records, updating 0 existing records. [2025-09-05T19:07:14.629691] [WARN ] [VALIDATOR ] WLTG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:14.730986] [INFO ] [MAIN ] WLK: Combined dataset has 22676 total records. [2025-09-05T19:07:15.001510] [WARN ] [VALIDATOR ] WLK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:15.203584] [WARN ] [VALIDATOR ] WLKP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:15.207040] [INFO ] [MAIN ] WLKP: Combined data validation passed. [2025-09-05T19:07:15.232087] [WARN ] [VALIDATOR ] WLTG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:15.234826] [INFO ] [MAIN ] WLTG: Combined data validation passed. [2025-09-05T19:07:15.224816] [WARN ] [VALIDATOR ] WLK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:15.239018] [INFO ] [MAIN ] WLKP: Update completed successfully. [2025-09-05T19:07:15.238632] [INFO ] [MAIN ] WLK: Combined data validation passed. [2025-09-05T19:07:15.241746] [INFO ] [MAIN ] Update Progress: 2294/2363 symbols completed. WLKP took 3.6s. Estimated remaining: 2m 1s. Rate: 34.1 symbols/min [2025-09-05T19:07:15.249502] [INFO ] [MAIN ] WLTG: Update completed successfully. [2025-09-05T19:07:15.249952] [INFO ] [MAIN ] Update Progress: 2295/2363 symbols completed. WLTG took 2.2s. Estimated remaining: 1m 59s. Rate: 34.2 symbols/min [2025-09-05T19:07:15.707950] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:15.773588] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:15.786159] [INFO ] [MAIN ] WLK: Update completed successfully. [2025-09-05T19:07:15.799274] [INFO ] [MAIN ] Update Progress: 2296/2363 symbols completed. WLK took 4.7s. Estimated remaining: 1m 58s. Rate: 34.2 symbols/min [2025-09-05T19:07:15.823703] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-05T19:07:15.856066] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-05T19:07:15.939114] [INFO ] [MAIN ] WM: Loaded 24212 existing records. [2025-09-05T19:07:15.980562] [INFO ] [MAIN ] WMB: Loaded 25599 existing records. [2025-09-05T19:07:16.085132] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:16.313465] [INFO ] [MAIN ] WM: Found 1 missing trading days. [2025-09-05T19:07:16.317599] [INFO ] [MAIN ] WM: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:16.328218] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-05T19:07:16.335333] [INFO ] [MAIN ] WMK: Loaded 6228 existing records. [2025-09-05T19:07:16.477333] [INFO ] [MAIN ] WMB: Found 1 missing trading days. [2025-09-05T19:07:16.497881] [INFO ] [MAIN ] WMB: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:16.498262] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-05T19:07:16.620439] [INFO ] [MAIN ] WMK: Found 1 missing trading days. [2025-09-05T19:07:16.620705] [INFO ] [MAIN ] WMK: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:16.620948] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-05T19:07:17.204868] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-05T19:07:17.212393] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-05T19:07:17.411867] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-05T19:07:17.445416] [INFO ] [MAIN ] WMK: Adding 83 new records, updating 0 existing records. [2025-09-05T19:07:17.447100] [INFO ] [MAIN ] WMK: Combined dataset has 6311 total records. [2025-09-05T19:07:17.621908] [WARN ] [VALIDATOR ] WMK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:17.825818] [WARN ] [VALIDATOR ] WMK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:17.826045] [INFO ] [MAIN ] WMK: Combined data validation passed. [2025-09-05T19:07:17.867947] [INFO ] [MAIN ] WMK: Update completed successfully. [2025-09-05T19:07:17.868866] [INFO ] [MAIN ] Update Progress: 2297/2363 symbols completed. WMK took 2.1s. Estimated remaining: 1m 56s. Rate: 34.2 symbols/min [2025-09-05T19:07:18.021189] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T19:07:18.052583] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:18.085054] [WARN ] [MAIN ] WMS: No existing data found, performing full refresh instead. [2025-09-05T19:07:18.085283] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-05T19:07:18.085330] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-05T19:07:18.085379] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-05T19:07:18.431006] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-05T19:07:18.477692] [INFO ] [MAIN ] WMB: Adding 390 new records, updating 0 existing records. [2025-09-05T19:07:18.753128] [INFO ] [REMOTE ] WMS: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:07:18.778768] [INFO ] [MAIN ] WM: Adding 380 new records, updating 0 existing records. [2025-09-05T19:07:18.758631] [INFO ] [MAIN ] WMB: Combined dataset has 25989 total records. [2025-09-05T19:07:18.780336] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-05T19:07:18.884187] [INFO ] [MAIN ] WM: Combined dataset has 24592 total records. [2025-09-05T19:07:19.065787] [WARN ] [VALIDATOR ] WMB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:19.134899] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-05T19:07:19.202605] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-05T19:07:19.286290] [WARN ] [VALIDATOR ] WM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:19.604609] [WARN ] [VALIDATOR ] WM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:19.605033] [INFO ] [MAIN ] WM: Combined data validation passed. [2025-09-05T19:07:19.604895] [WARN ] [VALIDATOR ] WMB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:19.605820] [INFO ] [MAIN ] WMB: Combined data validation passed. [2025-09-05T19:07:19.912858] [INFO ] [MAIN ] WM: Update completed successfully. [2025-09-05T19:07:19.920070] [INFO ] [MAIN ] WMB: Update completed successfully. [2025-09-05T19:07:19.919985] [INFO ] [MAIN ] Update Progress: 2298/2363 symbols completed. WM took 4.7s. Estimated remaining: 1m 54s. Rate: 34.2 symbols/min [2025-09-05T19:07:19.923374] [INFO ] [MAIN ] Update Progress: 2299/2363 symbols completed. WMB took 4.6s. Estimated remaining: 1m 52s. Rate: 34.2 symbols/min [2025-09-05T19:07:20.239027] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:20.284019] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:20.310691] [INFO ] [MAIN ] WNC: Loaded 18224 existing records. [2025-09-05T19:07:20.450050] [INFO ] [MAIN ] WMT: Loaded 25720 existing records. [2025-09-05T19:07:20.453461] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-05T19:07:20.466781] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-05T19:07:20.643535] [INFO ] [MAIN ] WNC: Found 1 missing trading days. [2025-09-05T19:07:20.646023] [INFO ] [MAIN ] WNC: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:20.646269] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-05T19:07:20.726794] [INFO ] [MAIN ] WMT: Found 1 missing trading days. [2025-09-05T19:07:20.727097] [INFO ] [MAIN ] WMT: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:20.727370] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-05T19:07:20.792399] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-05T19:07:20.799393] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-05T19:07:21.807257] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-05T19:07:21.818484] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-05T19:07:22.105480] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-05T19:07:22.208168] [INFO ] [MAIN ] WNC: Adding 262 new records, updating 0 existing records. [2025-09-05T19:07:22.227480] [INFO ] [MAIN ] WNC: Combined dataset has 18486 total records. [2025-09-05T19:07:22.231686] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-05T19:07:22.346723] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-05T19:07:22.452980] [WARN ] [VALIDATOR ] WNC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:22.662696] [WARN ] [VALIDATOR ] WNC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:22.662897] [INFO ] [MAIN ] WNC: Combined data validation passed. [2025-09-05T19:07:22.776579] [INFO ] [MAIN ] WNC: Update completed successfully. [2025-09-05T19:07:22.778357] [INFO ] [MAIN ] Update Progress: 2300/2363 symbols completed. WNC took 2.8s. Estimated remaining: 1m 51s. Rate: 34.2 symbols/min [2025-09-05T19:07:22.953256] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:22.972594] [INFO ] [MAIN ] WNS: Loaded 19909 existing records. [2025-09-05T19:07:23.156336] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-05T19:07:23.156426] [INFO ] [MAIN ] WNS: Found 1 missing trading days. [2025-09-05T19:07:23.159769] [INFO ] [MAIN ] WNS: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:23.169704] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-05T19:07:23.313754] [INFO ] [MAIN ] WMT: Adding 390 new records, updating 0 existing records. [2025-09-05T19:07:23.317493] [INFO ] [MAIN ] WMT: Combined dataset has 26110 total records. [2025-09-05T19:07:23.526929] [WARN ] [VALIDATOR ] WMT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:23.772152] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-05T19:07:23.791192] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-05T19:07:23.799537] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-05T19:07:23.801417] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-05T19:07:23.811506] [WARN ] [VALIDATOR ] WMT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:23.811720] [INFO ] [MAIN ] WMT: Combined data validation passed. [2025-09-05T19:07:23.982891] [INFO ] [MAIN ] WMT: Update completed successfully. [2025-09-05T19:07:23.985897] [INFO ] [MAIN ] Update Progress: 2301/2363 symbols completed. WMT took 4.1s. Estimated remaining: 1m 49s. Rate: 34.2 symbols/min [2025-09-05T19:07:24.152635] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:24.177768] [INFO ] [MAIN ] WOLF: Loaded 25528 existing records. [2025-09-05T19:07:24.351987] [INFO ] [MAIN ] WOLF: Found 1 missing trading days. [2025-09-05T19:07:24.352127] [INFO ] [MAIN ] WOLF: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:24.352328] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-05T19:07:24.701118] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T19:07:24.814544] [INFO ] [MAIN ] WNS: Adding 365 new records, updating 0 existing records. [2025-09-05T19:07:24.817697] [INFO ] [MAIN ] WNS: Combined dataset has 20274 total records. [2025-09-05T19:07:25.003346] [WARN ] [VALIDATOR ] WNS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:25.220160] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-05T19:07:25.229165] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-05T19:07:25.256237] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-05T19:07:25.264911] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-05T19:07:25.276101] [WARN ] [VALIDATOR ] WNS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:25.276307] [INFO ] [MAIN ] WNS: Combined data validation passed. [2025-09-05T19:07:25.407407] [INFO ] [MAIN ] WNS: Update completed successfully. [2025-09-05T19:07:25.410663] [INFO ] [MAIN ] Update Progress: 2302/2363 symbols completed. WNS took 2.6s. Estimated remaining: 1m 47s. Rate: 34.2 symbols/min [2025-09-05T19:07:25.590638] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:25.590828] [WARN ] [MAIN ] WOR: No existing data found, performing full refresh instead. [2025-09-05T19:07:25.591023] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-05T19:07:25.591075] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-05T19:07:25.591124] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-05T19:07:25.955688] [INFO ] [REMOTE ] WOR: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:07:25.956037] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-05T19:07:26.460021] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-05T19:07:26.603105] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-05T19:07:26.632384] [INFO ] [MAIN ] WOLF: Adding 373 new records, updating 0 existing records. [2025-09-05T19:07:26.636767] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-05T19:07:26.640494] [INFO ] [MAIN ] WOLF: Combined dataset has 25901 total records. [2025-09-05T19:07:26.823962] [WARN ] [VALIDATOR ] WOLF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:27.054369] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-05T19:07:27.065069] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-05T19:07:27.075559] [WARN ] [VALIDATOR ] WOLF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:27.075866] [INFO ] [MAIN ] WOLF: Combined data validation passed. [2025-09-05T19:07:27.188010] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-05T19:07:27.194879] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-05T19:07:27.261303] [INFO ] [MAIN ] WOLF: Update completed successfully. [2025-09-05T19:07:27.264541] [INFO ] [MAIN ] Update Progress: 2303/2363 symbols completed. WOLF took 3.3s. Estimated remaining: 1m 45s. Rate: 34.2 symbols/min [2025-09-05T19:07:27.430855] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:27.431034] [WARN ] [MAIN ] WOW: No existing data found, performing full refresh instead. [2025-09-05T19:07:27.431159] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-05T19:07:27.431198] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-05T19:07:27.431247] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-05T19:07:27.779546] [INFO ] [REMOTE ] WOW: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:07:27.779881] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-05T19:07:27.872756] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T19:07:27.875155] [INFO ] [REMOTE ] WLY: Full fetch complete (32897 records). [2025-09-05T19:07:28.242944] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-05T19:07:28.376303] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-05T19:07:28.387117] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-05T19:07:28.406601] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-05T19:07:28.413842] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-05T19:07:28.449912] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-05T19:07:28.450083] [INFO ] [MAIN ] Update Progress: 2304/2363 symbols completed. WLY took 15.4s. Estimated remaining: 1m 44s. Rate: 34.2 symbols/min [2025-09-05T19:07:28.617570] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:28.641097] [INFO ] [MAIN ] WPC: Loaded 22984 existing records. [2025-09-05T19:07:28.836196] [INFO ] [MAIN ] WPC: Found 1 missing trading days. [2025-09-05T19:07:28.838883] [INFO ] [MAIN ] WPC: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:28.839108] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-05T19:07:28.842660] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-05T19:07:28.848746] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-05T19:07:29.947347] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-05T19:07:29.954990] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-05T19:07:29.987422] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-05T19:07:29.996572] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-05T19:07:30.048604] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-05T19:07:30.054364] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-05T19:07:30.222006] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T19:07:30.360063] [INFO ] [MAIN ] WPC: Adding 363 new records, updating 0 existing records. [2025-09-05T19:07:30.363436] [INFO ] [MAIN ] WPC: Combined dataset has 23347 total records. [2025-09-05T19:07:30.539021] [WARN ] [VALIDATOR ] WPC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:30.732285] [WARN ] [VALIDATOR ] WPC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:30.732481] [INFO ] [MAIN ] WPC: Combined data validation passed. [2025-09-05T19:07:30.895831] [INFO ] [MAIN ] WPC: Update completed successfully. [2025-09-05T19:07:30.900427] [INFO ] [MAIN ] Update Progress: 2305/2363 symbols completed. WPC took 2.5s. Estimated remaining: 1m 42s. Rate: 34.2 symbols/min [2025-09-05T19:07:31.073127] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:31.099082] [INFO ] [MAIN ] WPM: Loaded 25009 existing records. [2025-09-05T19:07:31.278350] [INFO ] [MAIN ] WPM: Found 1 missing trading days. [2025-09-05T19:07:31.278839] [INFO ] [MAIN ] WPM: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:31.279348] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-05T19:07:31.323597] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-05T19:07:31.322384] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-05T19:07:31.330896] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-05T19:07:31.370179] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-05T19:07:31.863486] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-05T19:07:32.639275] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-05T19:07:32.663420] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-05T19:07:32.793296] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-05T19:07:33.006274] [INFO ] [MAIN ] WPM: Adding 383 new records, updating 0 existing records. [2025-09-05T19:07:33.011012] [INFO ] [MAIN ] WPM: Combined dataset has 25392 total records. [2025-09-05T19:07:33.193000] [WARN ] [VALIDATOR ] WPM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:33.318216] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-05T19:07:33.382719] [INFO ] [REMOTE ] WMS: Full fetch complete (42941 records). [2025-09-05T19:07:33.466457] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-05T19:07:33.811845] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-05T19:07:33.879320] [WARN ] [VALIDATOR ] WPM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:33.890262] [INFO ] [MAIN ] WPM: Combined data validation passed. [2025-09-05T19:07:34.078947] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-05T19:07:34.138833] [INFO ] [MAIN ] WPM: Update completed successfully. [2025-09-05T19:07:34.144189] [INFO ] [MAIN ] Update Progress: 2306/2363 symbols completed. WPM took 3.2s. Estimated remaining: 1m 40s. Rate: 34.2 symbols/min [2025-09-05T19:07:34.266632] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-05T19:07:34.379314] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:34.419119] [INFO ] [MAIN ] WPP: Loaded 17020 existing records. [2025-09-05T19:07:34.546882] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-05T19:07:34.557265] [INFO ] [MAIN ] Update Progress: 2307/2363 symbols completed. WMS took 16.7s. Estimated remaining: 1m 38s. Rate: 34.2 symbols/min [2025-09-05T19:07:34.629659] [INFO ] [MAIN ] WPP: Found 1 missing trading days. [2025-09-05T19:07:34.660553] [INFO ] [MAIN ] WPP: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:34.790025] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:34.807804] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-05T19:07:34.834047] [INFO ] [MAIN ] WRB: Loaded 24035 existing records. [2025-09-05T19:07:35.010773] [INFO ] [MAIN ] WRB: Found 1 missing trading days. [2025-09-05T19:07:35.010971] [INFO ] [MAIN ] WRB: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:35.063423] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-05T19:07:35.461061] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-05T19:07:35.863544] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-05T19:07:36.516602] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-05T19:07:36.666621] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-05T19:07:36.666513] [INFO ] [MAIN ] WRB: Adding 355 new records, updating 0 existing records. [2025-09-05T19:07:36.671455] [INFO ] [MAIN ] WRB: Combined dataset has 24390 total records. [2025-09-05T19:07:36.852600] [WARN ] [VALIDATOR ] WRB: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:37.065240] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-05T19:07:37.082100] [WARN ] [VALIDATOR ] WRB: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:37.082355] [INFO ] [MAIN ] WRB: Combined data validation passed. [2025-09-05T19:07:37.237294] [INFO ] [MAIN ] WRB: Update completed successfully. [2025-09-05T19:07:37.240069] [INFO ] [MAIN ] Update Progress: 2308/2363 symbols completed. WRB took 2.7s. Estimated remaining: 1m 37s. Rate: 34.2 symbols/min [2025-09-05T19:07:37.418406] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:37.441873] [INFO ] [MAIN ] WRBY: Loaded 23843 existing records. [2025-09-05T19:07:37.472234] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-05T19:07:37.623039] [INFO ] [MAIN ] WRBY: Found 1 missing trading days. [2025-09-05T19:07:37.623177] [INFO ] [MAIN ] WRBY: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:37.992583] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-05T19:07:38.263444] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-05T19:07:38.647294] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-05T19:07:38.744779] [INFO ] [MAIN ] WPP: Adding 233 new records, updating 0 existing records. [2025-09-05T19:07:38.747614] [INFO ] [MAIN ] WPP: Combined dataset has 17253 total records. [2025-09-05T19:07:38.925604] [WARN ] [VALIDATOR ] WPP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:39.068592] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-05T19:07:39.120459] [WARN ] [VALIDATOR ] WPP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:39.120678] [INFO ] [MAIN ] WPP: Combined data validation passed. [2025-09-05T19:07:39.229303] [INFO ] [MAIN ] WPP: Update completed successfully. [2025-09-05T19:07:39.231350] [INFO ] [MAIN ] Update Progress: 2309/2363 symbols completed. WPP took 5.1s. Estimated remaining: 1m 35s. Rate: 34.2 symbols/min [2025-09-05T19:07:39.405291] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:39.423100] [INFO ] [MAIN ] WS: Loaded 17401 existing records. [2025-09-05T19:07:39.604424] [INFO ] [MAIN ] WS: Found 1 missing trading days. [2025-09-05T19:07:39.604620] [INFO ] [MAIN ] WS: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:39.757458] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-05T19:07:39.863521] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-05T19:07:40.338061] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-05T19:07:40.663503] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-05T19:07:40.868072] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-05T19:07:40.933240] [INFO ] [MAIN ] WS: Adding 163 new records, updating 0 existing records. [2025-09-05T19:07:40.936559] [INFO ] [MAIN ] WS: Combined dataset has 17564 total records. [2025-09-05T19:07:41.119088] [WARN ] [VALIDATOR ] WS: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:07:41.322480] [WARN ] [VALIDATOR ] WS: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:07:41.322918] [INFO ] [MAIN ] WS: Combined data validation passed. [2025-09-05T19:07:41.442128] [INFO ] [MAIN ] WS: Update completed successfully. [2025-09-05T19:07:41.445276] [INFO ] [MAIN ] Update Progress: 2310/2363 symbols completed. WS took 2.2s. Estimated remaining: 1m 33s. Rate: 34.2 symbols/min [2025-09-05T19:07:41.468608] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-05T19:07:41.628430] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:41.657163] [INFO ] [MAIN ] WSM: Loaded 23655 existing records. [2025-09-05T19:07:41.851930] [INFO ] [MAIN ] WSM: Found 1 missing trading days. [2025-09-05T19:07:41.852183] [INFO ] [MAIN ] WSM: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:42.141489] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-05T19:07:42.143948] [INFO ] [REMOTE ] WOW: Full fetch complete (31307 records). [2025-09-05T19:07:42.268688] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-05T19:07:42.534573] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-05T19:07:42.672462] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-05T19:07:42.672600] [INFO ] [MAIN ] Update Progress: 2311/2363 symbols completed. WOW took 15.4s. Estimated remaining: 1m 31s. Rate: 34.2 symbols/min [2025-09-05T19:07:42.850066] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:42.868680] [INFO ] [MAIN ] WSO: Loaded 18322 existing records. [2025-09-05T19:07:43.052665] [INFO ] [MAIN ] WSO: Found 1 missing trading days. [2025-09-05T19:07:43.052823] [INFO ] [MAIN ] WSO: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:43.063486] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-05T19:07:43.178871] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-05T19:07:43.347474] [INFO ] [MAIN ] WRBY: Adding 326 new records, updating 0 existing records. [2025-09-05T19:07:43.351985] [INFO ] [MAIN ] WRBY: Combined dataset has 24169 total records. [2025-09-05T19:07:43.623600] [WARN ] [VALIDATOR ] WRBY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:43.868534] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-05T19:07:43.929695] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-05T19:07:44.033115] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-05T19:07:44.064436] [INFO ] [MAIN ] WSO: Adding 198 new records, updating 0 existing records. [2025-09-05T19:07:44.171293] [INFO ] [MAIN ] WSO: Combined dataset has 18520 total records. [2025-09-05T19:07:44.273316] [INFO ] [MAIN ] WSM: Adding 337 new records, updating 0 existing records. [2025-09-05T19:07:44.429422] [INFO ] [MAIN ] WSM: Combined dataset has 23992 total records. [2025-09-05T19:07:44.459545] [WARN ] [VALIDATOR ] WSO: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:07:44.679692] [WARN ] [VALIDATOR ] WRBY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:44.683457] [INFO ] [MAIN ] WRBY: Combined data validation passed. [2025-09-05T19:07:44.901822] [WARN ] [VALIDATOR ] WSM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:45.136764] [INFO ] [MAIN ] WRBY: Update completed successfully. [2025-09-05T19:07:45.144689] [INFO ] [MAIN ] Update Progress: 2312/2363 symbols completed. WRBY took 7.9s. Estimated remaining: 1m 30s. Rate: 34.2 symbols/min [2025-09-05T19:07:45.311876] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-05T19:07:45.353840] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-05T19:07:45.400402] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:45.418030] [INFO ] [MAIN ] WSR: Loaded 10443 existing records. [2025-09-05T19:07:45.605608] [INFO ] [MAIN ] WSR: Found 1 missing trading days. [2025-09-05T19:07:45.607765] [INFO ] [MAIN ] WSR: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:45.608541] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-05T19:07:45.612506] [WARN ] [VALIDATOR ] WSM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:45.612826] [INFO ] [MAIN ] WSM: Combined data validation passed. [2025-09-05T19:07:45.612581] [WARN ] [VALIDATOR ] WSO: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:07:45.613374] [INFO ] [MAIN ] WSO: Combined data validation passed. [2025-09-05T19:07:45.891951] [INFO ] [MAIN ] WSM: Update completed successfully. [2025-09-05T19:07:45.894666] [INFO ] [MAIN ] Update Progress: 2313/2363 symbols completed. WSM took 4.4s. Estimated remaining: 1m 28s. Rate: 34.2 symbols/min [2025-09-05T19:07:45.894895] [INFO ] [MAIN ] WSO: Update completed successfully. [2025-09-05T19:07:45.942611] [INFO ] [MAIN ] Update Progress: 2314/2363 symbols completed. WSO took 3.3s. Estimated remaining: 1m 26s. Rate: 34.2 symbols/min [2025-09-05T19:07:46.232483] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:46.265403] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:46.270281] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-05T19:07:46.272238] [INFO ] [REMOTE ] WOR: Full fetch complete (27348 records). [2025-09-05T19:07:46.484523] [INFO ] [MAIN ] WST: Loaded 17049 existing records. [2025-09-05T19:07:46.624315] [INFO ] [MAIN ] WT: Loaded 23466 existing records. [2025-09-05T19:07:46.834742] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-05T19:07:47.027134] [INFO ] [MAIN ] WST: Found 1 missing trading days. [2025-09-05T19:07:47.042970] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-05T19:07:47.042812] [INFO ] [MAIN ] WST: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:47.069626] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-05T19:07:47.097981] [INFO ] [MAIN ] WSR: Adding 195 new records, updating 0 existing records. [2025-09-05T19:07:47.171391] [INFO ] [MAIN ] WT: Found 1 missing trading days. [2025-09-05T19:07:47.171990] [INFO ] [MAIN ] WT: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:47.172428] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-05T19:07:47.173981] [INFO ] [MAIN ] WSR: Combined dataset has 10638 total records. [2025-09-05T19:07:47.442252] [WARN ] [VALIDATOR ] WSR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:47.646126] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-05T19:07:47.646448] [INFO ] [MAIN ] Update Progress: 2315/2363 symbols completed. WOR took 22.2s. Estimated remaining: 1m 24s. Rate: 34.2 symbols/min [2025-09-05T19:07:47.818279] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:47.833463] [WARN ] [VALIDATOR ] WSR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:47.840334] [INFO ] [MAIN ] WSR: Combined data validation passed. [2025-09-05T19:07:47.841194] [INFO ] [MAIN ] WTI: Loaded 21093 existing records. [2025-09-05T19:07:48.091942] [INFO ] [MAIN ] WTI: Found 1 missing trading days. [2025-09-05T19:07:48.095034] [INFO ] [MAIN ] WTI: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:48.104339] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-05T19:07:48.110625] [INFO ] [MAIN ] WSR: Update completed successfully. [2025-09-05T19:07:48.111972] [INFO ] [MAIN ] Update Progress: 2316/2363 symbols completed. WSR took 3.0s. Estimated remaining: 1m 22s. Rate: 34.2 symbols/min [2025-09-05T19:07:48.293187] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:48.296002] [INFO ] [MAIN ] WTM: Loaded 894 existing records. [2025-09-05T19:07:48.416727] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:07:48.524537] [INFO ] [MAIN ] WTM: Found 1 missing trading days. [2025-09-05T19:07:48.545322] [INFO ] [MAIN ] WTM: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:48.589532] [INFO ] [MAIN ] WST: Adding 181 new records, updating 0 existing records. [2025-09-05T19:07:48.592782] [INFO ] [MAIN ] WST: Combined dataset has 17230 total records. [2025-09-05T19:07:48.671513] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-05T19:07:48.782004] [WARN ] [VALIDATOR ] WST: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:48.905182] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-05T19:07:49.138453] [INFO ] [MAIN ] WT: Adding 383 new records, updating 0 existing records. [2025-09-05T19:07:49.145852] [INFO ] [MAIN ] WT: Combined dataset has 23849 total records. [2025-09-05T19:07:49.329190] [WARN ] [VALIDATOR ] WST: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:49.352412] [INFO ] [MAIN ] WST: Combined data validation passed. [2025-09-05T19:07:49.352241] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T19:07:49.356673] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-05T19:07:49.434429] [INFO ] [MAIN ] WTM: Adding 6 new records, updating 0 existing records. [2025-09-05T19:07:49.472364] [WARN ] [VALIDATOR ] WT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:49.645899] [INFO ] [MAIN ] WTM: Combined dataset has 900 total records. [2025-09-05T19:07:49.666426] [INFO ] [MAIN ] WTI: Adding 307 new records, updating 0 existing records. [2025-09-05T19:07:49.867421] [INFO ] [MAIN ] WTI: Combined dataset has 21400 total records. [2025-09-05T19:07:50.033547] [WARN ] [VALIDATOR ] WTM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:50.331278] [WARN ] [VALIDATOR ] WTI: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:50.367220] [INFO ] [MAIN ] WST: Update completed successfully. [2025-09-05T19:07:50.449588] [INFO ] [MAIN ] Update Progress: 2317/2363 symbols completed. WST took 4.6s. Estimated remaining: 1m 21s. Rate: 34.2 symbols/min [2025-09-05T19:07:50.637216] [WARN ] [VALIDATOR ] WT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:50.637588] [INFO ] [MAIN ] WT: Combined data validation passed. [2025-09-05T19:07:50.637132] [WARN ] [VALIDATOR ] WTI: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:50.637807] [INFO ] [MAIN ] WTI: Combined data validation passed. [2025-09-05T19:07:50.637272] [WARN ] [VALIDATOR ] WTM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:50.638703] [INFO ] [MAIN ] WTM: Combined data validation passed. [2025-09-05T19:07:50.647681] [INFO ] [MAIN ] WTM: Update completed successfully. [2025-09-05T19:07:50.647995] [INFO ] [MAIN ] Update Progress: 2318/2363 symbols completed. WTM took 2.5s. Estimated remaining: 1m 19s. Rate: 34.2 symbols/min [2025-09-05T19:07:50.901827] [INFO ] [MAIN ] WT: Update completed successfully. [2025-09-05T19:07:50.915985] [INFO ] [MAIN ] Update Progress: 2319/2363 symbols completed. WT took 4.9s. Estimated remaining: 1m 17s. Rate: 34.2 symbols/min [2025-09-05T19:07:50.935016] [INFO ] [MAIN ] WTI: Update completed successfully. [2025-09-05T19:07:50.937876] [INFO ] [MAIN ] Update Progress: 2320/2363 symbols completed. WTI took 3.3s. Estimated remaining: 1m 15s. Rate: 34.2 symbols/min [2025-09-05T19:07:51.493906] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:51.599874] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:51.640473] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:51.644270] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:51.663756] [INFO ] [MAIN ] WTS: Loaded 8561 existing records. [2025-09-05T19:07:51.823122] [INFO ] [MAIN ] WTTR: Loaded 20562 existing records. [2025-09-05T19:07:51.821780] [INFO ] [MAIN ] WU: Loaded 25516 existing records. [2025-09-05T19:07:51.873116] [INFO ] [MAIN ] WTRG: Loaded 24488 existing records. [2025-09-05T19:07:52.034549] [INFO ] [MAIN ] WTS: Found 1 missing trading days. [2025-09-05T19:07:52.085157] [INFO ] [MAIN ] WTS: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:52.188212] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-05T19:07:52.440975] [INFO ] [MAIN ] WTTR: Found 1 missing trading days. [2025-09-05T19:07:52.535733] [INFO ] [MAIN ] WTTR: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:52.537731] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-05T19:07:52.537170] [INFO ] [MAIN ] WTRG: Found 1 missing trading days. [2025-09-05T19:07:52.554813] [INFO ] [MAIN ] WU: Found 1 missing trading days. [2025-09-05T19:07:52.555984] [INFO ] [MAIN ] WTRG: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:52.556453] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-05T19:07:52.556106] [INFO ] [MAIN ] WU: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:52.558288] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-05T19:07:53.353977] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T19:07:53.399134] [INFO ] [MAIN ] WTS: Adding 136 new records, updating 0 existing records. [2025-09-05T19:07:53.401074] [INFO ] [MAIN ] WTS: Combined dataset has 8697 total records. [2025-09-05T19:07:53.585841] [WARN ] [VALIDATOR ] WTS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:53.792446] [WARN ] [VALIDATOR ] WTS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:53.792747] [INFO ] [MAIN ] WTS: Combined data validation passed. [2025-09-05T19:07:53.851040] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-05T19:07:53.963248] [INFO ] [MAIN ] WTS: Update completed successfully. [2025-09-05T19:07:53.990716] [INFO ] [MAIN ] Update Progress: 2321/2363 symbols completed. WTS took 3.1s. Estimated remaining: 1m 14s. Rate: 34.2 symbols/min [2025-09-05T19:07:54.007043] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T19:07:54.026975] [INFO ] [MAIN ] WTRG: Adding 375 new records, updating 0 existing records. [2025-09-05T19:07:54.343374] [INFO ] [MAIN ] WTTR: Adding 333 new records, updating 0 existing records. [2025-09-05T19:07:54.364370] [INFO ] [MAIN ] WTRG: Combined dataset has 24863 total records. [2025-09-05T19:07:54.366535] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:54.459765] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-05T19:07:54.530032] [INFO ] [MAIN ] WTTR: Combined dataset has 20895 total records. [2025-09-05T19:07:54.641443] [WARN ] [VALIDATOR ] WTRG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:54.658149] [INFO ] [MAIN ] WWW: Loaded 23382 existing records. [2025-09-05T19:07:55.086009] [INFO ] [MAIN ] WU: Adding 389 new records, updating 0 existing records. [2025-09-05T19:07:55.229466] [WARN ] [VALIDATOR ] WTTR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:55.375397] [INFO ] [MAIN ] WWW: Found 1 missing trading days. [2025-09-05T19:07:55.375633] [INFO ] [MAIN ] WWW: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:55.415135] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-05T19:07:55.443200] [INFO ] [MAIN ] WU: Combined dataset has 25905 total records. [2025-09-05T19:07:55.728518] [WARN ] [VALIDATOR ] WU: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:55.940330] [WARN ] [VALIDATOR ] WTTR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:55.940410] [WARN ] [VALIDATOR ] WTRG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:55.941010] [INFO ] [MAIN ] WTTR: Combined data validation passed. [2025-09-05T19:07:55.941582] [INFO ] [MAIN ] WTRG: Combined data validation passed. [2025-09-05T19:07:56.214603] [WARN ] [VALIDATOR ] WU: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:56.216855] [INFO ] [MAIN ] WU: Combined data validation passed. [2025-09-05T19:07:56.317855] [INFO ] [MAIN ] WTRG: Update completed successfully. [2025-09-05T19:07:56.322889] [INFO ] [MAIN ] Update Progress: 2322/2363 symbols completed. WTRG took 5.4s. Estimated remaining: 1m 12s. Rate: 34.2 symbols/min [2025-09-05T19:07:56.450425] [INFO ] [MAIN ] WTTR: Update completed successfully. [2025-09-05T19:07:56.463852] [INFO ] [MAIN ] Update Progress: 2323/2363 symbols completed. WTTR took 5.5s. Estimated remaining: 1m 10s. Rate: 34.2 symbols/min [2025-09-05T19:07:56.585135] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:56.739942] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:56.762137] [INFO ] [MAIN ] WY: Loaded 25347 existing records. [2025-09-05T19:07:56.849013] [INFO ] [MAIN ] XFLT: Loaded 14471 existing records. [2025-09-05T19:07:57.111897] [INFO ] [MAIN ] WU: Update completed successfully. [2025-09-05T19:07:57.121986] [INFO ] [MAIN ] WY: Found 1 missing trading days. [2025-09-05T19:07:57.115017] [INFO ] [MAIN ] Update Progress: 2324/2363 symbols completed. WU took 6.2s. Estimated remaining: 1m 8s. Rate: 34.2 symbols/min [2025-09-05T19:07:57.132522] [INFO ] [MAIN ] WY: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:57.174562] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-05T19:07:57.224292] [INFO ] [MAIN ] XFLT: Found 1 missing trading days. [2025-09-05T19:07:57.236242] [INFO ] [MAIN ] XFLT: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:57.257684] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-05T19:07:57.310046] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-05T19:07:57.425979] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:57.519387] [INFO ] [MAIN ] WWW: Adding 372 new records, updating 0 existing records. [2025-09-05T19:07:57.522889] [INFO ] [MAIN ] WWW: Combined dataset has 23754 total records. [2025-09-05T19:07:57.722048] [WARN ] [VALIDATOR ] WWW: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:57.765810] [INFO ] [MAIN ] XHR: Loaded 33421 existing records. [2025-09-05T19:07:58.103613] [INFO ] [MAIN ] XHR: Found 1 missing trading days. [2025-09-05T19:07:58.103899] [INFO ] [MAIN ] XHR: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:58.104139] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-05T19:07:58.116717] [WARN ] [VALIDATOR ] WWW: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:07:58.116929] [INFO ] [MAIN ] WWW: Combined data validation passed. [2025-09-05T19:07:58.268969] [INFO ] [MAIN ] WWW: Update completed successfully. [2025-09-05T19:07:58.272194] [INFO ] [MAIN ] Update Progress: 2325/2363 symbols completed. WWW took 4.3s. Estimated remaining: 1m 7s. Rate: 34.2 symbols/min [2025-09-05T19:07:58.398177] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T19:07:58.502180] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:07:58.541415] [INFO ] [MAIN ] XFLT: Adding 146 new records, updating 0 existing records. [2025-09-05T19:07:58.544225] [INFO ] [MAIN ] XFLT: Combined dataset has 14617 total records. [2025-09-05T19:07:58.690035] [INFO ] [MAIN ] XIFR: Loaded 21057 existing records. [2025-09-05T19:07:58.735808] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-05T19:07:58.797436] [WARN ] [VALIDATOR ] XFLT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:59.230888] [INFO ] [MAIN ] XIFR: Found 1 missing trading days. [2025-09-05T19:07:59.283091] [INFO ] [MAIN ] XIFR: Need to fetch 1 months: 2025-09 [2025-09-05T19:07:59.288925] [INFO ] [MAIN ] WY: Adding 386 new records, updating 0 existing records. [2025-09-05T19:07:59.289417] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-05T19:07:59.296031] [INFO ] [MAIN ] WY: Combined dataset has 25733 total records. [2025-09-05T19:07:59.441476] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T19:07:59.495535] [WARN ] [VALIDATOR ] WY: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:07:59.792222] [INFO ] [MAIN ] XHR: Adding 310 new records, updating 0 existing records. [2025-09-05T19:07:59.840036] [INFO ] [MAIN ] XHR: Combined dataset has 33731 total records. [2025-09-05T19:08:00.036825] [WARN ] [VALIDATOR ] XHR: Not fatal, but first date in data (2025-04-07) does not match expected start date (2025-01-31) [2025-09-05T19:08:00.091100] [WARN ] [VALIDATOR ] XFLT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:00.114461] [INFO ] [MAIN ] XFLT: Combined data validation passed. [2025-09-05T19:08:00.114231] [WARN ] [VALIDATOR ] WY: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:00.137081] [INFO ] [MAIN ] WY: Combined data validation passed. [2025-09-05T19:08:00.354094] [INFO ] [MAIN ] XFLT: Update completed successfully. [2025-09-05T19:08:00.398077] [INFO ] [MAIN ] Update Progress: 2326/2363 symbols completed. XFLT took 3.9s. Estimated remaining: 1m 5s. Rate: 34.2 symbols/min [2025-09-05T19:08:00.633769] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:00.710743] [INFO ] [MAIN ] WY: Update completed successfully. [2025-09-05T19:08:00.714232] [INFO ] [MAIN ] Update Progress: 2327/2363 symbols completed. WY took 4.4s. Estimated remaining: 1m 3s. Rate: 34.2 symbols/min [2025-09-05T19:08:00.726224] [WARN ] [VALIDATOR ] XHR: Missing days changed. Total missing: 45 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04 [2025-09-05T19:08:00.770264] [INFO ] [MAIN ] XHR: Combined data validation passed. [2025-09-05T19:08:00.827537] [INFO ] [MAIN ] XOM: Loaded 25713 existing records. [2025-09-05T19:08:00.999106] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:01.145931] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-05T19:08:01.233963] [INFO ] [MAIN ] XOM: Found 1 missing trading days. [2025-09-05T19:08:01.235825] [INFO ] [MAIN ] XOM: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:01.260211] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-05T19:08:01.352157] [INFO ] [MAIN ] XPER: Loaded 13988 existing records. [2025-09-05T19:08:01.527936] [INFO ] [MAIN ] XIFR: Adding 336 new records, updating 0 existing records. [2025-09-05T19:08:01.642893] [INFO ] [MAIN ] XPER: Found 1 missing trading days. [2025-09-05T19:08:01.644820] [INFO ] [MAIN ] XPER: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:01.646547] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-05T19:08:01.653806] [INFO ] [MAIN ] XIFR: Combined dataset has 21393 total records. [2025-09-05T19:08:01.806407] [INFO ] [MAIN ] XHR: Update completed successfully. [2025-09-05T19:08:01.844488] [INFO ] [MAIN ] Update Progress: 2328/2363 symbols completed. XHR took 4.7s. Estimated remaining: 1m 1s. Rate: 34.3 symbols/min [2025-09-05T19:08:01.933830] [WARN ] [VALIDATOR ] XIFR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:02.262698] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:02.301727] [INFO ] [MAIN ] XPEV: Loaded 25594 existing records. [2025-09-05T19:08:02.333460] [WARN ] [VALIDATOR ] XIFR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:02.381324] [INFO ] [MAIN ] XIFR: Combined data validation passed. [2025-09-05T19:08:02.573091] [INFO ] [MAIN ] XPEV: Found 1 missing trading days. [2025-09-05T19:08:02.584959] [INFO ] [MAIN ] XPEV: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:02.585239] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-05T19:08:02.617348] [INFO ] [MAIN ] XIFR: Update completed successfully. [2025-09-05T19:08:02.621602] [INFO ] [MAIN ] Update Progress: 2329/2363 symbols completed. XIFR took 4.3s. Estimated remaining: 59.5s. Rate: 34.3 symbols/min [2025-09-05T19:08:02.795627] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:02.801115] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-05T19:08:02.947740] [INFO ] [MAIN ] XPER: Adding 218 new records, updating 0 existing records. [2025-09-05T19:08:02.955869] [INFO ] [MAIN ] XPO: Loaded 22391 existing records. [2025-09-05T19:08:03.068965] [INFO ] [MAIN ] XPER: Combined dataset has 14206 total records. [2025-09-05T19:08:03.207042] [INFO ] [MAIN ] XPO: Found 1 missing trading days. [2025-09-05T19:08:03.222996] [INFO ] [MAIN ] XPO: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:03.233328] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-05T19:08:03.319070] [WARN ] [VALIDATOR ] XPER: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:03.530297] [WARN ] [VALIDATOR ] XPER: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:03.530552] [INFO ] [MAIN ] XPER: Combined data validation passed. [2025-09-05T19:08:03.614369] [INFO ] [MAIN ] XPER: Update completed successfully. [2025-09-05T19:08:03.616361] [INFO ] [MAIN ] Update Progress: 2330/2363 symbols completed. XPER took 2.9s. Estimated remaining: 57.8s. Rate: 34.3 symbols/min [2025-09-05T19:08:03.785068] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:03.792542] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-05T19:08:03.918117] [INFO ] [MAIN ] XPOF: Loaded 18123 existing records. [2025-09-05T19:08:04.022350] [INFO ] [MAIN ] XOM: Adding 390 new records, updating 0 existing records. [2025-09-05T19:08:04.168341] [INFO ] [MAIN ] XOM: Combined dataset has 26103 total records. [2025-09-05T19:08:04.168251] [INFO ] [MAIN ] XPOF: Found 1 missing trading days. [2025-09-05T19:08:04.168619] [INFO ] [MAIN ] XPOF: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:04.168922] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-05T19:08:04.355949] [WARN ] [VALIDATOR ] XOM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:04.553093] [WARN ] [VALIDATOR ] XOM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:04.553299] [INFO ] [MAIN ] XOM: Combined data validation passed. [2025-09-05T19:08:04.742054] [INFO ] [MAIN ] XOM: Update completed successfully. [2025-09-05T19:08:04.746285] [INFO ] [MAIN ] Update Progress: 2331/2363 symbols completed. XOM took 4.3s. Estimated remaining: 56.0s. Rate: 34.3 symbols/min [2025-09-05T19:08:04.746843] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-05T19:08:04.819039] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T19:08:05.169134] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:05.225916] [INFO ] [MAIN ] XPO: Adding 331 new records, updating 0 existing records. [2025-09-05T19:08:05.229515] [INFO ] [MAIN ] XPEV: Adding 390 new records, updating 0 existing records. [2025-09-05T19:08:05.237531] [INFO ] [MAIN ] XPO: Combined dataset has 22722 total records. [2025-09-05T19:08:05.282566] [INFO ] [MAIN ] XPEV: Combined dataset has 25984 total records. [2025-09-05T19:08:05.512382] [INFO ] [MAIN ] XPRO: Loaded 21842 existing records. [2025-09-05T19:08:05.542464] [WARN ] [VALIDATOR ] XPO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:05.712360] [WARN ] [VALIDATOR ] XPEV: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:05.993036] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-05T19:08:06.199763] [INFO ] [MAIN ] XPRO: Found 1 missing trading days. [2025-09-05T19:08:06.252049] [INFO ] [MAIN ] XPRO: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:06.278412] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-05T19:08:06.320375] [INFO ] [MAIN ] XPOF: Adding 286 new records, updating 0 existing records. [2025-09-05T19:08:06.328403] [INFO ] [MAIN ] XPOF: Combined dataset has 18409 total records. [2025-09-05T19:08:06.518916] [WARN ] [VALIDATOR ] XPOF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:06.532048] [WARN ] [VALIDATOR ] XPEV: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:06.557677] [INFO ] [MAIN ] XPEV: Combined data validation passed. [2025-09-05T19:08:06.531937] [WARN ] [VALIDATOR ] XPO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:06.590801] [INFO ] [MAIN ] XPO: Combined data validation passed. [2025-09-05T19:08:07.006184] [INFO ] [MAIN ] XPO: Update completed successfully. [2025-09-05T19:08:07.011247] [INFO ] [MAIN ] Update Progress: 2332/2363 symbols completed. XPO took 4.4s. Estimated remaining: 54.3s. Rate: 34.3 symbols/min [2025-09-05T19:08:07.176754] [INFO ] [MAIN ] XPEV: Update completed successfully. [2025-09-05T19:08:07.187270] [INFO ] [MAIN ] Update Progress: 2333/2363 symbols completed. XPEV took 5.3s. Estimated remaining: 52.5s. Rate: 34.3 symbols/min [2025-09-05T19:08:07.230146] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:07.411524] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:07.413503] [INFO ] [MAIN ] XYF: Loaded 15744 existing records. [2025-09-05T19:08:07.613149] [INFO ] [MAIN ] XYF: Found 1 missing trading days. [2025-09-05T19:08:07.614009] [INFO ] [MAIN ] XYL: Loaded 21972 existing records. [2025-09-05T19:08:07.614865] [INFO ] [MAIN ] XYF: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:07.615226] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-05T19:08:07.795867] [INFO ] [MAIN ] XYL: Found 1 missing trading days. [2025-09-05T19:08:07.804101] [INFO ] [MAIN ] XYL: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:07.804574] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-05T19:08:07.808477] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-05T19:08:07.869684] [WARN ] [VALIDATOR ] XPOF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:07.890236] [INFO ] [MAIN ] XPOF: Combined data validation passed. [2025-09-05T19:08:07.940202] [INFO ] [MAIN ] XPRO: Adding 367 new records, updating 0 existing records. [2025-09-05T19:08:08.037820] [INFO ] [MAIN ] XPRO: Combined dataset has 22209 total records. [2025-09-05T19:08:08.081993] [INFO ] [MAIN ] XPOF: Update completed successfully. [2025-09-05T19:08:08.115528] [INFO ] [MAIN ] Update Progress: 2334/2363 symbols completed. XPOF took 4.5s. Estimated remaining: 50.7s. Rate: 34.3 symbols/min [2025-09-05T19:08:08.412042] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:08.394306] [WARN ] [VALIDATOR ] XPRO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:08.623907] [INFO ] [MAIN ] XYZ: Loaded 25676 existing records. [2025-09-05T19:08:08.805690] [INFO ] [MAIN ] XYZ: Found 1 missing trading days. [2025-09-05T19:08:08.805913] [INFO ] [MAIN ] XYZ: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:08.806271] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-05T19:08:08.819141] [WARN ] [VALIDATOR ] XPRO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:08.819372] [INFO ] [MAIN ] XPRO: Combined data validation passed. [2025-09-05T19:08:08.956780] [INFO ] [MAIN ] XPRO: Update completed successfully. [2025-09-05T19:08:08.960331] [INFO ] [MAIN ] Update Progress: 2335/2363 symbols completed. XPRO took 4.2s. Estimated remaining: 49.0s. Rate: 34.3 symbols/min [2025-09-05T19:08:08.957555] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-05T19:08:09.201016] [INFO ] [MAIN ] XYF: Adding 249 new records, updating 0 existing records. [2025-09-05T19:08:09.220502] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:09.227712] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-05T19:08:09.267524] [INFO ] [MAIN ] XYF: Combined dataset has 15993 total records. [2025-09-05T19:08:09.453901] [INFO ] [MAIN ] XYL: Adding 355 new records, updating 0 existing records. [2025-09-05T19:08:09.436964] [INFO ] [MAIN ] YALA: Loaded 17265 existing records. [2025-09-05T19:08:09.634935] [INFO ] [MAIN ] XYL: Combined dataset has 22327 total records. [2025-09-05T19:08:09.740343] [INFO ] [MAIN ] YALA: Found 1 missing trading days. [2025-09-05T19:08:09.745636] [WARN ] [VALIDATOR ] XYF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:09.766814] [INFO ] [MAIN ] YALA: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:09.793813] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-05T19:08:10.110899] [WARN ] [VALIDATOR ] XYL: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:10.326660] [WARN ] [VALIDATOR ] XYF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:10.326730] [WARN ] [VALIDATOR ] XYL: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:10.326930] [INFO ] [MAIN ] XYF: Combined data validation passed. [2025-09-05T19:08:10.327224] [INFO ] [MAIN ] XYL: Combined data validation passed. [2025-09-05T19:08:10.539456] [INFO ] [MAIN ] XYF: Update completed successfully. [2025-09-05T19:08:10.542002] [INFO ] [MAIN ] Update Progress: 2336/2363 symbols completed. XYF took 3.5s. Estimated remaining: 47.2s. Rate: 34.3 symbols/min [2025-09-05T19:08:10.720328] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:10.742417] [INFO ] [MAIN ] XYL: Update completed successfully. [2025-09-05T19:08:10.745202] [INFO ] [MAIN ] Update Progress: 2337/2363 symbols completed. XYL took 3.5s. Estimated remaining: 45.5s. Rate: 34.3 symbols/min [2025-09-05T19:08:10.937535] [INFO ] [MAIN ] YELP: Loaded 21736 existing records. [2025-09-05T19:08:10.939214] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:11.134301] [INFO ] [MAIN ] YELP: Found 1 missing trading days. [2025-09-05T19:08:11.142461] [INFO ] [MAIN ] YELP: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:11.143295] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-05T19:08:11.142947] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-05T19:08:11.171032] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T19:08:11.215520] [INFO ] [MAIN ] YETI: Loaded 25239 existing records. [2025-09-05T19:08:11.409293] [INFO ] [MAIN ] YALA: Adding 203 new records, updating 0 existing records. [2025-09-05T19:08:11.520767] [INFO ] [MAIN ] XYZ: Adding 390 new records, updating 0 existing records. [2025-09-05T19:08:11.594692] [INFO ] [MAIN ] YETI: Found 1 missing trading days. [2025-09-05T19:08:11.594979] [INFO ] [MAIN ] YETI: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:11.595376] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-05T19:08:11.595472] [INFO ] [MAIN ] YALA: Combined dataset has 17468 total records. [2025-09-05T19:08:11.678583] [INFO ] [MAIN ] XYZ: Combined dataset has 26066 total records. [2025-09-05T19:08:11.887119] [WARN ] [VALIDATOR ] YALA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:12.074686] [WARN ] [VALIDATOR ] XYZ: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:12.365790] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-05T19:08:12.499586] [INFO ] [MAIN ] YELP: Adding 321 new records, updating 0 existing records. [2025-09-05T19:08:12.506270] [WARN ] [VALIDATOR ] XYZ: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:12.506213] [WARN ] [VALIDATOR ] YALA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:12.506457] [INFO ] [MAIN ] XYZ: Combined data validation passed. [2025-09-05T19:08:12.506612] [INFO ] [MAIN ] YELP: Combined dataset has 22057 total records. [2025-09-05T19:08:12.506812] [INFO ] [MAIN ] YALA: Combined data validation passed. [2025-09-05T19:08:12.875920] [WARN ] [VALIDATOR ] YELP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:13.130970] [INFO ] [MAIN ] YALA: Update completed successfully. [2025-09-05T19:08:13.133236] [INFO ] [MAIN ] Update Progress: 2338/2363 symbols completed. YALA took 4.2s. Estimated remaining: 43.7s. Rate: 34.3 symbols/min [2025-09-05T19:08:13.232463] [INFO ] [MAIN ] XYZ: Update completed successfully. [2025-09-05T19:08:13.258303] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-05T19:08:13.257076] [INFO ] [MAIN ] Update Progress: 2339/2363 symbols completed. XYZ took 5.1s. Estimated remaining: 42.0s. Rate: 34.3 symbols/min [2025-09-05T19:08:13.510048] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:13.590112] [INFO ] [MAIN ] YETI: Adding 0 new records, updating 0 existing records. [2025-09-05T19:08:13.670983] [INFO ] [MAIN ] YETI: Combined dataset has 25239 total records. [2025-09-05T19:08:13.676866] [FATAL] [VALIDATOR ] YETI: Data is stale - most recent date (2025-09-04) is before last completed trading day (2025-09-05). Symbol may be delisted or halted. [2025-09-05T19:08:13.675630] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:13.677371] [FATAL] [MAIN ] YETI: Combined data validation failed. [2025-09-05T19:08:13.678918] [WARN ] [MAIN ] YETI: Deleting existing primary and derivative data due to validation failure. [2025-09-05T19:08:13.679615] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-05T19:08:13.680809] [INFO ] [LOCAL ] YETI: Starting deletion of derivative data. [2025-09-05T19:08:13.690767] [INFO ] [MAIN ] Update Progress: 2340/2363 symbols completed. YETI took 2.9s. Estimated remaining: 40.2s. Rate: 34.3 symbols/min [2025-09-05T19:08:13.724729] [INFO ] [MAIN ] YEXT: Loaded 20867 existing records. [2025-09-05T19:08:13.919528] [INFO ] [MAIN ] YMM: Loaded 25015 existing records. [2025-09-05T19:08:13.994738] [WARN ] [VALIDATOR ] YELP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:14.069100] [INFO ] [MAIN ] YELP: Combined data validation passed. [2025-09-05T19:08:14.149228] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:14.173988] [INFO ] [MAIN ] YEXT: Found 1 missing trading days. [2025-09-05T19:08:14.177475] [WARN ] [MAIN ] YOU: No existing data found, performing full refresh instead. [2025-09-05T19:08:14.177562] [INFO ] [MAIN ] YEXT: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:14.178203] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-05T19:08:14.178470] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-05T19:08:14.179913] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-05T19:08:14.244569] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-05T19:08:14.377328] [INFO ] [MAIN ] YMM: Found 1 missing trading days. [2025-09-05T19:08:14.405772] [INFO ] [MAIN ] YMM: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:14.411877] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-05T19:08:14.768727] [INFO ] [REMOTE ] YOU: Fetching primary data covering 150 trading days from 2025-01-31 to 2025-09-05 (requires 9 months of data pull). [2025-09-05T19:08:14.795389] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-05T19:08:14.815210] [INFO ] [MAIN ] YELP: Update completed successfully. [2025-09-05T19:08:14.818084] [INFO ] [MAIN ] Update Progress: 2341/2363 symbols completed. YELP took 4.3s. Estimated remaining: 38.4s. Rate: 34.3 symbols/min [2025-09-05T19:08:14.995826] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:15.018435] [INFO ] [MAIN ] YPF: Loaded 23460 existing records. [2025-09-05T19:08:15.190812] [INFO ] [MAIN ] YPF: Found 1 missing trading days. [2025-09-05T19:08:15.190964] [INFO ] [MAIN ] YPF: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:15.191170] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-05T19:08:15.652358] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-05T19:08:15.794446] [INFO ] [MAIN ] YMM: Adding 389 new records, updating 0 existing records. [2025-09-05T19:08:15.797729] [INFO ] [MAIN ] YMM: Combined dataset has 25404 total records. [2025-09-05T19:08:15.976036] [WARN ] [VALIDATOR ] YMM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:16.075857] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-05T19:08:16.322610] [INFO ] [MAIN ] YEXT: Adding 317 new records, updating 0 existing records. [2025-09-05T19:08:16.332383] [INFO ] [MAIN ] YEXT: Combined dataset has 21184 total records. [2025-09-05T19:08:16.434372] [WARN ] [VALIDATOR ] YMM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:16.455549] [INFO ] [MAIN ] YMM: Combined data validation passed. [2025-09-05T19:08:16.655636] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-05T19:08:16.725122] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-05T19:08:16.689307] [WARN ] [VALIDATOR ] YEXT: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:16.760386] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-05T19:08:16.790520] [INFO ] [MAIN ] YMM: Update completed successfully. [2025-09-05T19:08:16.807121] [INFO ] [MAIN ] Update Progress: 2342/2363 symbols completed. YMM took 3.5s. Estimated remaining: 36.7s. Rate: 34.3 symbols/min [2025-09-05T19:08:17.231739] [INFO ] [MAIN ] YPF: Adding 363 new records, updating 0 existing records. [2025-09-05T19:08:17.366136] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:17.391219] [INFO ] [MAIN ] YRD: Loaded 5158 existing records. [2025-09-05T19:08:17.425823] [INFO ] [MAIN ] YPF: Combined dataset has 23823 total records. [2025-09-05T19:08:17.748088] [INFO ] [MAIN ] YRD: Found 1 missing trading days. [2025-09-05T19:08:17.774490] [INFO ] [MAIN ] YRD: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:17.815150] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-05T19:08:17.814720] [WARN ] [VALIDATOR ] YPF: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:17.817457] [WARN ] [VALIDATOR ] YEXT: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:17.817866] [INFO ] [MAIN ] YEXT: Combined data validation passed. [2025-09-05T19:08:18.197255] [INFO ] [MAIN ] YEXT: Update completed successfully. [2025-09-05T19:08:18.202920] [INFO ] [MAIN ] Update Progress: 2343/2363 symbols completed. YEXT took 5.1s. Estimated remaining: 34.9s. Rate: 34.3 symbols/min [2025-09-05T19:08:18.396342] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:18.414738] [WARN ] [VALIDATOR ] YPF: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:18.422118] [INFO ] [MAIN ] YPF: Combined data validation passed. [2025-09-05T19:08:18.423016] [INFO ] [MAIN ] YSG: Loaded 15431 existing records. [2025-09-05T19:08:18.752096] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-05T19:08:18.819778] [INFO ] [MAIN ] YSG: Found 1 missing trading days. [2025-09-05T19:08:18.830774] [INFO ] [MAIN ] YSG: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:18.836752] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-05T19:08:18.844915] [INFO ] [MAIN ] YRD: Adding 69 new records, updating 0 existing records. [2025-09-05T19:08:18.825246] [INFO ] [MAIN ] YPF: Update completed successfully. [2025-09-05T19:08:18.854284] [INFO ] [MAIN ] Update Progress: 2344/2363 symbols completed. YPF took 4.0s. Estimated remaining: 33.2s. Rate: 34.3 symbols/min [2025-09-05T19:08:18.879095] [INFO ] [MAIN ] YRD: Combined dataset has 5227 total records. [2025-09-05T19:08:19.126315] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-05T19:08:19.203767] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-05T19:08:19.247513] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:19.326411] [WARN ] [VALIDATOR ] YRD: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:19.534053] [INFO ] [MAIN ] YUM: Loaded 24206 existing records. [2025-09-05T19:08:19.715007] [INFO ] [MAIN ] YUM: Found 1 missing trading days. [2025-09-05T19:08:19.715381] [INFO ] [MAIN ] YUM: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:19.715667] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-05T19:08:19.727694] [WARN ] [VALIDATOR ] YRD: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:19.727893] [INFO ] [MAIN ] YRD: Combined data validation passed. [2025-09-05T19:08:19.759088] [INFO ] [MAIN ] YRD: Update completed successfully. [2025-09-05T19:08:19.759903] [INFO ] [MAIN ] Update Progress: 2345/2363 symbols completed. YRD took 2.9s. Estimated remaining: 31.4s. Rate: 34.4 symbols/min [2025-09-05T19:08:19.935042] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:19.959617] [INFO ] [MAIN ] YUMC: Loaded 24980 existing records. [2025-09-05T19:08:20.084311] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-05T19:08:20.252494] [INFO ] [MAIN ] YUMC: Found 1 missing trading days. [2025-09-05T19:08:20.261595] [INFO ] [MAIN ] YUMC: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:20.261516] [INFO ] [MAIN ] YSG: Adding 278 new records, updating 0 existing records. [2025-09-05T19:08:20.262023] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-05T19:08:20.266462] [INFO ] [MAIN ] YSG: Combined dataset has 15709 total records. [2025-09-05T19:08:20.447510] [WARN ] [VALIDATOR ] YSG: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:20.636203] [WARN ] [VALIDATOR ] YSG: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:20.636418] [INFO ] [MAIN ] YSG: Combined data validation passed. [2025-09-05T19:08:20.735730] [INFO ] [MAIN ] YSG: Update completed successfully. [2025-09-05T19:08:20.737808] [INFO ] [MAIN ] Update Progress: 2346/2363 symbols completed. YSG took 2.5s. Estimated remaining: 29.7s. Rate: 34.4 symbols/min [2025-09-05T19:08:20.907665] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:20.932090] [INFO ] [MAIN ] ZBH: Loaded 24294 existing records. [2025-09-05T19:08:21.105394] [INFO ] [MAIN ] ZBH: Found 1 missing trading days. [2025-09-05T19:08:21.105544] [INFO ] [MAIN ] ZBH: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:21.105787] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-05T19:08:21.240856] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-05T19:08:21.252158] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-05T19:08:21.261152] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-05T19:08:21.402704] [INFO ] [MAIN ] YUM: Adding 384 new records, updating 0 existing records. [2025-09-05T19:08:21.406019] [INFO ] [MAIN ] YUM: Combined dataset has 24590 total records. [2025-09-05T19:08:21.593325] [WARN ] [VALIDATOR ] YUM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:21.808588] [WARN ] [VALIDATOR ] YUM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:21.808833] [INFO ] [MAIN ] YUM: Combined data validation passed. [2025-09-05T19:08:21.968392] [INFO ] [MAIN ] YUM: Update completed successfully. [2025-09-05T19:08:21.971941] [INFO ] [MAIN ] Update Progress: 2347/2363 symbols completed. YUM took 3.1s. Estimated remaining: 27.9s. Rate: 34.4 symbols/min [2025-09-05T19:08:22.146705] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:22.159518] [INFO ] [MAIN ] ZEPP: Loaded 11827 existing records. [2025-09-05T19:08:22.286366] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-05T19:08:22.403229] [INFO ] [MAIN ] ZEPP: Found 1 missing trading days. [2025-09-05T19:08:22.418771] [INFO ] [MAIN ] ZEPP: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:22.424231] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-05T19:08:22.519903] [INFO ] [MAIN ] YUMC: Adding 384 new records, updating 0 existing records. [2025-09-05T19:08:22.524761] [INFO ] [MAIN ] YUMC: Combined dataset has 25364 total records. [2025-09-05T19:08:22.695765] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-05T19:08:22.714661] [WARN ] [VALIDATOR ] YUMC: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:23.058727] [INFO ] [MAIN ] ZBH: Adding 358 new records, updating 0 existing records. [2025-09-05T19:08:23.067895] [INFO ] [MAIN ] ZBH: Combined dataset has 24652 total records. [2025-09-05T19:08:23.261774] [WARN ] [VALIDATOR ] ZBH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:23.405220] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-05T19:08:23.466906] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-05T19:08:23.521196] [WARN ] [VALIDATOR ] YUMC: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:23.522031] [INFO ] [MAIN ] YUMC: Combined data validation passed. [2025-09-05T19:08:23.658218] [WARN ] [VALIDATOR ] ZBH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:23.676749] [INFO ] [MAIN ] ZBH: Combined data validation passed. [2025-09-05T19:08:23.802756] [INFO ] [MAIN ] YUMC: Update completed successfully. [2025-09-05T19:08:23.810745] [INFO ] [MAIN ] Update Progress: 2348/2363 symbols completed. YUMC took 4.1s. Estimated remaining: 26.2s. Rate: 34.4 symbols/min [2025-09-05T19:08:23.806606] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-05T19:08:24.108784] [INFO ] [MAIN ] ZEPP: Adding 283 new records, updating 0 existing records. [2025-09-05T19:08:24.146822] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:24.163951] [INFO ] [MAIN ] ZEPP: Combined dataset has 12110 total records. [2025-09-05T19:08:24.209387] [INFO ] [MAIN ] ZBH: Update completed successfully. [2025-09-05T19:08:24.245819] [INFO ] [MAIN ] Update Progress: 2349/2363 symbols completed. ZBH took 3.5s. Estimated remaining: 24.4s. Rate: 34.4 symbols/min [2025-09-05T19:08:24.446242] [WARN ] [VALIDATOR ] ZEPP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:24.548250] [INFO ] [MAIN ] ZETA: Loaded 25645 existing records. [2025-09-05T19:08:24.736776] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:24.925917] [INFO ] [MAIN ] ZETA: Found 1 missing trading days. [2025-09-05T19:08:24.927259] [INFO ] [MAIN ] ZETA: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:24.927956] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-05T19:08:24.937145] [INFO ] [MAIN ] ZGN: Loaded 19255 existing records. [2025-09-05T19:08:25.120963] [INFO ] [MAIN ] ZGN: Found 1 missing trading days. [2025-09-05T19:08:25.121383] [INFO ] [MAIN ] ZGN: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:25.121726] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-05T19:08:25.153844] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-05T19:08:25.166289] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-05T19:08:25.174029] [WARN ] [VALIDATOR ] ZEPP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:25.174288] [INFO ] [MAIN ] ZEPP: Combined data validation passed. [2025-09-05T19:08:25.248295] [INFO ] [MAIN ] ZEPP: Update completed successfully. [2025-09-05T19:08:25.249934] [INFO ] [MAIN ] Update Progress: 2350/2363 symbols completed. ZEPP took 3.3s. Estimated remaining: 22.7s. Rate: 34.4 symbols/min [2025-09-05T19:08:25.419218] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:25.431699] [INFO ] [MAIN ] ZH: Loaded 12135 existing records. [2025-09-05T19:08:25.603769] [INFO ] [MAIN ] ZH: Found 1 missing trading days. [2025-09-05T19:08:25.603920] [INFO ] [MAIN ] ZH: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:25.604133] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-05T19:08:26.471219] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-05T19:08:26.587949] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-05T19:08:26.632569] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-05T19:08:26.650571] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-05T19:08:26.668851] [INFO ] [MAIN ] ZGN: Adding 347 new records, updating 0 existing records. [2025-09-05T19:08:26.738221] [INFO ] [MAIN ] ZH: Adding 157 new records, updating 0 existing records. [2025-09-05T19:08:26.740481] [INFO ] [MAIN ] ZGN: Combined dataset has 19602 total records. [2025-09-05T19:08:26.778672] [INFO ] [MAIN ] ZH: Combined dataset has 12292 total records. [2025-09-05T19:08:27.154620] [WARN ] [VALIDATOR ] ZGN: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:27.191308] [WARN ] [VALIDATOR ] ZH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:27.198316] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-05T19:08:27.727494] [INFO ] [MAIN ] ZETA: Adding 389 new records, updating 0 existing records. [2025-09-05T19:08:27.757127] [INFO ] [MAIN ] ZETA: Combined dataset has 26034 total records. [2025-09-05T19:08:27.768347] [WARN ] [VALIDATOR ] ZH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:27.768220] [WARN ] [VALIDATOR ] ZGN: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:27.784811] [INFO ] [MAIN ] ZH: Combined data validation passed. [2025-09-05T19:08:27.797375] [INFO ] [MAIN ] ZGN: Combined data validation passed. [2025-09-05T19:08:28.150707] [WARN ] [VALIDATOR ] ZETA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:28.282977] [INFO ] [MAIN ] ZH: Update completed successfully. [2025-09-05T19:08:28.308490] [INFO ] [MAIN ] Update Progress: 2351/2363 symbols completed. ZH took 3.1s. Estimated remaining: 21.0s. Rate: 34.4 symbols/min [2025-09-05T19:08:28.576000] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:28.586339] [INFO ] [MAIN ] ZGN: Update completed successfully. [2025-09-05T19:08:28.588941] [INFO ] [MAIN ] Update Progress: 2352/2363 symbols completed. ZGN took 4.3s. Estimated remaining: 19.2s. Rate: 34.4 symbols/min [2025-09-05T19:08:28.748545] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-05T19:08:28.757044] [INFO ] [MAIN ] ZIM: Loaded 25551 existing records. [2025-09-05T19:08:28.839543] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-05T19:08:28.915198] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:29.046376] [INFO ] [MAIN ] ZIM: Found 1 missing trading days. [2025-09-05T19:08:29.046631] [INFO ] [MAIN ] ZIM: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:29.047070] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-05T19:08:29.058096] [INFO ] [MAIN ] ZIP: Loaded 20656 existing records. [2025-09-05T19:08:29.237119] [INFO ] [MAIN ] ZIP: Found 1 missing trading days. [2025-09-05T19:08:29.237433] [INFO ] [MAIN ] ZIP: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:29.237772] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-05T19:08:29.242220] [WARN ] [VALIDATOR ] ZETA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:29.242457] [INFO ] [MAIN ] ZETA: Combined data validation passed. [2025-09-05T19:08:29.410335] [INFO ] [MAIN ] ZETA: Update completed successfully. [2025-09-05T19:08:29.413511] [INFO ] [MAIN ] Update Progress: 2353/2363 symbols completed. ZETA took 5.6s. Estimated remaining: 17.4s. Rate: 34.4 symbols/min [2025-09-05T19:08:29.583626] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:29.602067] [INFO ] [MAIN ] ZK: Loaded 16854 existing records. [2025-09-05T19:08:29.787488] [INFO ] [MAIN ] ZK: Found 1 missing trading days. [2025-09-05T19:08:29.787665] [INFO ] [MAIN ] ZK: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:29.787880] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-05T19:08:30.408002] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-05T19:08:30.526268] [INFO ] [MAIN ] ZIP: Adding 310 new records, updating 0 existing records. [2025-09-05T19:08:30.530258] [INFO ] [MAIN ] ZIP: Combined dataset has 20966 total records. [2025-09-05T19:08:30.719915] [WARN ] [VALIDATOR ] ZIP: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:30.868442] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-05T19:08:30.932045] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-05T19:08:31.226568] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-05T19:08:31.255684] [INFO ] [MAIN ] ZK: Adding 341 new records, updating 0 existing records. [2025-09-05T19:08:31.269801] [INFO ] [MAIN ] ZIM: Adding 384 new records, updating 0 existing records. [2025-09-05T19:08:31.279051] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-05T19:08:31.284734] [INFO ] [MAIN ] ZIM: Combined dataset has 25935 total records. [2025-09-05T19:08:31.284899] [INFO ] [MAIN ] ZK: Combined dataset has 17195 total records. [2025-09-05T19:08:31.353185] [WARN ] [VALIDATOR ] ZIP: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:31.453484] [INFO ] [MAIN ] ZIP: Combined data validation passed. [2025-09-05T19:08:31.618678] [WARN ] [VALIDATOR ] ZIM: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:31.721266] [WARN ] [VALIDATOR ] ZK: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:32.182588] [INFO ] [MAIN ] ZIP: Update completed successfully. [2025-09-05T19:08:32.186371] [INFO ] [MAIN ] Update Progress: 2354/2363 symbols completed. ZIP took 3.6s. Estimated remaining: 15.7s. Rate: 34.4 symbols/min [2025-09-05T19:08:32.310914] [WARN ] [VALIDATOR ] ZIM: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:32.321442] [WARN ] [VALIDATOR ] ZK: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:32.326821] [INFO ] [MAIN ] ZK: Combined data validation passed. [2025-09-05T19:08:32.326708] [INFO ] [MAIN ] ZIM: Combined data validation passed. [2025-09-05T19:08:32.381466] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:32.553936] [INFO ] [MAIN ] ZKH: Loaded 4556 existing records. [2025-09-05T19:08:32.742869] [INFO ] [MAIN ] ZK: Update completed successfully. [2025-09-05T19:08:32.751738] [INFO ] [MAIN ] Update Progress: 2355/2363 symbols completed. ZK took 3.3s. Estimated remaining: 14.0s. Rate: 34.4 symbols/min [2025-09-05T19:08:32.772782] [INFO ] [MAIN ] ZKH: Found 1 missing trading days. [2025-09-05T19:08:32.773659] [INFO ] [MAIN ] ZKH: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:32.785819] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-05T19:08:32.969581] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:32.979940] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-05T19:08:32.990113] [INFO ] [REMOTE ] YOU: Full fetch complete (54470 records). [2025-09-05T19:08:33.137023] [INFO ] [MAIN ] ZTO: Loaded 23419 existing records. [2025-09-05T19:08:33.474345] [INFO ] [MAIN ] ZIM: Update completed successfully. [2025-09-05T19:08:33.499447] [INFO ] [MAIN ] Update Progress: 2356/2363 symbols completed. ZIM took 5.2s. Estimated remaining: 12.2s. Rate: 34.4 symbols/min [2025-09-05T19:08:33.519074] [INFO ] [MAIN ] ZTO: Found 1 missing trading days. [2025-09-05T19:08:33.565508] [INFO ] [MAIN ] ZTO: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:33.560335] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-05T19:08:33.650008] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-05T19:08:33.711063] [INFO ] [MAIN ] ZKH: Adding 9 new records, updating 0 existing records. [2025-09-05T19:08:33.717203] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-05T19:08:33.773393] [INFO ] [MAIN ] ZKH: Combined dataset has 4565 total records. [2025-09-05T19:08:33.797905] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:34.028783] [INFO ] [MAIN ] ZTR: Loaded 8879 existing records. [2025-09-05T19:08:34.084616] [WARN ] [VALIDATOR ] ZKH: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:34.406494] [INFO ] [MAIN ] ZTR: Found 1 missing trading days. [2025-09-05T19:08:34.435809] [INFO ] [MAIN ] ZTR: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:34.462461] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-05T19:08:34.620540] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-05T19:08:34.620821] [INFO ] [MAIN ] Update Progress: 2357/2363 symbols completed. YOU took 20.9s. Estimated remaining: 10.5s. Rate: 34.4 symbols/min [2025-09-05T19:08:34.621357] [WARN ] [VALIDATOR ] ZKH: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:34.621469] [INFO ] [MAIN ] ZKH: Combined data validation passed. [2025-09-05T19:08:34.646598] [INFO ] [MAIN ] ZKH: Update completed successfully. [2025-09-05T19:08:34.647188] [INFO ] [MAIN ] Update Progress: 2358/2363 symbols completed. ZKH took 2.5s. Estimated remaining: 8.7s. Rate: 34.4 symbols/min [2025-09-05T19:08:35.322852] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-05T19:08:35.465211] [INFO ] [MAIN ] ZTO: Adding 381 new records, updating 0 existing records. [2025-09-05T19:08:35.472042] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-05T19:08:35.542376] [INFO ] [MAIN ] ZTO: Combined dataset has 23800 total records. [2025-09-05T19:08:35.546082] [INFO ] [MAIN ] ZTR: Adding 183 new records, updating 0 existing records. [2025-09-05T19:08:35.649488] [INFO ] [MAIN ] ZTR: Combined dataset has 9062 total records. [2025-09-05T19:08:35.862153] [WARN ] [VALIDATOR ] ZTO: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:36.009004] [WARN ] [VALIDATOR ] ZTR: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:36.356948] [WARN ] [VALIDATOR ] ZTO: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:36.357074] [WARN ] [VALIDATOR ] ZTR: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:36.357403] [INFO ] [MAIN ] ZTO: Combined data validation passed. [2025-09-05T19:08:36.357806] [INFO ] [MAIN ] ZTR: Combined data validation passed. [2025-09-05T19:08:36.515048] [INFO ] [MAIN ] ZTR: Update completed successfully. [2025-09-05T19:08:36.536205] [INFO ] [MAIN ] Update Progress: 2359/2363 symbols completed. ZTR took 3.0s. Estimated remaining: 7.0s. Rate: 34.4 symbols/min [2025-09-05T19:08:36.565885] [INFO ] [MAIN ] ZTO: Update completed successfully. [2025-09-05T19:08:36.568488] [INFO ] [MAIN ] Update Progress: 2360/2363 symbols completed. ZTO took 3.8s. Estimated remaining: 5.2s. Rate: 34.4 symbols/min [2025-09-05T19:08:37.081100] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:37.083506] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:37.125779] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-08-27 to 2025-09-05. [2025-09-05T19:08:37.151602] [INFO ] [MAIN ] ZWS: Loaded 19726 existing records. [2025-09-05T19:08:37.255054] [INFO ] [MAIN ] ZTS: Loaded 25332 existing records. [2025-09-05T19:08:37.261545] [INFO ] [MAIN ] ZVIA: Loaded 17908 existing records. [2025-09-05T19:08:37.589916] [INFO ] [MAIN ] ZWS: Found 1 missing trading days. [2025-09-05T19:08:37.642604] [INFO ] [MAIN ] ZWS: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:37.697821] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-05T19:08:37.697437] [INFO ] [MAIN ] ZVIA: Found 1 missing trading days. [2025-09-05T19:08:37.723438] [INFO ] [MAIN ] ZVIA: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:37.730635] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-05T19:08:37.730289] [INFO ] [MAIN ] ZTS: Found 1 missing trading days. [2025-09-05T19:08:37.731514] [INFO ] [MAIN ] ZTS: Need to fetch 1 months: 2025-09 [2025-09-05T19:08:37.731893] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-05T19:08:39.069860] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-05T19:08:39.190834] [INFO ] [MAIN ] ZWS: Adding 347 new records, updating 0 existing records. [2025-09-05T19:08:39.200787] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-05T19:08:39.246372] [INFO ] [MAIN ] ZWS: Combined dataset has 20073 total records. [2025-09-05T19:08:39.252466] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-05T19:08:39.537211] [INFO ] [MAIN ] ZVIA: Adding 274 new records, updating 0 existing records. [2025-09-05T19:08:39.582699] [INFO ] [MAIN ] ZTS: Adding 383 new records, updating 0 existing records. [2025-09-05T19:08:39.664980] [WARN ] [VALIDATOR ] ZWS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:39.704095] [INFO ] [MAIN ] ZVIA: Combined dataset has 18182 total records. [2025-09-05T19:08:39.928962] [INFO ] [MAIN ] ZTS: Combined dataset has 25715 total records. [2025-09-05T19:08:40.136982] [WARN ] [VALIDATOR ] ZVIA: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:40.337592] [WARN ] [VALIDATOR ] ZTS: Not fatal, but first date in data (2025-06-02) does not match expected start date (2025-01-31) [2025-09-05T19:08:40.645518] [WARN ] [VALIDATOR ] ZVIA: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:40.645727] [WARN ] [VALIDATOR ] ZWS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:40.645977] [INFO ] [MAIN ] ZWS: Combined data validation passed. [2025-09-05T19:08:40.646287] [INFO ] [MAIN ] ZVIA: Combined data validation passed. [2025-09-05T19:08:40.645871] [WARN ] [VALIDATOR ] ZTS: Missing days changed. Total missing: 83 No longer missing: 2025-01-30 All missing: 2025-01-31, 2025-02-03, 2025-02-04, 2025-02-05, 2025-02-06, 2025-02-07, 2025-02-10, 2025-02-11, 2025-02-12, 2025-02-13, 2025-02-14, 2025-02-18, 2025-02-19, 2025-02-20, 2025-02-21, 2025-02-24, 2025-02-25, 2025-02-26, 2025-02-27, 2025-02-28, 2025-03-03, 2025-03-04, 2025-03-05, 2025-03-06, 2025-03-07, 2025-03-10, 2025-03-11, 2025-03-12, 2025-03-13, 2025-03-14, 2025-03-17, 2025-03-18, 2025-03-19, 2025-03-20, 2025-03-21, 2025-03-24, 2025-03-25, 2025-03-26, 2025-03-27, 2025-03-28, 2025-03-31, 2025-04-01, 2025-04-02, 2025-04-03, 2025-04-04, 2025-04-07, 2025-04-08, 2025-04-09, 2025-04-10, 2025-04-11, 2025-04-14, 2025-04-15, 2025-04-16, 2025-04-17, 2025-04-21, 2025-04-22, 2025-04-23, 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29, 2025-04-30, 2025-05-01, 2025-05-02, 2025-05-05, 2025-05-06, 2025-05-07, 2025-05-08, 2025-05-09, 2025-05-12, 2025-05-13, 2025-05-14, 2025-05-15, 2025-05-16, 2025-05-19, 2025-05-20, 2025-05-21, 2025-05-22, 2025-05-23, 2025-05-27, 2025-05-28, 2025-05-29, 2025-05-30 [2025-09-05T19:08:40.647175] [INFO ] [MAIN ] ZTS: Combined data validation passed. [2025-09-05T19:08:40.989570] [INFO ] [MAIN ] ZVIA: Update completed successfully. [2025-09-05T19:08:40.993892] [INFO ] [MAIN ] Update Progress: 2361/2363 symbols completed. ZVIA took 4.4s. Estimated remaining: 3.5s. Rate: 34.4 symbols/min [2025-09-05T19:08:41.048758] [INFO ] [MAIN ] ZWS: Update completed successfully. [2025-09-05T19:08:41.054759] [INFO ] [MAIN ] Update Progress: 2362/2363 symbols completed. ZWS took 4.5s. Estimated remaining: 1.7s. Rate: 34.4 symbols/min [2025-09-05T19:08:41.055340] [INFO ] [MAIN ] ZTS: Update completed successfully. [2025-09-05T19:08:41.058599] [INFO ] [MAIN ] Update Progress: 2363/2363 symbols completed. ZTS took 4.5s. Estimated remaining: 0.0s. Rate: 34.4 symbols/min [2025-09-05T19:08:41.061449] [INFO ] [MAIN ] Parallel update completed in 1h 8m 37s [2025-09-05T19:08:41.061545] [WARN ] [MAIN ] Failed symbols (246): AA, ABR, AAT, AD, ADT, ADX, AGM, AGO, AHH, AKA... [2025-09-05T19:08:41.061603] [INFO ] [MAIN ] Update success rate: 89.6% (2117/2363 symbols) [2025-09-05T19:08:41.804838] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-05T19:08:41.805090] [INFO ] [STATE ] Last completion updated: 2025-09-05T19:08:41.804924 [2025-09-05T19:08:41.805341] [WARN ] [STATE ] State set to: RUNNING [2025-09-05T19:08:41.805401] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-05T19:08:41.805511] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-05T19:08:41.805568] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-05T19:08:41.935481] [INFO ] [LOCAL ] Deleted 1802 derivative data files. [2025-09-05T19:08:41.935922] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-05T19:08:41.938121] [INFO ] [LOCAL ] Found 2117 symbols with primary data. [2025-09-05T19:08:41.938380] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2117 symbols [2025-09-05T19:08:41.940715] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:41.943184] [INFO ] [MAIN ] AAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:41.943355] [INFO ] [MAIN ] AACT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:41.947082] [INFO ] [MAIN ] AAM: Loaded 473 primary data records. [2025-09-05T19:08:42.043205] [INFO ] [MAIN ] AACT: Loaded 5459 primary data records. [2025-09-05T19:08:42.345202] [INFO ] [MAIN ] A: Loaded 24306 primary data records. [2025-09-05T19:08:42.824363] [INFO ] [MAIN ] AAM: Generated 1349 derivative records from 473 primary records. [2025-09-05T19:08:42.836887] [INFO ] [MAIN ] AAM: Successfully saved derivative data. [2025-09-05T19:08:42.849296] [INFO ] [MAIN ] Derivative Progress: 1/2117 symbols completed. AAM took 0.9s. Estimated remaining: 32m 8s. Rate: 65.9 symbols/min [2025-09-05T19:08:42.850196] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:42.851238] [INFO ] [MAIN ] AACT: Generated 871 derivative records from 5459 primary records. [2025-09-05T19:08:42.873335] [INFO ] [MAIN ] A: Generated 871 derivative records from 24306 primary records. [2025-09-05T19:08:42.872563] [INFO ] [MAIN ] AACT: Successfully saved derivative data. [2025-09-05T19:08:42.875864] [INFO ] [MAIN ] Derivative Progress: 2/2117 symbols completed. AACT took 0.9s. Estimated remaining: 16m 32s. Rate: 128.0 symbols/min [2025-09-05T19:08:42.881546] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:42.900212] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-05T19:08:42.901465] [INFO ] [MAIN ] Derivative Progress: 3/2117 symbols completed. A took 1.0s. Estimated remaining: 11m 19s. Rate: 186.9 symbols/min [2025-09-05T19:08:42.901769] [INFO ] [MAIN ] AAUC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:42.902693] [INFO ] [MAIN ] AAMI: Loaded 18603 primary data records. [2025-09-05T19:08:43.008502] [INFO ] [MAIN ] AAUC: Loaded 5518 primary data records. [2025-09-05T19:08:43.177167] [INFO ] [MAIN ] AAP: Loaded 25202 primary data records. [2025-09-05T19:08:43.696041] [INFO ] [MAIN ] AAUC: Generated 805 derivative records from 5518 primary records. [2025-09-05T19:08:43.696941] [INFO ] [MAIN ] AAMI: Generated 1352 derivative records from 18603 primary records. [2025-09-05T19:08:43.716125] [INFO ] [MAIN ] AAUC: Successfully saved derivative data. [2025-09-05T19:08:43.718086] [INFO ] [MAIN ] Derivative Progress: 4/2117 symbols completed. AAUC took 0.8s. Estimated remaining: 15m 40s. Rate: 134.8 symbols/min [2025-09-05T19:08:43.720201] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:43.727805] [INFO ] [MAIN ] AAMI: Successfully saved derivative data. [2025-09-05T19:08:43.731415] [INFO ] [MAIN ] Derivative Progress: 5/2117 symbols completed. AAMI took 0.9s. Estimated remaining: 12m 37s. Rate: 167.3 symbols/min [2025-09-05T19:08:43.728625] [INFO ] [MAIN ] AAP: Generated 871 derivative records from 25202 primary records. [2025-09-05T19:08:43.733048] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:43.742128] [INFO ] [MAIN ] AB: Loaded 1561 primary data records. [2025-09-05T19:08:43.779344] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-05T19:08:43.799234] [INFO ] [MAIN ] Derivative Progress: 6/2117 symbols completed. AAP took 0.9s. Estimated remaining: 10m 55s. Rate: 193.4 symbols/min [2025-09-05T19:08:43.845594] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:43.946675] [INFO ] [MAIN ] ABBV: Loaded 26075 primary data records. [2025-09-05T19:08:44.016477] [INFO ] [MAIN ] ABCB: Loaded 14087 primary data records. [2025-09-05T19:08:44.113707] [INFO ] [MAIN ] AB: Generated 143 derivative records from 1561 primary records. [2025-09-05T19:08:44.279336] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-05T19:08:44.342043] [INFO ] [MAIN ] Derivative Progress: 7/2117 symbols completed. AB took 0.6s. Estimated remaining: 12m 5s. Rate: 174.7 symbols/min [2025-09-05T19:08:44.342414] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:44.509688] [INFO ] [MAIN ] ABEV: Loaded 25797 primary data records. [2025-09-05T19:08:44.510561] [INFO ] [MAIN ] ABBV: Generated 871 derivative records from 26075 primary records. [2025-09-05T19:08:44.627360] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-05T19:08:44.645136] [INFO ] [MAIN ] Derivative Progress: 8/2117 symbols completed. ABBV took 0.9s. Estimated remaining: 11m 54s. Rate: 177.3 symbols/min [2025-09-05T19:08:44.675884] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:44.676806] [INFO ] [MAIN ] ABCB: Generated 871 derivative records from 14087 primary records. [2025-09-05T19:08:44.776599] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-05T19:08:44.778501] [INFO ] [MAIN ] Derivative Progress: 9/2117 symbols completed. ABCB took 0.9s. Estimated remaining: 11m 5s. Rate: 190.1 symbols/min [2025-09-05T19:08:44.782884] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:44.783215] [INFO ] [MAIN ] ABG: Loaded 8788 primary data records. [2025-09-05T19:08:45.046582] [INFO ] [MAIN ] ABM: Loaded 23660 primary data records. [2025-09-05T19:08:45.121781] [INFO ] [MAIN ] ABEV: Generated 871 derivative records from 25797 primary records. [2025-09-05T19:08:45.250161] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-05T19:08:45.377436] [INFO ] [MAIN ] Derivative Progress: 10/2117 symbols completed. ABEV took 1.0s. Estimated remaining: 12m 5s. Rate: 174.5 symbols/min [2025-09-05T19:08:45.388813] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:45.398760] [INFO ] [MAIN ] ABG: Generated 871 derivative records from 8788 primary records. [2025-09-05T19:08:45.409162] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-05T19:08:45.410977] [INFO ] [MAIN ] Derivative Progress: 11/2117 symbols completed. ABG took 0.8s. Estimated remaining: 11m 5s. Rate: 190.0 symbols/min [2025-09-05T19:08:45.411235] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:45.434954] [INFO ] [MAIN ] ACA: Loaded 10958 primary data records. [2025-09-05T19:08:45.435873] [INFO ] [MAIN ] ABM: Generated 1352 derivative records from 23660 primary records. [2025-09-05T19:08:45.645173] [INFO ] [MAIN ] ABT: Loaded 40374 primary data records. [2025-09-05T19:08:45.718140] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-05T19:08:45.729751] [INFO ] [MAIN ] Derivative Progress: 12/2117 symbols completed. ABM took 1.0s. Estimated remaining: 11m 5s. Rate: 189.9 symbols/min [2025-09-05T19:08:45.752470] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:45.992424] [INFO ] [MAIN ] ACCO: Loaded 17829 primary data records. [2025-09-05T19:08:46.190396] [INFO ] [MAIN ] ACA: Generated 871 derivative records from 10958 primary records. [2025-09-05T19:08:46.257382] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-05T19:08:46.259519] [INFO ] [MAIN ] Derivative Progress: 13/2117 symbols completed. ACA took 0.8s. Estimated remaining: 11m 39s. Rate: 180.5 symbols/min [2025-09-05T19:08:46.272891] [INFO ] [MAIN ] ABT: Generated 1352 derivative records from 40374 primary records. [2025-09-05T19:08:46.294676] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-05T19:08:46.297515] [INFO ] [MAIN ] Derivative Progress: 14/2117 symbols completed. ABT took 0.9s. Estimated remaining: 10m 55s. Rate: 192.7 symbols/min [2025-09-05T19:08:46.294595] [INFO ] [MAIN ] ACCO: Generated 871 derivative records from 17829 primary records. [2025-09-05T19:08:46.305904] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-05T19:08:46.307444] [INFO ] [MAIN ] Derivative Progress: 15/2117 symbols completed. ACCO took 0.6s. Estimated remaining: 10m 12s. Rate: 206.0 symbols/min [2025-09-05T19:08:46.307957] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:46.308080] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:46.308219] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:46.345603] [INFO ] [MAIN ] ACEL: Loaded 20467 primary data records. [2025-09-05T19:08:46.476155] [INFO ] [MAIN ] ACI: Loaded 40088 primary data records. [2025-09-05T19:08:46.534961] [INFO ] [MAIN ] ACHR: Loaded 40558 primary data records. [2025-09-05T19:08:47.203394] [INFO ] [MAIN ] ACEL: Generated 1352 derivative records from 20467 primary records. [2025-09-05T19:08:47.231079] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-05T19:08:47.230748] [INFO ] [MAIN ] ACI: Generated 1352 derivative records from 40088 primary records. [2025-09-05T19:08:47.233861] [INFO ] [MAIN ] Derivative Progress: 16/2117 symbols completed. ACEL took 0.9s. Estimated remaining: 11m 35s. Rate: 181.3 symbols/min [2025-09-05T19:08:47.234076] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:47.251060] [INFO ] [MAIN ] ACHR: Generated 1352 derivative records from 40558 primary records. [2025-09-05T19:08:47.267435] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-05T19:08:47.270144] [INFO ] [MAIN ] Derivative Progress: 17/2117 symbols completed. ACI took 1.0s. Estimated remaining: 10m 59s. Rate: 191.3 symbols/min [2025-09-05T19:08:47.270767] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:47.272531] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-05T19:08:47.274937] [INFO ] [MAIN ] Derivative Progress: 18/2117 symbols completed. ACHR took 1.0s. Estimated remaining: 10m 22s. Rate: 202.4 symbols/min [2025-09-05T19:08:47.280842] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:47.291083] [INFO ] [MAIN ] ACM: Loaded 20326 primary data records. [2025-09-05T19:08:47.406105] [INFO ] [MAIN ] ACP: Loaded 14649 primary data records. [2025-09-05T19:08:47.699116] [INFO ] [MAIN ] ACN: Loaded 40188 primary data records. [2025-09-05T19:08:48.150479] [INFO ] [MAIN ] ACM: Generated 871 derivative records from 20326 primary records. [2025-09-05T19:08:48.171502] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-05T19:08:48.171210] [INFO ] [MAIN ] ACP: Generated 871 derivative records from 14649 primary records. [2025-09-05T19:08:48.173943] [INFO ] [MAIN ] Derivative Progress: 19/2117 symbols completed. ACM took 0.9s. Estimated remaining: 11m 29s. Rate: 182.8 symbols/min [2025-09-05T19:08:48.175594] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:48.186031] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-05T19:08:48.188070] [INFO ] [MAIN ] Derivative Progress: 20/2117 symbols completed. ACP took 0.9s. Estimated remaining: 10m 55s. Rate: 192.0 symbols/min [2025-09-05T19:08:48.188517] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:48.192550] [INFO ] [MAIN ] ACR: Loaded 4393 primary data records. [2025-09-05T19:08:48.319858] [INFO ] [MAIN ] ACN: Generated 1352 derivative records from 40188 primary records. [2025-09-05T19:08:48.320243] [INFO ] [MAIN ] ACRE: Loaded 16059 primary data records. [2025-09-05T19:08:48.605387] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-05T19:08:48.612419] [INFO ] [MAIN ] Derivative Progress: 21/2117 symbols completed. ACN took 1.3s. Estimated remaining: 11m 6s. Rate: 188.8 symbols/min [2025-09-05T19:08:48.618982] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:48.748886] [INFO ] [MAIN ] ACV: Loaded 2750 primary data records. [2025-09-05T19:08:49.007351] [INFO ] [MAIN ] ACR: Generated 1352 derivative records from 4393 primary records. [2025-09-05T19:08:49.023440] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-05T19:08:49.025551] [INFO ] [MAIN ] Derivative Progress: 22/2117 symbols completed. ACR took 0.9s. Estimated remaining: 11m 15s. Rate: 186.2 symbols/min [2025-09-05T19:08:49.032208] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:49.033960] [INFO ] [MAIN ] ACRE: Generated 871 derivative records from 16059 primary records. [2025-09-05T19:08:49.045125] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-05T19:08:49.053615] [INFO ] [MAIN ] Derivative Progress: 23/2117 symbols completed. ACRE took 0.9s. Estimated remaining: 10m 48s. Rate: 193.9 symbols/min [2025-09-05T19:08:49.054844] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:49.054771] [INFO ] [MAIN ] ACV: Generated 871 derivative records from 2750 primary records. [2025-09-05T19:08:49.070194] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-05T19:08:49.071459] [INFO ] [MAIN ] Derivative Progress: 24/2117 symbols completed. ACV took 0.5s. Estimated remaining: 10m 22s. Rate: 201.9 symbols/min [2025-09-05T19:08:49.071693] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:49.082446] [INFO ] [MAIN ] ACVA: Loaded 23225 primary data records. [2025-09-05T19:08:49.203761] [INFO ] [MAIN ] ADCT: Loaded 18178 primary data records. [2025-09-05T19:08:49.281101] [INFO ] [MAIN ] ADC: Loaded 22122 primary data records. [2025-09-05T19:08:49.857133] [INFO ] [MAIN ] ACVA: Generated 871 derivative records from 23225 primary records. [2025-09-05T19:08:49.869873] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-05T19:08:49.871551] [INFO ] [MAIN ] Derivative Progress: 25/2117 symbols completed. ACVA took 0.8s. Estimated remaining: 11m 4s. Rate: 189.1 symbols/min [2025-09-05T19:08:49.879171] [INFO ] [MAIN ] ADC: Generated 871 derivative records from 22122 primary records. [2025-09-05T19:08:49.886988] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:49.886934] [INFO ] [MAIN ] ADCT: Generated 871 derivative records from 18178 primary records. [2025-09-05T19:08:49.906167] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-05T19:08:49.907400] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-05T19:08:49.910087] [INFO ] [MAIN ] Derivative Progress: 26/2117 symbols completed. ADC took 0.9s. Estimated remaining: 10m 41s. Rate: 195.7 symbols/min [2025-09-05T19:08:49.912440] [INFO ] [MAIN ] Derivative Progress: 27/2117 symbols completed. ADCT took 0.8s. Estimated remaining: 10m 17s. Rate: 203.2 symbols/min [2025-09-05T19:08:49.912831] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:49.912322] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:49.966680] [INFO ] [MAIN ] ADNT: Loaded 22897 primary data records. [2025-09-05T19:08:49.998437] [INFO ] [MAIN ] ADM: Loaded 40184 primary data records. [2025-09-05T19:08:49.987414] [INFO ] [MAIN ] AEE: Loaded 24313 primary data records. [2025-09-05T19:08:50.823895] [INFO ] [MAIN ] ADNT: Generated 871 derivative records from 22897 primary records. [2025-09-05T19:08:50.846488] [INFO ] [MAIN ] AEE: Generated 871 derivative records from 24313 primary records. [2025-09-05T19:08:50.866751] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-05T19:08:50.869969] [INFO ] [MAIN ] Derivative Progress: 28/2117 symbols completed. ADNT took 1.0s. Estimated remaining: 11m 6s. Rate: 188.1 symbols/min [2025-09-05T19:08:50.867748] [INFO ] [MAIN ] ADM: Generated 1352 derivative records from 40184 primary records. [2025-09-05T19:08:50.872855] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-05T19:08:50.875985] [INFO ] [MAIN ] Derivative Progress: 29/2117 symbols completed. AEE took 1.0s. Estimated remaining: 10m 44s. Rate: 194.7 symbols/min [2025-09-05T19:08:50.888376] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-05T19:08:50.890853] [INFO ] [MAIN ] Derivative Progress: 30/2117 symbols completed. ADM took 1.0s. Estimated remaining: 10m 23s. Rate: 201.1 symbols/min [2025-09-05T19:08:50.891439] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:50.891777] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:50.891924] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:50.900496] [INFO ] [MAIN ] AEFC: Loaded 3596 primary data records. [2025-09-05T19:08:51.107933] [INFO ] [MAIN ] AEM: Loaded 25903 primary data records. [2025-09-05T19:08:51.108674] [INFO ] [MAIN ] AEG: Loaded 23888 primary data records. [2025-09-05T19:08:51.730067] [INFO ] [MAIN ] AEFC: Generated 871 derivative records from 3596 primary records. [2025-09-05T19:08:51.742360] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-05T19:08:51.744300] [INFO ] [MAIN ] Derivative Progress: 31/2117 symbols completed. AEFC took 0.9s. Estimated remaining: 10m 60s. Rate: 189.7 symbols/min [2025-09-05T19:08:51.745068] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:51.767272] [INFO ] [MAIN ] AEM: Generated 871 derivative records from 25903 primary records. [2025-09-05T19:08:51.766391] [INFO ] [MAIN ] AEG: Generated 871 derivative records from 23888 primary records. [2025-09-05T19:08:51.796721] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-05T19:08:51.799265] [INFO ] [MAIN ] Derivative Progress: 32/2117 symbols completed. AEM took 0.9s. Estimated remaining: 10m 43s. Rate: 194.7 symbols/min [2025-09-05T19:08:51.800133] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:51.800884] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-05T19:08:51.803242] [INFO ] [MAIN ] Derivative Progress: 33/2117 symbols completed. AEG took 0.9s. Estimated remaining: 10m 23s. Rate: 200.7 symbols/min [2025-09-05T19:08:51.803638] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:51.822038] [INFO ] [MAIN ] AEO: Loaded 25978 primary data records. [2025-09-05T19:08:51.826221] [INFO ] [MAIN ] AES: Loaded 4283 primary data records. [2025-09-05T19:08:52.116917] [INFO ] [MAIN ] AER: Loaded 23104 primary data records. [2025-09-05T19:08:52.405188] [INFO ] [MAIN ] AES: Generated 143 derivative records from 4283 primary records. [2025-09-05T19:08:52.441139] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-05T19:08:52.498175] [INFO ] [MAIN ] Derivative Progress: 34/2117 symbols completed. AES took 0.7s. Estimated remaining: 10m 47s. Rate: 193.2 symbols/min [2025-09-05T19:08:52.498684] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:52.513483] [INFO ] [MAIN ] AESI: Loaded 3826 primary data records. [2025-09-05T19:08:52.511238] [INFO ] [MAIN ] AEO: Generated 871 derivative records from 25978 primary records. [2025-09-05T19:08:52.627222] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-05T19:08:52.628677] [INFO ] [MAIN ] Derivative Progress: 35/2117 symbols completed. AEO took 0.9s. Estimated remaining: 10m 36s. Rate: 196.4 symbols/min [2025-09-05T19:08:52.634194] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:52.730697] [INFO ] [MAIN ] AER: Generated 871 derivative records from 23104 primary records. [2025-09-05T19:08:52.732532] [INFO ] [MAIN ] AFB: Loaded 8362 primary data records. [2025-09-05T19:08:52.733142] [INFO ] [MAIN ] AESI: Generated 143 derivative records from 3826 primary records. [2025-09-05T19:08:52.772700] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-05T19:08:52.773299] [INFO ] [MAIN ] Derivative Progress: 36/2117 symbols completed. AESI took 0.3s. Estimated remaining: 10m 26s. Rate: 199.4 symbols/min [2025-09-05T19:08:52.774262] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:52.779954] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-05T19:08:52.793785] [INFO ] [MAIN ] Derivative Progress: 37/2117 symbols completed. AER took 1.0s. Estimated remaining: 10m 10s. Rate: 204.5 symbols/min [2025-09-05T19:08:52.822209] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:52.933236] [INFO ] [MAIN ] AFGB: Loaded 1109 primary data records. [2025-09-05T19:08:53.069775] [INFO ] [MAIN ] AFG: Loaded 15894 primary data records. [2025-09-05T19:08:53.581342] [INFO ] [MAIN ] AFB: Generated 1352 derivative records from 8362 primary records. [2025-09-05T19:08:53.604879] [INFO ] [MAIN ] AFGB: Generated 870 derivative records from 1109 primary records. [2025-09-05T19:08:53.603986] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-05T19:08:53.607286] [INFO ] [MAIN ] Derivative Progress: 38/2117 symbols completed. AFB took 1.0s. Estimated remaining: 10m 38s. Rate: 195.4 symbols/min [2025-09-05T19:08:53.609252] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:53.623016] [INFO ] [MAIN ] AFG: Generated 871 derivative records from 15894 primary records. [2025-09-05T19:08:53.625948] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-05T19:08:53.632288] [INFO ] [MAIN ] AFGC: Loaded 2015 primary data records. [2025-09-05T19:08:53.633927] [INFO ] [MAIN ] Derivative Progress: 39/2117 symbols completed. AFGB took 0.8s. Estimated remaining: 10m 23s. Rate: 200.1 symbols/min [2025-09-05T19:08:53.639525] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:53.751595] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-05T19:08:53.751901] [INFO ] [MAIN ] AFGD: Loaded 848 primary data records. [2025-09-05T19:08:53.768853] [INFO ] [MAIN ] Derivative Progress: 40/2117 symbols completed. AFG took 1.0s. Estimated remaining: 10m 14s. Rate: 202.9 symbols/min [2025-09-05T19:08:53.884418] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:54.043488] [INFO ] [MAIN ] AFGE: Loaded 1374 primary data records. [2025-09-05T19:08:54.422232] [INFO ] [MAIN ] AFGC: Generated 1351 derivative records from 2015 primary records. [2025-09-05T19:08:54.444699] [INFO ] [MAIN ] AFGD: Generated 871 derivative records from 848 primary records. [2025-09-05T19:08:54.448012] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-05T19:08:54.450232] [INFO ] [MAIN ] Derivative Progress: 41/2117 symbols completed. AFGC took 0.8s. Estimated remaining: 10m 34s. Rate: 196.6 symbols/min [2025-09-05T19:08:54.453920] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:54.459968] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-05T19:08:54.461773] [INFO ] [MAIN ] Derivative Progress: 42/2117 symbols completed. AFGD took 0.8s. Estimated remaining: 10m 19s. Rate: 201.2 symbols/min [2025-09-05T19:08:54.462196] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:54.470093] [INFO ] [MAIN ] AFGE: Generated 871 derivative records from 1374 primary records. [2025-09-05T19:08:54.479931] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-05T19:08:54.481359] [INFO ] [MAIN ] Derivative Progress: 43/2117 symbols completed. AFGE took 0.6s. Estimated remaining: 10m 5s. Rate: 205.7 symbols/min [2025-09-05T19:08:54.491887] [INFO ] [MAIN ] AG: Loaded 4284 primary data records. [2025-09-05T19:08:54.604528] [INFO ] [MAIN ] AFL: Loaded 25713 primary data records. [2025-09-05T19:08:54.870062] [INFO ] [MAIN ] AG: Generated 143 derivative records from 4284 primary records. [2025-09-05T19:08:54.928259] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-05T19:08:54.928740] [INFO ] [MAIN ] Derivative Progress: 44/2117 symbols completed. AG took 0.5s. Estimated remaining: 10m 12s. Rate: 203.2 symbols/min [2025-09-05T19:08:54.944000] [INFO ] [MAIN ] AFL: Generated 871 derivative records from 25713 primary records. [2025-09-05T19:08:54.952812] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-05T19:08:54.954522] [INFO ] [MAIN ] Derivative Progress: 45/2117 symbols completed. AFL took 0.5s. Estimated remaining: 9m 59s. Rate: 207.4 symbols/min [2025-09-05T19:08:54.955372] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:54.955178] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:54.955286] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:54.960956] [INFO ] [MAIN ] AGD: Loaded 1641 primary data records. [2025-09-05T19:08:55.024540] [INFO ] [MAIN ] AGCO: Loaded 3240 primary data records. [2025-09-05T19:08:55.241551] [INFO ] [MAIN ] AGI: Loaded 25885 primary data records. [2025-09-05T19:08:55.520168] [INFO ] [MAIN ] AGD: Generated 143 derivative records from 1641 primary records. [2025-09-05T19:08:55.582816] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-05T19:08:55.631859] [INFO ] [MAIN ] Derivative Progress: 46/2117 symbols completed. AGD took 0.7s. Estimated remaining: 10m 17s. Rate: 201.6 symbols/min [2025-09-05T19:08:55.641401] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:55.644264] [INFO ] [MAIN ] AGCO: Generated 143 derivative records from 3240 primary records. [2025-09-05T19:08:55.647903] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-05T19:08:55.648685] [INFO ] [MAIN ] Derivative Progress: 47/2117 symbols completed. AGCO took 0.7s. Estimated remaining: 10m 4s. Rate: 205.7 symbols/min [2025-09-05T19:08:55.649027] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:55.672856] [INFO ] [MAIN ] AGI: Generated 871 derivative records from 25885 primary records. [2025-09-05T19:08:55.683794] [INFO ] [MAIN ] AGRO: Loaded 14344 primary data records. [2025-09-05T19:08:55.730202] [INFO ] [MAIN ] AGL: Loaded 25276 primary data records. [2025-09-05T19:08:55.749829] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-05T19:08:55.806165] [INFO ] [MAIN ] Derivative Progress: 48/2117 symbols completed. AGI took 0.9s. Estimated remaining: 9m 58s. Rate: 207.7 symbols/min [2025-09-05T19:08:55.865485] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:56.178695] [INFO ] [MAIN ] AGX: Loaded 25230 primary data records. [2025-09-05T19:08:56.515045] [INFO ] [MAIN ] AGL: Generated 871 derivative records from 25276 primary records. [2025-09-05T19:08:56.515943] [INFO ] [MAIN ] AGRO: Generated 871 derivative records from 14344 primary records. [2025-09-05T19:08:56.532228] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-05T19:08:56.534319] [INFO ] [MAIN ] Derivative Progress: 49/2117 symbols completed. AGRO took 0.9s. Estimated remaining: 10m 16s. Rate: 201.4 symbols/min [2025-09-05T19:08:56.534563] [INFO ] [MAIN ] AHL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:56.534629] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-05T19:08:56.537330] [INFO ] [MAIN ] Derivative Progress: 50/2117 symbols completed. AGL took 0.9s. Estimated remaining: 10m 4s. Rate: 205.5 symbols/min [2025-09-05T19:08:56.537769] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:56.560577] [INFO ] [MAIN ] AHL: Loaded 10987 primary data records. [2025-09-05T19:08:56.556229] [INFO ] [MAIN ] AGX: Generated 1351 derivative records from 25230 primary records. [2025-09-05T19:08:56.692456] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-05T19:08:56.771766] [INFO ] [MAIN ] Derivative Progress: 51/2117 symbols completed. AGX took 0.9s. Estimated remaining: 10m 1s. Rate: 206.3 symbols/min [2025-09-05T19:08:56.769675] [INFO ] [MAIN ] AHR: Loaded 37080 primary data records. [2025-09-05T19:08:56.822514] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:56.940704] [INFO ] [MAIN ] AHT: Loaded 3316 primary data records. [2025-09-05T19:08:57.354799] [INFO ] [MAIN ] AHL: Generated 871 derivative records from 10987 primary records. [2025-09-05T19:08:57.365820] [INFO ] [MAIN ] AHL: Successfully saved derivative data. [2025-09-05T19:08:57.367246] [INFO ] [MAIN ] Derivative Progress: 52/2117 symbols completed. AHL took 0.8s. Estimated remaining: 10m 13s. Rate: 202.2 symbols/min [2025-09-05T19:08:57.368197] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:57.388299] [INFO ] [MAIN ] AHT: Generated 870 derivative records from 3316 primary records. [2025-09-05T19:08:57.388924] [INFO ] [MAIN ] AHR: Generated 1352 derivative records from 37080 primary records. [2025-09-05T19:08:57.409600] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-05T19:08:57.417782] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-05T19:08:57.420427] [INFO ] [MAIN ] Derivative Progress: 53/2117 symbols completed. AHR took 0.9s. Estimated remaining: 10m 3s. Rate: 205.4 symbols/min [2025-09-05T19:08:57.422084] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:57.422030] [INFO ] [MAIN ] Derivative Progress: 54/2117 symbols completed. AHT took 0.6s. Estimated remaining: 9m 52s. Rate: 209.3 symbols/min [2025-09-05T19:08:57.422549] [INFO ] [MAIN ] AII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:57.434725] [INFO ] [MAIN ] AI: Loaded 26158 primary data records. [2025-09-05T19:08:57.525900] [INFO ] [MAIN ] AII: Loaded 6817 primary data records. [2025-09-05T19:08:57.841579] [INFO ] [MAIN ] AIG: Loaded 40231 primary data records. [2025-09-05T19:08:58.244073] [INFO ] [MAIN ] AI: Generated 871 derivative records from 26158 primary records. [2025-09-05T19:08:58.257774] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-05T19:08:58.259383] [INFO ] [MAIN ] Derivative Progress: 55/2117 symbols completed. AI took 0.9s. Estimated remaining: 10m 12s. Rate: 202.2 symbols/min [2025-09-05T19:08:58.266669] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:58.268174] [INFO ] [MAIN ] AII: Generated 871 derivative records from 6817 primary records. [2025-09-05T19:08:58.280749] [INFO ] [MAIN ] AII: Successfully saved derivative data. [2025-09-05T19:08:58.282633] [INFO ] [MAIN ] Derivative Progress: 56/2117 symbols completed. AII took 0.9s. Estimated remaining: 10m 2s. Rate: 205.6 symbols/min [2025-09-05T19:08:58.282965] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:58.291372] [INFO ] [MAIN ] AIN: Loaded 12002 primary data records. [2025-09-05T19:08:58.391240] [INFO ] [MAIN ] AIG: Generated 1352 derivative records from 40231 primary records. [2025-09-05T19:08:58.428972] [INFO ] [MAIN ] AIO: Loaded 9675 primary data records. [2025-09-05T19:08:58.576086] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-05T19:08:58.597185] [INFO ] [MAIN ] Derivative Progress: 57/2117 symbols completed. AIG took 1.2s. Estimated remaining: 10m 2s. Rate: 205.3 symbols/min [2025-09-05T19:08:58.674300] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:58.870242] [INFO ] [MAIN ] AIR: Loaded 20011 primary data records. [2025-09-05T19:08:58.934267] [INFO ] [MAIN ] AIN: Generated 871 derivative records from 12002 primary records. [2025-09-05T19:08:59.124402] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-05T19:08:59.314312] [INFO ] [MAIN ] Derivative Progress: 58/2117 symbols completed. AIN took 1.0s. Estimated remaining: 10m 17s. Rate: 200.3 symbols/min [2025-09-05T19:08:59.347041] [INFO ] [MAIN ] AIO: Generated 1351 derivative records from 9675 primary records. [2025-09-05T19:08:59.375443] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-05T19:08:59.380196] [INFO ] [MAIN ] Derivative Progress: 59/2117 symbols completed. AIO took 1.1s. Estimated remaining: 10m 8s. Rate: 203.0 symbols/min [2025-09-05T19:08:59.402823] [INFO ] [MAIN ] AIR: Generated 1351 derivative records from 20011 primary records. [2025-09-05T19:08:59.423209] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-05T19:08:59.426013] [INFO ] [MAIN ] Derivative Progress: 60/2117 symbols completed. AIR took 0.8s. Estimated remaining: 9m 60s. Rate: 205.9 symbols/min [2025-09-05T19:08:59.427378] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:59.427290] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:59.427690] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:08:59.482401] [INFO ] [MAIN ] AIZ: Loaded 14209 primary data records. [2025-09-05T19:08:59.484376] [INFO ] [MAIN ] AIT: Loaded 21476 primary data records. [2025-09-05T19:08:59.605114] [INFO ] [MAIN ] AIV: Loaded 30156 primary data records. [2025-09-05T19:09:00.556142] [INFO ] [MAIN ] AIZ: Generated 871 derivative records from 14209 primary records. [2025-09-05T19:09:00.568222] [INFO ] [MAIN ] AIT: Generated 1352 derivative records from 21476 primary records. [2025-09-05T19:09:00.601353] [INFO ] [MAIN ] AIV: Generated 1352 derivative records from 30156 primary records. [2025-09-05T19:09:00.600215] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-05T19:09:00.603632] [INFO ] [MAIN ] Derivative Progress: 61/2117 symbols completed. AIZ took 1.2s. Estimated remaining: 10m 29s. Rate: 196.1 symbols/min [2025-09-05T19:09:00.605323] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:00.607182] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-05T19:09:00.614746] [INFO ] [MAIN ] Derivative Progress: 62/2117 symbols completed. AIT took 1.2s. Estimated remaining: 10m 19s. Rate: 199.2 symbols/min [2025-09-05T19:09:00.619111] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:00.621160] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-05T19:09:00.623624] [INFO ] [MAIN ] Derivative Progress: 63/2117 symbols completed. AIV took 1.2s. Estimated remaining: 10m 9s. Rate: 202.3 symbols/min [2025-09-05T19:09:00.624541] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:00.627236] [INFO ] [MAIN ] AIZN: Loaded 1873 primary data records. [2025-09-05T19:09:00.916252] [INFO ] [MAIN ] AKR: Loaded 22764 primary data records. [2025-09-05T19:09:00.939225] [INFO ] [MAIN ] AJG: Loaded 35056 primary data records. [2025-09-05T19:09:01.448278] [INFO ] [MAIN ] AIZN: Generated 871 derivative records from 1873 primary records. [2025-09-05T19:09:01.459816] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-05T19:09:01.461417] [INFO ] [MAIN ] Derivative Progress: 64/2117 symbols completed. AIZN took 0.9s. Estimated remaining: 10m 26s. Rate: 196.7 symbols/min [2025-09-05T19:09:01.462080] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:01.487321] [INFO ] [MAIN ] AKR: Generated 871 derivative records from 22764 primary records. [2025-09-05T19:09:01.488238] [INFO ] [MAIN ] AJG: Generated 1351 derivative records from 35056 primary records. [2025-09-05T19:09:01.519029] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-05T19:09:01.521957] [INFO ] [MAIN ] Derivative Progress: 65/2117 symbols completed. AKR took 0.9s. Estimated remaining: 10m 18s. Rate: 199.1 symbols/min [2025-09-05T19:09:01.523435] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:01.524145] [INFO ] [MAIN ] AL: Loaded 20342 primary data records. [2025-09-05T19:09:01.525376] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-05T19:09:01.529793] [INFO ] [MAIN ] Derivative Progress: 66/2117 symbols completed. AJG took 0.9s. Estimated remaining: 10m 9s. Rate: 202.1 symbols/min [2025-09-05T19:09:01.541468] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:01.794084] [INFO ] [MAIN ] ALB: Loaded 25909 primary data records. [2025-09-05T19:09:01.915248] [INFO ] [MAIN ] ALC: Loaded 38224 primary data records. [2025-09-05T19:09:02.410695] [INFO ] [MAIN ] AL: Generated 871 derivative records from 20342 primary records. [2025-09-05T19:09:02.424821] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-05T19:09:02.427025] [INFO ] [MAIN ] Derivative Progress: 67/2117 symbols completed. AL took 1.0s. Estimated remaining: 10m 27s. Rate: 196.2 symbols/min [2025-09-05T19:09:02.427385] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:02.441800] [INFO ] [MAIN ] ALB: Generated 871 derivative records from 25909 primary records. [2025-09-05T19:09:02.459515] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-05T19:09:02.461174] [INFO ] [MAIN ] Derivative Progress: 68/2117 symbols completed. ALB took 0.9s. Estimated remaining: 10m 18s. Rate: 198.8 symbols/min [2025-09-05T19:09:02.478574] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:02.479988] [INFO ] [MAIN ] ALE: Loaded 15627 primary data records. [2025-09-05T19:09:02.479401] [INFO ] [MAIN ] ALC: Generated 1352 derivative records from 38224 primary records. [2025-09-05T19:09:02.639783] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-05T19:09:02.665962] [INFO ] [MAIN ] Derivative Progress: 69/2117 symbols completed. ALC took 1.1s. Estimated remaining: 10m 15s. Rate: 199.7 symbols/min [2025-09-05T19:09:02.699852] [INFO ] [MAIN ] ALEX: Loaded 22669 primary data records. [2025-09-05T19:09:02.765072] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:02.878120] [INFO ] [MAIN ] ALG: Loaded 7757 primary data records. [2025-09-05T19:09:03.244889] [INFO ] [MAIN ] ALE: Generated 871 derivative records from 15627 primary records. [2025-09-05T19:09:03.340616] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-05T19:09:03.342411] [INFO ] [MAIN ] Derivative Progress: 70/2117 symbols completed. ALE took 0.9s. Estimated remaining: 10m 26s. Rate: 196.2 symbols/min [2025-09-05T19:09:03.342958] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:03.358317] [INFO ] [MAIN ] ALEX: Generated 1352 derivative records from 22669 primary records. [2025-09-05T19:09:03.381787] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-05T19:09:03.384311] [INFO ] [MAIN ] Derivative Progress: 71/2117 symbols completed. ALEX took 0.9s. Estimated remaining: 10m 18s. Rate: 198.6 symbols/min [2025-09-05T19:09:03.385226] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:03.403583] [INFO ] [MAIN ] ALG: Generated 1352 derivative records from 7757 primary records. [2025-09-05T19:09:03.405891] [INFO ] [MAIN ] ALIT: Loaded 25488 primary data records. [2025-09-05T19:09:03.553675] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-05T19:09:03.604061] [INFO ] [MAIN ] Derivative Progress: 72/2117 symbols completed. ALG took 0.9s. Estimated remaining: 10m 15s. Rate: 199.4 symbols/min [2025-09-05T19:09:03.669131] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:03.670091] [INFO ] [MAIN ] ALK: Loaded 25570 primary data records. [2025-09-05T19:09:03.921587] [INFO ] [MAIN ] ALL: Loaded 24338 primary data records. [2025-09-05T19:09:04.036057] [INFO ] [MAIN ] ALIT: Generated 871 derivative records from 25488 primary records. [2025-09-05T19:09:04.174543] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-05T19:09:04.175810] [INFO ] [MAIN ] Derivative Progress: 73/2117 symbols completed. ALIT took 0.8s. Estimated remaining: 10m 23s. Rate: 197.0 symbols/min [2025-09-05T19:09:04.186307] [INFO ] [MAIN ] ALK: Generated 871 derivative records from 25570 primary records. [2025-09-05T19:09:04.195996] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-05T19:09:04.197740] [INFO ] [MAIN ] Derivative Progress: 74/2117 symbols completed. ALK took 0.8s. Estimated remaining: 10m 15s. Rate: 199.5 symbols/min [2025-09-05T19:09:04.207393] [INFO ] [MAIN ] ALL: Generated 871 derivative records from 24338 primary records. [2025-09-05T19:09:04.215627] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-05T19:09:04.217182] [INFO ] [MAIN ] Derivative Progress: 75/2117 symbols completed. ALL took 0.5s. Estimated remaining: 10m 7s. Rate: 202.0 symbols/min [2025-09-05T19:09:04.217565] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:04.217793] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:04.217749] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:04.240847] [INFO ] [MAIN ] ALTG: Loaded 17403 primary data records. [2025-09-05T19:09:04.384783] [INFO ] [MAIN ] ALSN: Loaded 32324 primary data records. [2025-09-05T19:09:04.453702] [INFO ] [MAIN ] ALLE: Loaded 33715 primary data records. [2025-09-05T19:09:05.197044] [INFO ] [MAIN ] ALTG: Generated 1352 derivative records from 17403 primary records. [2025-09-05T19:09:05.217307] [INFO ] [MAIN ] ALSN: Generated 1352 derivative records from 32324 primary records. [2025-09-05T19:09:05.233513] [INFO ] [MAIN ] ALLE: Generated 1352 derivative records from 33715 primary records. [2025-09-05T19:09:05.246629] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-05T19:09:05.250613] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-05T19:09:05.249254] [INFO ] [MAIN ] Derivative Progress: 76/2117 symbols completed. ALTG took 1.0s. Estimated remaining: 10m 26s. Rate: 195.6 symbols/min [2025-09-05T19:09:05.253979] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:05.254034] [INFO ] [MAIN ] Derivative Progress: 77/2117 symbols completed. ALSN took 1.0s. Estimated remaining: 10m 18s. Rate: 198.1 symbols/min [2025-09-05T19:09:05.260947] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:05.268290] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-05T19:09:05.270402] [INFO ] [MAIN ] Derivative Progress: 78/2117 symbols completed. ALLE took 1.1s. Estimated remaining: 10m 10s. Rate: 200.6 symbols/min [2025-09-05T19:09:05.273209] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:05.278726] [INFO ] [MAIN ] ALUR: Loaded 7751 primary data records. [2025-09-05T19:09:05.347478] [INFO ] [MAIN ] ALX: Loaded 4271 primary data records. [2025-09-05T19:09:05.703001] [INFO ] [MAIN ] AM: Loaded 39117 primary data records. [2025-09-05T19:09:06.125020] [INFO ] [MAIN ] ALUR: Generated 1352 derivative records from 7751 primary records. [2025-09-05T19:09:06.146884] [INFO ] [MAIN ] ALX: Generated 871 derivative records from 4271 primary records. [2025-09-05T19:09:06.155849] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-05T19:09:06.157598] [INFO ] [MAIN ] Derivative Progress: 79/2117 symbols completed. ALX took 0.9s. Estimated remaining: 10m 25s. Rate: 195.7 symbols/min [2025-09-05T19:09:06.158613] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:06.159523] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-05T19:09:06.161978] [INFO ] [MAIN ] Derivative Progress: 80/2117 symbols completed. ALUR took 0.9s. Estimated remaining: 10m 17s. Rate: 198.2 symbols/min [2025-09-05T19:09:06.162466] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:06.176287] [INFO ] [MAIN ] AM: Generated 1352 derivative records from 39117 primary records. [2025-09-05T19:09:06.204362] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-05T19:09:06.206462] [INFO ] [MAIN ] Derivative Progress: 81/2117 symbols completed. AM took 0.9s. Estimated remaining: 10m 10s. Rate: 200.3 symbols/min [2025-09-05T19:09:06.206800] [INFO ] [MAIN ] AMBQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:06.226571] [INFO ] [MAIN ] AMBP: Loaded 21679 primary data records. [2025-09-05T19:09:06.234968] [INFO ] [MAIN ] AMBC: Loaded 27631 primary data records. [2025-09-05T19:09:06.353872] [INFO ] [MAIN ] AMBQ: Loaded 5712 primary data records. [2025-09-05T19:09:06.988144] [INFO ] [MAIN ] AMBQ: Generated 343 derivative records from 5712 primary records. [2025-09-05T19:09:07.001633] [INFO ] [MAIN ] AMBQ: Successfully saved derivative data. [2025-09-05T19:09:07.003353] [INFO ] [MAIN ] Derivative Progress: 82/2117 symbols completed. AMBQ took 0.8s. Estimated remaining: 10m 22s. Rate: 196.3 symbols/min [2025-09-05T19:09:07.003570] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:07.002671] [INFO ] [MAIN ] AMBP: Generated 871 derivative records from 21679 primary records. [2025-09-05T19:09:07.016265] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-05T19:09:07.017850] [INFO ] [MAIN ] Derivative Progress: 83/2117 symbols completed. AMBP took 0.9s. Estimated remaining: 10m 15s. Rate: 198.6 symbols/min [2025-09-05T19:09:07.018327] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:07.028949] [INFO ] [MAIN ] AMBC: Generated 1352 derivative records from 27631 primary records. [2025-09-05T19:09:07.042589] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-05T19:09:07.045422] [INFO ] [MAIN ] Derivative Progress: 84/2117 symbols completed. AMBC took 0.9s. Estimated remaining: 10m 8s. Rate: 200.7 symbols/min [2025-09-05T19:09:07.045863] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:07.084855] [INFO ] [MAIN ] AMC: Loaded 40508 primary data records. [2025-09-05T19:09:07.257230] [INFO ] [MAIN ] AMCR: Loaded 40411 primary data records. [2025-09-05T19:09:07.272976] [INFO ] [MAIN ] AME: Loaded 36494 primary data records. [2025-09-05T19:09:08.030829] [INFO ] [MAIN ] AMC: Generated 1352 derivative records from 40508 primary records. [2025-09-05T19:09:08.045104] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-05T19:09:08.047814] [INFO ] [MAIN ] Derivative Progress: 85/2117 symbols completed. AMC took 1.0s. Estimated remaining: 10m 24s. Rate: 195.3 symbols/min [2025-09-05T19:09:08.048499] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:08.064294] [INFO ] [MAIN ] AMCR: Generated 1352 derivative records from 40411 primary records. [2025-09-05T19:09:08.089979] [INFO ] [MAIN ] AME: Generated 1352 derivative records from 36494 primary records. [2025-09-05T19:09:08.098565] [INFO ] [MAIN ] AMG: Loaded 15133 primary data records. [2025-09-05T19:09:08.104304] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-05T19:09:08.110780] [INFO ] [MAIN ] Derivative Progress: 86/2117 symbols completed. AMCR took 1.1s. Estimated remaining: 10m 18s. Rate: 197.2 symbols/min [2025-09-05T19:09:08.141395] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:08.225741] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-05T19:09:08.232970] [INFO ] [MAIN ] Derivative Progress: 87/2117 symbols completed. AME took 1.2s. Estimated remaining: 10m 14s. Rate: 198.5 symbols/min [2025-09-05T19:09:08.253879] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:08.437458] [INFO ] [MAIN ] AMP: Loaded 14963 primary data records. [2025-09-05T19:09:08.436793] [INFO ] [MAIN ] AMH: Loaded 38819 primary data records. [2025-09-05T19:09:08.973004] [INFO ] [MAIN ] AMG: Generated 1352 derivative records from 15133 primary records. [2025-09-05T19:09:08.988901] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-05T19:09:08.991177] [INFO ] [MAIN ] Derivative Progress: 88/2117 symbols completed. AMG took 0.9s. Estimated remaining: 10m 24s. Rate: 195.2 symbols/min [2025-09-05T19:09:09.002750] [INFO ] [MAIN ] AMP: Generated 871 derivative records from 14963 primary records. [2025-09-05T19:09:09.011662] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-05T19:09:09.013432] [INFO ] [MAIN ] Derivative Progress: 89/2117 symbols completed. AMP took 0.8s. Estimated remaining: 10m 17s. Rate: 197.2 symbols/min [2025-09-05T19:09:09.024742] [INFO ] [MAIN ] AMH: Generated 1352 derivative records from 38819 primary records. [2025-09-05T19:09:09.036463] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-05T19:09:09.038654] [INFO ] [MAIN ] Derivative Progress: 90/2117 symbols completed. AMH took 0.9s. Estimated remaining: 10m 10s. Rate: 199.3 symbols/min [2025-09-05T19:09:09.039199] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:09.039150] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:09.039262] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:09.083438] [INFO ] [MAIN ] AMPX: Loaded 25810 primary data records. [2025-09-05T19:09:09.085042] [INFO ] [MAIN ] AMPY: Loaded 18393 primary data records. [2025-09-05T19:09:09.217080] [INFO ] [MAIN ] AMRC: Loaded 28283 primary data records. [2025-09-05T19:09:09.916588] [INFO ] [MAIN ] AMPY: Generated 871 derivative records from 18393 primary records. [2025-09-05T19:09:09.932100] [INFO ] [MAIN ] AMPX: Generated 871 derivative records from 25810 primary records. [2025-09-05T19:09:09.942624] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-05T19:09:09.947826] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-05T19:09:09.947298] [INFO ] [MAIN ] Derivative Progress: 91/2117 symbols completed. AMPY took 0.9s. Estimated remaining: 10m 24s. Rate: 194.9 symbols/min [2025-09-05T19:09:09.955190] [INFO ] [MAIN ] AMRZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:09.958834] [INFO ] [MAIN ] Derivative Progress: 92/2117 symbols completed. AMPX took 0.9s. Estimated remaining: 10m 17s. Rate: 197.0 symbols/min [2025-09-05T19:09:09.960332] [INFO ] [MAIN ] AMRC: Generated 1352 derivative records from 28283 primary records. [2025-09-05T19:09:09.960458] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:09.977533] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-05T19:09:09.984804] [INFO ] [MAIN ] Derivative Progress: 93/2117 symbols completed. AMRC took 0.9s. Estimated remaining: 10m 10s. Rate: 199.0 symbols/min [2025-09-05T19:09:09.985210] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:10.001526] [INFO ] [MAIN ] AMRZ: Loaded 19974 primary data records. [2025-09-05T19:09:10.106698] [INFO ] [MAIN ] AMT: Loaded 25253 primary data records. [2025-09-05T19:09:10.105606] [INFO ] [MAIN ] AMTB: Loaded 10359 primary data records. [2025-09-05T19:09:10.742699] [INFO ] [MAIN ] AMRZ: Generated 688 derivative records from 19974 primary records. [2025-09-05T19:09:10.750412] [INFO ] [MAIN ] AMRZ: Successfully saved derivative data. [2025-09-05T19:09:10.753158] [INFO ] [MAIN ] Derivative Progress: 94/2117 symbols completed. AMRZ took 0.8s. Estimated remaining: 10m 20s. Rate: 195.7 symbols/min [2025-09-05T19:09:10.754037] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:10.769319] [INFO ] [MAIN ] AMTB: Generated 871 derivative records from 10359 primary records. [2025-09-05T19:09:10.768701] [INFO ] [MAIN ] AMT: Generated 871 derivative records from 25253 primary records. [2025-09-05T19:09:10.778269] [INFO ] [MAIN ] AMTD: Loaded 2612 primary data records. [2025-09-05T19:09:10.809169] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-05T19:09:10.826360] [INFO ] [MAIN ] Derivative Progress: 95/2117 symbols completed. AMT took 0.9s. Estimated remaining: 10m 15s. Rate: 197.3 symbols/min [2025-09-05T19:09:10.839296] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:10.856986] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-05T19:09:10.864193] [INFO ] [MAIN ] Derivative Progress: 96/2117 symbols completed. AMTB took 0.9s. Estimated remaining: 10m 9s. Rate: 199.1 symbols/min [2025-09-05T19:09:10.881541] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:11.082180] [INFO ] [MAIN ] AMWL: Loaded 6456 primary data records. [2025-09-05T19:09:11.176361] [INFO ] [MAIN ] AMTM: Loaded 24360 primary data records. [2025-09-05T19:09:11.661976] [INFO ] [MAIN ] AMTD: Generated 1352 derivative records from 2612 primary records. [2025-09-05T19:09:11.676462] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-05T19:09:11.678791] [INFO ] [MAIN ] Derivative Progress: 97/2117 symbols completed. AMTD took 0.9s. Estimated remaining: 10m 19s. Rate: 195.7 symbols/min [2025-09-05T19:09:11.679568] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:11.693945] [INFO ] [MAIN ] AMTM: Generated 871 derivative records from 24360 primary records. [2025-09-05T19:09:11.719108] [INFO ] [MAIN ] AMWL: Generated 1352 derivative records from 6456 primary records. [2025-09-05T19:09:11.721347] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-05T19:09:11.723873] [INFO ] [MAIN ] Derivative Progress: 98/2117 symbols completed. AMTM took 0.9s. Estimated remaining: 10m 14s. Rate: 197.4 symbols/min [2025-09-05T19:09:11.724362] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:11.756564] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-05T19:09:11.760706] [INFO ] [MAIN ] AMX: Loaded 23456 primary data records. [2025-09-05T19:09:11.760516] [INFO ] [MAIN ] Derivative Progress: 99/2117 symbols completed. AMWL took 0.9s. Estimated remaining: 10m 8s. Rate: 199.2 symbols/min [2025-09-05T19:09:11.761245] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:11.887219] [INFO ] [MAIN ] AN: Loaded 14501 primary data records. [2025-09-05T19:09:12.240682] [INFO ] [MAIN ] ANET: Loaded 40506 primary data records. [2025-09-05T19:09:12.638761] [INFO ] [MAIN ] AMX: Generated 871 derivative records from 23456 primary records. [2025-09-05T19:09:12.649794] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-05T19:09:12.652938] [INFO ] [MAIN ] Derivative Progress: 100/2117 symbols completed. AMX took 1.0s. Estimated remaining: 10m 20s. Rate: 195.3 symbols/min [2025-09-05T19:09:12.653375] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:12.661155] [INFO ] [MAIN ] AN: Generated 871 derivative records from 14501 primary records. [2025-09-05T19:09:12.670817] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-05T19:09:12.672567] [INFO ] [MAIN ] Derivative Progress: 101/2117 symbols completed. AN took 0.9s. Estimated remaining: 10m 13s. Rate: 197.2 symbols/min [2025-09-05T19:09:12.673148] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:12.690146] [INFO ] [MAIN ] ANET: Generated 1352 derivative records from 40506 primary records. [2025-09-05T19:09:12.721769] [INFO ] [MAIN ] ANRO: Loaded 14431 primary data records. [2025-09-05T19:09:12.722653] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-05T19:09:12.756185] [INFO ] [MAIN ] Derivative Progress: 102/2117 symbols completed. ANET took 1.0s. Estimated remaining: 10m 9s. Rate: 198.6 symbols/min [2025-09-05T19:09:12.774753] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:12.850106] [INFO ] [MAIN ] ANF: Loaded 39205 primary data records. [2025-09-05T19:09:13.123409] [INFO ] [MAIN ] ANVS: Loaded 11549 primary data records. [2025-09-05T19:09:13.549061] [INFO ] [MAIN ] ANRO: Generated 1352 derivative records from 14431 primary records. [2025-09-05T19:09:13.570418] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-05T19:09:13.573635] [INFO ] [MAIN ] Derivative Progress: 103/2117 symbols completed. ANRO took 0.9s. Estimated remaining: 10m 19s. Rate: 195.4 symbols/min [2025-09-05T19:09:13.584902] [INFO ] [MAIN ] ANF: Generated 1352 derivative records from 39205 primary records. [2025-09-05T19:09:13.606841] [INFO ] [MAIN ] ANVS: Generated 871 derivative records from 11549 primary records. [2025-09-05T19:09:13.607012] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-05T19:09:13.610515] [INFO ] [MAIN ] Derivative Progress: 104/2117 symbols completed. ANF took 1.0s. Estimated remaining: 10m 13s. Rate: 197.0 symbols/min [2025-09-05T19:09:13.618122] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-05T19:09:13.619450] [INFO ] [MAIN ] Derivative Progress: 105/2117 symbols completed. ANVS took 0.8s. Estimated remaining: 10m 7s. Rate: 198.9 symbols/min [2025-09-05T19:09:13.619875] [INFO ] [MAIN ] AOMD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:13.619963] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:13.620159] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:13.625128] [INFO ] [MAIN ] AOMD: Loaded 1297 primary data records. [2025-09-05T19:09:13.736179] [INFO ] [MAIN ] AOMR: Loaded 8036 primary data records. [2025-09-05T19:09:13.897183] [INFO ] [MAIN ] AOD: Loaded 22991 primary data records. [2025-09-05T19:09:14.416827] [INFO ] [MAIN ] AOMD: Generated 871 derivative records from 1297 primary records. [2025-09-05T19:09:14.427237] [INFO ] [MAIN ] AOMD: Successfully saved derivative data. [2025-09-05T19:09:14.429085] [INFO ] [MAIN ] Derivative Progress: 106/2117 symbols completed. AOMD took 0.8s. Estimated remaining: 10m 16s. Rate: 195.7 symbols/min [2025-09-05T19:09:14.429266] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:14.439966] [INFO ] [MAIN ] AOMR: Generated 871 derivative records from 8036 primary records. [2025-09-05T19:09:14.449491] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-05T19:09:14.451312] [INFO ] [MAIN ] Derivative Progress: 107/2117 symbols completed. AOMR took 0.8s. Estimated remaining: 10m 11s. Rate: 197.5 symbols/min [2025-09-05T19:09:14.451790] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:14.466548] [INFO ] [MAIN ] AOD: Generated 1352 derivative records from 22991 primary records. [2025-09-05T19:09:14.490289] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-05T19:09:14.492921] [INFO ] [MAIN ] Derivative Progress: 108/2117 symbols completed. AOD took 0.9s. Estimated remaining: 10m 6s. Rate: 199.0 symbols/min [2025-09-05T19:09:14.493398] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:14.520348] [INFO ] [MAIN ] AON: Loaded 34414 primary data records. [2025-09-05T19:09:14.520808] [INFO ] [MAIN ] AORT: Loaded 22120 primary data records. [2025-09-05T19:09:15.114466] [INFO ] [MAIN ] AOS: Loaded 37221 primary data records. [2025-09-05T19:09:15.436360] [INFO ] [MAIN ] AON: Generated 1351 derivative records from 34414 primary records. [2025-09-05T19:09:15.438584] [INFO ] [MAIN ] AORT: Generated 1352 derivative records from 22120 primary records. [2025-09-05T19:09:15.471553] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-05T19:09:15.475995] [INFO ] [MAIN ] Derivative Progress: 109/2117 symbols completed. AORT took 1.0s. Estimated remaining: 10m 18s. Rate: 195.0 symbols/min [2025-09-05T19:09:15.472159] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-05T19:09:15.476510] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:15.485741] [INFO ] [MAIN ] Derivative Progress: 110/2117 symbols completed. AON took 1.1s. Estimated remaining: 10m 12s. Rate: 196.7 symbols/min [2025-09-05T19:09:15.490308] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:15.491197] [INFO ] [MAIN ] AOS: Generated 1352 derivative records from 37221 primary records. [2025-09-05T19:09:15.509806] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-05T19:09:15.508844] [INFO ] [MAIN ] AP: Loaded 4129 primary data records. [2025-09-05T19:09:15.511934] [INFO ] [MAIN ] Derivative Progress: 111/2117 symbols completed. AOS took 1.0s. Estimated remaining: 10m 7s. Rate: 198.4 symbols/min [2025-09-05T19:09:15.543237] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:15.763454] [INFO ] [MAIN ] APAM: Loaded 27627 primary data records. [2025-09-05T19:09:15.892931] [INFO ] [MAIN ] APD: Loaded 34157 primary data records. [2025-09-05T19:09:16.340961] [INFO ] [MAIN ] AP: Generated 871 derivative records from 4129 primary records. [2025-09-05T19:09:16.351869] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-05T19:09:16.353458] [INFO ] [MAIN ] Derivative Progress: 112/2117 symbols completed. AP took 0.9s. Estimated remaining: 10m 16s. Rate: 195.3 symbols/min [2025-09-05T19:09:16.353884] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:16.370456] [INFO ] [MAIN ] APAM: Generated 1352 derivative records from 27627 primary records. [2025-09-05T19:09:16.391910] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-05T19:09:16.401353] [INFO ] [MAIN ] Derivative Progress: 113/2117 symbols completed. APAM took 0.9s. Estimated remaining: 10m 11s. Rate: 196.7 symbols/min [2025-09-05T19:09:16.403001] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:16.403897] [INFO ] [MAIN ] APG: Loaded 24700 primary data records. [2025-09-05T19:09:16.446163] [INFO ] [MAIN ] APD: Generated 1352 derivative records from 34157 primary records. [2025-09-05T19:09:16.526251] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-05T19:09:16.539166] [INFO ] [MAIN ] Derivative Progress: 114/2117 symbols completed. APD took 1.0s. Estimated remaining: 10m 8s. Rate: 197.7 symbols/min [2025-09-05T19:09:16.539703] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:16.629634] [INFO ] [MAIN ] APH: Loaded 26062 primary data records. [2025-09-05T19:09:16.961184] [INFO ] [MAIN ] APLE: Loaded 25140 primary data records. [2025-09-05T19:09:17.101419] [INFO ] [MAIN ] APG: Generated 871 derivative records from 24700 primary records. [2025-09-05T19:09:17.224736] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-05T19:09:17.227184] [INFO ] [MAIN ] Derivative Progress: 115/2117 symbols completed. APG took 0.9s. Estimated remaining: 10m 14s. Rate: 195.5 symbols/min [2025-09-05T19:09:17.228666] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:17.242212] [INFO ] [MAIN ] APH: Generated 871 derivative records from 26062 primary records. [2025-09-05T19:09:17.253885] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-05T19:09:17.255762] [INFO ] [MAIN ] Derivative Progress: 116/2117 symbols completed. APH took 0.9s. Estimated remaining: 10m 9s. Rate: 197.1 symbols/min [2025-09-05T19:09:17.256163] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:17.267005] [INFO ] [MAIN ] APLE: Generated 871 derivative records from 25140 primary records. [2025-09-05T19:09:17.286393] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-05T19:09:17.288051] [INFO ] [MAIN ] Derivative Progress: 117/2117 symbols completed. APLE took 0.7s. Estimated remaining: 10m 4s. Rate: 198.6 symbols/min [2025-09-05T19:09:17.288307] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:17.307234] [INFO ] [MAIN ] APO: Loaded 40152 primary data records. [2025-09-05T19:09:17.454827] [INFO ] [MAIN ] APTV: Loaded 39161 primary data records. [2025-09-05T19:09:17.471530] [INFO ] [MAIN ] AQN: Loaded 25007 primary data records. [2025-09-05T19:09:18.207693] [INFO ] [MAIN ] APO: Generated 1352 derivative records from 40152 primary records. [2025-09-05T19:09:18.225325] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-05T19:09:18.227449] [INFO ] [MAIN ] Derivative Progress: 118/2117 symbols completed. APO took 1.0s. Estimated remaining: 10m 15s. Rate: 195.1 symbols/min [2025-09-05T19:09:18.244394] [INFO ] [MAIN ] AQN: Generated 871 derivative records from 25007 primary records. [2025-09-05T19:09:18.246229] [INFO ] [MAIN ] APTV: Generated 1352 derivative records from 39161 primary records. [2025-09-05T19:09:18.260335] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-05T19:09:18.265071] [INFO ] [MAIN ] Derivative Progress: 119/2117 symbols completed. AQN took 1.0s. Estimated remaining: 10m 10s. Rate: 196.5 symbols/min [2025-09-05T19:09:18.267965] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-05T19:09:18.271119] [INFO ] [MAIN ] Derivative Progress: 120/2117 symbols completed. APTV took 1.0s. Estimated remaining: 10m 5s. Rate: 198.2 symbols/min [2025-09-05T19:09:18.271626] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:18.271550] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:18.272326] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:18.277494] [INFO ] [MAIN ] AQNB: Loaded 3106 primary data records. [2025-09-05T19:09:18.481824] [INFO ] [MAIN ] AR: Loaded 25997 primary data records. [2025-09-05T19:09:18.616703] [INFO ] [MAIN ] ARCO: Loaded 33815 primary data records. [2025-09-05T19:09:19.116677] [INFO ] [MAIN ] AQNB: Generated 1352 derivative records from 3106 primary records. [2025-09-05T19:09:19.132407] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-05T19:09:19.136096] [INFO ] [MAIN ] Derivative Progress: 121/2117 symbols completed. AQNB took 0.9s. Estimated remaining: 10m 14s. Rate: 195.2 symbols/min [2025-09-05T19:09:19.136446] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:19.150926] [INFO ] [MAIN ] AR: Generated 871 derivative records from 25997 primary records. [2025-09-05T19:09:19.165315] [INFO ] [MAIN ] ARDC: Loaded 10784 primary data records. [2025-09-05T19:09:19.166556] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-05T19:09:19.210519] [INFO ] [MAIN ] ARCO: Generated 1352 derivative records from 33815 primary records. [2025-09-05T19:09:19.198756] [INFO ] [MAIN ] Derivative Progress: 122/2117 symbols completed. AR took 0.9s. Estimated remaining: 10m 9s. Rate: 196.5 symbols/min [2025-09-05T19:09:19.221168] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:19.292966] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-05T19:09:19.298952] [INFO ] [MAIN ] Derivative Progress: 123/2117 symbols completed. ARCO took 1.0s. Estimated remaining: 10m 6s. Rate: 197.5 symbols/min [2025-09-05T19:09:19.299265] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:19.471018] [INFO ] [MAIN ] ARDT: Loaded 13718 primary data records. [2025-09-05T19:09:19.599497] [INFO ] [MAIN ] ARE: Loaded 24529 primary data records. [2025-09-05T19:09:20.049353] [INFO ] [MAIN ] ARDC: Generated 1352 derivative records from 10784 primary records. [2025-09-05T19:09:20.067868] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-05T19:09:20.070350] [INFO ] [MAIN ] Derivative Progress: 124/2117 symbols completed. ARDC took 0.9s. Estimated remaining: 10m 13s. Rate: 195.1 symbols/min [2025-09-05T19:09:20.080080] [INFO ] [MAIN ] ARDT: Generated 871 derivative records from 13718 primary records. [2025-09-05T19:09:20.080731] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:20.091777] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-05T19:09:20.093483] [INFO ] [MAIN ] Derivative Progress: 125/2117 symbols completed. ARDT took 0.9s. Estimated remaining: 10m 8s. Rate: 196.6 symbols/min [2025-09-05T19:09:20.100624] [INFO ] [MAIN ] ARGD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:20.102104] [INFO ] [MAIN ] ARE: Generated 871 derivative records from 24529 primary records. [2025-09-05T19:09:20.112399] [INFO ] [MAIN ] ARGD: Loaded 1533 primary data records. [2025-09-05T19:09:20.114384] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-05T19:09:20.116115] [INFO ] [MAIN ] Derivative Progress: 126/2117 symbols completed. ARE took 0.8s. Estimated remaining: 10m 3s. Rate: 198.0 symbols/min [2025-09-05T19:09:20.186310] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:20.237782] [INFO ] [MAIN ] ARES: Loaded 23535 primary data records. [2025-09-05T19:09:20.513237] [INFO ] [MAIN ] ARMK: Loaded 24202 primary data records. [2025-09-05T19:09:20.876606] [INFO ] [MAIN ] ARGD: Generated 871 derivative records from 1533 primary records. [2025-09-05T19:09:20.886898] [INFO ] [MAIN ] ARGD: Successfully saved derivative data. [2025-09-05T19:09:20.893963] [INFO ] [MAIN ] ARES: Generated 871 derivative records from 23535 primary records. [2025-09-05T19:09:20.895501] [INFO ] [MAIN ] Derivative Progress: 127/2117 symbols completed. ARGD took 0.8s. Estimated remaining: 10m 10s. Rate: 195.6 symbols/min [2025-09-05T19:09:20.896068] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:20.905828] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-05T19:09:20.907688] [INFO ] [MAIN ] Derivative Progress: 128/2117 symbols completed. ARES took 0.8s. Estimated remaining: 10m 6s. Rate: 197.1 symbols/min [2025-09-05T19:09:20.908164] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:20.924933] [INFO ] [MAIN ] ARMK: Generated 871 derivative records from 24202 primary records. [2025-09-05T19:09:20.933370] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-05T19:09:20.940923] [INFO ] [MAIN ] Derivative Progress: 129/2117 symbols completed. ARMK took 0.8s. Estimated remaining: 10m 1s. Rate: 198.4 symbols/min [2025-09-05T19:09:20.949056] [INFO ] [MAIN ] ARX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:20.949669] [INFO ] [MAIN ] AROC: Loaded 23764 primary data records. [2025-09-05T19:09:21.068857] [INFO ] [MAIN ] ARX: Loaded 9788 primary data records. [2025-09-05T19:09:21.068936] [INFO ] [MAIN ] ARR: Loaded 25149 primary data records. [2025-09-05T19:09:21.663993] [INFO ] [MAIN ] ARX: Generated 395 derivative records from 9788 primary records. [2025-09-05T19:09:21.678250] [INFO ] [MAIN ] AROC: Generated 871 derivative records from 23764 primary records. [2025-09-05T19:09:21.680044] [INFO ] [MAIN ] ARX: Successfully saved derivative data. [2025-09-05T19:09:21.681566] [INFO ] [MAIN ] Derivative Progress: 130/2117 symbols completed. ARX took 0.7s. Estimated remaining: 10m 7s. Rate: 196.3 symbols/min [2025-09-05T19:09:21.681834] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:21.688979] [INFO ] [MAIN ] ARR: Generated 871 derivative records from 25149 primary records. [2025-09-05T19:09:21.707010] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-05T19:09:21.706895] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-05T19:09:21.708762] [INFO ] [MAIN ] Derivative Progress: 131/2117 symbols completed. ARR took 0.8s. Estimated remaining: 10m 3s. Rate: 197.6 symbols/min [2025-09-05T19:09:21.709030] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:21.710526] [INFO ] [MAIN ] Derivative Progress: 132/2117 symbols completed. AROC took 0.8s. Estimated remaining: 9m 58s. Rate: 199.1 symbols/min [2025-09-05T19:09:21.711055] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:21.729843] [INFO ] [MAIN ] ASA: Loaded 10193 primary data records. [2025-09-05T19:09:21.855794] [INFO ] [MAIN ] AS: Loaded 25806 primary data records. [2025-09-05T19:09:22.135377] [INFO ] [MAIN ] ASAN: Loaded 39575 primary data records. [2025-09-05T19:09:22.614854] [INFO ] [MAIN ] ASA: Generated 1352 derivative records from 10193 primary records. [2025-09-05T19:09:22.631202] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-05T19:09:22.638055] [INFO ] [MAIN ] AS: Generated 870 derivative records from 25806 primary records. [2025-09-05T19:09:22.640624] [INFO ] [MAIN ] Derivative Progress: 133/2117 symbols completed. ASA took 0.9s. Estimated remaining: 10m 7s. Rate: 196.1 symbols/min [2025-09-05T19:09:22.649610] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-05T19:09:22.650853] [INFO ] [MAIN ] Derivative Progress: 134/2117 symbols completed. AS took 1.0s. Estimated remaining: 10m 2s. Rate: 197.5 symbols/min [2025-09-05T19:09:22.662829] [INFO ] [MAIN ] ASAN: Generated 1352 derivative records from 39575 primary records. [2025-09-05T19:09:22.674839] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-05T19:09:22.676936] [INFO ] [MAIN ] Derivative Progress: 135/2117 symbols completed. ASAN took 1.0s. Estimated remaining: 9m 58s. Rate: 198.8 symbols/min [2025-09-05T19:09:22.677301] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:22.677422] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:22.677532] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:22.681999] [INFO ] [MAIN ] ASBA: Loaded 1780 primary data records. [2025-09-05T19:09:22.957518] [INFO ] [MAIN ] ASB: Loaded 23710 primary data records. [2025-09-05T19:09:22.958658] [INFO ] [MAIN ] ASC: Loaded 28364 primary data records. [2025-09-05T19:09:23.478141] [INFO ] [MAIN ] ASBA: Generated 871 derivative records from 1780 primary records. [2025-09-05T19:09:23.489965] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-05T19:09:23.491795] [INFO ] [MAIN ] Derivative Progress: 136/2117 symbols completed. ASBA took 0.8s. Estimated remaining: 10m 5s. Rate: 196.4 symbols/min [2025-09-05T19:09:23.492134] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:23.506946] [INFO ] [MAIN ] ASB: Generated 871 derivative records from 23710 primary records. [2025-09-05T19:09:23.521897] [INFO ] [MAIN ] ASC: Generated 1352 derivative records from 28364 primary records. [2025-09-05T19:09:23.522186] [INFO ] [MAIN ] ASG: Loaded 9317 primary data records. [2025-09-05T19:09:23.643552] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-05T19:09:23.661381] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-05T19:09:23.662890] [INFO ] [MAIN ] Derivative Progress: 137/2117 symbols completed. ASB took 1.0s. Estimated remaining: 10m 3s. Rate: 197.0 symbols/min [2025-09-05T19:09:23.675626] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:23.675556] [INFO ] [MAIN ] Derivative Progress: 138/2117 symbols completed. ASC took 1.0s. Estimated remaining: 9m 59s. Rate: 198.4 symbols/min [2025-09-05T19:09:23.676209] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:23.814242] [INFO ] [MAIN ] ASGI: Loaded 16855 primary data records. [2025-09-05T19:09:23.938817] [INFO ] [MAIN ] ASG: Generated 871 derivative records from 9317 primary records. [2025-09-05T19:09:23.967260] [INFO ] [MAIN ] ASGN: Loaded 26810 primary data records. [2025-09-05T19:09:24.055744] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-05T19:09:24.171821] [INFO ] [MAIN ] Derivative Progress: 139/2117 symbols completed. ASG took 0.7s. Estimated remaining: 10m 1s. Rate: 197.5 symbols/min [2025-09-05T19:09:24.198810] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:24.416923] [INFO ] [MAIN ] ASH: Loaded 28027 primary data records. [2025-09-05T19:09:24.482626] [INFO ] [MAIN ] ASGI: Generated 1352 derivative records from 16855 primary records. [2025-09-05T19:09:24.608740] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-05T19:09:24.629705] [INFO ] [MAIN ] ASGN: Generated 1352 derivative records from 26810 primary records. [2025-09-05T19:09:24.632847] [INFO ] [MAIN ] Derivative Progress: 140/2117 symbols completed. ASGI took 1.0s. Estimated remaining: 10m 3s. Rate: 196.7 symbols/min [2025-09-05T19:09:24.636933] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:24.736524] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-05T19:09:24.739186] [INFO ] [MAIN ] Derivative Progress: 141/2117 symbols completed. ASGN took 1.1s. Estimated remaining: 9m 60s. Rate: 197.7 symbols/min [2025-09-05T19:09:24.739744] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:24.755145] [INFO ] [MAIN ] ASIX: Loaded 17367 primary data records. [2025-09-05T19:09:25.099669] [INFO ] [MAIN ] ASPN: Loaded 37433 primary data records. [2025-09-05T19:09:25.176003] [INFO ] [MAIN ] ASH: Generated 1352 derivative records from 28027 primary records. [2025-09-05T19:09:25.270814] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-05T19:09:25.307598] [INFO ] [MAIN ] Derivative Progress: 142/2117 symbols completed. ASH took 1.1s. Estimated remaining: 10m 3s. Rate: 196.5 symbols/min [2025-09-05T19:09:25.308030] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:25.399898] [INFO ] [MAIN ] ASR: Loaded 4736 primary data records. [2025-09-05T19:09:25.567428] [INFO ] [MAIN ] ASIX: Generated 1352 derivative records from 17367 primary records. [2025-09-05T19:09:25.670922] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-05T19:09:25.673313] [INFO ] [MAIN ] Derivative Progress: 143/2117 symbols completed. ASIX took 1.0s. Estimated remaining: 10m 4s. Rate: 196.2 symbols/min [2025-09-05T19:09:25.675066] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:25.688411] [INFO ] [MAIN ] ASPN: Generated 1352 derivative records from 37433 primary records. [2025-09-05T19:09:25.702790] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-05T19:09:25.705324] [INFO ] [MAIN ] Derivative Progress: 144/2117 symbols completed. ASPN took 1.0s. Estimated remaining: 9m 60s. Rate: 197.4 symbols/min [2025-09-05T19:09:25.710917] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:25.722455] [INFO ] [MAIN ] ATEN: Loaded 18746 primary data records. [2025-09-05T19:09:25.776799] [INFO ] [MAIN ] ASR: Generated 871 derivative records from 4736 primary records. [2025-09-05T19:09:25.849158] [INFO ] [MAIN ] ATGE: Loaded 14295 primary data records. [2025-09-05T19:09:25.982226] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-05T19:09:26.009599] [INFO ] [MAIN ] Derivative Progress: 145/2117 symbols completed. ASR took 0.7s. Estimated remaining: 9m 59s. Rate: 197.4 symbols/min [2025-09-05T19:09:26.075088] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:26.227485] [INFO ] [MAIN ] ATHM: Loaded 13690 primary data records. [2025-09-05T19:09:26.487620] [INFO ] [MAIN ] ATEN: Generated 871 derivative records from 18746 primary records. [2025-09-05T19:09:26.499738] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-05T19:09:26.508948] [INFO ] [MAIN ] Derivative Progress: 146/2117 symbols completed. ATEN took 0.8s. Estimated remaining: 10m 2s. Rate: 196.5 symbols/min [2025-09-05T19:09:26.510288] [INFO ] [MAIN ] ATGE: Generated 871 derivative records from 14295 primary records. [2025-09-05T19:09:26.510867] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:26.522062] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-05T19:09:26.523922] [INFO ] [MAIN ] Derivative Progress: 147/2117 symbols completed. ATGE took 0.8s. Estimated remaining: 9m 58s. Rate: 197.8 symbols/min [2025-09-05T19:09:26.530161] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:26.534336] [INFO ] [MAIN ] ATHS: Loaded 5149 primary data records. [2025-09-05T19:09:26.667250] [INFO ] [MAIN ] ATHM: Generated 871 derivative records from 13690 primary records. [2025-09-05T19:09:26.772297] [INFO ] [MAIN ] ATI: Loaded 25037 primary data records. [2025-09-05T19:09:26.916791] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-05T19:09:26.935486] [INFO ] [MAIN ] Derivative Progress: 148/2117 symbols completed. ATHM took 0.9s. Estimated remaining: 9m 59s. Rate: 197.3 symbols/min [2025-09-05T19:09:27.132624] [INFO ] [MAIN ] ATHS: Generated 1352 derivative records from 5149 primary records. [2025-09-05T19:09:27.146391] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-05T19:09:27.150182] [INFO ] [MAIN ] Derivative Progress: 149/2117 symbols completed. ATHS took 0.6s. Estimated remaining: 9m 57s. Rate: 197.7 symbols/min [2025-09-05T19:09:27.157901] [INFO ] [MAIN ] ATI: Generated 871 derivative records from 25037 primary records. [2025-09-05T19:09:27.165865] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-05T19:09:27.167342] [INFO ] [MAIN ] Derivative Progress: 150/2117 symbols completed. ATI took 0.6s. Estimated remaining: 9m 53s. Rate: 199.0 symbols/min [2025-09-05T19:09:27.167862] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:27.167762] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:27.168166] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:27.186985] [INFO ] [MAIN ] ATKR: Loaded 16804 primary data records. [2025-09-05T19:09:27.309536] [INFO ] [MAIN ] ATO: Loaded 19169 primary data records. [2025-09-05T19:09:27.469101] [INFO ] [MAIN ] ATMU: Loaded 28922 primary data records. [2025-09-05T19:09:28.016030] [INFO ] [MAIN ] ATKR: Generated 871 derivative records from 16804 primary records. [2025-09-05T19:09:28.034180] [INFO ] [MAIN ] ATO: Generated 871 derivative records from 19169 primary records. [2025-09-05T19:09:28.035564] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-05T19:09:28.037047] [INFO ] [MAIN ] Derivative Progress: 151/2117 symbols completed. ATKR took 0.9s. Estimated remaining: 10m 0s. Rate: 196.5 symbols/min [2025-09-05T19:09:28.037417] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:28.046194] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-05T19:09:28.048025] [INFO ] [MAIN ] Derivative Progress: 152/2117 symbols completed. ATO took 0.9s. Estimated remaining: 9m 56s. Rate: 197.8 symbols/min [2025-09-05T19:09:28.048240] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:28.068937] [INFO ] [MAIN ] ATMU: Generated 1352 derivative records from 28922 primary records. [2025-09-05T19:09:28.079656] [INFO ] [MAIN ] ATS: Loaded 8814 primary data records. [2025-09-05T19:09:28.152844] [INFO ] [MAIN ] ATR: Loaded 15200 primary data records. [2025-09-05T19:09:28.213956] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-05T19:09:28.246594] [INFO ] [MAIN ] Derivative Progress: 153/2117 symbols completed. ATMU took 1.1s. Estimated remaining: 9m 54s. Rate: 198.2 symbols/min [2025-09-05T19:09:28.272370] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:28.614203] [INFO ] [MAIN ] ATS: Generated 871 derivative records from 8814 primary records. [2025-09-05T19:09:28.615784] [INFO ] [MAIN ] ATUS: Loaded 37697 primary data records. [2025-09-05T19:09:28.690387] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-05T19:09:28.703335] [INFO ] [MAIN ] Derivative Progress: 154/2117 symbols completed. ATS took 0.7s. Estimated remaining: 9m 56s. Rate: 197.6 symbols/min [2025-09-05T19:09:28.739179] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:28.739059] [INFO ] [MAIN ] ATR: Generated 871 derivative records from 15200 primary records. [2025-09-05T19:09:28.825166] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-05T19:09:28.902701] [INFO ] [MAIN ] Derivative Progress: 155/2117 symbols completed. ATR took 0.9s. Estimated remaining: 9m 54s. Rate: 198.0 symbols/min [2025-09-05T19:09:28.914186] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:28.929666] [INFO ] [MAIN ] AUNA: Loaded 3602 primary data records. [2025-09-05T19:09:29.043407] [INFO ] [MAIN ] AU: Loaded 25612 primary data records. [2025-09-05T19:09:29.496609] [INFO ] [MAIN ] ATUS: Generated 1352 derivative records from 37697 primary records. [2025-09-05T19:09:29.516295] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-05T19:09:29.518762] [INFO ] [MAIN ] Derivative Progress: 156/2117 symbols completed. ATUS took 1.2s. Estimated remaining: 9m 58s. Rate: 196.7 symbols/min [2025-09-05T19:09:29.519271] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:29.534030] [INFO ] [MAIN ] AU: Generated 871 derivative records from 25612 primary records. [2025-09-05T19:09:29.545243] [INFO ] [MAIN ] AUNA: Generated 1352 derivative records from 3602 primary records. [2025-09-05T19:09:29.562113] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-05T19:09:29.564289] [INFO ] [MAIN ] Derivative Progress: 157/2117 symbols completed. AU took 0.8s. Estimated remaining: 9m 55s. Rate: 197.8 symbols/min [2025-09-05T19:09:29.573267] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:29.575960] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-05T19:09:29.579827] [INFO ] [MAIN ] Derivative Progress: 158/2117 symbols completed. AUNA took 0.7s. Estimated remaining: 9m 51s. Rate: 199.0 symbols/min [2025-09-05T19:09:29.580623] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:29.592167] [INFO ] [MAIN ] AVAL: Loaded 3865 primary data records. [2025-09-05T19:09:29.614873] [INFO ] [MAIN ] AVA: Loaded 29394 primary data records. [2025-09-05T19:09:29.953819] [INFO ] [MAIN ] AVB: Loaded 20473 primary data records. [2025-09-05T19:09:30.433485] [INFO ] [MAIN ] AVAL: Generated 871 derivative records from 3865 primary records. [2025-09-05T19:09:30.450591] [INFO ] [MAIN ] AVA: Generated 1352 derivative records from 29394 primary records. [2025-09-05T19:09:30.456104] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-05T19:09:30.457743] [INFO ] [MAIN ] Derivative Progress: 159/2117 symbols completed. AVAL took 0.9s. Estimated remaining: 9m 57s. Rate: 196.6 symbols/min [2025-09-05T19:09:30.463668] [INFO ] [MAIN ] AVBC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:30.474205] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-05T19:09:30.477195] [INFO ] [MAIN ] Derivative Progress: 160/2117 symbols completed. AVA took 1.0s. Estimated remaining: 9m 54s. Rate: 197.8 symbols/min [2025-09-05T19:09:30.477958] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:30.488073] [INFO ] [MAIN ] AVBC: Loaded 3538 primary data records. [2025-09-05T19:09:30.487715] [INFO ] [MAIN ] AVB: Generated 871 derivative records from 20473 primary records. [2025-09-05T19:09:30.558758] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-05T19:09:30.573966] [INFO ] [MAIN ] Derivative Progress: 161/2117 symbols completed. AVB took 1.0s. Estimated remaining: 9m 51s. Rate: 198.6 symbols/min [2025-09-05T19:09:30.602911] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:30.640881] [INFO ] [MAIN ] AVD: Loaded 11480 primary data records. [2025-09-05T19:09:30.839884] [INFO ] [MAIN ] AVNS: Loaded 16319 primary data records. [2025-09-05T19:09:31.105103] [INFO ] [MAIN ] AVBC: Generated 321 derivative records from 3538 primary records. [2025-09-05T19:09:31.186471] [INFO ] [MAIN ] AVBC: Successfully saved derivative data. [2025-09-05T19:09:31.187161] [INFO ] [MAIN ] Derivative Progress: 162/2117 symbols completed. AVBC took 0.7s. Estimated remaining: 9m 54s. Rate: 197.4 symbols/min [2025-09-05T19:09:31.187336] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:31.268349] [INFO ] [MAIN ] AVD: Generated 871 derivative records from 11480 primary records. [2025-09-05T19:09:31.283552] [INFO ] [MAIN ] AVNT: Loaded 19287 primary data records. [2025-09-05T19:09:31.284717] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-05T19:09:31.299052] [INFO ] [MAIN ] Derivative Progress: 163/2117 symbols completed. AVD took 0.8s. Estimated remaining: 9m 52s. Rate: 198.1 symbols/min [2025-09-05T19:09:31.360072] [INFO ] [MAIN ] AVNS: Generated 871 derivative records from 16319 primary records. [2025-09-05T19:09:31.482974] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-05T19:09:31.543018] [INFO ] [MAIN ] Derivative Progress: 164/2117 symbols completed. AVNS took 1.0s. Estimated remaining: 9m 51s. Rate: 198.4 symbols/min [2025-09-05T19:09:31.558796] [INFO ] [MAIN ] AVNT: Generated 871 derivative records from 19287 primary records. [2025-09-05T19:09:31.567063] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-05T19:09:31.568542] [INFO ] [MAIN ] Derivative Progress: 165/2117 symbols completed. AVNT took 0.4s. Estimated remaining: 9m 47s. Rate: 199.5 symbols/min [2025-09-05T19:09:31.569584] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:31.569289] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:31.569724] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:31.606389] [INFO ] [MAIN ] AVY: Loaded 17177 primary data records. [2025-09-05T19:09:31.606910] [INFO ] [MAIN ] AWF: Loaded 17390 primary data records. [2025-09-05T19:09:31.819933] [INFO ] [MAIN ] AVTR: Loaded 25989 primary data records. [2025-09-05T19:09:32.380669] [INFO ] [MAIN ] AVY: Generated 871 derivative records from 17177 primary records. [2025-09-05T19:09:32.401705] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-05T19:09:32.400737] [INFO ] [MAIN ] AWF: Generated 1352 derivative records from 17390 primary records. [2025-09-05T19:09:32.403656] [INFO ] [MAIN ] Derivative Progress: 166/2117 symbols completed. AVY took 0.8s. Estimated remaining: 9m 53s. Rate: 197.4 symbols/min [2025-09-05T19:09:32.404058] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:32.423633] [INFO ] [MAIN ] AVTR: Generated 871 derivative records from 25989 primary records. [2025-09-05T19:09:32.435566] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-05T19:09:32.443571] [INFO ] [MAIN ] Derivative Progress: 167/2117 symbols completed. AWF took 0.9s. Estimated remaining: 9m 50s. Rate: 198.4 symbols/min [2025-09-05T19:09:32.444440] [INFO ] [MAIN ] AWI: Loaded 12650 primary data records. [2025-09-05T19:09:32.444669] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:32.445611] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-05T19:09:32.467927] [INFO ] [MAIN ] Derivative Progress: 168/2117 symbols completed. AVTR took 0.9s. Estimated remaining: 9m 46s. Rate: 199.5 symbols/min [2025-09-05T19:09:32.484396] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:32.697990] [INFO ] [MAIN ] AWP: Loaded 16955 primary data records. [2025-09-05T19:09:32.823103] [INFO ] [MAIN ] AWK: Loaded 36394 primary data records. [2025-09-05T19:09:33.165666] [INFO ] [MAIN ] AWI: Generated 871 derivative records from 12650 primary records. [2025-09-05T19:09:33.314393] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-05T19:09:33.316033] [INFO ] [MAIN ] Derivative Progress: 169/2117 symbols completed. AWI took 0.9s. Estimated remaining: 9m 52s. Rate: 197.4 symbols/min [2025-09-05T19:09:33.316269] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:33.338782] [INFO ] [MAIN ] AWP: Generated 1352 derivative records from 16955 primary records. [2025-09-05T19:09:33.345385] [INFO ] [MAIN ] AWR: Loaded 16442 primary data records. [2025-09-05T19:09:33.469081] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-05T19:09:33.465632] [INFO ] [MAIN ] AWK: Generated 1352 derivative records from 36394 primary records. [2025-09-05T19:09:33.471870] [INFO ] [MAIN ] Derivative Progress: 170/2117 symbols completed. AWP took 1.0s. Estimated remaining: 9m 50s. Rate: 197.9 symbols/min [2025-09-05T19:09:33.483433] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:33.563294] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-05T19:09:33.565587] [INFO ] [MAIN ] Derivative Progress: 171/2117 symbols completed. AWK took 1.1s. Estimated remaining: 9m 48s. Rate: 198.7 symbols/min [2025-09-05T19:09:33.654189] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:33.654659] [INFO ] [MAIN ] AX: Loaded 13142 primary data records. [2025-09-05T19:09:33.904915] [INFO ] [MAIN ] AXL: Loaded 24443 primary data records. [2025-09-05T19:09:34.097072] [INFO ] [MAIN ] AWR: Generated 1352 derivative records from 16442 primary records. [2025-09-05T19:09:34.169459] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-05T19:09:34.171748] [INFO ] [MAIN ] Derivative Progress: 172/2117 symbols completed. AWR took 0.9s. Estimated remaining: 9m 51s. Rate: 197.6 symbols/min [2025-09-05T19:09:34.178743] [INFO ] [MAIN ] AX: Generated 871 derivative records from 13142 primary records. [2025-09-05T19:09:34.178977] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:34.188678] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-05T19:09:34.190531] [INFO ] [MAIN ] Derivative Progress: 173/2117 symbols completed. AX took 0.7s. Estimated remaining: 9m 47s. Rate: 198.7 symbols/min [2025-09-05T19:09:34.191109] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:34.194624] [INFO ] [MAIN ] AXR: Loaded 1539 primary data records. [2025-09-05T19:09:34.287782] [INFO ] [MAIN ] AXL: Generated 871 derivative records from 24443 primary records. [2025-09-05T19:09:34.338615] [INFO ] [MAIN ] AXP: Loaded 25843 primary data records. [2025-09-05T19:09:34.451522] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-05T19:09:34.563452] [INFO ] [MAIN ] Derivative Progress: 174/2117 symbols completed. AXL took 0.9s. Estimated remaining: 9m 48s. Rate: 198.4 symbols/min [2025-09-05T19:09:34.571189] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:34.719538] [INFO ] [MAIN ] AXS: Loaded 18849 primary data records. [2025-09-05T19:09:34.836332] [INFO ] [MAIN ] AXR: Generated 871 derivative records from 1539 primary records. [2025-09-05T19:09:34.975512] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-05T19:09:34.977221] [INFO ] [MAIN ] Derivative Progress: 175/2117 symbols completed. AXR took 0.8s. Estimated remaining: 9m 49s. Rate: 198.0 symbols/min [2025-09-05T19:09:34.978635] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:34.978384] [INFO ] [MAIN ] AXP: Generated 871 derivative records from 25843 primary records. [2025-09-05T19:09:34.989482] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-05T19:09:34.990982] [INFO ] [MAIN ] Derivative Progress: 176/2117 symbols completed. AXP took 0.8s. Estimated remaining: 9m 45s. Rate: 199.0 symbols/min [2025-09-05T19:09:34.991232] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:35.003865] [INFO ] [MAIN ] AXS: Generated 871 derivative records from 18849 primary records. [2025-09-05T19:09:35.026835] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-05T19:09:35.028539] [INFO ] [MAIN ] Derivative Progress: 177/2117 symbols completed. AXS took 0.5s. Estimated remaining: 9m 42s. Rate: 200.0 symbols/min [2025-09-05T19:09:35.034777] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:35.036960] [INFO ] [MAIN ] AYI: Loaded 18488 primary data records. [2025-09-05T19:09:35.145377] [INFO ] [MAIN ] AZO: Loaded 5123 primary data records. [2025-09-05T19:09:35.145461] [INFO ] [MAIN ] AXTA: Loaded 39242 primary data records. [2025-09-05T19:09:35.924309] [INFO ] [MAIN ] AYI: Generated 1351 derivative records from 18488 primary records. [2025-09-05T19:09:35.926303] [INFO ] [MAIN ] AZO: Generated 871 derivative records from 5123 primary records. [2025-09-05T19:09:35.948012] [INFO ] [MAIN ] AXTA: Generated 1352 derivative records from 39242 primary records. [2025-09-05T19:09:35.955949] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-05T19:09:35.958266] [INFO ] [MAIN ] Derivative Progress: 178/2117 symbols completed. AZO took 0.9s. Estimated remaining: 9m 48s. Rate: 197.7 symbols/min [2025-09-05T19:09:35.970303] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-05T19:09:35.972707] [INFO ] [MAIN ] Derivative Progress: 179/2117 symbols completed. AYI took 1.0s. Estimated remaining: 9m 45s. Rate: 198.8 symbols/min [2025-09-05T19:09:35.974870] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-05T19:09:35.977243] [INFO ] [MAIN ] Derivative Progress: 180/2117 symbols completed. AXTA took 1.0s. Estimated remaining: 9m 42s. Rate: 199.9 symbols/min [2025-09-05T19:09:35.977929] [INFO ] [MAIN ] B: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:35.977802] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:35.978028] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:36.011584] [INFO ] [MAIN ] AZZ: Loaded 16888 primary data records. [2025-09-05T19:09:36.130762] [INFO ] [MAIN ] B: Loaded 26113 primary data records. [2025-09-05T19:09:36.286300] [INFO ] [MAIN ] BA: Loaded 40532 primary data records. [2025-09-05T19:09:36.835215] [INFO ] [MAIN ] B: Generated 871 derivative records from 26113 primary records. [2025-09-05T19:09:36.850916] [INFO ] [MAIN ] B: Successfully saved derivative data. [2025-09-05T19:09:36.852621] [INFO ] [MAIN ] Derivative Progress: 181/2117 symbols completed. B took 0.9s. Estimated remaining: 9m 47s. Rate: 197.8 symbols/min [2025-09-05T19:09:36.852931] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:36.866168] [INFO ] [MAIN ] AZZ: Generated 1352 derivative records from 16888 primary records. [2025-09-05T19:09:36.878310] [INFO ] [MAIN ] BA: Generated 1352 derivative records from 40532 primary records. [2025-09-05T19:09:36.903361] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-05T19:09:36.915969] [INFO ] [MAIN ] Derivative Progress: 182/2117 symbols completed. AZZ took 0.9s. Estimated remaining: 9m 45s. Rate: 198.6 symbols/min [2025-09-05T19:09:36.918344] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:36.920103] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-05T19:09:36.922624] [INFO ] [MAIN ] Derivative Progress: 183/2117 symbols completed. BA took 0.9s. Estimated remaining: 9m 41s. Rate: 199.7 symbols/min [2025-09-05T19:09:36.923944] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:36.933959] [INFO ] [MAIN ] BABA: Loaded 26191 primary data records. [2025-09-05T19:09:37.158540] [INFO ] [MAIN ] BAH: Loaded 24980 primary data records. [2025-09-05T19:09:37.349577] [INFO ] [MAIN ] BAC: Loaded 40548 primary data records. [2025-09-05T19:09:37.781564] [INFO ] [MAIN ] BABA: Generated 871 derivative records from 26191 primary records. [2025-09-05T19:09:37.795162] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-05T19:09:37.798199] [INFO ] [MAIN ] Derivative Progress: 184/2117 symbols completed. BABA took 0.9s. Estimated remaining: 9m 47s. Rate: 197.6 symbols/min [2025-09-05T19:09:37.798587] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:37.815098] [INFO ] [MAIN ] BAH: Generated 871 derivative records from 24980 primary records. [2025-09-05T19:09:37.839569] [INFO ] [MAIN ] BAK: Loaded 19351 primary data records. [2025-09-05T19:09:37.840300] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-05T19:09:37.853156] [INFO ] [MAIN ] Derivative Progress: 185/2117 symbols completed. BAH took 0.9s. Estimated remaining: 9m 44s. Rate: 198.5 symbols/min [2025-09-05T19:09:37.872773] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:37.981726] [INFO ] [MAIN ] BAC: Generated 1352 derivative records from 40548 primary records. [2025-09-05T19:09:38.126853] [INFO ] [MAIN ] BALL: Loaded 24877 primary data records. [2025-09-05T19:09:38.151667] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-05T19:09:38.164700] [INFO ] [MAIN ] Derivative Progress: 186/2117 symbols completed. BAC took 1.2s. Estimated remaining: 9m 44s. Rate: 198.5 symbols/min [2025-09-05T19:09:38.189759] [INFO ] [MAIN ] BALY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:38.337369] [INFO ] [MAIN ] BALY: Loaded 4400 primary data records. [2025-09-05T19:09:38.564279] [INFO ] [MAIN ] BAK: Generated 871 derivative records from 19351 primary records. [2025-09-05T19:09:38.710549] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-05T19:09:38.712596] [INFO ] [MAIN ] Derivative Progress: 187/2117 symbols completed. BAK took 0.9s. Estimated remaining: 9m 46s. Rate: 197.6 symbols/min [2025-09-05T19:09:38.713659] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:38.726914] [INFO ] [MAIN ] BALL: Generated 871 derivative records from 24877 primary records. [2025-09-05T19:09:38.736308] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-05T19:09:38.738041] [INFO ] [MAIN ] Derivative Progress: 188/2117 symbols completed. BALL took 0.9s. Estimated remaining: 9m 43s. Rate: 198.6 symbols/min [2025-09-05T19:09:38.745225] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:38.762156] [INFO ] [MAIN ] BALY: Generated 871 derivative records from 4400 primary records. [2025-09-05T19:09:38.784384] [INFO ] [MAIN ] BALY: Successfully saved derivative data. [2025-09-05T19:09:38.783215] [INFO ] [MAIN ] BAM: Loaded 25081 primary data records. [2025-09-05T19:09:38.787053] [INFO ] [MAIN ] Derivative Progress: 189/2117 symbols completed. BALY took 0.6s. Estimated remaining: 9m 40s. Rate: 199.5 symbols/min [2025-09-05T19:09:38.792419] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:38.998749] [INFO ] [MAIN ] BAP: Loaded 19316 primary data records. [2025-09-05T19:09:39.102322] [INFO ] [MAIN ] BANC: Loaded 38427 primary data records. [2025-09-05T19:09:39.627791] [INFO ] [MAIN ] BAM: Generated 871 derivative records from 25081 primary records. [2025-09-05T19:09:39.640184] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-05T19:09:39.642077] [INFO ] [MAIN ] Derivative Progress: 190/2117 symbols completed. BAM took 0.9s. Estimated remaining: 9m 45s. Rate: 197.6 symbols/min [2025-09-05T19:09:39.643082] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:39.671543] [INFO ] [MAIN ] BANC: Generated 1352 derivative records from 38427 primary records. [2025-09-05T19:09:39.672351] [INFO ] [MAIN ] BAP: Generated 1352 derivative records from 19316 primary records. [2025-09-05T19:09:39.707306] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-05T19:09:39.720069] [INFO ] [MAIN ] Derivative Progress: 191/2117 symbols completed. BAP took 0.9s. Estimated remaining: 9m 43s. Rate: 198.3 symbols/min [2025-09-05T19:09:39.717689] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-05T19:09:39.722699] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:39.722844] [INFO ] [MAIN ] Derivative Progress: 192/2117 symbols completed. BANC took 1.0s. Estimated remaining: 9m 39s. Rate: 199.4 symbols/min [2025-09-05T19:09:39.724812] [INFO ] [MAIN ] BARK: Loaded 29135 primary data records. [2025-09-05T19:09:39.725059] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:40.015860] [INFO ] [MAIN ] BAX: Loaded 25987 primary data records. [2025-09-05T19:09:40.146313] [INFO ] [MAIN ] BB: Loaded 39754 primary data records. [2025-09-05T19:09:40.564908] [INFO ] [MAIN ] BARK: Generated 1352 derivative records from 29135 primary records. [2025-09-05T19:09:40.582329] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-05T19:09:40.584782] [INFO ] [MAIN ] Derivative Progress: 193/2117 symbols completed. BARK took 0.9s. Estimated remaining: 9m 45s. Rate: 197.5 symbols/min [2025-09-05T19:09:40.592264] [INFO ] [MAIN ] BAX: Generated 871 derivative records from 25987 primary records. [2025-09-05T19:09:40.601332] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-05T19:09:40.603190] [INFO ] [MAIN ] Derivative Progress: 194/2117 symbols completed. BAX took 0.9s. Estimated remaining: 9m 42s. Rate: 198.4 symbols/min [2025-09-05T19:09:40.614673] [INFO ] [MAIN ] BB: Generated 1352 derivative records from 39754 primary records. [2025-09-05T19:09:40.626918] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-05T19:09:40.629183] [INFO ] [MAIN ] Derivative Progress: 195/2117 symbols completed. BB took 0.9s. Estimated remaining: 9m 38s. Rate: 199.3 symbols/min [2025-09-05T19:09:40.629825] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:40.629789] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:40.630154] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:40.635009] [INFO ] [MAIN ] BBDO: Loaded 2160 primary data records. [2025-09-05T19:09:40.949356] [INFO ] [MAIN ] BBD: Loaded 25829 primary data records. [2025-09-05T19:09:40.950894] [INFO ] [MAIN ] BBAR: Loaded 31030 primary data records. [2025-09-05T19:09:41.493183] [INFO ] [MAIN ] BBDO: Generated 871 derivative records from 2160 primary records. [2025-09-05T19:09:41.503471] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-05T19:09:41.505121] [INFO ] [MAIN ] Derivative Progress: 196/2117 symbols completed. BBDO took 0.9s. Estimated remaining: 9m 44s. Rate: 197.4 symbols/min [2025-09-05T19:09:41.505876] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:41.516920] [INFO ] [MAIN ] BBD: Generated 871 derivative records from 25829 primary records. [2025-09-05T19:09:41.530277] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-05T19:09:41.531865] [INFO ] [MAIN ] Derivative Progress: 197/2117 symbols completed. BBD took 0.9s. Estimated remaining: 9m 41s. Rate: 198.3 symbols/min [2025-09-05T19:09:41.532186] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:41.542060] [INFO ] [MAIN ] BBN: Loaded 14035 primary data records. [2025-09-05T19:09:41.598338] [INFO ] [MAIN ] BBU: Loaded 2434 primary data records. [2025-09-05T19:09:41.599374] [INFO ] [MAIN ] BBAR: Generated 1352 derivative records from 31030 primary records. [2025-09-05T19:09:41.832504] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-05T19:09:41.913498] [INFO ] [MAIN ] Derivative Progress: 198/2117 symbols completed. BBAR took 1.3s. Estimated remaining: 9m 41s. Rate: 198.1 symbols/min [2025-09-05T19:09:42.090774] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:42.106110] [INFO ] [MAIN ] BBUC: Loaded 5948 primary data records. [2025-09-05T19:09:42.232492] [INFO ] [MAIN ] BBU: Generated 871 derivative records from 2434 primary records. [2025-09-05T19:09:42.280681] [INFO ] [MAIN ] BBN: Generated 1352 derivative records from 14035 primary records. [2025-09-05T19:09:42.423740] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-05T19:09:42.427425] [INFO ] [MAIN ] Derivative Progress: 199/2117 symbols completed. BBU took 0.9s. Estimated remaining: 9m 43s. Rate: 197.4 symbols/min [2025-09-05T19:09:42.428777] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:42.431618] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-05T19:09:42.434502] [INFO ] [MAIN ] Derivative Progress: 200/2117 symbols completed. BBN took 0.9s. Estimated remaining: 9m 40s. Rate: 198.4 symbols/min [2025-09-05T19:09:42.435066] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:42.457293] [INFO ] [MAIN ] BBUC: Generated 871 derivative records from 5948 primary records. [2025-09-05T19:09:42.463907] [INFO ] [MAIN ] BBW: Loaded 11544 primary data records. [2025-09-05T19:09:42.582271] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-05T19:09:42.584012] [INFO ] [MAIN ] Derivative Progress: 201/2117 symbols completed. BBUC took 0.5s. Estimated remaining: 9m 38s. Rate: 198.9 symbols/min [2025-09-05T19:09:42.585249] [INFO ] [MAIN ] BBVA: Loaded 23717 primary data records. [2025-09-05T19:09:42.606221] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:42.982636] [INFO ] [MAIN ] BBWI: Loaded 25992 primary data records. [2025-09-05T19:09:43.232859] [INFO ] [MAIN ] BBW: Generated 871 derivative records from 11544 primary records. [2025-09-05T19:09:43.251038] [INFO ] [MAIN ] BBVA: Generated 871 derivative records from 23717 primary records. [2025-09-05T19:09:43.259890] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-05T19:09:43.261958] [INFO ] [MAIN ] Derivative Progress: 202/2117 symbols completed. BBW took 0.8s. Estimated remaining: 9m 41s. Rate: 197.6 symbols/min [2025-09-05T19:09:43.262344] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:43.265072] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-05T19:09:43.266857] [INFO ] [MAIN ] Derivative Progress: 203/2117 symbols completed. BBVA took 0.8s. Estimated remaining: 9m 38s. Rate: 198.6 symbols/min [2025-09-05T19:09:43.267272] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:43.278488] [INFO ] [MAIN ] BBWI: Generated 871 derivative records from 25992 primary records. [2025-09-05T19:09:43.297125] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-05T19:09:43.314883] [INFO ] [MAIN ] Derivative Progress: 204/2117 symbols completed. BBWI took 0.7s. Estimated remaining: 9m 36s. Rate: 199.4 symbols/min [2025-09-05T19:09:43.315205] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:43.316312] [INFO ] [MAIN ] BC: Loaded 21072 primary data records. [2025-09-05T19:09:43.442929] [INFO ] [MAIN ] BBY: Loaded 40261 primary data records. [2025-09-05T19:09:43.717112] [INFO ] [MAIN ] BCAT: Loaded 25630 primary data records. [2025-09-05T19:09:44.176703] [INFO ] [MAIN ] BC: Generated 871 derivative records from 21072 primary records. [2025-09-05T19:09:44.191106] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-05T19:09:44.192678] [INFO ] [MAIN ] Derivative Progress: 205/2117 symbols completed. BC took 0.9s. Estimated remaining: 9m 41s. Rate: 197.6 symbols/min [2025-09-05T19:09:44.193466] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:44.210150] [INFO ] [MAIN ] BBY: Generated 1352 derivative records from 40261 primary records. [2025-09-05T19:09:44.243945] [INFO ] [MAIN ] BCC: Loaded 13782 primary data records. [2025-09-05T19:09:44.244556] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-05T19:09:44.260806] [INFO ] [MAIN ] Derivative Progress: 206/2117 symbols completed. BBY took 1.0s. Estimated remaining: 9m 38s. Rate: 198.3 symbols/min [2025-09-05T19:09:44.245455] [INFO ] [MAIN ] BCAT: Generated 1352 derivative records from 25630 primary records. [2025-09-05T19:09:44.309392] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:44.461722] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-05T19:09:44.511874] [INFO ] [MAIN ] BCH: Loaded 13792 primary data records. [2025-09-05T19:09:44.514137] [INFO ] [MAIN ] Derivative Progress: 207/2117 symbols completed. BCAT took 1.2s. Estimated remaining: 9m 37s. Rate: 198.5 symbols/min [2025-09-05T19:09:44.550982] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:44.779695] [INFO ] [MAIN ] BCO: Loaded 12344 primary data records. [2025-09-05T19:09:44.889596] [INFO ] [MAIN ] BCC: Generated 871 derivative records from 13782 primary records. [2025-09-05T19:09:45.048853] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-05T19:09:45.050320] [INFO ] [MAIN ] Derivative Progress: 208/2117 symbols completed. BCC took 0.9s. Estimated remaining: 9m 39s. Rate: 197.7 symbols/min [2025-09-05T19:09:45.063015] [INFO ] [MAIN ] BCH: Generated 871 derivative records from 13792 primary records. [2025-09-05T19:09:45.072318] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-05T19:09:45.074436] [INFO ] [MAIN ] Derivative Progress: 209/2117 symbols completed. BCH took 0.8s. Estimated remaining: 9m 36s. Rate: 198.6 symbols/min [2025-09-05T19:09:45.082488] [INFO ] [MAIN ] BCO: Generated 871 derivative records from 12344 primary records. [2025-09-05T19:09:45.090518] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-05T19:09:45.092100] [INFO ] [MAIN ] Derivative Progress: 210/2117 symbols completed. BCO took 0.5s. Estimated remaining: 9m 33s. Rate: 199.5 symbols/min [2025-09-05T19:09:45.092750] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:45.092691] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:45.092573] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:45.110041] [INFO ] [MAIN ] BCSF: Loaded 12659 primary data records. [2025-09-05T19:09:45.213068] [INFO ] [MAIN ] BCX: Loaded 10566 primary data records. [2025-09-05T19:09:45.398169] [INFO ] [MAIN ] BCS: Loaded 25924 primary data records. [2025-09-05T19:09:45.866959] [INFO ] [MAIN ] BCSF: Generated 871 derivative records from 12659 primary records. [2025-09-05T19:09:45.877279] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-05T19:09:45.878608] [INFO ] [MAIN ] Derivative Progress: 211/2117 symbols completed. BCSF took 0.8s. Estimated remaining: 9m 38s. Rate: 198.0 symbols/min [2025-09-05T19:09:45.878925] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:45.888897] [INFO ] [MAIN ] BCX: Generated 871 derivative records from 10566 primary records. [2025-09-05T19:09:45.900897] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-05T19:09:45.903316] [INFO ] [MAIN ] Derivative Progress: 212/2117 symbols completed. BCX took 0.8s. Estimated remaining: 9m 35s. Rate: 198.9 symbols/min [2025-09-05T19:09:45.904463] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:45.910409] [INFO ] [MAIN ] BDC: Loaded 11884 primary data records. [2025-09-05T19:09:45.941294] [INFO ] [MAIN ] BCS: Generated 871 derivative records from 25924 primary records. [2025-09-05T19:09:46.122784] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-05T19:09:46.123731] [INFO ] [MAIN ] BDJ: Loaded 22185 primary data records. [2025-09-05T19:09:46.125697] [INFO ] [MAIN ] Derivative Progress: 213/2117 symbols completed. BCS took 1.0s. Estimated remaining: 9m 34s. Rate: 199.1 symbols/min [2025-09-05T19:09:46.245161] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:46.522277] [INFO ] [MAIN ] BDC: Generated 871 derivative records from 11884 primary records. [2025-09-05T19:09:46.539783] [INFO ] [MAIN ] BDX: Loaded 39774 primary data records. [2025-09-05T19:09:46.586177] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-05T19:09:46.615724] [INFO ] [MAIN ] Derivative Progress: 214/2117 symbols completed. BDC took 0.7s. Estimated remaining: 9m 35s. Rate: 198.5 symbols/min [2025-09-05T19:09:46.652465] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:46.850764] [INFO ] [MAIN ] BDJ: Generated 1352 derivative records from 22185 primary records. [2025-09-05T19:09:46.875305] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-05T19:09:46.876705] [INFO ] [MAIN ] BE: Loaded 26051 primary data records. [2025-09-05T19:09:46.879818] [INFO ] [MAIN ] Derivative Progress: 215/2117 symbols completed. BDJ took 1.0s. Estimated remaining: 9m 35s. Rate: 198.6 symbols/min [2025-09-05T19:09:46.900720] [INFO ] [MAIN ] BEDU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:46.952337] [INFO ] [MAIN ] BEDU: Loaded 198 primary data records. [2025-09-05T19:09:47.382547] [INFO ] [MAIN ] BDX: Generated 1352 derivative records from 39774 primary records. [2025-09-05T19:09:47.397708] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-05T19:09:47.400551] [INFO ] [MAIN ] Derivative Progress: 216/2117 symbols completed. BDX took 1.2s. Estimated remaining: 9m 36s. Rate: 198.0 symbols/min [2025-09-05T19:09:47.401125] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:47.409162] [INFO ] [MAIN ] BE: Generated 871 derivative records from 26051 primary records. [2025-09-05T19:09:47.421622] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-05T19:09:47.423800] [INFO ] [MAIN ] Derivative Progress: 217/2117 symbols completed. BE took 0.8s. Estimated remaining: 9m 33s. Rate: 198.8 symbols/min [2025-09-05T19:09:47.424143] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:47.436750] [INFO ] [MAIN ] BEDU: Generated 871 derivative records from 198 primary records. [2025-09-05T19:09:47.450021] [INFO ] [MAIN ] BEDU: Successfully saved derivative data. [2025-09-05T19:09:47.452796] [INFO ] [MAIN ] Derivative Progress: 218/2117 symbols completed. BEDU took 0.6s. Estimated remaining: 9m 31s. Rate: 199.7 symbols/min [2025-09-05T19:09:47.453120] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:47.450520] [INFO ] [MAIN ] BEP: Loaded 18333 primary data records. [2025-09-05T19:09:47.586595] [INFO ] [MAIN ] BEPH: Loaded 2369 primary data records. [2025-09-05T19:09:47.702580] [INFO ] [MAIN ] BEPC: Loaded 34653 primary data records. [2025-09-05T19:09:48.242412] [INFO ] [MAIN ] BEP: Generated 871 derivative records from 18333 primary records. [2025-09-05T19:09:48.252701] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-05T19:09:48.254368] [INFO ] [MAIN ] Derivative Progress: 219/2117 symbols completed. BEP took 0.9s. Estimated remaining: 9m 35s. Rate: 198.1 symbols/min [2025-09-05T19:09:48.254917] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:48.266022] [INFO ] [MAIN ] BEPH: Generated 871 derivative records from 2369 primary records. [2025-09-05T19:09:48.268577] [INFO ] [MAIN ] BEPI: Loaded 2910 primary data records. [2025-09-05T19:09:48.320922] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-05T19:09:48.343964] [INFO ] [MAIN ] Derivative Progress: 220/2117 symbols completed. BEPH took 0.9s. Estimated remaining: 9m 33s. Rate: 198.8 symbols/min [2025-09-05T19:09:48.344844] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:48.396669] [INFO ] [MAIN ] BEPC: Generated 1352 derivative records from 34653 primary records. [2025-09-05T19:09:48.420850] [INFO ] [MAIN ] BEPJ: Loaded 2021 primary data records. [2025-09-05T19:09:48.674621] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-05T19:09:48.680625] [INFO ] [MAIN ] Derivative Progress: 221/2117 symbols completed. BEPC took 1.3s. Estimated remaining: 9m 33s. Rate: 198.7 symbols/min [2025-09-05T19:09:48.728380] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:48.880892] [INFO ] [MAIN ] BFAM: Loaded 16402 primary data records. [2025-09-05T19:09:48.966544] [INFO ] [MAIN ] BEPI: Generated 1352 derivative records from 2910 primary records. [2025-09-05T19:09:49.044451] [INFO ] [MAIN ] BEPJ: Generated 871 derivative records from 2021 primary records. [2025-09-05T19:09:49.100455] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-05T19:09:49.127437] [INFO ] [MAIN ] Derivative Progress: 222/2117 symbols completed. BEPJ took 0.8s. Estimated remaining: 9m 34s. Rate: 198.2 symbols/min [2025-09-05T19:09:49.131686] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-05T19:09:49.133947] [INFO ] [MAIN ] Derivative Progress: 223/2117 symbols completed. BEPI took 0.9s. Estimated remaining: 9m 31s. Rate: 199.1 symbols/min [2025-09-05T19:09:49.134089] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:49.206044] [INFO ] [MAIN ] BFAM: Generated 871 derivative records from 16402 primary records. [2025-09-05T19:09:49.223291] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-05T19:09:49.224704] [INFO ] [MAIN ] Derivative Progress: 224/2117 symbols completed. BFAM took 0.5s. Estimated remaining: 9m 29s. Rate: 199.7 symbols/min [2025-09-05T19:09:49.238829] [INFO ] [MAIN ] BFH: Loaded 31219 primary data records. [2025-09-05T19:09:49.517692] [INFO ] [MAIN ] BFH: Generated 1352 derivative records from 31219 primary records. [2025-09-05T19:09:49.529588] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-05T19:09:49.531665] [INFO ] [MAIN ] Derivative Progress: 225/2117 symbols completed. BFH took 0.4s. Estimated remaining: 9m 28s. Rate: 199.7 symbols/min [2025-09-05T19:09:49.532188] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:49.532425] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:49.532540] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:49.539485] [INFO ] [MAIN ] BFS: Loaded 4656 primary data records. [2025-09-05T19:09:49.602505] [INFO ] [MAIN ] BFK: Loaded 10550 primary data records. [2025-09-05T19:09:49.965100] [INFO ] [MAIN ] BFLY: Loaded 39082 primary data records. [2025-09-05T19:09:50.384457] [INFO ] [MAIN ] BFS: Generated 871 derivative records from 4656 primary records. [2025-09-05T19:09:50.395874] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-05T19:09:50.398200] [INFO ] [MAIN ] Derivative Progress: 226/2117 symbols completed. BFS took 0.9s. Estimated remaining: 9m 33s. Rate: 198.1 symbols/min [2025-09-05T19:09:50.399231] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:50.411024] [INFO ] [MAIN ] BFK: Generated 1352 derivative records from 10550 primary records. [2025-09-05T19:09:50.426925] [INFO ] [MAIN ] BFZ: Loaded 6091 primary data records. [2025-09-05T19:09:50.476187] [INFO ] [MAIN ] BFLY: Generated 1352 derivative records from 39082 primary records. [2025-09-05T19:09:50.496287] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-05T19:09:50.513273] [INFO ] [MAIN ] Derivative Progress: 227/2117 symbols completed. BFK took 1.0s. Estimated remaining: 9m 31s. Rate: 198.6 symbols/min [2025-09-05T19:09:50.541488] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:50.605883] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-05T19:09:50.635463] [INFO ] [MAIN ] Derivative Progress: 228/2117 symbols completed. BFLY took 1.1s. Estimated remaining: 9m 29s. Rate: 199.1 symbols/min [2025-09-05T19:09:50.690763] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:50.708398] [INFO ] [MAIN ] BGR: Loaded 6419 primary data records. [2025-09-05T19:09:50.739074] [INFO ] [MAIN ] BG: Loaded 24724 primary data records. [2025-09-05T19:09:51.026393] [INFO ] [MAIN ] BFZ: Generated 871 derivative records from 6091 primary records. [2025-09-05T19:09:51.174973] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-05T19:09:51.282942] [INFO ] [MAIN ] Derivative Progress: 229/2117 symbols completed. BFZ took 0.9s. Estimated remaining: 9m 32s. Rate: 198.1 symbols/min [2025-09-05T19:09:51.283753] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:51.302286] [INFO ] [MAIN ] BGR: Generated 871 derivative records from 6419 primary records. [2025-09-05T19:09:51.319042] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-05T19:09:51.338584] [INFO ] [MAIN ] Derivative Progress: 230/2117 symbols completed. BGR took 0.6s. Estimated remaining: 9m 29s. Rate: 198.8 symbols/min [2025-09-05T19:09:51.339865] [INFO ] [MAIN ] BG: Generated 871 derivative records from 24724 primary records. [2025-09-05T19:09:51.340222] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:51.354909] [INFO ] [MAIN ] BGSF: Loaded 3999 primary data records. [2025-09-05T19:09:51.352030] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-05T19:09:51.391388] [INFO ] [MAIN ] Derivative Progress: 231/2117 symbols completed. BG took 0.8s. Estimated remaining: 9m 27s. Rate: 199.6 symbols/min [2025-09-05T19:09:51.416406] [INFO ] [MAIN ] BGS: Loaded 37991 primary data records. [2025-09-05T19:09:51.442801] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:51.634950] [INFO ] [MAIN ] BGX: Loaded 7771 primary data records. [2025-09-05T19:09:52.520386] [INFO ] [MAIN ] BGSF: Generated 1352 derivative records from 3999 primary records. [2025-09-05T19:09:52.534305] [INFO ] [MAIN ] BGS: Generated 1352 derivative records from 37991 primary records. [2025-09-05T19:09:52.572623] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-05T19:09:52.578441] [INFO ] [MAIN ] Derivative Progress: 232/2117 symbols completed. BGSF took 1.2s. Estimated remaining: 9m 34s. Rate: 197.1 symbols/min [2025-09-05T19:09:52.578947] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:52.575635] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-05T19:09:52.583515] [INFO ] [MAIN ] Derivative Progress: 233/2117 symbols completed. BGS took 1.3s. Estimated remaining: 9m 31s. Rate: 197.9 symbols/min [2025-09-05T19:09:52.584256] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:52.603447] [INFO ] [MAIN ] BGX: Generated 1352 derivative records from 7771 primary records. [2025-09-05T19:09:52.638870] [INFO ] [MAIN ] BH: Loaded 9816 primary data records. [2025-09-05T19:09:52.641185] [INFO ] [MAIN ] BGY: Loaded 11195 primary data records. [2025-09-05T19:09:52.740593] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-05T19:09:52.771305] [INFO ] [MAIN ] Derivative Progress: 234/2117 symbols completed. BGX took 1.4s. Estimated remaining: 9m 30s. Rate: 198.2 symbols/min [2025-09-05T19:09:52.817099] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:53.237862] [INFO ] [MAIN ] BHC: Loaded 22790 primary data records. [2025-09-05T19:09:53.496924] [INFO ] [MAIN ] BH: Generated 871 derivative records from 9816 primary records. [2025-09-05T19:09:53.498137] [INFO ] [MAIN ] BGY: Generated 871 derivative records from 11195 primary records. [2025-09-05T19:09:53.520735] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-05T19:09:53.520675] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-05T19:09:53.522139] [INFO ] [MAIN ] Derivative Progress: 235/2117 symbols completed. BH took 0.9s. Estimated remaining: 9m 33s. Rate: 197.0 symbols/min [2025-09-05T19:09:53.524113] [INFO ] [MAIN ] Derivative Progress: 236/2117 symbols completed. BGY took 0.9s. Estimated remaining: 9m 31s. Rate: 197.8 symbols/min [2025-09-05T19:09:53.524615] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:53.524578] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:53.539743] [INFO ] [MAIN ] BHC: Generated 871 derivative records from 22790 primary records. [2025-09-05T19:09:53.552360] [INFO ] [MAIN ] BHE: Loaded 11188 primary data records. [2025-09-05T19:09:53.558178] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-05T19:09:53.603560] [INFO ] [MAIN ] Derivative Progress: 237/2117 symbols completed. BHC took 0.8s. Estimated remaining: 9m 28s. Rate: 198.4 symbols/min [2025-09-05T19:09:53.649882] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:53.673741] [INFO ] [MAIN ] BHK: Loaded 17706 primary data records. [2025-09-05T19:09:54.000851] [INFO ] [MAIN ] BHP: Loaded 25879 primary data records. [2025-09-05T19:09:54.403569] [INFO ] [MAIN ] BHE: Generated 871 derivative records from 11188 primary records. [2025-09-05T19:09:54.415362] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-05T19:09:54.417186] [INFO ] [MAIN ] Derivative Progress: 238/2117 symbols completed. BHE took 0.9s. Estimated remaining: 9m 32s. Rate: 197.0 symbols/min [2025-09-05T19:09:54.431870] [INFO ] [MAIN ] BHK: Generated 1352 derivative records from 17706 primary records. [2025-09-05T19:09:54.453719] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-05T19:09:54.456961] [INFO ] [MAIN ] Derivative Progress: 239/2117 symbols completed. BHK took 0.9s. Estimated remaining: 9m 30s. Rate: 197.7 symbols/min [2025-09-05T19:09:54.454531] [INFO ] [MAIN ] BHP: Generated 871 derivative records from 25879 primary records. [2025-09-05T19:09:54.465377] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-05T19:09:54.466939] [INFO ] [MAIN ] Derivative Progress: 240/2117 symbols completed. BHP took 0.8s. Estimated remaining: 9m 27s. Rate: 198.5 symbols/min [2025-09-05T19:09:54.467455] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:54.467710] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:54.467561] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:54.488035] [INFO ] [MAIN ] BIO: Loaded 12274 primary data records. [2025-09-05T19:09:54.613689] [INFO ] [MAIN ] BILL: Loaded 25564 primary data records. [2025-09-05T19:09:54.612871] [INFO ] [MAIN ] BHVN: Loaded 24280 primary data records. [2025-09-05T19:09:55.240579] [INFO ] [MAIN ] BIO: Generated 871 derivative records from 12274 primary records. [2025-09-05T19:09:55.252358] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-05T19:09:55.261553] [INFO ] [MAIN ] Derivative Progress: 241/2117 symbols completed. BIO took 0.8s. Estimated remaining: 9m 31s. Rate: 197.2 symbols/min [2025-09-05T19:09:55.263379] [INFO ] [MAIN ] BHVN: Generated 871 derivative records from 24280 primary records. [2025-09-05T19:09:55.263485] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:55.271697] [INFO ] [MAIN ] BILL: Generated 871 derivative records from 25564 primary records. [2025-09-05T19:09:55.286510] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-05T19:09:55.289015] [INFO ] [MAIN ] Derivative Progress: 242/2117 symbols completed. BHVN took 0.8s. Estimated remaining: 9m 28s. Rate: 198.0 symbols/min [2025-09-05T19:09:55.289438] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:55.290337] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-05T19:09:55.292011] [INFO ] [MAIN ] Derivative Progress: 243/2117 symbols completed. BILL took 0.8s. Estimated remaining: 9m 26s. Rate: 198.8 symbols/min [2025-09-05T19:09:55.292946] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:55.296391] [INFO ] [MAIN ] BIPH: Loaded 1086 primary data records. [2025-09-05T19:09:55.491912] [INFO ] [MAIN ] BIP: Loaded 28653 primary data records. [2025-09-05T19:09:55.595754] [INFO ] [MAIN ] BIPC: Loaded 30991 primary data records. [2025-09-05T19:09:56.154303] [INFO ] [MAIN ] BIPH: Generated 870 derivative records from 1086 primary records. [2025-09-05T19:09:56.164388] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-05T19:09:56.167374] [INFO ] [MAIN ] Derivative Progress: 244/2117 symbols completed. BIPH took 0.9s. Estimated remaining: 9m 30s. Rate: 197.2 symbols/min [2025-09-05T19:09:56.168385] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:56.173115] [INFO ] [MAIN ] BIPI: Loaded 1447 primary data records. [2025-09-05T19:09:56.305296] [INFO ] [MAIN ] BIP: Generated 1352 derivative records from 28653 primary records. [2025-09-05T19:09:56.322914] [INFO ] [MAIN ] BIPC: Generated 1352 derivative records from 30991 primary records. [2025-09-05T19:09:56.403277] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-05T19:09:56.454446] [INFO ] [MAIN ] Derivative Progress: 245/2117 symbols completed. BIP took 1.2s. Estimated remaining: 9m 29s. Rate: 197.3 symbols/min [2025-09-05T19:09:56.463406] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:56.467948] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-05T19:09:56.470634] [INFO ] [MAIN ] Derivative Progress: 246/2117 symbols completed. BIPC took 1.2s. Estimated remaining: 9m 27s. Rate: 198.0 symbols/min [2025-09-05T19:09:56.472819] [INFO ] [MAIN ] BIPJ: Loaded 1481 primary data records. [2025-09-05T19:09:56.473161] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:56.726605] [INFO ] [MAIN ] BIPI: Generated 871 derivative records from 1447 primary records. [2025-09-05T19:09:56.748184] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-05T19:09:56.749321] [INFO ] [MAIN ] BIRK: Loaded 38387 primary data records. [2025-09-05T19:09:56.751106] [INFO ] [MAIN ] Derivative Progress: 247/2117 symbols completed. BIPI took 0.6s. Estimated remaining: 9m 26s. Rate: 198.1 symbols/min [2025-09-05T19:09:56.752304] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:56.920430] [INFO ] [MAIN ] BIT: Loaded 16089 primary data records. [2025-09-05T19:09:57.005374] [INFO ] [MAIN ] BIPJ: Generated 871 derivative records from 1481 primary records. [2025-09-05T19:09:57.219890] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-05T19:09:57.226907] [INFO ] [MAIN ] Derivative Progress: 248/2117 symbols completed. BIPJ took 0.8s. Estimated remaining: 9m 27s. Rate: 197.6 symbols/min [2025-09-05T19:09:57.237808] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:57.425717] [INFO ] [MAIN ] BIRK: Generated 1352 derivative records from 38387 primary records. [2025-09-05T19:09:57.428241] [INFO ] [MAIN ] BJ: Loaded 24890 primary data records. [2025-09-05T19:09:57.558470] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-05T19:09:57.577872] [INFO ] [MAIN ] Derivative Progress: 249/2117 symbols completed. BIRK took 1.1s. Estimated remaining: 9m 27s. Rate: 197.5 symbols/min [2025-09-05T19:09:57.600103] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:57.695575] [INFO ] [MAIN ] BIT: Generated 1352 derivative records from 16089 primary records. [2025-09-05T19:09:57.714755] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-05T19:09:57.717995] [INFO ] [MAIN ] Derivative Progress: 250/2117 symbols completed. BIT took 1.0s. Estimated remaining: 9m 26s. Rate: 197.9 symbols/min [2025-09-05T19:09:57.718482] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:57.743223] [INFO ] [MAIN ] BJ: Generated 871 derivative records from 24890 primary records. [2025-09-05T19:09:57.757787] [INFO ] [MAIN ] BK: Loaded 40349 primary data records. [2025-09-05T19:09:57.802133] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-05T19:09:57.821778] [INFO ] [MAIN ] Derivative Progress: 251/2117 symbols completed. BJ took 0.6s. Estimated remaining: 9m 24s. Rate: 198.5 symbols/min [2025-09-05T19:09:57.861841] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:58.052399] [INFO ] [MAIN ] BKD: Loaded 38014 primary data records. [2025-09-05T19:09:58.147768] [INFO ] [MAIN ] BKE: Loaded 16158 primary data records. [2025-09-05T19:09:58.591073] [INFO ] [MAIN ] BK: Generated 1352 derivative records from 40349 primary records. [2025-09-05T19:09:58.609139] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-05T19:09:58.611410] [INFO ] [MAIN ] Derivative Progress: 252/2117 symbols completed. BK took 1.0s. Estimated remaining: 9m 27s. Rate: 197.2 symbols/min [2025-09-05T19:09:58.611903] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:58.619034] [INFO ] [MAIN ] BKE: Generated 871 derivative records from 16158 primary records. [2025-09-05T19:09:58.629082] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-05T19:09:58.631335] [INFO ] [MAIN ] Derivative Progress: 253/2117 symbols completed. BKE took 0.8s. Estimated remaining: 9m 25s. Rate: 197.9 symbols/min [2025-09-05T19:09:58.647049] [INFO ] [MAIN ] BKD: Generated 1352 derivative records from 38014 primary records. [2025-09-05T19:09:58.665001] [INFO ] [MAIN ] BKKT: Loaded 18510 primary data records. [2025-09-05T19:09:58.666296] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-05T19:09:58.700282] [INFO ] [MAIN ] Derivative Progress: 254/2117 symbols completed. BKD took 1.0s. Estimated remaining: 9m 23s. Rate: 198.5 symbols/min [2025-09-05T19:09:58.909679] [INFO ] [MAIN ] BKKT: Generated 871 derivative records from 18510 primary records. [2025-09-05T19:09:58.917864] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-05T19:09:58.919179] [INFO ] [MAIN ] Derivative Progress: 255/2117 symbols completed. BKKT took 0.3s. Estimated remaining: 9m 22s. Rate: 198.8 symbols/min [2025-09-05T19:09:58.919835] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:58.920018] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:58.920402] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:58.926041] [INFO ] [MAIN ] BKN: Loaded 3425 primary data records. [2025-09-05T19:09:59.137983] [INFO ] [MAIN ] BKSY: Loaded 24499 primary data records. [2025-09-05T19:09:59.173979] [INFO ] [MAIN ] BKU: Loaded 31467 primary data records. [2025-09-05T19:09:59.740377] [INFO ] [MAIN ] BKN: Generated 871 derivative records from 3425 primary records. [2025-09-05T19:09:59.750129] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-05T19:09:59.751678] [INFO ] [MAIN ] Derivative Progress: 256/2117 symbols completed. BKN took 0.8s. Estimated remaining: 9m 26s. Rate: 197.4 symbols/min [2025-09-05T19:09:59.751932] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:59.762894] [INFO ] [MAIN ] BKSY: Generated 871 derivative records from 24499 primary records. [2025-09-05T19:09:59.776793] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-05T19:09:59.778516] [INFO ] [MAIN ] Derivative Progress: 257/2117 symbols completed. BKSY took 0.9s. Estimated remaining: 9m 23s. Rate: 198.1 symbols/min [2025-09-05T19:09:59.779429] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:09:59.792505] [INFO ] [MAIN ] BLCO: Loaded 17059 primary data records. [2025-09-05T19:09:59.796972] [INFO ] [MAIN ] BKU: Generated 1352 derivative records from 31467 primary records. [2025-09-05T19:09:59.965269] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-05T19:09:59.994361] [INFO ] [MAIN ] Derivative Progress: 258/2117 symbols completed. BKU took 1.1s. Estimated remaining: 9m 22s. Rate: 198.3 symbols/min [2025-09-05T19:10:00.057961] [INFO ] [MAIN ] BLDR: Loaded 25277 primary data records. [2025-09-05T19:10:00.056887] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:00.160911] [INFO ] [MAIN ] BLE: Loaded 6822 primary data records. [2025-09-05T19:10:00.577874] [INFO ] [MAIN ] BLCO: Generated 871 derivative records from 17059 primary records. [2025-09-05T19:10:00.588766] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-05T19:10:00.590357] [INFO ] [MAIN ] Derivative Progress: 259/2117 symbols completed. BLCO took 0.8s. Estimated remaining: 9m 24s. Rate: 197.6 symbols/min [2025-09-05T19:10:00.590661] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:00.615608] [INFO ] [MAIN ] BLDR: Generated 871 derivative records from 25277 primary records. [2025-09-05T19:10:00.616554] [INFO ] [MAIN ] BLE: Generated 871 derivative records from 6822 primary records. [2025-09-05T19:10:00.642445] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-05T19:10:00.644852] [INFO ] [MAIN ] Derivative Progress: 260/2117 symbols completed. BLE took 0.6s. Estimated remaining: 9m 22s. Rate: 198.2 symbols/min [2025-09-05T19:10:00.645454] [INFO ] [MAIN ] BLSH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:00.645996] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-05T19:10:00.648023] [INFO ] [MAIN ] Derivative Progress: 261/2117 symbols completed. BLDR took 0.9s. Estimated remaining: 9m 20s. Rate: 199.0 symbols/min [2025-09-05T19:10:00.648668] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:00.662160] [INFO ] [MAIN ] BLND: Loaded 36741 primary data records. [2025-09-05T19:10:00.704923] [INFO ] [MAIN ] BLSH: Loaded 6397 primary data records. [2025-09-05T19:10:00.760689] [INFO ] [MAIN ] BLW: Loaded 5868 primary data records. [2025-09-05T19:10:01.406340] [INFO ] [MAIN ] BLSH: Generated 213 derivative records from 6397 primary records. [2025-09-05T19:10:01.411582] [INFO ] [MAIN ] BLSH: Successfully saved derivative data. [2025-09-05T19:10:01.412698] [INFO ] [MAIN ] Derivative Progress: 262/2117 symbols completed. BLSH took 0.8s. Estimated remaining: 9m 23s. Rate: 197.8 symbols/min [2025-09-05T19:10:01.413038] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:01.429285] [INFO ] [MAIN ] BLND: Generated 1352 derivative records from 36741 primary records. [2025-09-05T19:10:01.455910] [INFO ] [MAIN ] BLX: Loaded 11665 primary data records. [2025-09-05T19:10:01.456700] [INFO ] [MAIN ] BLW: Generated 871 derivative records from 5868 primary records. [2025-09-05T19:10:01.459886] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-05T19:10:01.473567] [INFO ] [MAIN ] Derivative Progress: 263/2117 symbols completed. BLND took 0.9s. Estimated remaining: 9m 21s. Rate: 198.4 symbols/min [2025-09-05T19:10:01.505954] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:01.560350] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-05T19:10:01.581802] [INFO ] [MAIN ] Derivative Progress: 264/2117 symbols completed. BLW took 0.9s. Estimated remaining: 9m 19s. Rate: 198.9 symbols/min [2025-09-05T19:10:01.595818] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:01.833385] [INFO ] [MAIN ] BMA: Loaded 16542 primary data records. [2025-09-05T19:10:01.859509] [INFO ] [MAIN ] BME: Loaded 5400 primary data records. [2025-09-05T19:10:02.462176] [INFO ] [MAIN ] BLX: Generated 1352 derivative records from 11665 primary records. [2025-09-05T19:10:02.481193] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-05T19:10:02.483530] [INFO ] [MAIN ] Derivative Progress: 265/2117 symbols completed. BLX took 1.1s. Estimated remaining: 9m 23s. Rate: 197.4 symbols/min [2025-09-05T19:10:02.483907] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:02.499578] [INFO ] [MAIN ] BMA: Generated 871 derivative records from 16542 primary records. [2025-09-05T19:10:02.510825] [INFO ] [MAIN ] BME: Generated 871 derivative records from 5400 primary records. [2025-09-05T19:10:02.531017] [INFO ] [MAIN ] BMEZ: Loaded 11975 primary data records. [2025-09-05T19:10:02.531835] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-05T19:10:02.533977] [INFO ] [MAIN ] Derivative Progress: 266/2117 symbols completed. BME took 0.9s. Estimated remaining: 9m 21s. Rate: 198.0 symbols/min [2025-09-05T19:10:02.539963] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:02.557712] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-05T19:10:02.588248] [INFO ] [MAIN ] Derivative Progress: 267/2117 symbols completed. BMA took 1.1s. Estimated remaining: 9m 19s. Rate: 198.6 symbols/min [2025-09-05T19:10:02.617281] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:02.670310] [INFO ] [MAIN ] BMI: Loaded 11385 primary data records. [2025-09-05T19:10:02.705747] [INFO ] [MAIN ] BMN: Loaded 1241 primary data records. [2025-09-05T19:10:03.373108] [INFO ] [MAIN ] BMEZ: Generated 871 derivative records from 11975 primary records. [2025-09-05T19:10:03.390273] [INFO ] [MAIN ] BMI: Generated 871 derivative records from 11385 primary records. [2025-09-05T19:10:03.407523] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-05T19:10:03.407628] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-05T19:10:03.416906] [INFO ] [MAIN ] Derivative Progress: 268/2117 symbols completed. BMI took 0.9s. Estimated remaining: 9m 22s. Rate: 197.4 symbols/min [2025-09-05T19:10:03.414768] [INFO ] [MAIN ] BMN: Generated 871 derivative records from 1241 primary records. [2025-09-05T19:10:03.419306] [INFO ] [MAIN ] Derivative Progress: 269/2117 symbols completed. BMEZ took 0.9s. Estimated remaining: 9m 20s. Rate: 198.1 symbols/min [2025-09-05T19:10:03.426132] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-05T19:10:03.427773] [INFO ] [MAIN ] Derivative Progress: 270/2117 symbols completed. BMN took 0.8s. Estimated remaining: 9m 17s. Rate: 198.8 symbols/min [2025-09-05T19:10:03.428331] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:03.428636] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:03.428522] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:03.445326] [INFO ] [MAIN ] BNED: Loaded 14609 primary data records. [2025-09-05T19:10:03.611299] [INFO ] [MAIN ] BN: Loaded 25593 primary data records. [2025-09-05T19:10:03.676197] [INFO ] [MAIN ] BMO: Loaded 30721 primary data records. [2025-09-05T19:10:04.278390] [INFO ] [MAIN ] BNED: Generated 871 derivative records from 14609 primary records. [2025-09-05T19:10:04.291124] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-05T19:10:04.293231] [INFO ] [MAIN ] Derivative Progress: 271/2117 symbols completed. BNED took 0.9s. Estimated remaining: 9m 21s. Rate: 197.4 symbols/min [2025-09-05T19:10:04.293575] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:04.304223] [INFO ] [MAIN ] BN: Generated 871 derivative records from 25593 primary records. [2025-09-05T19:10:04.315980] [INFO ] [MAIN ] BNH: Loaded 3381 primary data records. [2025-09-05T19:10:04.340323] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-05T19:10:04.358599] [INFO ] [MAIN ] Derivative Progress: 272/2117 symbols completed. BN took 0.9s. Estimated remaining: 9m 19s. Rate: 198.0 symbols/min [2025-09-05T19:10:04.377814] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:04.441890] [INFO ] [MAIN ] BNJ: Loaded 1066 primary data records. [2025-09-05T19:10:04.497571] [INFO ] [MAIN ] BMO: Generated 1352 derivative records from 30721 primary records. [2025-09-05T19:10:04.733133] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-05T19:10:04.735563] [INFO ] [MAIN ] Derivative Progress: 273/2117 symbols completed. BMO took 1.3s. Estimated remaining: 9m 19s. Rate: 197.8 symbols/min [2025-09-05T19:10:04.736198] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:04.900084] [INFO ] [MAIN ] BNS: Loaded 24797 primary data records. [2025-09-05T19:10:04.994003] [INFO ] [MAIN ] BNH: Generated 1352 derivative records from 3381 primary records. [2025-09-05T19:10:05.133563] [INFO ] [MAIN ] BNJ: Generated 870 derivative records from 1066 primary records. [2025-09-05T19:10:05.172160] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-05T19:10:05.233707] [INFO ] [MAIN ] Derivative Progress: 274/2117 symbols completed. BNH took 0.9s. Estimated remaining: 9m 20s. Rate: 197.4 symbols/min [2025-09-05T19:10:05.235571] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:05.240224] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-05T19:10:05.242202] [INFO ] [MAIN ] Derivative Progress: 275/2117 symbols completed. BNJ took 0.9s. Estimated remaining: 9m 18s. Rate: 198.1 symbols/min [2025-09-05T19:10:05.242607] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:05.244820] [INFO ] [MAIN ] BNT: Loaded 1357 primary data records. [2025-09-05T19:10:05.356497] [INFO ] [MAIN ] BNY: Loaded 3671 primary data records. [2025-09-05T19:10:05.612486] [INFO ] [MAIN ] BNS: Generated 871 derivative records from 24797 primary records. [2025-09-05T19:10:05.734685] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-05T19:10:05.736632] [INFO ] [MAIN ] Derivative Progress: 276/2117 symbols completed. BNS took 1.0s. Estimated remaining: 9m 19s. Rate: 197.6 symbols/min [2025-09-05T19:10:05.737770] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:05.754217] [INFO ] [MAIN ] BNT: Generated 871 derivative records from 1357 primary records. [2025-09-05T19:10:05.758025] [INFO ] [MAIN ] BOC: Loaded 9217 primary data records. [2025-09-05T19:10:05.875509] [INFO ] [MAIN ] BNY: Generated 871 derivative records from 3671 primary records. [2025-09-05T19:10:05.874798] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-05T19:10:05.877590] [INFO ] [MAIN ] Derivative Progress: 277/2117 symbols completed. BNT took 0.6s. Estimated remaining: 9m 18s. Rate: 198.0 symbols/min [2025-09-05T19:10:05.903567] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:06.012663] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-05T19:10:06.014093] [INFO ] [MAIN ] Derivative Progress: 278/2117 symbols completed. BNY took 0.8s. Estimated remaining: 9m 16s. Rate: 198.4 symbols/min [2025-09-05T19:10:06.014453] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:06.022825] [INFO ] [MAIN ] BOE: Loaded 7847 primary data records. [2025-09-05T19:10:06.219589] [INFO ] [MAIN ] BOH: Loaded 22973 primary data records. [2025-09-05T19:10:06.387823] [INFO ] [MAIN ] BOC: Generated 871 derivative records from 9217 primary records. [2025-09-05T19:10:06.471457] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-05T19:10:06.472878] [INFO ] [MAIN ] Derivative Progress: 279/2117 symbols completed. BOC took 0.7s. Estimated remaining: 9m 17s. Rate: 198.0 symbols/min [2025-09-05T19:10:06.558506] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:06.570715] [INFO ] [MAIN ] BOE: Generated 871 derivative records from 7847 primary records. [2025-09-05T19:10:06.582711] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-05T19:10:06.584449] [INFO ] [MAIN ] Derivative Progress: 280/2117 symbols completed. BOE took 0.7s. Estimated remaining: 9m 15s. Rate: 198.5 symbols/min [2025-09-05T19:10:06.590912] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:06.618534] [INFO ] [MAIN ] BOND: Loaded 24077 primary data records. [2025-09-05T19:10:06.619614] [INFO ] [MAIN ] BOH: Generated 1352 derivative records from 22973 primary records. [2025-09-05T19:10:06.741073] [INFO ] [MAIN ] BOOT: Loaded 18428 primary data records. [2025-09-05T19:10:06.792847] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-05T19:10:06.844850] [INFO ] [MAIN ] Derivative Progress: 281/2117 symbols completed. BOH took 0.8s. Estimated remaining: 9m 15s. Rate: 198.6 symbols/min [2025-09-05T19:10:06.917729] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:07.173461] [INFO ] [MAIN ] BORR: Loaded 24787 primary data records. [2025-09-05T19:10:07.317014] [INFO ] [MAIN ] BOND: Generated 1352 derivative records from 24077 primary records. [2025-09-05T19:10:07.371996] [INFO ] [MAIN ] BOOT: Generated 871 derivative records from 18428 primary records. [2025-09-05T19:10:07.453673] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-05T19:10:07.455190] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-05T19:10:07.457814] [INFO ] [MAIN ] Derivative Progress: 282/2117 symbols completed. BOND took 0.9s. Estimated remaining: 9m 16s. Rate: 197.8 symbols/min [2025-09-05T19:10:07.460940] [INFO ] [MAIN ] Derivative Progress: 283/2117 symbols completed. BOOT took 0.9s. Estimated remaining: 9m 14s. Rate: 198.5 symbols/min [2025-09-05T19:10:07.461081] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:07.473338] [INFO ] [MAIN ] BORR: Generated 871 derivative records from 24787 primary records. [2025-09-05T19:10:07.487151] [INFO ] [MAIN ] BOW: Loaded 10253 primary data records. [2025-09-05T19:10:07.488451] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-05T19:10:07.521266] [INFO ] [MAIN ] Derivative Progress: 284/2117 symbols completed. BORR took 0.6s. Estimated remaining: 9m 12s. Rate: 199.1 symbols/min [2025-09-05T19:10:07.760286] [INFO ] [MAIN ] BOW: Generated 871 derivative records from 10253 primary records. [2025-09-05T19:10:07.768438] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-05T19:10:07.769782] [INFO ] [MAIN ] Derivative Progress: 285/2117 symbols completed. BOW took 0.3s. Estimated remaining: 9m 12s. Rate: 199.2 symbols/min [2025-09-05T19:10:07.770261] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:07.770429] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:07.770365] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:07.811905] [INFO ] [MAIN ] BR: Loaded 16298 primary data records. [2025-09-05T19:10:07.813839] [INFO ] [MAIN ] BP: Loaded 26086 primary data records. [2025-09-05T19:10:07.953131] [INFO ] [MAIN ] BOX: Loaded 24476 primary data records. [2025-09-05T19:10:08.563553] [INFO ] [MAIN ] BR: Generated 871 derivative records from 16298 primary records. [2025-09-05T19:10:08.573382] [INFO ] [MAIN ] BP: Generated 871 derivative records from 26086 primary records. [2025-09-05T19:10:08.598368] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-05T19:10:08.600333] [INFO ] [MAIN ] Derivative Progress: 286/2117 symbols completed. BP took 0.8s. Estimated remaining: 9m 15s. Rate: 198.0 symbols/min [2025-09-05T19:10:08.596692] [INFO ] [MAIN ] BOX: Generated 871 derivative records from 24476 primary records. [2025-09-05T19:10:08.602291] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-05T19:10:08.602633] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:08.610582] [INFO ] [MAIN ] Derivative Progress: 287/2117 symbols completed. BR took 0.8s. Estimated remaining: 9m 13s. Rate: 198.7 symbols/min [2025-09-05T19:10:08.611478] [INFO ] [MAIN ] BRFS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:08.614808] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-05T19:10:08.616778] [INFO ] [MAIN ] Derivative Progress: 288/2117 symbols completed. BOX took 0.8s. Estimated remaining: 9m 10s. Rate: 199.4 symbols/min [2025-09-05T19:10:08.617299] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:08.643998] [INFO ] [MAIN ] BRCC: Loaded 20203 primary data records. [2025-09-05T19:10:08.773338] [INFO ] [MAIN ] BRFS: Loaded 31147 primary data records. [2025-09-05T19:10:08.774722] [INFO ] [MAIN ] BRO: Loaded 25445 primary data records. [2025-09-05T19:10:09.479328] [INFO ] [MAIN ] BRCC: Generated 871 derivative records from 20203 primary records. [2025-09-05T19:10:09.487158] [INFO ] [MAIN ] BRO: Generated 871 derivative records from 25445 primary records. [2025-09-05T19:10:09.507694] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-05T19:10:09.509305] [INFO ] [MAIN ] Derivative Progress: 289/2117 symbols completed. BRCC took 0.9s. Estimated remaining: 9m 14s. Rate: 198.0 symbols/min [2025-09-05T19:10:09.510145] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-05T19:10:09.512350] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:09.512292] [INFO ] [MAIN ] Derivative Progress: 290/2117 symbols completed. BRO took 0.9s. Estimated remaining: 9m 12s. Rate: 198.7 symbols/min [2025-09-05T19:10:09.524301] [INFO ] [MAIN ] BRFS: Generated 1352 derivative records from 31147 primary records. [2025-09-05T19:10:09.524452] [INFO ] [MAIN ] BRSL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:09.540011] [INFO ] [MAIN ] BRFS: Successfully saved derivative data. [2025-09-05T19:10:09.542551] [INFO ] [MAIN ] Derivative Progress: 291/2117 symbols completed. BRFS took 0.9s. Estimated remaining: 9m 10s. Rate: 199.3 symbols/min [2025-09-05T19:10:09.542940] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:09.565318] [INFO ] [MAIN ] BRSL: Loaded 16962 primary data records. [2025-09-05T19:10:09.668234] [INFO ] [MAIN ] BROS: Loaded 25847 primary data records. [2025-09-05T19:10:09.736532] [INFO ] [MAIN ] BRSP: Loaded 17766 primary data records. [2025-09-05T19:10:10.327819] [INFO ] [MAIN ] BRSL: Generated 598 derivative records from 16962 primary records. [2025-09-05T19:10:10.336955] [INFO ] [MAIN ] BRSL: Successfully saved derivative data. [2025-09-05T19:10:10.339759] [INFO ] [MAIN ] Derivative Progress: 292/2117 symbols completed. BRSL took 0.8s. Estimated remaining: 9m 13s. Rate: 198.2 symbols/min [2025-09-05T19:10:10.340413] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:10.348314] [INFO ] [MAIN ] BROS: Generated 871 derivative records from 25847 primary records. [2025-09-05T19:10:10.359870] [INFO ] [MAIN ] BRT: Loaded 2369 primary data records. [2025-09-05T19:10:10.403331] [INFO ] [MAIN ] BRSP: Generated 871 derivative records from 17766 primary records. [2025-09-05T19:10:10.417732] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-05T19:10:10.433880] [INFO ] [MAIN ] Derivative Progress: 293/2117 symbols completed. BROS took 0.9s. Estimated remaining: 9m 11s. Rate: 198.7 symbols/min [2025-09-05T19:10:10.469318] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:10.498708] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-05T19:10:10.500373] [INFO ] [MAIN ] Derivative Progress: 294/2117 symbols completed. BRSP took 1.0s. Estimated remaining: 9m 9s. Rate: 199.2 symbols/min [2025-09-05T19:10:10.500926] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:10.584901] [INFO ] [MAIN ] BRW: Loaded 10195 primary data records. [2025-09-05T19:10:10.886856] [INFO ] [MAIN ] BRX: Loaded 25209 primary data records. [2025-09-05T19:10:11.131962] [INFO ] [MAIN ] BRT: Generated 871 derivative records from 2369 primary records. [2025-09-05T19:10:11.198514] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-05T19:10:11.201151] [INFO ] [MAIN ] Derivative Progress: 295/2117 symbols completed. BRT took 0.9s. Estimated remaining: 9m 11s. Rate: 198.3 symbols/min [2025-09-05T19:10:11.201452] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:11.213879] [INFO ] [MAIN ] BRW: Generated 871 derivative records from 10195 primary records. [2025-09-05T19:10:11.227178] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-05T19:10:11.229485] [INFO ] [MAIN ] Derivative Progress: 296/2117 symbols completed. BRW took 0.8s. Estimated remaining: 9m 9s. Rate: 198.9 symbols/min [2025-09-05T19:10:11.230873] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:11.237712] [INFO ] [MAIN ] BSBR: Loaded 17611 primary data records. [2025-09-05T19:10:11.265206] [INFO ] [MAIN ] BRX: Generated 871 derivative records from 25209 primary records. [2025-09-05T19:10:11.355311] [INFO ] [MAIN ] BSL: Loaded 3319 primary data records. [2025-09-05T19:10:11.516776] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-05T19:10:11.530688] [INFO ] [MAIN ] Derivative Progress: 297/2117 symbols completed. BRX took 1.0s. Estimated remaining: 9m 9s. Rate: 198.9 symbols/min [2025-09-05T19:10:11.531427] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:11.767036] [INFO ] [MAIN ] BSM: Loaded 16464 primary data records. [2025-09-05T19:10:12.018102] [INFO ] [MAIN ] BSBR: Generated 871 derivative records from 17611 primary records. [2025-09-05T19:10:12.026737] [INFO ] [MAIN ] BSL: Generated 871 derivative records from 3319 primary records. [2025-09-05T19:10:12.041192] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-05T19:10:12.042970] [INFO ] [MAIN ] Derivative Progress: 298/2117 symbols completed. BSBR took 0.8s. Estimated remaining: 9m 10s. Rate: 198.4 symbols/min [2025-09-05T19:10:12.045103] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-05T19:10:12.047426] [INFO ] [MAIN ] Derivative Progress: 299/2117 symbols completed. BSL took 0.8s. Estimated remaining: 9m 8s. Rate: 199.1 symbols/min [2025-09-05T19:10:12.057826] [INFO ] [MAIN ] BSM: Generated 871 derivative records from 16464 primary records. [2025-09-05T19:10:12.065917] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-05T19:10:12.067498] [INFO ] [MAIN ] Derivative Progress: 300/2117 symbols completed. BSM took 0.5s. Estimated remaining: 9m 6s. Rate: 199.7 symbols/min [2025-09-05T19:10:12.068284] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:12.068620] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:12.068781] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:12.073256] [INFO ] [MAIN ] BTA: Loaded 2540 primary data records. [2025-09-05T19:10:12.195158] [INFO ] [MAIN ] BSTZ: Loaded 12352 primary data records. [2025-09-05T19:10:12.431562] [INFO ] [MAIN ] BSX: Loaded 26061 primary data records. [2025-09-05T19:10:12.852266] [INFO ] [MAIN ] BTA: Generated 871 derivative records from 2540 primary records. [2025-09-05T19:10:12.865608] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-05T19:10:12.874324] [INFO ] [MAIN ] Derivative Progress: 301/2117 symbols completed. BTA took 0.8s. Estimated remaining: 9m 9s. Rate: 198.6 symbols/min [2025-09-05T19:10:12.874810] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:12.872899] [INFO ] [MAIN ] BSTZ: Generated 871 derivative records from 12352 primary records. [2025-09-05T19:10:12.885284] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-05T19:10:12.887555] [INFO ] [MAIN ] Derivative Progress: 302/2117 symbols completed. BSTZ took 0.8s. Estimated remaining: 9m 7s. Rate: 199.2 symbols/min [2025-09-05T19:10:12.892203] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:12.899613] [INFO ] [MAIN ] BTCM: Loaded 10211 primary data records. [2025-09-05T19:10:12.951046] [INFO ] [MAIN ] BSX: Generated 871 derivative records from 26061 primary records. [2025-09-05T19:10:13.062956] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-05T19:10:13.079761] [INFO ] [MAIN ] Derivative Progress: 303/2117 symbols completed. BSX took 1.0s. Estimated remaining: 9m 6s. Rate: 199.5 symbols/min [2025-09-05T19:10:13.130705] [INFO ] [MAIN ] BTI: Loaded 26008 primary data records. [2025-09-05T19:10:13.187553] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:13.375908] [INFO ] [MAIN ] BTO: Loaded 4121 primary data records. [2025-09-05T19:10:13.688723] [INFO ] [MAIN ] BTCM: Generated 871 derivative records from 10211 primary records. [2025-09-05T19:10:13.766754] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-05T19:10:13.768206] [INFO ] [MAIN ] Derivative Progress: 304/2117 symbols completed. BTCM took 0.9s. Estimated remaining: 9m 8s. Rate: 198.6 symbols/min [2025-09-05T19:10:13.766680] [INFO ] [MAIN ] BTI: Generated 871 derivative records from 26008 primary records. [2025-09-05T19:10:13.769005] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:13.781357] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-05T19:10:13.783442] [INFO ] [MAIN ] Derivative Progress: 305/2117 symbols completed. BTI took 0.9s. Estimated remaining: 9m 6s. Rate: 199.2 symbols/min [2025-09-05T19:10:13.783963] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:13.788143] [INFO ] [MAIN ] BTT: Loaded 7257 primary data records. [2025-09-05T19:10:13.890037] [INFO ] [MAIN ] BTO: Generated 871 derivative records from 4121 primary records. [2025-09-05T19:10:13.994699] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-05T19:10:14.051731] [INFO ] [MAIN ] Derivative Progress: 306/2117 symbols completed. BTO took 0.9s. Estimated remaining: 9m 5s. Rate: 199.3 symbols/min [2025-09-05T19:10:14.052075] [INFO ] [MAIN ] BTX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:14.070724] [INFO ] [MAIN ] BTU: Loaded 40145 primary data records. [2025-09-05T19:10:14.225610] [INFO ] [MAIN ] BTX: Loaded 23984 primary data records. [2025-09-05T19:10:14.256448] [INFO ] [MAIN ] BTT: Generated 871 derivative records from 7257 primary records. [2025-09-05T19:10:14.485459] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-05T19:10:14.497601] [INFO ] [MAIN ] Derivative Progress: 307/2117 symbols completed. BTT took 0.7s. Estimated remaining: 9m 6s. Rate: 199.0 symbols/min [2025-09-05T19:10:14.545182] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:14.674116] [INFO ] [MAIN ] BTZ: Loaded 9859 primary data records. [2025-09-05T19:10:14.685594] [INFO ] [MAIN ] BTU: Generated 1352 derivative records from 40145 primary records. [2025-09-05T19:10:14.801269] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-05T19:10:14.814560] [INFO ] [MAIN ] Derivative Progress: 308/2117 symbols completed. BTU took 1.0s. Estimated remaining: 9m 5s. Rate: 199.0 symbols/min [2025-09-05T19:10:14.815098] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:14.948292] [INFO ] [MAIN ] BUI: Loaded 8583 primary data records. [2025-09-05T19:10:14.989698] [INFO ] [MAIN ] BTX: Generated 1352 derivative records from 23984 primary records. [2025-09-05T19:10:15.187955] [INFO ] [MAIN ] BTX: Successfully saved derivative data. [2025-09-05T19:10:15.243344] [INFO ] [MAIN ] Derivative Progress: 309/2117 symbols completed. BTX took 1.2s. Estimated remaining: 9m 6s. Rate: 198.7 symbols/min [2025-09-05T19:10:15.246747] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:15.256379] [INFO ] [MAIN ] BTZ: Generated 871 derivative records from 9859 primary records. [2025-09-05T19:10:15.267617] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-05T19:10:15.269667] [INFO ] [MAIN ] Derivative Progress: 310/2117 symbols completed. BTZ took 0.8s. Estimated remaining: 9m 4s. Rate: 199.3 symbols/min [2025-09-05T19:10:15.275907] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:15.299813] [INFO ] [MAIN ] BUR: Loaded 22709 primary data records. [2025-09-05T19:10:15.300742] [INFO ] [MAIN ] BUI: Generated 1352 derivative records from 8583 primary records. [2025-09-05T19:10:15.454180] [INFO ] [MAIN ] BURL: Loaded 21893 primary data records. [2025-09-05T19:10:15.494729] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-05T19:10:15.548151] [INFO ] [MAIN ] Derivative Progress: 311/2117 symbols completed. BUI took 0.7s. Estimated remaining: 9m 4s. Rate: 199.3 symbols/min [2025-09-05T19:10:15.628821] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:15.821157] [INFO ] [MAIN ] BUXX: Loaded 11844 primary data records. [2025-09-05T19:10:15.947682] [INFO ] [MAIN ] BUR: Generated 871 derivative records from 22709 primary records. [2025-09-05T19:10:16.161888] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-05T19:10:16.170019] [INFO ] [MAIN ] Derivative Progress: 312/2117 symbols completed. BUR took 0.9s. Estimated remaining: 9m 5s. Rate: 198.7 symbols/min [2025-09-05T19:10:16.171473] [INFO ] [MAIN ] BURL: Generated 871 derivative records from 21893 primary records. [2025-09-05T19:10:16.172988] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:16.182626] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-05T19:10:16.184456] [INFO ] [MAIN ] Derivative Progress: 313/2117 symbols completed. BURL took 0.9s. Estimated remaining: 9m 3s. Rate: 199.3 symbols/min [2025-09-05T19:10:16.199673] [INFO ] [MAIN ] BUXX: Generated 1351 derivative records from 11844 primary records. [2025-09-05T19:10:16.221040] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-05T19:10:16.231793] [INFO ] [MAIN ] Derivative Progress: 314/2117 symbols completed. BUXX took 0.7s. Estimated remaining: 9m 1s. Rate: 199.8 symbols/min [2025-09-05T19:10:16.232899] [INFO ] [MAIN ] BV: Loaded 28758 primary data records. [2025-09-05T19:10:16.513757] [INFO ] [MAIN ] BV: Generated 1352 derivative records from 28758 primary records. [2025-09-05T19:10:16.525758] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-05T19:10:16.527846] [INFO ] [MAIN ] Derivative Progress: 315/2117 symbols completed. BV took 0.4s. Estimated remaining: 9m 1s. Rate: 199.8 symbols/min [2025-09-05T19:10:16.528472] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:16.528395] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:16.528588] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:16.567826] [INFO ] [MAIN ] BW: Loaded 18160 primary data records. [2025-09-05T19:10:16.595549] [INFO ] [MAIN ] BWA: Loaded 25288 primary data records. [2025-09-05T19:10:16.675524] [INFO ] [MAIN ] BVN: Loaded 20933 primary data records. [2025-09-05T19:10:17.298777] [INFO ] [MAIN ] BW: Generated 871 derivative records from 18160 primary records. [2025-09-05T19:10:17.323067] [INFO ] [MAIN ] BVN: Generated 871 derivative records from 20933 primary records. [2025-09-05T19:10:17.323862] [INFO ] [MAIN ] BWA: Generated 871 derivative records from 25288 primary records. [2025-09-05T19:10:17.323933] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-05T19:10:17.326271] [INFO ] [MAIN ] Derivative Progress: 316/2117 symbols completed. BW took 0.8s. Estimated remaining: 9m 4s. Rate: 198.8 symbols/min [2025-09-05T19:10:17.332249] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:17.339691] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-05T19:10:17.341481] [INFO ] [MAIN ] Derivative Progress: 317/2117 symbols completed. BVN took 0.8s. Estimated remaining: 9m 2s. Rate: 199.4 symbols/min [2025-09-05T19:10:17.342339] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:17.344597] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-05T19:10:17.346309] [INFO ] [MAIN ] Derivative Progress: 318/2117 symbols completed. BWA took 0.8s. Estimated remaining: 8m 60s. Rate: 200.0 symbols/min [2025-09-05T19:10:17.346621] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:17.358913] [INFO ] [MAIN ] BWG: Loaded 6412 primary data records. [2025-09-05T19:10:17.445938] [INFO ] [MAIN ] BWLP: Loaded 15428 primary data records. [2025-09-05T19:10:17.477405] [INFO ] [MAIN ] BWMX: Loaded 4609 primary data records. [2025-09-05T19:10:18.080299] [INFO ] [MAIN ] BWG: Generated 871 derivative records from 6412 primary records. [2025-09-05T19:10:18.102410] [INFO ] [MAIN ] BWMX: Generated 871 derivative records from 4609 primary records. [2025-09-05T19:10:18.103236] [INFO ] [MAIN ] BWLP: Generated 871 derivative records from 15428 primary records. [2025-09-05T19:10:18.117387] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-05T19:10:18.119989] [INFO ] [MAIN ] Derivative Progress: 319/2117 symbols completed. BWG took 0.8s. Estimated remaining: 9m 2s. Rate: 199.0 symbols/min [2025-09-05T19:10:18.120542] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-05T19:10:18.122697] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:18.123091] [INFO ] [MAIN ] Derivative Progress: 320/2117 symbols completed. BWLP took 0.8s. Estimated remaining: 9m 0s. Rate: 199.6 symbols/min [2025-09-05T19:10:18.123718] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:18.123930] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-05T19:10:18.125818] [INFO ] [MAIN ] Derivative Progress: 321/2117 symbols completed. BWMX took 0.8s. Estimated remaining: 8m 58s. Rate: 200.2 symbols/min [2025-09-05T19:10:18.126204] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:18.130523] [INFO ] [MAIN ] BWNB: Loaded 1905 primary data records. [2025-09-05T19:10:18.132387] [INFO ] [MAIN ] BWSN: Loaded 2478 primary data records. [2025-09-05T19:10:18.504537] [INFO ] [MAIN ] BWXT: Loaded 23297 primary data records. [2025-09-05T19:10:18.907391] [INFO ] [MAIN ] BWNB: Generated 871 derivative records from 1905 primary records. [2025-09-05T19:10:18.908256] [INFO ] [MAIN ] BWSN: Generated 871 derivative records from 2478 primary records. [2025-09-05T19:10:18.924365] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-05T19:10:18.926279] [INFO ] [MAIN ] Derivative Progress: 322/2117 symbols completed. BWSN took 0.8s. Estimated remaining: 9m 1s. Rate: 199.2 symbols/min [2025-09-05T19:10:18.933442] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-05T19:10:18.935481] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:18.936342] [INFO ] [MAIN ] Derivative Progress: 323/2117 symbols completed. BWNB took 0.8s. Estimated remaining: 8m 59s. Rate: 199.8 symbols/min [2025-09-05T19:10:18.936283] [INFO ] [MAIN ] BWXT: Generated 871 derivative records from 23297 primary records. [2025-09-05T19:10:18.936514] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:18.945806] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-05T19:10:18.949150] [INFO ] [MAIN ] Derivative Progress: 324/2117 symbols completed. BWXT took 0.8s. Estimated remaining: 8m 57s. Rate: 200.4 symbols/min [2025-09-05T19:10:18.949611] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:18.954079] [INFO ] [MAIN ] BXC: Loaded 6676 primary data records. [2025-09-05T19:10:19.120723] [INFO ] [MAIN ] BX: Loaded 25935 primary data records. [2025-09-05T19:10:19.198956] [INFO ] [MAIN ] BXMT: Loaded 22328 primary data records. [2025-09-05T19:10:19.699059] [INFO ] [MAIN ] BXC: Generated 871 derivative records from 6676 primary records. [2025-09-05T19:10:19.708236] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-05T19:10:19.711225] [INFO ] [MAIN ] Derivative Progress: 325/2117 symbols completed. BXC took 0.8s. Estimated remaining: 8m 59s. Rate: 199.4 symbols/min [2025-09-05T19:10:19.711578] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:19.719602] [INFO ] [MAIN ] BX: Generated 871 derivative records from 25935 primary records. [2025-09-05T19:10:19.737805] [INFO ] [MAIN ] BXMT: Generated 871 derivative records from 22328 primary records. [2025-09-05T19:10:19.742827] [INFO ] [MAIN ] BXMX: Loaded 8559 primary data records. [2025-09-05T19:10:19.742439] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-05T19:10:19.748563] [INFO ] [MAIN ] Derivative Progress: 326/2117 symbols completed. BX took 0.8s. Estimated remaining: 8m 57s. Rate: 200.0 symbols/min [2025-09-05T19:10:19.761225] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:19.782773] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-05T19:10:19.796188] [INFO ] [MAIN ] Derivative Progress: 327/2117 symbols completed. BXMT took 0.8s. Estimated remaining: 8m 56s. Rate: 200.5 symbols/min [2025-09-05T19:10:19.821838] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:20.012172] [INFO ] [MAIN ] BXP: Loaded 23964 primary data records. [2025-09-05T19:10:20.128920] [INFO ] [MAIN ] BXSL: Loaded 22484 primary data records. [2025-09-05T19:10:20.419051] [INFO ] [MAIN ] BXMX: Generated 871 derivative records from 8559 primary records. [2025-09-05T19:10:20.552489] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-05T19:10:20.554683] [INFO ] [MAIN ] Derivative Progress: 328/2117 symbols completed. BXMX took 0.8s. Estimated remaining: 8m 58s. Rate: 199.6 symbols/min [2025-09-05T19:10:20.565502] [INFO ] [MAIN ] BXP: Generated 871 derivative records from 23964 primary records. [2025-09-05T19:10:20.575934] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-05T19:10:20.577549] [INFO ] [MAIN ] Derivative Progress: 329/2117 symbols completed. BXP took 0.8s. Estimated remaining: 8m 56s. Rate: 200.1 symbols/min [2025-09-05T19:10:20.584327] [INFO ] [MAIN ] BXSL: Generated 871 derivative records from 22484 primary records. [2025-09-05T19:10:20.592305] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-05T19:10:20.593863] [INFO ] [MAIN ] Derivative Progress: 330/2117 symbols completed. BXSL took 0.8s. Estimated remaining: 8m 54s. Rate: 200.7 symbols/min [2025-09-05T19:10:20.594267] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:20.594341] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:20.594590] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:20.601542] [INFO ] [MAIN ] BYM: Loaded 5292 primary data records. [2025-09-05T19:10:20.713350] [INFO ] [MAIN ] BY: Loaded 11044 primary data records. [2025-09-05T19:10:20.902826] [INFO ] [MAIN ] BYD: Loaded 22300 primary data records. [2025-09-05T19:10:21.414536] [INFO ] [MAIN ] BYM: Generated 871 derivative records from 5292 primary records. [2025-09-05T19:10:21.433578] [INFO ] [MAIN ] BY: Generated 871 derivative records from 11044 primary records. [2025-09-05T19:10:21.434359] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-05T19:10:21.436137] [INFO ] [MAIN ] Derivative Progress: 331/2117 symbols completed. BYM took 0.8s. Estimated remaining: 8m 57s. Rate: 199.6 symbols/min [2025-09-05T19:10:21.436965] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:21.446233] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-05T19:10:21.447847] [INFO ] [MAIN ] Derivative Progress: 332/2117 symbols completed. BY took 0.9s. Estimated remaining: 8m 55s. Rate: 200.2 symbols/min [2025-09-05T19:10:21.448220] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:21.463178] [INFO ] [MAIN ] BYD: Generated 871 derivative records from 22300 primary records. [2025-09-05T19:10:21.472311] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-05T19:10:21.481508] [INFO ] [MAIN ] Derivative Progress: 333/2117 symbols completed. BYD took 0.9s. Estimated remaining: 8m 53s. Rate: 200.7 symbols/min [2025-09-05T19:10:21.481800] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:21.482701] [INFO ] [MAIN ] BZH: Loaded 15408 primary data records. [2025-09-05T19:10:21.591843] [INFO ] [MAIN ] CAAP: Loaded 8162 primary data records. [2025-09-05T19:10:21.660551] [INFO ] [MAIN ] C: Loaded 26112 primary data records. [2025-09-05T19:10:22.299482] [INFO ] [MAIN ] BZH: Generated 871 derivative records from 15408 primary records. [2025-09-05T19:10:22.308627] [INFO ] [MAIN ] CAAP: Generated 871 derivative records from 8162 primary records. [2025-09-05T19:10:22.326700] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-05T19:10:22.328483] [INFO ] [MAIN ] Derivative Progress: 334/2117 symbols completed. BZH took 0.9s. Estimated remaining: 8m 56s. Rate: 199.6 symbols/min [2025-09-05T19:10:22.336229] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:22.337334] [INFO ] [MAIN ] C: Generated 871 derivative records from 26112 primary records. [2025-09-05T19:10:22.337754] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-05T19:10:22.340278] [INFO ] [MAIN ] Derivative Progress: 335/2117 symbols completed. CAAP took 0.9s. Estimated remaining: 8m 54s. Rate: 200.2 symbols/min [2025-09-05T19:10:22.340618] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:22.349381] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-05T19:10:22.351154] [INFO ] [MAIN ] Derivative Progress: 336/2117 symbols completed. C took 0.9s. Estimated remaining: 8m 52s. Rate: 200.8 symbols/min [2025-09-05T19:10:22.353806] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:22.360614] [INFO ] [MAIN ] CACI: Loaded 10131 primary data records. [2025-09-05T19:10:22.546816] [INFO ] [MAIN ] CADE: Loaded 24107 primary data records. [2025-09-05T19:10:22.656259] [INFO ] [MAIN ] CAE: Loaded 29144 primary data records. [2025-09-05T19:10:23.182691] [INFO ] [MAIN ] CACI: Generated 871 derivative records from 10131 primary records. [2025-09-05T19:10:23.194315] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-05T19:10:23.196197] [INFO ] [MAIN ] Derivative Progress: 337/2117 symbols completed. CACI took 0.9s. Estimated remaining: 8m 55s. Rate: 199.7 symbols/min [2025-09-05T19:10:23.196721] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:23.207371] [INFO ] [MAIN ] CADE: Generated 871 derivative records from 24107 primary records. [2025-09-05T19:10:23.209015] [INFO ] [MAIN ] CAF: Loaded 1346 primary data records. [2025-09-05T19:10:23.350138] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-05T19:10:23.356073] [INFO ] [MAIN ] CAE: Generated 1352 derivative records from 29144 primary records. [2025-09-05T19:10:23.421337] [INFO ] [MAIN ] Derivative Progress: 338/2117 symbols completed. CADE took 1.1s. Estimated remaining: 8m 54s. Rate: 199.8 symbols/min [2025-09-05T19:10:23.475502] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:23.480880] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-05T19:10:23.483367] [INFO ] [MAIN ] Derivative Progress: 339/2117 symbols completed. CAE took 1.1s. Estimated remaining: 8m 53s. Rate: 200.3 symbols/min [2025-09-05T19:10:23.484206] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:23.505830] [INFO ] [MAIN ] CAF: Generated 871 derivative records from 1346 primary records. [2025-09-05T19:10:23.529002] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-05T19:10:23.531562] [INFO ] [MAIN ] CAG: Loaded 26055 primary data records. [2025-09-05T19:10:23.530464] [INFO ] [MAIN ] Derivative Progress: 340/2117 symbols completed. CAF took 0.3s. Estimated remaining: 8m 51s. Rate: 200.8 symbols/min [2025-09-05T19:10:23.531937] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:23.628870] [INFO ] [MAIN ] CAH: Loaded 24906 primary data records. [2025-09-05T19:10:23.887625] [INFO ] [MAIN ] CAL: Loaded 20317 primary data records. [2025-09-05T19:10:24.316969] [INFO ] [MAIN ] CAG: Generated 871 derivative records from 26055 primary records. [2025-09-05T19:10:24.329635] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-05T19:10:24.338689] [INFO ] [MAIN ] Derivative Progress: 341/2117 symbols completed. CAG took 0.9s. Estimated remaining: 8m 53s. Rate: 199.8 symbols/min [2025-09-05T19:10:24.337416] [INFO ] [MAIN ] CAH: Generated 871 derivative records from 24906 primary records. [2025-09-05T19:10:24.339305] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:24.350705] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-05T19:10:24.359493] [INFO ] [MAIN ] Derivative Progress: 342/2117 symbols completed. CAH took 0.9s. Estimated remaining: 8m 52s. Rate: 200.3 symbols/min [2025-09-05T19:10:24.357801] [INFO ] [MAIN ] CAL: Generated 871 derivative records from 20317 primary records. [2025-09-05T19:10:24.359714] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:24.378141] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-05T19:10:24.379466] [INFO ] [MAIN ] CANG: Loaded 13874 primary data records. [2025-09-05T19:10:24.381133] [INFO ] [MAIN ] Derivative Progress: 343/2117 symbols completed. CAL took 0.8s. Estimated remaining: 8m 50s. Rate: 200.9 symbols/min [2025-09-05T19:10:24.452581] [INFO ] [MAIN ] CAPL: Loaded 4086 primary data records. [2025-09-05T19:10:24.911017] [INFO ] [MAIN ] CANG: Generated 871 derivative records from 13874 primary records. [2025-09-05T19:10:24.920148] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-05T19:10:24.921462] [INFO ] [MAIN ] Derivative Progress: 344/2117 symbols completed. CANG took 0.6s. Estimated remaining: 8m 51s. Rate: 200.4 symbols/min [2025-09-05T19:10:24.933773] [INFO ] [MAIN ] CAPL: Generated 1352 derivative records from 4086 primary records. [2025-09-05T19:10:24.945857] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-05T19:10:24.948096] [INFO ] [MAIN ] Derivative Progress: 345/2117 symbols completed. CAPL took 0.6s. Estimated remaining: 8m 49s. Rate: 201.0 symbols/min [2025-09-05T19:10:24.948573] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:24.948827] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:24.948894] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:24.956181] [INFO ] [MAIN ] CATO: Loaded 5064 primary data records. [2025-09-05T19:10:25.140133] [INFO ] [MAIN ] CARS: Loaded 29914 primary data records. [2025-09-05T19:10:25.392715] [INFO ] [MAIN ] CAT: Loaded 39856 primary data records. [2025-09-05T19:10:25.854083] [INFO ] [MAIN ] CATO: Generated 1351 derivative records from 5064 primary records. [2025-09-05T19:10:25.870043] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-05T19:10:25.872301] [INFO ] [MAIN ] Derivative Progress: 346/2117 symbols completed. CATO took 0.9s. Estimated remaining: 8m 52s. Rate: 199.7 symbols/min [2025-09-05T19:10:25.872518] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:25.887176] [INFO ] [MAIN ] CARS: Generated 1352 derivative records from 29914 primary records. [2025-09-05T19:10:25.902382] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-05T19:10:25.912621] [INFO ] [MAIN ] Derivative Progress: 347/2117 symbols completed. CARS took 1.0s. Estimated remaining: 8m 50s. Rate: 200.2 symbols/min [2025-09-05T19:10:25.912964] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:25.924368] [INFO ] [MAIN ] CAT: Generated 1352 derivative records from 39856 primary records. [2025-09-05T19:10:25.935361] [INFO ] [MAIN ] CAVA: Loaded 26052 primary data records. [2025-09-05T19:10:26.131264] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-05T19:10:26.137591] [INFO ] [MAIN ] Derivative Progress: 348/2117 symbols completed. CAT took 1.2s. Estimated remaining: 8m 50s. Rate: 200.4 symbols/min [2025-09-05T19:10:26.205862] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:26.207019] [INFO ] [MAIN ] CB: Loaded 37479 primary data records. [2025-09-05T19:10:26.296076] [INFO ] [MAIN ] CBAN: Loaded 4846 primary data records. [2025-09-05T19:10:26.775979] [INFO ] [MAIN ] CAVA: Generated 871 derivative records from 26052 primary records. [2025-09-05T19:10:26.788217] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-05T19:10:26.790389] [INFO ] [MAIN ] Derivative Progress: 349/2117 symbols completed. CAVA took 0.9s. Estimated remaining: 8m 51s. Rate: 199.7 symbols/min [2025-09-05T19:10:26.790769] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:26.803697] [INFO ] [MAIN ] CBL: Loaded 8278 primary data records. [2025-09-05T19:10:26.811180] [INFO ] [MAIN ] CBAN: Generated 871 derivative records from 4846 primary records. [2025-09-05T19:10:26.920940] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-05T19:10:26.934151] [INFO ] [MAIN ] Derivative Progress: 350/2117 symbols completed. CBAN took 0.7s. Estimated remaining: 8m 50s. Rate: 200.0 symbols/min [2025-09-05T19:10:26.932235] [INFO ] [MAIN ] CB: Generated 1352 derivative records from 37479 primary records. [2025-09-05T19:10:26.934529] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:27.078025] [INFO ] [MAIN ] CBNA: Loaded 1549 primary data records. [2025-09-05T19:10:27.116809] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-05T19:10:27.139228] [INFO ] [MAIN ] Derivative Progress: 351/2117 symbols completed. CB took 1.2s. Estimated remaining: 8m 49s. Rate: 200.2 symbols/min [2025-09-05T19:10:27.160265] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:27.340278] [INFO ] [MAIN ] CBL: Generated 871 derivative records from 8278 primary records. [2025-09-05T19:10:27.350117] [INFO ] [MAIN ] CBRE: Loaded 24128 primary data records. [2025-09-05T19:10:27.440281] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-05T19:10:27.470409] [INFO ] [MAIN ] Derivative Progress: 352/2117 symbols completed. CBL took 0.7s. Estimated remaining: 8m 49s. Rate: 200.1 symbols/min [2025-09-05T19:10:27.496698] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:27.583520] [INFO ] [MAIN ] CBNA: Generated 871 derivative records from 1549 primary records. [2025-09-05T19:10:27.655015] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-05T19:10:27.657201] [INFO ] [MAIN ] Derivative Progress: 353/2117 symbols completed. CBNA took 0.7s. Estimated remaining: 8m 48s. Rate: 200.3 symbols/min [2025-09-05T19:10:27.658042] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:27.671255] [INFO ] [MAIN ] CBT: Loaded 23391 primary data records. [2025-09-05T19:10:27.782427] [INFO ] [MAIN ] CBU: Loaded 11294 primary data records. [2025-09-05T19:10:27.852527] [INFO ] [MAIN ] CBRE: Generated 871 derivative records from 24128 primary records. [2025-09-05T19:10:28.086356] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-05T19:10:28.115219] [INFO ] [MAIN ] Derivative Progress: 354/2117 symbols completed. CBRE took 1.0s. Estimated remaining: 8m 49s. Rate: 200.0 symbols/min [2025-09-05T19:10:28.141357] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:28.224924] [INFO ] [MAIN ] CBT: Generated 1352 derivative records from 23391 primary records. [2025-09-05T19:10:28.243179] [INFO ] [MAIN ] CBU: Generated 871 derivative records from 11294 primary records. [2025-09-05T19:10:28.261862] [INFO ] [MAIN ] CBZ: Loaded 25094 primary data records. [2025-09-05T19:10:28.261259] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-05T19:10:28.263902] [INFO ] [MAIN ] Derivative Progress: 355/2117 symbols completed. CBU took 0.6s. Estimated remaining: 8m 48s. Rate: 200.3 symbols/min [2025-09-05T19:10:28.275378] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-05T19:10:28.264158] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:28.287131] [INFO ] [MAIN ] Derivative Progress: 356/2117 symbols completed. CBT took 0.8s. Estimated remaining: 8m 46s. Rate: 200.8 symbols/min [2025-09-05T19:10:28.307923] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:28.558865] [INFO ] [MAIN ] CCI: Loaded 25780 primary data records. [2025-09-05T19:10:28.701958] [INFO ] [MAIN ] CC: Loaded 39921 primary data records. [2025-09-05T19:10:29.000386] [INFO ] [MAIN ] CBZ: Generated 1352 derivative records from 25094 primary records. [2025-09-05T19:10:29.165156] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-05T19:10:29.173243] [INFO ] [MAIN ] CCI: Generated 871 derivative records from 25780 primary records. [2025-09-05T19:10:29.175634] [INFO ] [MAIN ] Derivative Progress: 357/2117 symbols completed. CBZ took 1.0s. Estimated remaining: 8m 49s. Rate: 199.7 symbols/min [2025-09-05T19:10:29.176602] [INFO ] [MAIN ] CCIA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:29.186032] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-05T19:10:29.188981] [INFO ] [MAIN ] Derivative Progress: 358/2117 symbols completed. CCI took 0.9s. Estimated remaining: 8m 47s. Rate: 200.3 symbols/min [2025-09-05T19:10:29.187766] [INFO ] [MAIN ] CCIA: Loaded 654 primary data records. [2025-09-05T19:10:29.372083] [INFO ] [MAIN ] CC: Generated 1352 derivative records from 39921 primary records. [2025-09-05T19:10:29.445315] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-05T19:10:29.447837] [INFO ] [MAIN ] Derivative Progress: 359/2117 symbols completed. CC took 1.2s. Estimated remaining: 8m 46s. Rate: 200.4 symbols/min [2025-09-05T19:10:29.458619] [INFO ] [MAIN ] CCIA: Generated 871 derivative records from 654 primary records. [2025-09-05T19:10:29.465442] [INFO ] [MAIN ] CCIA: Successfully saved derivative data. [2025-09-05T19:10:29.466815] [INFO ] [MAIN ] Derivative Progress: 360/2117 symbols completed. CCIA took 0.3s. Estimated remaining: 8m 45s. Rate: 200.9 symbols/min [2025-09-05T19:10:29.467371] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:29.467541] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:29.467603] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:29.478973] [INFO ] [MAIN ] CCIF: Loaded 7399 primary data records. [2025-09-05T19:10:29.613796] [INFO ] [MAIN ] CCJ: Loaded 26090 primary data records. [2025-09-05T19:10:29.667212] [INFO ] [MAIN ] CCK: Loaded 21985 primary data records. [2025-09-05T19:10:30.228525] [INFO ] [MAIN ] CCIF: Generated 871 derivative records from 7399 primary records. [2025-09-05T19:10:30.246440] [INFO ] [MAIN ] CCJ: Generated 871 derivative records from 26090 primary records. [2025-09-05T19:10:30.245577] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-05T19:10:30.248957] [INFO ] [MAIN ] Derivative Progress: 361/2117 symbols completed. CCIF took 0.8s. Estimated remaining: 8m 47s. Rate: 200.0 symbols/min [2025-09-05T19:10:30.250296] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:30.263814] [INFO ] [MAIN ] CCK: Generated 871 derivative records from 21985 primary records. [2025-09-05T19:10:30.274424] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-05T19:10:30.276001] [INFO ] [MAIN ] Derivative Progress: 362/2117 symbols completed. CCK took 0.8s. Estimated remaining: 8m 45s. Rate: 200.5 symbols/min [2025-09-05T19:10:30.272533] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-05T19:10:30.277749] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:30.277786] [INFO ] [MAIN ] Derivative Progress: 363/2117 symbols completed. CCJ took 0.8s. Estimated remaining: 8m 43s. Rate: 201.0 symbols/min [2025-09-05T19:10:30.278449] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:30.293599] [INFO ] [MAIN ] CCRD: Loaded 6260 primary data records. [2025-09-05T19:10:30.413176] [INFO ] [MAIN ] CCL: Loaded 26171 primary data records. [2025-09-05T19:10:30.469050] [INFO ] [MAIN ] CCO: Loaded 23588 primary data records. [2025-09-05T19:10:31.038830] [INFO ] [MAIN ] CCRD: Generated 871 derivative records from 6260 primary records. [2025-09-05T19:10:31.050842] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-05T19:10:31.052337] [INFO ] [MAIN ] Derivative Progress: 364/2117 symbols completed. CCRD took 0.8s. Estimated remaining: 8m 45s. Rate: 200.2 symbols/min [2025-09-05T19:10:31.053139] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:31.060810] [INFO ] [MAIN ] CCL: Generated 871 derivative records from 26171 primary records. [2025-09-05T19:10:31.072095] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-05T19:10:31.073713] [INFO ] [MAIN ] Derivative Progress: 365/2117 symbols completed. CCL took 0.8s. Estimated remaining: 8m 44s. Rate: 200.7 symbols/min [2025-09-05T19:10:31.080452] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:31.085632] [INFO ] [MAIN ] CCO: Generated 871 derivative records from 23588 primary records. [2025-09-05T19:10:31.099182] [INFO ] [MAIN ] CCS: Loaded 14715 primary data records. [2025-09-05T19:10:31.113174] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-05T19:10:31.145919] [INFO ] [MAIN ] Derivative Progress: 366/2117 symbols completed. CCO took 0.9s. Estimated remaining: 8m 42s. Rate: 201.1 symbols/min [2025-09-05T19:10:31.189297] [INFO ] [MAIN ] CCU: Loaded 10467 primary data records. [2025-09-05T19:10:31.181065] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:31.601968] [INFO ] [MAIN ] CDE: Loaded 26022 primary data records. [2025-09-05T19:10:31.799237] [INFO ] [MAIN ] CCS: Generated 871 derivative records from 14715 primary records. [2025-09-05T19:10:31.930905] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-05T19:10:31.932803] [INFO ] [MAIN ] Derivative Progress: 367/2117 symbols completed. CCS took 0.9s. Estimated remaining: 8m 44s. Rate: 200.2 symbols/min [2025-09-05T19:10:31.933811] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:31.941489] [INFO ] [MAIN ] CCU: Generated 871 derivative records from 10467 primary records. [2025-09-05T19:10:31.952332] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-05T19:10:31.953946] [INFO ] [MAIN ] Derivative Progress: 368/2117 symbols completed. CCU took 0.9s. Estimated remaining: 8m 43s. Rate: 200.7 symbols/min [2025-09-05T19:10:31.954301] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:31.966257] [INFO ] [MAIN ] CDE: Generated 871 derivative records from 26022 primary records. [2025-09-05T19:10:31.969785] [INFO ] [MAIN ] CDLR: Loaded 7111 primary data records. [2025-09-05T19:10:32.087335] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-05T19:10:32.094516] [INFO ] [MAIN ] Derivative Progress: 369/2117 symbols completed. CDE took 0.9s. Estimated remaining: 8m 42s. Rate: 201.0 symbols/min [2025-09-05T19:10:32.101665] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:32.096241] [INFO ] [MAIN ] CDP: Loaded 20316 primary data records. [2025-09-05T19:10:32.373482] [INFO ] [MAIN ] CDRE: Loaded 12127 primary data records. [2025-09-05T19:10:32.794955] [INFO ] [MAIN ] CDLR: Generated 1352 derivative records from 7111 primary records. [2025-09-05T19:10:32.820947] [INFO ] [MAIN ] CDP: Generated 871 derivative records from 20316 primary records. [2025-09-05T19:10:32.821854] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-05T19:10:32.824031] [INFO ] [MAIN ] Derivative Progress: 370/2117 symbols completed. CDLR took 0.9s. Estimated remaining: 8m 44s. Rate: 200.2 symbols/min [2025-09-05T19:10:32.824869] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:32.833809] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-05T19:10:32.835679] [INFO ] [MAIN ] Derivative Progress: 371/2117 symbols completed. CDP took 0.9s. Estimated remaining: 8m 42s. Rate: 200.7 symbols/min [2025-09-05T19:10:32.836100] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:32.845457] [INFO ] [MAIN ] CDRE: Generated 871 derivative records from 12127 primary records. [2025-09-05T19:10:32.862227] [INFO ] [MAIN ] CEE: Loaded 2732 primary data records. [2025-09-05T19:10:32.895015] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-05T19:10:32.935572] [INFO ] [MAIN ] Derivative Progress: 372/2117 symbols completed. CDRE took 0.8s. Estimated remaining: 8m 41s. Rate: 201.1 symbols/min [2025-09-05T19:10:32.975308] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:32.979216] [INFO ] [MAIN ] CE: Loaded 24660 primary data records. [2025-09-05T19:10:33.305074] [INFO ] [MAIN ] CF: Loaded 25376 primary data records. [2025-09-05T19:10:33.610822] [INFO ] [MAIN ] CEE: Generated 871 derivative records from 2732 primary records. [2025-09-05T19:10:33.619977] [INFO ] [MAIN ] CE: Generated 871 derivative records from 24660 primary records. [2025-09-05T19:10:33.632062] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-05T19:10:33.633481] [INFO ] [MAIN ] Derivative Progress: 373/2117 symbols completed. CEE took 0.8s. Estimated remaining: 8m 42s. Rate: 200.4 symbols/min [2025-09-05T19:10:33.637822] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-05T19:10:33.639275] [INFO ] [MAIN ] Derivative Progress: 374/2117 symbols completed. CE took 0.8s. Estimated remaining: 8m 41s. Rate: 200.9 symbols/min [2025-09-05T19:10:33.648011] [INFO ] [MAIN ] CF: Generated 871 derivative records from 25376 primary records. [2025-09-05T19:10:33.655968] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-05T19:10:33.657540] [INFO ] [MAIN ] Derivative Progress: 375/2117 symbols completed. CF took 0.7s. Estimated remaining: 8m 39s. Rate: 201.4 symbols/min [2025-09-05T19:10:33.658219] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:33.658160] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:33.658359] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:33.662709] [INFO ] [MAIN ] CGV: Loaded 729 primary data records. [2025-09-05T19:10:33.773810] [INFO ] [MAIN ] CHCT: Loaded 12057 primary data records. [2025-09-05T19:10:34.025134] [INFO ] [MAIN ] CGAU: Loaded 31647 primary data records. [2025-09-05T19:10:34.444877] [INFO ] [MAIN ] CGV: Generated 869 derivative records from 729 primary records. [2025-09-05T19:10:34.463397] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-05T19:10:34.462862] [INFO ] [MAIN ] CHCT: Generated 871 derivative records from 12057 primary records. [2025-09-05T19:10:34.464870] [INFO ] [MAIN ] Derivative Progress: 376/2117 symbols completed. CGV took 0.8s. Estimated remaining: 8m 41s. Rate: 200.5 symbols/min [2025-09-05T19:10:34.471877] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:34.476526] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-05T19:10:34.480211] [INFO ] [MAIN ] Derivative Progress: 377/2117 symbols completed. CHCT took 0.8s. Estimated remaining: 8m 39s. Rate: 201.0 symbols/min [2025-09-05T19:10:34.480495] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:34.491324] [INFO ] [MAIN ] CGAU: Generated 1352 derivative records from 31647 primary records. [2025-09-05T19:10:34.513469] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-05T19:10:34.515889] [INFO ] [MAIN ] Derivative Progress: 378/2117 symbols completed. CGAU took 0.9s. Estimated remaining: 8m 38s. Rate: 201.5 symbols/min [2025-09-05T19:10:34.516231] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:34.521417] [INFO ] [MAIN ] CHE: Loaded 7515 primary data records. [2025-09-05T19:10:34.639696] [INFO ] [MAIN ] CHD: Loaded 25475 primary data records. [2025-09-05T19:10:34.802682] [INFO ] [MAIN ] CHGG: Loaded 23443 primary data records. [2025-09-05T19:10:35.315686] [INFO ] [MAIN ] CHE: Generated 871 derivative records from 7515 primary records. [2025-09-05T19:10:35.330016] [INFO ] [MAIN ] CHD: Generated 871 derivative records from 25475 primary records. [2025-09-05T19:10:35.332897] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-05T19:10:35.339822] [INFO ] [MAIN ] Derivative Progress: 379/2117 symbols completed. CHE took 0.9s. Estimated remaining: 8m 40s. Rate: 200.5 symbols/min [2025-09-05T19:10:35.342589] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-05T19:10:35.342498] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:35.344159] [INFO ] [MAIN ] Derivative Progress: 380/2117 symbols completed. CHD took 0.9s. Estimated remaining: 8m 38s. Rate: 201.0 symbols/min [2025-09-05T19:10:35.345230] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:35.354214] [INFO ] [MAIN ] CHGG: Generated 871 derivative records from 23443 primary records. [2025-09-05T19:10:35.374762] [INFO ] [MAIN ] CHMI: Loaded 9852 primary data records. [2025-09-05T19:10:35.374444] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-05T19:10:35.396969] [INFO ] [MAIN ] Derivative Progress: 381/2117 symbols completed. CHGG took 0.9s. Estimated remaining: 8m 37s. Rate: 201.5 symbols/min [2025-09-05T19:10:35.412893] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:35.488212] [INFO ] [MAIN ] CHH: Loaded 14803 primary data records. [2025-09-05T19:10:35.624331] [INFO ] [MAIN ] CHN: Loaded 2412 primary data records. [2025-09-05T19:10:36.122205] [INFO ] [MAIN ] CHMI: Generated 871 derivative records from 9852 primary records. [2025-09-05T19:10:36.139259] [INFO ] [MAIN ] CHH: Generated 871 derivative records from 14803 primary records. [2025-09-05T19:10:36.145851] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-05T19:10:36.149047] [INFO ] [MAIN ] Derivative Progress: 382/2117 symbols completed. CHMI took 0.8s. Estimated remaining: 8m 39s. Rate: 200.7 symbols/min [2025-09-05T19:10:36.150728] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:36.151024] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-05T19:10:36.154209] [INFO ] [MAIN ] Derivative Progress: 383/2117 symbols completed. CHH took 0.8s. Estimated remaining: 8m 37s. Rate: 201.2 symbols/min [2025-09-05T19:10:36.154985] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:36.162693] [INFO ] [MAIN ] CHN: Generated 871 derivative records from 2412 primary records. [2025-09-05T19:10:36.176757] [INFO ] [MAIN ] CHT: Loaded 8971 primary data records. [2025-09-05T19:10:36.176511] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-05T19:10:36.204375] [INFO ] [MAIN ] Derivative Progress: 384/2117 symbols completed. CHN took 0.8s. Estimated remaining: 8m 36s. Rate: 201.6 symbols/min [2025-09-05T19:10:36.219944] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:36.301208] [INFO ] [MAIN ] CHPT: Loaded 23421 primary data records. [2025-09-05T19:10:36.435455] [INFO ] [MAIN ] CIB: Loaded 13909 primary data records. [2025-09-05T19:10:36.956997] [INFO ] [MAIN ] CHT: Generated 871 derivative records from 8971 primary records. [2025-09-05T19:10:36.975333] [INFO ] [MAIN ] CHPT: Generated 871 derivative records from 23421 primary records. [2025-09-05T19:10:36.979360] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-05T19:10:36.987616] [INFO ] [MAIN ] Derivative Progress: 385/2117 symbols completed. CHT took 0.8s. Estimated remaining: 8m 38s. Rate: 200.8 symbols/min [2025-09-05T19:10:36.995984] [INFO ] [MAIN ] CIB: Generated 871 derivative records from 13909 primary records. [2025-09-05T19:10:36.996433] [INFO ] [MAIN ] CICB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:36.997772] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-05T19:10:37.000301] [INFO ] [MAIN ] Derivative Progress: 386/2117 symbols completed. CHPT took 0.8s. Estimated remaining: 8m 36s. Rate: 201.3 symbols/min [2025-09-05T19:10:37.005124] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:37.009227] [INFO ] [MAIN ] CICB: Loaded 635 primary data records. [2025-09-05T19:10:37.055369] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-05T19:10:37.077394] [INFO ] [MAIN ] Derivative Progress: 387/2117 symbols completed. CIB took 0.9s. Estimated remaining: 8m 35s. Rate: 201.7 symbols/min [2025-09-05T19:10:37.077853] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:37.154143] [INFO ] [MAIN ] CIF: Loaded 1785 primary data records. [2025-09-05T19:10:37.263898] [INFO ] [MAIN ] CIEN: Loaded 25254 primary data records. [2025-09-05T19:10:37.825844] [INFO ] [MAIN ] CICB: Generated 870 derivative records from 635 primary records. [2025-09-05T19:10:37.835767] [INFO ] [MAIN ] CICB: Successfully saved derivative data. [2025-09-05T19:10:37.837352] [INFO ] [MAIN ] Derivative Progress: 388/2117 symbols completed. CICB took 0.8s. Estimated remaining: 8m 36s. Rate: 200.9 symbols/min [2025-09-05T19:10:37.847903] [INFO ] [MAIN ] CIF: Generated 871 derivative records from 1785 primary records. [2025-09-05T19:10:37.857280] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-05T19:10:37.858768] [INFO ] [MAIN ] Derivative Progress: 389/2117 symbols completed. CIF took 0.8s. Estimated remaining: 8m 35s. Rate: 201.3 symbols/min [2025-09-05T19:10:37.865777] [INFO ] [MAIN ] CIEN: Generated 871 derivative records from 25254 primary records. [2025-09-05T19:10:37.873843] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-05T19:10:37.875441] [INFO ] [MAIN ] Derivative Progress: 390/2117 symbols completed. CIEN took 0.9s. Estimated remaining: 8m 33s. Rate: 201.8 symbols/min [2025-09-05T19:10:37.876134] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:37.876046] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:37.876284] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:37.885491] [INFO ] [MAIN ] CII: Loaded 6309 primary data records. [2025-09-05T19:10:38.029009] [INFO ] [MAIN ] CIM: Loaded 16984 primary data records. [2025-09-05T19:10:38.056569] [INFO ] [MAIN ] CIG: Loaded 21983 primary data records. [2025-09-05T19:10:38.669634] [INFO ] [MAIN ] CII: Generated 871 derivative records from 6309 primary records. [2025-09-05T19:10:38.682163] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-05T19:10:38.691074] [INFO ] [MAIN ] Derivative Progress: 391/2117 symbols completed. CII took 0.8s. Estimated remaining: 8m 35s. Rate: 200.9 symbols/min [2025-09-05T19:10:38.691903] [INFO ] [MAIN ] CIG: Generated 871 derivative records from 21983 primary records. [2025-09-05T19:10:38.699218] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:38.706925] [INFO ] [MAIN ] CIM: Generated 871 derivative records from 16984 primary records. [2025-09-05T19:10:38.709522] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-05T19:10:38.711222] [INFO ] [MAIN ] Derivative Progress: 392/2117 symbols completed. CIG took 0.8s. Estimated remaining: 8m 34s. Rate: 201.4 symbols/min [2025-09-05T19:10:38.717419] [INFO ] [MAIN ] CIMO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:38.721342] [INFO ] [MAIN ] CIMN: Loaded 1140 primary data records. [2025-09-05T19:10:38.722559] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-05T19:10:38.744976] [INFO ] [MAIN ] Derivative Progress: 393/2117 symbols completed. CIM took 0.9s. Estimated remaining: 8m 32s. Rate: 201.9 symbols/min [2025-09-05T19:10:38.762823] [INFO ] [MAIN ] CIMO: Loaded 1277 primary data records. [2025-09-05T19:10:38.797128] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:38.977852] [INFO ] [MAIN ] CINT: Loaded 8843 primary data records. [2025-09-05T19:10:39.490446] [INFO ] [MAIN ] CIMN: Generated 871 derivative records from 1140 primary records. [2025-09-05T19:10:39.501611] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-05T19:10:39.505089] [INFO ] [MAIN ] Derivative Progress: 394/2117 symbols completed. CIMN took 0.8s. Estimated remaining: 8m 34s. Rate: 201.1 symbols/min [2025-09-05T19:10:39.511567] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:39.519087] [INFO ] [MAIN ] CINT: Generated 871 derivative records from 8843 primary records. [2025-09-05T19:10:39.520581] [INFO ] [MAIN ] CIMO: Generated 871 derivative records from 1277 primary records. [2025-09-05T19:10:39.538654] [INFO ] [MAIN ] CIMO: Successfully saved derivative data. [2025-09-05T19:10:39.540253] [INFO ] [MAIN ] Derivative Progress: 395/2117 symbols completed. CIMO took 0.8s. Estimated remaining: 8m 33s. Rate: 201.5 symbols/min [2025-09-05T19:10:39.538522] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-05T19:10:39.540536] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:39.542077] [INFO ] [MAIN ] Derivative Progress: 396/2117 symbols completed. CINT took 0.8s. Estimated remaining: 8m 31s. Rate: 202.0 symbols/min [2025-09-05T19:10:39.547218] [INFO ] [MAIN ] CIO: Loaded 10400 primary data records. [2025-09-05T19:10:39.542877] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:39.758156] [INFO ] [MAIN ] CIVI: Loaded 25563 primary data records. [2025-09-05T19:10:39.864760] [INFO ] [MAIN ] CL: Loaded 26029 primary data records. [2025-09-05T19:10:40.342015] [INFO ] [MAIN ] CIO: Generated 871 derivative records from 10400 primary records. [2025-09-05T19:10:40.353794] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-05T19:10:40.355915] [INFO ] [MAIN ] Derivative Progress: 397/2117 symbols completed. CIO took 0.8s. Estimated remaining: 8m 33s. Rate: 201.2 symbols/min [2025-09-05T19:10:40.356194] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:40.364532] [INFO ] [MAIN ] CIVI: Generated 871 derivative records from 25563 primary records. [2025-09-05T19:10:40.385763] [INFO ] [MAIN ] CL: Generated 871 derivative records from 26029 primary records. [2025-09-05T19:10:40.386609] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-05T19:10:40.388261] [INFO ] [MAIN ] Derivative Progress: 398/2117 symbols completed. CIVI took 0.8s. Estimated remaining: 8m 32s. Rate: 201.6 symbols/min [2025-09-05T19:10:40.388796] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:40.402888] [INFO ] [MAIN ] CLB: Loaded 15661 primary data records. [2025-09-05T19:10:40.402377] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-05T19:10:40.404520] [INFO ] [MAIN ] Derivative Progress: 399/2117 symbols completed. CL took 0.9s. Estimated remaining: 8m 30s. Rate: 202.1 symbols/min [2025-09-05T19:10:40.405882] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:40.476415] [INFO ] [MAIN ] CLCO: Loaded 4999 primary data records. [2025-09-05T19:10:40.785953] [INFO ] [MAIN ] CLH: Loaded 20699 primary data records. [2025-09-05T19:10:41.175357] [INFO ] [MAIN ] CLB: Generated 871 derivative records from 15661 primary records. [2025-09-05T19:10:41.187507] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-05T19:10:41.189659] [INFO ] [MAIN ] Derivative Progress: 400/2117 symbols completed. CLB took 0.8s. Estimated remaining: 8m 32s. Rate: 201.3 symbols/min [2025-09-05T19:10:41.190059] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:41.199453] [INFO ] [MAIN ] CLCO: Generated 871 derivative records from 4999 primary records. [2025-09-05T19:10:41.210201] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-05T19:10:41.211816] [INFO ] [MAIN ] Derivative Progress: 401/2117 symbols completed. CLCO took 0.8s. Estimated remaining: 8m 30s. Rate: 201.7 symbols/min [2025-09-05T19:10:41.215167] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:41.215400] [INFO ] [MAIN ] CLPR: Loaded 5281 primary data records. [2025-09-05T19:10:41.297013] [INFO ] [MAIN ] CLH: Generated 1352 derivative records from 20699 primary records. [2025-09-05T19:10:41.427155] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-05T19:10:41.485672] [INFO ] [MAIN ] Derivative Progress: 402/2117 symbols completed. CLH took 1.1s. Estimated remaining: 8m 30s. Rate: 201.8 symbols/min [2025-09-05T19:10:41.486628] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:41.503610] [INFO ] [MAIN ] CLS: Loaded 40399 primary data records. [2025-09-05T19:10:41.641606] [INFO ] [MAIN ] CLVT: Loaded 25287 primary data records. [2025-09-05T19:10:41.890196] [INFO ] [MAIN ] CLPR: Generated 871 derivative records from 5281 primary records. [2025-09-05T19:10:41.992922] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-05T19:10:42.050721] [INFO ] [MAIN ] Derivative Progress: 403/2117 symbols completed. CLPR took 0.9s. Estimated remaining: 8m 31s. Rate: 201.3 symbols/min [2025-09-05T19:10:42.067706] [INFO ] [MAIN ] CLS: Generated 1352 derivative records from 40399 primary records. [2025-09-05T19:10:42.082741] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-05T19:10:42.086826] [INFO ] [MAIN ] Derivative Progress: 404/2117 symbols completed. CLS took 0.9s. Estimated remaining: 8m 29s. Rate: 201.8 symbols/min [2025-09-05T19:10:42.094075] [INFO ] [MAIN ] CLVT: Generated 871 derivative records from 25287 primary records. [2025-09-05T19:10:42.101905] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-05T19:10:42.103475] [INFO ] [MAIN ] Derivative Progress: 405/2117 symbols completed. CLVT took 0.6s. Estimated remaining: 8m 28s. Rate: 202.2 symbols/min [2025-09-05T19:10:42.103982] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:42.104056] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:42.104154] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:42.118120] [INFO ] [MAIN ] CLW: Loaded 9939 primary data records. [2025-09-05T19:10:42.326401] [INFO ] [MAIN ] CLX: Loaded 25401 primary data records. [2025-09-05T19:10:42.442539] [INFO ] [MAIN ] CMA: Loaded 37709 primary data records. [2025-09-05T19:10:42.979375] [INFO ] [MAIN ] CLW: Generated 871 derivative records from 9939 primary records. [2025-09-05T19:10:42.989800] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-05T19:10:42.991392] [INFO ] [MAIN ] Derivative Progress: 406/2117 symbols completed. CLW took 0.9s. Estimated remaining: 8m 30s. Rate: 201.2 symbols/min [2025-09-05T19:10:42.991680] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:43.001561] [INFO ] [MAIN ] CLX: Generated 871 derivative records from 25401 primary records. [2025-09-05T19:10:43.016189] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-05T19:10:43.018795] [INFO ] [MAIN ] Derivative Progress: 407/2117 symbols completed. CLX took 0.9s. Estimated remaining: 8m 29s. Rate: 201.7 symbols/min [2025-09-05T19:10:43.024280] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:43.025247] [INFO ] [MAIN ] CMBT: Loaded 15463 primary data records. [2025-09-05T19:10:43.068056] [INFO ] [MAIN ] CMA: Generated 1352 derivative records from 37709 primary records. [2025-09-05T19:10:43.138273] [INFO ] [MAIN ] CMCM: Loaded 2329 primary data records. [2025-09-05T19:10:43.310095] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-05T19:10:43.412279] [INFO ] [MAIN ] Derivative Progress: 408/2117 symbols completed. CMA took 1.3s. Estimated remaining: 8m 29s. Rate: 201.5 symbols/min [2025-09-05T19:10:43.429495] [INFO ] [MAIN ] CMDB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:43.514938] [INFO ] [MAIN ] CMDB: Loaded 7168 primary data records. [2025-09-05T19:10:43.827502] [INFO ] [MAIN ] CMBT: Generated 1352 derivative records from 15463 primary records. [2025-09-05T19:10:43.844184] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-05T19:10:43.846395] [INFO ] [MAIN ] Derivative Progress: 409/2117 symbols completed. CMBT took 0.9s. Estimated remaining: 8m 29s. Rate: 201.3 symbols/min [2025-09-05T19:10:43.853789] [INFO ] [MAIN ] CMCM: Generated 871 derivative records from 2329 primary records. [2025-09-05T19:10:43.853875] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:43.863327] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-05T19:10:43.864910] [INFO ] [MAIN ] Derivative Progress: 410/2117 symbols completed. CMCM took 0.8s. Estimated remaining: 8m 28s. Rate: 201.8 symbols/min [2025-09-05T19:10:43.865357] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:43.875875] [INFO ] [MAIN ] CMDB: Generated 871 derivative records from 7168 primary records. [2025-09-05T19:10:43.896977] [INFO ] [MAIN ] CMDB: Successfully saved derivative data. [2025-09-05T19:10:43.899150] [INFO ] [MAIN ] Derivative Progress: 411/2117 symbols completed. CMDB took 0.5s. Estimated remaining: 8m 26s. Rate: 202.2 symbols/min [2025-09-05T19:10:43.899421] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:43.909036] [INFO ] [MAIN ] CMG: Loaded 26098 primary data records. [2025-09-05T19:10:44.020416] [INFO ] [MAIN ] CMI: Loaded 19504 primary data records. [2025-09-05T19:10:44.119560] [INFO ] [MAIN ] CMP: Loaded 17658 primary data records. [2025-09-05T19:10:44.741527] [INFO ] [MAIN ] CMG: Generated 871 derivative records from 26098 primary records. [2025-09-05T19:10:44.758319] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-05T19:10:44.760134] [INFO ] [MAIN ] Derivative Progress: 412/2117 symbols completed. CMG took 0.9s. Estimated remaining: 8m 28s. Rate: 201.3 symbols/min [2025-09-05T19:10:44.768701] [INFO ] [MAIN ] CMI: Generated 871 derivative records from 19504 primary records. [2025-09-05T19:10:44.767200] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:44.783056] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-05T19:10:44.791258] [INFO ] [MAIN ] Derivative Progress: 413/2117 symbols completed. CMI took 0.9s. Estimated remaining: 8m 27s. Rate: 201.7 symbols/min [2025-09-05T19:10:44.797223] [INFO ] [MAIN ] CMP: Generated 871 derivative records from 17658 primary records. [2025-09-05T19:10:44.803885] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:44.832296] [INFO ] [MAIN ] CMRE: Loaded 17323 primary data records. [2025-09-05T19:10:44.834631] [INFO ] [MAIN ] CMSA: Loaded 1649 primary data records. [2025-09-05T19:10:44.874718] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-05T19:10:44.951385] [INFO ] [MAIN ] Derivative Progress: 414/2117 symbols completed. CMP took 1.1s. Estimated remaining: 8m 26s. Rate: 201.9 symbols/min [2025-09-05T19:10:45.053851] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:45.233566] [INFO ] [MAIN ] CMSC: Loaded 3772 primary data records. [2025-09-05T19:10:46.039522] [INFO ] [MAIN ] CMRE: Generated 871 derivative records from 17323 primary records. [2025-09-05T19:10:46.052303] [INFO ] [MAIN ] CMSA: Generated 871 derivative records from 1649 primary records. [2025-09-05T19:10:46.068496] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-05T19:10:46.070909] [INFO ] [MAIN ] Derivative Progress: 415/2117 symbols completed. CMRE took 1.3s. Estimated remaining: 8m 29s. Rate: 200.6 symbols/min [2025-09-05T19:10:46.071396] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:46.073272] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-05T19:10:46.075222] [INFO ] [MAIN ] Derivative Progress: 416/2117 symbols completed. CMSA took 1.3s. Estimated remaining: 8m 28s. Rate: 201.1 symbols/min [2025-09-05T19:10:46.075810] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:46.082328] [INFO ] [MAIN ] CMSD: Loaded 3690 primary data records. [2025-09-05T19:10:46.201067] [INFO ] [MAIN ] CMTG: Loaded 16921 primary data records. [2025-09-05T19:10:46.350408] [INFO ] [MAIN ] CMSC: Generated 1351 derivative records from 3772 primary records. [2025-09-05T19:10:46.597687] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-05T19:10:46.600465] [INFO ] [MAIN ] Derivative Progress: 417/2117 symbols completed. CMSC took 1.5s. Estimated remaining: 8m 28s. Rate: 200.7 symbols/min [2025-09-05T19:10:46.601507] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:46.610597] [INFO ] [MAIN ] CMU: Loaded 5326 primary data records. [2025-09-05T19:10:46.717999] [INFO ] [MAIN ] CMSD: Generated 871 derivative records from 3690 primary records. [2025-09-05T19:10:46.813916] [INFO ] [MAIN ] CMTG: Generated 871 derivative records from 16921 primary records. [2025-09-05T19:10:46.900073] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-05T19:10:46.902058] [INFO ] [MAIN ] Derivative Progress: 418/2117 symbols completed. CMSD took 0.8s. Estimated remaining: 8m 28s. Rate: 200.7 symbols/min [2025-09-05T19:10:46.911987] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-05T19:10:46.913941] [INFO ] [MAIN ] Derivative Progress: 419/2117 symbols completed. CMTG took 0.8s. Estimated remaining: 8m 26s. Rate: 201.2 symbols/min [2025-09-05T19:10:46.930184] [INFO ] [MAIN ] CMU: Generated 1352 derivative records from 5326 primary records. [2025-09-05T19:10:46.941433] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-05T19:10:46.943856] [INFO ] [MAIN ] Derivative Progress: 420/2117 symbols completed. CMU took 0.3s. Estimated remaining: 8m 25s. Rate: 201.6 symbols/min [2025-09-05T19:10:46.944463] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:46.944500] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:46.944910] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:46.953238] [INFO ] [MAIN ] CNF: Loaded 6659 primary data records. [2025-09-05T19:10:47.225396] [INFO ] [MAIN ] CNA: Loaded 25064 primary data records. [2025-09-05T19:10:47.233540] [INFO ] [MAIN ] CNC: Loaded 26172 primary data records. [2025-09-05T19:10:47.772024] [INFO ] [MAIN ] CNF: Generated 870 derivative records from 6659 primary records. [2025-09-05T19:10:47.788437] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-05T19:10:47.790187] [INFO ] [MAIN ] Derivative Progress: 421/2117 symbols completed. CNF took 0.8s. Estimated remaining: 8m 27s. Rate: 200.7 symbols/min [2025-09-05T19:10:47.790630] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:47.809148] [INFO ] [MAIN ] CNA: Generated 1352 derivative records from 25064 primary records. [2025-09-05T19:10:47.827703] [INFO ] [MAIN ] CNC: Generated 871 derivative records from 26172 primary records. [2025-09-05T19:10:47.856386] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-05T19:10:47.857894] [INFO ] [MAIN ] Derivative Progress: 422/2117 symbols completed. CNC took 0.9s. Estimated remaining: 8m 26s. Rate: 201.1 symbols/min [2025-09-05T19:10:47.859887] [INFO ] [MAIN ] CNH: Loaded 25952 primary data records. [2025-09-05T19:10:47.859976] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:47.866827] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-05T19:10:47.896359] [INFO ] [MAIN ] Derivative Progress: 423/2117 symbols completed. CNA took 1.0s. Estimated remaining: 8m 24s. Rate: 201.5 symbols/min [2025-09-05T19:10:47.934269] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:48.119532] [INFO ] [MAIN ] CNI: Loaded 25101 primary data records. [2025-09-05T19:10:48.211003] [INFO ] [MAIN ] CNM: Loaded 24558 primary data records. [2025-09-05T19:10:48.682845] [INFO ] [MAIN ] CNH: Generated 871 derivative records from 25952 primary records. [2025-09-05T19:10:48.696538] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-05T19:10:48.698297] [INFO ] [MAIN ] Derivative Progress: 424/2117 symbols completed. CNH took 0.9s. Estimated remaining: 8m 26s. Rate: 200.7 symbols/min [2025-09-05T19:10:48.698788] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:48.712627] [INFO ] [MAIN ] CNI: Generated 871 derivative records from 25101 primary records. [2025-09-05T19:10:48.732027] [INFO ] [MAIN ] CNM: Generated 871 derivative records from 24558 primary records. [2025-09-05T19:10:48.741552] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-05T19:10:48.751212] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-05T19:10:48.751119] [INFO ] [MAIN ] Derivative Progress: 425/2117 symbols completed. CNI took 0.9s. Estimated remaining: 8m 25s. Rate: 201.1 symbols/min [2025-09-05T19:10:48.753625] [INFO ] [MAIN ] CNNE: Loaded 18299 primary data records. [2025-09-05T19:10:48.753914] [INFO ] [MAIN ] Derivative Progress: 426/2117 symbols completed. CNM took 0.8s. Estimated remaining: 8m 23s. Rate: 201.6 symbols/min [2025-09-05T19:10:48.754114] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:48.760011] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:49.010475] [INFO ] [MAIN ] CNO: Loaded 19629 primary data records. [2025-09-05T19:10:49.052371] [INFO ] [MAIN ] CNP: Loaded 25944 primary data records. [2025-09-05T19:10:49.518933] [INFO ] [MAIN ] CNNE: Generated 871 derivative records from 18299 primary records. [2025-09-05T19:10:49.532903] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-05T19:10:49.534829] [INFO ] [MAIN ] Derivative Progress: 427/2117 symbols completed. CNNE took 0.8s. Estimated remaining: 8m 25s. Rate: 200.8 symbols/min [2025-09-05T19:10:49.535489] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:49.550887] [INFO ] [MAIN ] CNO: Generated 871 derivative records from 19629 primary records. [2025-09-05T19:10:49.572810] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-05T19:10:49.574418] [INFO ] [MAIN ] Derivative Progress: 428/2117 symbols completed. CNO took 0.8s. Estimated remaining: 8m 24s. Rate: 201.2 symbols/min [2025-09-05T19:10:49.571304] [INFO ] [MAIN ] CNP: Generated 871 derivative records from 25944 primary records. [2025-09-05T19:10:49.575108] [INFO ] [MAIN ] CNR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:49.597566] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-05T19:10:49.599163] [INFO ] [MAIN ] Derivative Progress: 429/2117 symbols completed. CNP took 0.8s. Estimated remaining: 8m 22s. Rate: 201.6 symbols/min [2025-09-05T19:10:49.599464] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:49.621689] [INFO ] [MAIN ] CNQ: Loaded 40342 primary data records. [2025-09-05T19:10:49.707162] [INFO ] [MAIN ] CNR: Loaded 21372 primary data records. [2025-09-05T19:10:49.724516] [INFO ] [MAIN ] CNS: Loaded 9764 primary data records. [2025-09-05T19:10:50.439277] [INFO ] [MAIN ] CNQ: Generated 1352 derivative records from 40342 primary records. [2025-09-05T19:10:50.444474] [INFO ] [MAIN ] CNR: Generated 871 derivative records from 21372 primary records. [2025-09-05T19:10:50.458033] [INFO ] [MAIN ] CNS: Generated 871 derivative records from 9764 primary records. [2025-09-05T19:10:50.478063] [INFO ] [MAIN ] CNR: Successfully saved derivative data. [2025-09-05T19:10:50.480803] [INFO ] [MAIN ] Derivative Progress: 430/2117 symbols completed. CNR took 0.9s. Estimated remaining: 8m 24s. Rate: 200.7 symbols/min [2025-09-05T19:10:50.481635] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:50.483361] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-05T19:10:50.485334] [INFO ] [MAIN ] Derivative Progress: 431/2117 symbols completed. CNS took 0.9s. Estimated remaining: 8m 23s. Rate: 201.2 symbols/min [2025-09-05T19:10:50.486246] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:50.486954] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-05T19:10:50.489288] [INFO ] [MAIN ] Derivative Progress: 432/2117 symbols completed. CNQ took 1.0s. Estimated remaining: 8m 21s. Rate: 201.6 symbols/min [2025-09-05T19:10:50.489669] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:50.509486] [INFO ] [MAIN ] CODI: Loaded 21384 primary data records. [2025-09-05T19:10:50.654841] [INFO ] [MAIN ] COLD: Loaded 25535 primary data records. [2025-09-05T19:10:50.655974] [INFO ] [MAIN ] COHR: Loaded 25871 primary data records. [2025-09-05T19:10:51.295856] [INFO ] [MAIN ] CODI: Generated 871 derivative records from 21384 primary records. [2025-09-05T19:10:51.313922] [INFO ] [MAIN ] COHR: Generated 871 derivative records from 25871 primary records. [2025-09-05T19:10:51.314864] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-05T19:10:51.322564] [INFO ] [MAIN ] Derivative Progress: 433/2117 symbols completed. CODI took 0.8s. Estimated remaining: 8m 23s. Rate: 200.8 symbols/min [2025-09-05T19:10:51.323746] [INFO ] [MAIN ] COLD: Generated 871 derivative records from 25535 primary records. [2025-09-05T19:10:51.340046] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-05T19:10:51.340362] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-05T19:10:51.342047] [INFO ] [MAIN ] Derivative Progress: 434/2117 symbols completed. COLD took 0.9s. Estimated remaining: 8m 22s. Rate: 201.2 symbols/min [2025-09-05T19:10:51.343814] [INFO ] [MAIN ] Derivative Progress: 435/2117 symbols completed. COHR took 0.9s. Estimated remaining: 8m 20s. Rate: 201.7 symbols/min [2025-09-05T19:10:51.344574] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:51.344483] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:51.344704] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:51.371394] [INFO ] [MAIN ] COOK: Loaded 12488 primary data records. [2025-09-05T19:10:51.489960] [INFO ] [MAIN ] CON: Loaded 19313 primary data records. [2025-09-05T19:10:51.490896] [INFO ] [MAIN ] COMP: Loaded 25848 primary data records. [2025-09-05T19:10:52.243631] [INFO ] [MAIN ] COOK: Generated 871 derivative records from 12488 primary records. [2025-09-05T19:10:52.272457] [INFO ] [MAIN ] COMP: Generated 871 derivative records from 25848 primary records. [2025-09-05T19:10:52.273722] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-05T19:10:52.275191] [INFO ] [MAIN ] Derivative Progress: 436/2117 symbols completed. COOK took 0.9s. Estimated remaining: 8m 23s. Rate: 200.7 symbols/min [2025-09-05T19:10:52.273547] [INFO ] [MAIN ] CON: Generated 871 derivative records from 19313 primary records. [2025-09-05T19:10:52.276076] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:52.294150] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-05T19:10:52.296447] [INFO ] [MAIN ] Derivative Progress: 437/2117 symbols completed. COMP took 1.0s. Estimated remaining: 8m 21s. Rate: 201.1 symbols/min [2025-09-05T19:10:52.297122] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:52.297679] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-05T19:10:52.299710] [INFO ] [MAIN ] Derivative Progress: 438/2117 symbols completed. CON took 1.0s. Estimated remaining: 8m 20s. Rate: 201.6 symbols/min [2025-09-05T19:10:52.301586] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:52.330313] [INFO ] [MAIN ] COR: Loaded 21763 primary data records. [2025-09-05T19:10:52.403198] [INFO ] [MAIN ] COTY: Loaded 25916 primary data records. [2025-09-05T19:10:52.437383] [INFO ] [MAIN ] COUR: Loaded 23907 primary data records. [2025-09-05T19:10:53.131984] [INFO ] [MAIN ] COR: Generated 871 derivative records from 21763 primary records. [2025-09-05T19:10:53.158333] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-05T19:10:53.158194] [INFO ] [MAIN ] COUR: Generated 871 derivative records from 23907 primary records. [2025-09-05T19:10:53.159079] [INFO ] [MAIN ] COTY: Generated 871 derivative records from 25916 primary records. [2025-09-05T19:10:53.160457] [INFO ] [MAIN ] Derivative Progress: 439/2117 symbols completed. COR took 0.9s. Estimated remaining: 8m 22s. Rate: 200.7 symbols/min [2025-09-05T19:10:53.167460] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:53.178037] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-05T19:10:53.179905] [INFO ] [MAIN ] Derivative Progress: 440/2117 symbols completed. COTY took 0.9s. Estimated remaining: 8m 20s. Rate: 201.2 symbols/min [2025-09-05T19:10:53.178289] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-05T19:10:53.180171] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:53.182334] [INFO ] [MAIN ] Derivative Progress: 441/2117 symbols completed. COUR took 0.9s. Estimated remaining: 8m 19s. Rate: 201.6 symbols/min [2025-09-05T19:10:53.183960] [INFO ] [MAIN ] CPAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:53.186880] [INFO ] [MAIN ] CPAC: Loaded 625 primary data records. [2025-09-05T19:10:53.314344] [INFO ] [MAIN ] CPA: Loaded 13641 primary data records. [2025-09-05T19:10:53.318703] [INFO ] [MAIN ] CP: Loaded 25784 primary data records. [2025-09-05T19:10:53.991569] [INFO ] [MAIN ] CPAC: Generated 870 derivative records from 625 primary records. [2025-09-05T19:10:54.001587] [INFO ] [MAIN ] CPAC: Successfully saved derivative data. [2025-09-05T19:10:54.010124] [INFO ] [MAIN ] Derivative Progress: 442/2117 symbols completed. CPAC took 0.8s. Estimated remaining: 8m 20s. Rate: 200.8 symbols/min [2025-09-05T19:10:54.010554] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:54.011714] [INFO ] [MAIN ] CPA: Generated 871 derivative records from 13641 primary records. [2025-09-05T19:10:54.020704] [INFO ] [MAIN ] CP: Generated 871 derivative records from 25784 primary records. [2025-09-05T19:10:54.041034] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-05T19:10:54.043412] [INFO ] [MAIN ] Derivative Progress: 443/2117 symbols completed. CPA took 0.9s. Estimated remaining: 8m 19s. Rate: 201.2 symbols/min [2025-09-05T19:10:54.043969] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:54.044852] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-05T19:10:54.047081] [INFO ] [MAIN ] Derivative Progress: 444/2117 symbols completed. CP took 0.9s. Estimated remaining: 8m 18s. Rate: 201.7 symbols/min [2025-09-05T19:10:54.048166] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:54.054100] [INFO ] [MAIN ] CPAY: Loaded 14556 primary data records. [2025-09-05T19:10:54.172269] [INFO ] [MAIN ] CPK: Loaded 6003 primary data records. [2025-09-05T19:10:54.178398] [INFO ] [MAIN ] CPF: Loaded 7356 primary data records. [2025-09-05T19:10:54.872520] [INFO ] [MAIN ] CPAY: Generated 871 derivative records from 14556 primary records. [2025-09-05T19:10:54.885172] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-05T19:10:54.888523] [INFO ] [MAIN ] Derivative Progress: 445/2117 symbols completed. CPAY took 0.9s. Estimated remaining: 8m 20s. Rate: 200.8 symbols/min [2025-09-05T19:10:54.896247] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:54.899988] [INFO ] [MAIN ] CPF: Generated 871 derivative records from 7356 primary records. [2025-09-05T19:10:54.915387] [INFO ] [MAIN ] CPK: Generated 871 derivative records from 6003 primary records. [2025-09-05T19:10:54.922540] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-05T19:10:54.925800] [INFO ] [MAIN ] Derivative Progress: 446/2117 symbols completed. CPF took 0.9s. Estimated remaining: 8m 18s. Rate: 201.2 symbols/min [2025-09-05T19:10:54.926254] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:54.928982] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-05T19:10:54.930901] [INFO ] [MAIN ] Derivative Progress: 447/2117 symbols completed. CPK took 0.9s. Estimated remaining: 8m 17s. Rate: 201.7 symbols/min [2025-09-05T19:10:54.940306] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:54.950213] [INFO ] [MAIN ] CPS: Loaded 11267 primary data records. [2025-09-05T19:10:55.033027] [INFO ] [MAIN ] CPRI: Loaded 25333 primary data records. [2025-09-05T19:10:55.099897] [INFO ] [MAIN ] CPT: Loaded 21306 primary data records. [2025-09-05T19:10:55.761335] [INFO ] [MAIN ] CPS: Generated 871 derivative records from 11267 primary records. [2025-09-05T19:10:55.786396] [INFO ] [MAIN ] CPT: Generated 871 derivative records from 21306 primary records. [2025-09-05T19:10:55.785266] [INFO ] [MAIN ] CPRI: Generated 871 derivative records from 25333 primary records. [2025-09-05T19:10:55.801545] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-05T19:10:55.803826] [INFO ] [MAIN ] Derivative Progress: 448/2117 symbols completed. CPS took 0.9s. Estimated remaining: 8m 19s. Rate: 200.8 symbols/min [2025-09-05T19:10:55.806396] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-05T19:10:55.808530] [INFO ] [MAIN ] Derivative Progress: 449/2117 symbols completed. CPRI took 0.9s. Estimated remaining: 8m 17s. Rate: 201.2 symbols/min [2025-09-05T19:10:55.808790] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-05T19:10:55.810621] [INFO ] [MAIN ] Derivative Progress: 450/2117 symbols completed. CPT took 0.9s. Estimated remaining: 8m 16s. Rate: 201.7 symbols/min [2025-09-05T19:10:55.811035] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:55.811210] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:55.811373] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:55.822797] [INFO ] [MAIN ] CRBD: Loaded 4744 primary data records. [2025-09-05T19:10:55.830072] [INFO ] [MAIN ] CQP: Loaded 10235 primary data records. [2025-09-05T19:10:55.953980] [INFO ] [MAIN ] CR: Loaded 11522 primary data records. [2025-09-05T19:10:56.599520] [INFO ] [MAIN ] CQP: Generated 871 derivative records from 10235 primary records. [2025-09-05T19:10:56.607248] [INFO ] [MAIN ] CRBD: Generated 871 derivative records from 4744 primary records. [2025-09-05T19:10:56.623996] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-05T19:10:56.626101] [INFO ] [MAIN ] Derivative Progress: 451/2117 symbols completed. CQP took 0.8s. Estimated remaining: 8m 18s. Rate: 200.9 symbols/min [2025-09-05T19:10:56.626469] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:56.633310] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-05T19:10:56.635730] [INFO ] [MAIN ] Derivative Progress: 452/2117 symbols completed. CRBD took 0.8s. Estimated remaining: 8m 16s. Rate: 201.3 symbols/min [2025-09-05T19:10:56.634346] [INFO ] [MAIN ] CR: Generated 871 derivative records from 11522 primary records. [2025-09-05T19:10:56.636012] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:56.645298] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-05T19:10:56.647004] [INFO ] [MAIN ] Derivative Progress: 453/2117 symbols completed. CR took 0.8s. Estimated remaining: 8m 15s. Rate: 201.8 symbols/min [2025-09-05T19:10:56.647403] [INFO ] [MAIN ] CRCL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:56.669800] [INFO ] [MAIN ] CRBG: Loaded 25445 primary data records. [2025-09-05T19:10:56.807135] [INFO ] [MAIN ] CRCL: Loaded 24817 primary data records. [2025-09-05T19:10:56.855930] [INFO ] [MAIN ] CRC: Loaded 32950 primary data records. [2025-09-05T19:10:57.524605] [INFO ] [MAIN ] CRBG: Generated 871 derivative records from 25445 primary records. [2025-09-05T19:10:57.532320] [INFO ] [MAIN ] CRCL: Generated 825 derivative records from 24817 primary records. [2025-09-05T19:10:57.550290] [INFO ] [MAIN ] CRCL: Successfully saved derivative data. [2025-09-05T19:10:57.552317] [INFO ] [MAIN ] Derivative Progress: 454/2117 symbols completed. CRCL took 0.9s. Estimated remaining: 8m 17s. Rate: 200.9 symbols/min [2025-09-05T19:10:57.554152] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-05T19:10:57.553606] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:57.555758] [INFO ] [MAIN ] Derivative Progress: 455/2117 symbols completed. CRBG took 0.9s. Estimated remaining: 8m 15s. Rate: 201.3 symbols/min [2025-09-05T19:10:57.556139] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:57.571174] [INFO ] [MAIN ] CRC: Generated 1352 derivative records from 32950 primary records. [2025-09-05T19:10:57.595262] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-05T19:10:57.597746] [INFO ] [MAIN ] Derivative Progress: 456/2117 symbols completed. CRC took 1.0s. Estimated remaining: 8m 14s. Rate: 201.7 symbols/min [2025-09-05T19:10:57.606589] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:57.628444] [INFO ] [MAIN ] CRGY: Loaded 25248 primary data records. [2025-09-05T19:10:57.761804] [INFO ] [MAIN ] CRH: Loaded 40255 primary data records. [2025-09-05T19:10:57.885267] [INFO ] [MAIN ] CRI: Loaded 24294 primary data records. [2025-09-05T19:10:58.440465] [INFO ] [MAIN ] CRGY: Generated 871 derivative records from 25248 primary records. [2025-09-05T19:10:58.450666] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-05T19:10:58.452194] [INFO ] [MAIN ] Derivative Progress: 457/2117 symbols completed. CRGY took 0.9s. Estimated remaining: 8m 16s. Rate: 200.9 symbols/min [2025-09-05T19:10:58.452631] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:58.463044] [INFO ] [MAIN ] CRI: Generated 871 derivative records from 24294 primary records. [2025-09-05T19:10:58.488549] [INFO ] [MAIN ] CRH: Generated 1352 derivative records from 40255 primary records. [2025-09-05T19:10:58.497470] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-05T19:10:58.501361] [INFO ] [MAIN ] Derivative Progress: 458/2117 symbols completed. CRI took 0.9s. Estimated remaining: 8m 15s. Rate: 201.2 symbols/min [2025-09-05T19:10:58.502619] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:58.511736] [INFO ] [MAIN ] CRL: Loaded 19323 primary data records. [2025-09-05T19:10:58.547300] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-05T19:10:58.557982] [INFO ] [MAIN ] Derivative Progress: 459/2117 symbols completed. CRH took 1.0s. Estimated remaining: 8m 13s. Rate: 201.6 symbols/min [2025-09-05T19:10:58.563906] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:58.828049] [INFO ] [MAIN ] CRM: Loaded 40510 primary data records. [2025-09-05T19:10:58.830230] [INFO ] [MAIN ] CRS: Loaded 32928 primary data records. [2025-09-05T19:10:59.378380] [INFO ] [MAIN ] CRL: Generated 871 derivative records from 19323 primary records. [2025-09-05T19:10:59.391286] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-05T19:10:59.392955] [INFO ] [MAIN ] Derivative Progress: 460/2117 symbols completed. CRL took 0.9s. Estimated remaining: 8m 15s. Rate: 200.8 symbols/min [2025-09-05T19:10:59.393699] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:59.400059] [INFO ] [MAIN ] CRT: Loaded 2341 primary data records. [2025-09-05T19:10:59.587463] [INFO ] [MAIN ] CRM: Generated 1352 derivative records from 40510 primary records. [2025-09-05T19:10:59.579157] [INFO ] [MAIN ] CRS: Generated 1352 derivative records from 32928 primary records. [2025-09-05T19:10:59.698594] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-05T19:10:59.700322] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-05T19:10:59.702733] [INFO ] [MAIN ] Derivative Progress: 461/2117 symbols completed. CRM took 1.2s. Estimated remaining: 8m 15s. Rate: 200.8 symbols/min [2025-09-05T19:10:59.705722] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:59.705815] [INFO ] [MAIN ] Derivative Progress: 462/2117 symbols completed. CRS took 1.1s. Estimated remaining: 8m 14s. Rate: 201.2 symbols/min [2025-09-05T19:10:59.707088] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:10:59.722852] [INFO ] [MAIN ] CRT: Generated 871 derivative records from 2341 primary records. [2025-09-05T19:10:59.725999] [INFO ] [MAIN ] CSR: Loaded 6201 primary data records. [2025-09-05T19:10:59.777428] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-05T19:10:59.814029] [INFO ] [MAIN ] Derivative Progress: 463/2117 symbols completed. CRT took 0.4s. Estimated remaining: 8m 13s. Rate: 201.5 symbols/min [2025-09-05T19:10:59.854954] [INFO ] [MAIN ] CSTM: Loaded 22874 primary data records. [2025-09-05T19:11:00.290099] [INFO ] [MAIN ] CSR: Generated 871 derivative records from 6201 primary records. [2025-09-05T19:11:00.298826] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-05T19:11:00.301346] [INFO ] [MAIN ] Derivative Progress: 464/2117 symbols completed. CSR took 0.6s. Estimated remaining: 8m 13s. Rate: 201.2 symbols/min [2025-09-05T19:11:00.308360] [INFO ] [MAIN ] CSTM: Generated 871 derivative records from 22874 primary records. [2025-09-05T19:11:00.316371] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-05T19:11:00.317963] [INFO ] [MAIN ] Derivative Progress: 465/2117 symbols completed. CSTM took 0.6s. Estimated remaining: 8m 12s. Rate: 201.6 symbols/min [2025-09-05T19:11:00.318340] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:00.318548] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:00.318436] [INFO ] [MAIN ] CSW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:00.324272] [INFO ] [MAIN ] CTBB: Loaded 3331 primary data records. [2025-09-05T19:11:00.418186] [INFO ] [MAIN ] CSW: Loaded 6632 primary data records. [2025-09-05T19:11:00.417970] [INFO ] [MAIN ] CSV: Loaded 9511 primary data records. [2025-09-05T19:11:01.113112] [INFO ] [MAIN ] CSW: Generated 806 derivative records from 6632 primary records. [2025-09-05T19:11:01.128993] [INFO ] [MAIN ] CTBB: Generated 871 derivative records from 3331 primary records. [2025-09-05T19:11:01.128151] [INFO ] [MAIN ] CSW: Successfully saved derivative data. [2025-09-05T19:11:01.130581] [INFO ] [MAIN ] Derivative Progress: 466/2117 symbols completed. CSW took 0.8s. Estimated remaining: 8m 13s. Rate: 200.9 symbols/min [2025-09-05T19:11:01.131595] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:01.153104] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-05T19:11:01.152763] [INFO ] [MAIN ] CSV: Generated 1352 derivative records from 9511 primary records. [2025-09-05T19:11:01.156984] [INFO ] [MAIN ] CTDD: Loaded 2714 primary data records. [2025-09-05T19:11:01.156553] [INFO ] [MAIN ] Derivative Progress: 467/2117 symbols completed. CTBB took 0.8s. Estimated remaining: 8m 12s. Rate: 201.3 symbols/min [2025-09-05T19:11:01.191533] [INFO ] [MAIN ] CTEV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:01.274753] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-05T19:11:01.288331] [INFO ] [MAIN ] CTEV: Loaded 6738 primary data records. [2025-09-05T19:11:01.306042] [INFO ] [MAIN ] Derivative Progress: 468/2117 symbols completed. CSV took 1.0s. Estimated remaining: 8m 11s. Rate: 201.5 symbols/min [2025-09-05T19:11:01.372502] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:01.577955] [INFO ] [MAIN ] CTO: Loaded 13237 primary data records. [2025-09-05T19:11:01.919270] [INFO ] [MAIN ] CTDD: Generated 871 derivative records from 2714 primary records. [2025-09-05T19:11:01.930900] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-05T19:11:01.932181] [INFO ] [MAIN ] Derivative Progress: 469/2117 symbols completed. CTDD took 0.8s. Estimated remaining: 8m 12s. Rate: 201.0 symbols/min [2025-09-05T19:11:01.932420] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:01.944875] [INFO ] [MAIN ] CTEV: Generated 870 derivative records from 6738 primary records. [2025-09-05T19:11:01.956035] [INFO ] [MAIN ] CTEV: Successfully saved derivative data. [2025-09-05T19:11:01.957934] [INFO ] [MAIN ] Derivative Progress: 470/2117 symbols completed. CTEV took 0.8s. Estimated remaining: 8m 11s. Rate: 201.4 symbols/min [2025-09-05T19:11:01.958309] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:01.965725] [INFO ] [MAIN ] CTO: Generated 871 derivative records from 13237 primary records. [2025-09-05T19:11:01.983736] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-05T19:11:01.985527] [INFO ] [MAIN ] Derivative Progress: 471/2117 symbols completed. CTO took 0.7s. Estimated remaining: 8m 9s. Rate: 201.8 symbols/min [2025-09-05T19:11:01.985800] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:02.007843] [INFO ] [MAIN ] CTOS: Loaded 27861 primary data records. [2025-09-05T19:11:02.139224] [INFO ] [MAIN ] CTRE: Loaded 24174 primary data records. [2025-09-05T19:11:02.144541] [INFO ] [MAIN ] CTRA: Loaded 26028 primary data records. [2025-09-05T19:11:02.857786] [INFO ] [MAIN ] CTOS: Generated 1352 derivative records from 27861 primary records. [2025-09-05T19:11:02.883954] [INFO ] [MAIN ] CTRA: Generated 871 derivative records from 26028 primary records. [2025-09-05T19:11:02.885049] [INFO ] [MAIN ] CTRE: Generated 871 derivative records from 24174 primary records. [2025-09-05T19:11:02.888790] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-05T19:11:02.894980] [INFO ] [MAIN ] Derivative Progress: 472/2117 symbols completed. CTOS took 1.0s. Estimated remaining: 8m 11s. Rate: 200.9 symbols/min [2025-09-05T19:11:02.904802] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:02.905382] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-05T19:11:02.907431] [INFO ] [MAIN ] Derivative Progress: 473/2117 symbols completed. CTRA took 0.9s. Estimated remaining: 8m 10s. Rate: 201.3 symbols/min [2025-09-05T19:11:02.908374] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:02.909344] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-05T19:11:02.911334] [INFO ] [MAIN ] Derivative Progress: 474/2117 symbols completed. CTRE took 0.9s. Estimated remaining: 8m 9s. Rate: 201.7 symbols/min [2025-09-05T19:11:02.911675] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:02.921554] [INFO ] [MAIN ] CTS: Loaded 9157 primary data records. [2025-09-05T19:11:03.043085] [INFO ] [MAIN ] CTRI: Loaded 20136 primary data records. [2025-09-05T19:11:03.278065] [INFO ] [MAIN ] CTVA: Loaded 25867 primary data records. [2025-09-05T19:11:03.675225] [INFO ] [MAIN ] CTS: Generated 871 derivative records from 9157 primary records. [2025-09-05T19:11:03.684736] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-05T19:11:03.686211] [INFO ] [MAIN ] Derivative Progress: 475/2117 symbols completed. CTS took 0.8s. Estimated remaining: 8m 10s. Rate: 201.1 symbols/min [2025-09-05T19:11:03.688012] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:03.697487] [INFO ] [MAIN ] CTRI: Generated 871 derivative records from 20136 primary records. [2025-09-05T19:11:03.714668] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-05T19:11:03.715523] [INFO ] [MAIN ] CTVA: Generated 871 derivative records from 25867 primary records. [2025-09-05T19:11:03.718422] [INFO ] [MAIN ] Derivative Progress: 476/2117 symbols completed. CTRI took 0.8s. Estimated remaining: 8m 9s. Rate: 201.4 symbols/min [2025-09-05T19:11:03.718878] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:03.726818] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-05T19:11:03.728886] [INFO ] [MAIN ] Derivative Progress: 477/2117 symbols completed. CTVA took 0.8s. Estimated remaining: 8m 7s. Rate: 201.8 symbols/min [2025-09-05T19:11:03.729308] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:03.753219] [INFO ] [MAIN ] CUBI: Loaded 13471 primary data records. [2025-09-05T19:11:03.801925] [INFO ] [MAIN ] CUBE: Loaded 38322 primary data records. [2025-09-05T19:11:03.924689] [INFO ] [MAIN ] CUK: Loaded 24614 primary data records. [2025-09-05T19:11:04.540398] [INFO ] [MAIN ] CUBI: Generated 871 derivative records from 13471 primary records. [2025-09-05T19:11:04.549737] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-05T19:11:04.550995] [INFO ] [MAIN ] Derivative Progress: 478/2117 symbols completed. CUBI took 0.8s. Estimated remaining: 8m 9s. Rate: 201.1 symbols/min [2025-09-05T19:11:04.572047] [INFO ] [MAIN ] CUK: Generated 871 derivative records from 24614 primary records. [2025-09-05T19:11:04.572616] [INFO ] [MAIN ] CUBE: Generated 1352 derivative records from 38322 primary records. [2025-09-05T19:11:04.592069] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-05T19:11:04.593007] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-05T19:11:04.594659] [INFO ] [MAIN ] Derivative Progress: 479/2117 symbols completed. CUK took 0.9s. Estimated remaining: 8m 8s. Rate: 201.5 symbols/min [2025-09-05T19:11:04.597122] [INFO ] [MAIN ] Derivative Progress: 480/2117 symbols completed. CUBE took 0.9s. Estimated remaining: 8m 7s. Rate: 201.9 symbols/min [2025-09-05T19:11:04.597734] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:04.597773] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:04.597591] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:04.601697] [INFO ] [MAIN ] CULP: Loaded 1298 primary data records. [2025-09-05T19:11:04.718600] [INFO ] [MAIN ] CURV: Loaded 14397 primary data records. [2025-09-05T19:11:04.810155] [INFO ] [MAIN ] CURB: Loaded 15997 primary data records. [2025-09-05T19:11:05.387121] [INFO ] [MAIN ] CULP: Generated 871 derivative records from 1298 primary records. [2025-09-05T19:11:05.403028] [INFO ] [MAIN ] CURV: Generated 871 derivative records from 14397 primary records. [2025-09-05T19:11:05.403869] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-05T19:11:05.412728] [INFO ] [MAIN ] Derivative Progress: 481/2117 symbols completed. CULP took 0.8s. Estimated remaining: 8m 8s. Rate: 201.2 symbols/min [2025-09-05T19:11:05.420400] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:05.420849] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-05T19:11:05.421829] [INFO ] [MAIN ] CURB: Generated 871 derivative records from 15997 primary records. [2025-09-05T19:11:05.423576] [INFO ] [MAIN ] Derivative Progress: 482/2117 symbols completed. CURV took 0.8s. Estimated remaining: 8m 7s. Rate: 201.6 symbols/min [2025-09-05T19:11:05.423915] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:05.432480] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-05T19:11:05.434269] [INFO ] [MAIN ] Derivative Progress: 483/2117 symbols completed. CURB took 0.8s. Estimated remaining: 8m 5s. Rate: 202.0 symbols/min [2025-09-05T19:11:05.434525] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:05.466158] [INFO ] [MAIN ] CVEO: Loaded 11607 primary data records. [2025-09-05T19:11:05.478207] [INFO ] [MAIN ] CUZ: Loaded 24119 primary data records. [2025-09-05T19:11:05.634246] [INFO ] [MAIN ] CVE: Loaded 25978 primary data records. [2025-09-05T19:11:06.238504] [INFO ] [MAIN ] CUZ: Generated 871 derivative records from 24119 primary records. [2025-09-05T19:11:06.247920] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-05T19:11:06.249760] [INFO ] [MAIN ] Derivative Progress: 484/2117 symbols completed. CUZ took 0.8s. Estimated remaining: 8m 7s. Rate: 201.2 symbols/min [2025-09-05T19:11:06.251322] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:06.269929] [INFO ] [MAIN ] CVEO: Generated 1352 derivative records from 11607 primary records. [2025-09-05T19:11:06.270566] [INFO ] [MAIN ] CVE: Generated 871 derivative records from 25978 primary records. [2025-09-05T19:11:06.296564] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-05T19:11:06.299961] [INFO ] [MAIN ] Derivative Progress: 485/2117 symbols completed. CVEO took 0.9s. Estimated remaining: 8m 6s. Rate: 201.6 symbols/min [2025-09-05T19:11:06.300245] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:06.300816] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-05T19:11:06.302968] [INFO ] [MAIN ] Derivative Progress: 486/2117 symbols completed. CVE took 0.9s. Estimated remaining: 8m 4s. Rate: 202.0 symbols/min [2025-09-05T19:11:06.303628] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:06.314925] [INFO ] [MAIN ] CVI: Loaded 22376 primary data records. [2025-09-05T19:11:06.355020] [INFO ] [MAIN ] CVLG: Loaded 6958 primary data records. [2025-09-05T19:11:06.741073] [INFO ] [MAIN ] CVNA: Loaded 25681 primary data records. [2025-09-05T19:11:07.071561] [INFO ] [MAIN ] CVI: Generated 871 derivative records from 22376 primary records. [2025-09-05T19:11:07.082745] [INFO ] [MAIN ] CVLG: Generated 871 derivative records from 6958 primary records. [2025-09-05T19:11:07.100103] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-05T19:11:07.102348] [INFO ] [MAIN ] Derivative Progress: 487/2117 symbols completed. CVI took 0.9s. Estimated remaining: 8m 6s. Rate: 201.3 symbols/min [2025-09-05T19:11:07.103590] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:07.106822] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-05T19:11:07.109026] [INFO ] [MAIN ] Derivative Progress: 488/2117 symbols completed. CVLG took 0.8s. Estimated remaining: 8m 5s. Rate: 201.7 symbols/min [2025-09-05T19:11:07.109509] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:07.117573] [INFO ] [MAIN ] CVNA: Generated 871 derivative records from 25681 primary records. [2025-09-05T19:11:07.126710] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-05T19:11:07.128446] [INFO ] [MAIN ] Derivative Progress: 489/2117 symbols completed. CVNA took 0.8s. Estimated remaining: 8m 3s. Rate: 202.1 symbols/min [2025-09-05T19:11:07.136166] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:07.151456] [INFO ] [MAIN ] CVS: Loaded 26070 primary data records. [2025-09-05T19:11:07.225370] [INFO ] [MAIN ] CW: Loaded 10733 primary data records. [2025-09-05T19:11:07.354528] [INFO ] [MAIN ] CVX: Loaded 26130 primary data records. [2025-09-05T19:11:07.919415] [INFO ] [MAIN ] CVS: Generated 871 derivative records from 26070 primary records. [2025-09-05T19:11:07.929520] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-05T19:11:07.931512] [INFO ] [MAIN ] Derivative Progress: 490/2117 symbols completed. CVS took 0.8s. Estimated remaining: 8m 5s. Rate: 201.4 symbols/min [2025-09-05T19:11:07.932632] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:07.946801] [INFO ] [MAIN ] CW: Generated 871 derivative records from 10733 primary records. [2025-09-05T19:11:07.947655] [INFO ] [MAIN ] CVX: Generated 871 derivative records from 26130 primary records. [2025-09-05T19:11:07.969494] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-05T19:11:07.971673] [INFO ] [MAIN ] Derivative Progress: 491/2117 symbols completed. CVX took 0.9s. Estimated remaining: 8m 4s. Rate: 201.7 symbols/min [2025-09-05T19:11:07.971985] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:07.971805] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-05T19:11:07.973746] [INFO ] [MAIN ] Derivative Progress: 492/2117 symbols completed. CW took 0.8s. Estimated remaining: 8m 2s. Rate: 202.1 symbols/min [2025-09-05T19:11:07.974082] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:07.987067] [INFO ] [MAIN ] CWK: Loaded 23954 primary data records. [2025-09-05T19:11:07.986265] [INFO ] [MAIN ] CXE: Loaded 2783 primary data records. [2025-09-05T19:11:08.272623] [INFO ] [MAIN ] CX: Loaded 25552 primary data records. [2025-09-05T19:11:08.757479] [INFO ] [MAIN ] CXE: Generated 871 derivative records from 2783 primary records. [2025-09-05T19:11:08.758940] [INFO ] [MAIN ] CWK: Generated 871 derivative records from 23954 primary records. [2025-09-05T19:11:08.776130] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-05T19:11:08.778128] [INFO ] [MAIN ] Derivative Progress: 493/2117 symbols completed. CWK took 0.8s. Estimated remaining: 8m 4s. Rate: 201.4 symbols/min [2025-09-05T19:11:08.780738] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-05T19:11:08.783304] [INFO ] [MAIN ] Derivative Progress: 494/2117 symbols completed. CXE took 0.8s. Estimated remaining: 8m 2s. Rate: 201.8 symbols/min [2025-09-05T19:11:08.790204] [INFO ] [MAIN ] CX: Generated 871 derivative records from 25552 primary records. [2025-09-05T19:11:08.798460] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-05T19:11:08.800123] [INFO ] [MAIN ] Derivative Progress: 495/2117 symbols completed. CX took 0.8s. Estimated remaining: 8m 1s. Rate: 202.2 symbols/min [2025-09-05T19:11:08.800865] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:08.800665] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:08.800960] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:08.807153] [INFO ] [MAIN ] CXH: Loaded 2983 primary data records. [2025-09-05T19:11:08.929090] [INFO ] [MAIN ] CXT: Loaded 15087 primary data records. [2025-09-05T19:11:08.989511] [INFO ] [MAIN ] CXW: Loaded 21207 primary data records. [2025-09-05T19:11:09.574519] [INFO ] [MAIN ] CXH: Generated 871 derivative records from 2983 primary records. [2025-09-05T19:11:09.584054] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-05T19:11:09.585661] [INFO ] [MAIN ] Derivative Progress: 496/2117 symbols completed. CXH took 0.8s. Estimated remaining: 8m 3s. Rate: 201.6 symbols/min [2025-09-05T19:11:09.587277] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:09.597611] [INFO ] [MAIN ] CXT: Generated 871 derivative records from 15087 primary records. [2025-09-05T19:11:09.605812] [INFO ] [MAIN ] CXW: Generated 871 derivative records from 21207 primary records. [2025-09-05T19:11:09.633059] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-05T19:11:09.633655] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-05T19:11:09.635501] [INFO ] [MAIN ] Derivative Progress: 497/2117 symbols completed. CXW took 0.8s. Estimated remaining: 8m 1s. Rate: 201.9 symbols/min [2025-09-05T19:11:09.637755] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:09.637687] [INFO ] [MAIN ] Derivative Progress: 498/2117 symbols completed. CXT took 0.8s. Estimated remaining: 8m 0s. Rate: 202.3 symbols/min [2025-09-05T19:11:09.638795] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:09.647192] [INFO ] [MAIN ] CYH: Loaded 23255 primary data records. [2025-09-05T19:11:09.768281] [INFO ] [MAIN ] DAC: Loaded 6152 primary data records. [2025-09-05T19:11:09.954046] [INFO ] [MAIN ] D: Loaded 26032 primary data records. [2025-09-05T19:11:10.403810] [INFO ] [MAIN ] CYH: Generated 871 derivative records from 23255 primary records. [2025-09-05T19:11:10.415588] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-05T19:11:10.417145] [INFO ] [MAIN ] Derivative Progress: 499/2117 symbols completed. CYH took 0.8s. Estimated remaining: 8m 1s. Rate: 201.6 symbols/min [2025-09-05T19:11:10.424016] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:10.425074] [INFO ] [MAIN ] DAC: Generated 871 derivative records from 6152 primary records. [2025-09-05T19:11:10.442662] [INFO ] [MAIN ] D: Generated 871 derivative records from 26032 primary records. [2025-09-05T19:11:10.444745] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-05T19:11:10.453303] [INFO ] [MAIN ] Derivative Progress: 500/2117 symbols completed. DAC took 0.8s. Estimated remaining: 8m 0s. Rate: 202.0 symbols/min [2025-09-05T19:11:10.460494] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:10.461699] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-05T19:11:10.463545] [INFO ] [MAIN ] Derivative Progress: 501/2117 symbols completed. D took 0.8s. Estimated remaining: 7m 59s. Rate: 202.4 symbols/min [2025-09-05T19:11:10.463863] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:10.478032] [INFO ] [MAIN ] DAN: Loaded 23934 primary data records. [2025-09-05T19:11:10.531155] [INFO ] [MAIN ] DAO: Loaded 8073 primary data records. [2025-09-05T19:11:10.778120] [INFO ] [MAIN ] DAR: Loaded 25224 primary data records. [2025-09-05T19:11:11.320345] [INFO ] [MAIN ] DAO: Generated 871 derivative records from 8073 primary records. [2025-09-05T19:11:11.321377] [INFO ] [MAIN ] DAN: Generated 871 derivative records from 23934 primary records. [2025-09-05T19:11:11.336685] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-05T19:11:11.338734] [INFO ] [MAIN ] Derivative Progress: 502/2117 symbols completed. DAO took 0.9s. Estimated remaining: 8m 1s. Rate: 201.6 symbols/min [2025-09-05T19:11:11.339145] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:11.342617] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-05T19:11:11.344575] [INFO ] [MAIN ] Derivative Progress: 503/2117 symbols completed. DAN took 0.9s. Estimated remaining: 7m 59s. Rate: 202.0 symbols/min [2025-09-05T19:11:11.344884] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:11.353262] [INFO ] [MAIN ] DAR: Generated 871 derivative records from 25224 primary records. [2025-09-05T19:11:11.362818] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-05T19:11:11.364700] [INFO ] [MAIN ] Derivative Progress: 504/2117 symbols completed. DAR took 0.9s. Estimated remaining: 7m 58s. Rate: 202.4 symbols/min [2025-09-05T19:11:11.364955] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:11.401556] [INFO ] [MAIN ] DB: Loaded 25349 primary data records. [2025-09-05T19:11:11.478824] [INFO ] [MAIN ] DAY: Loaded 37678 primary data records. [2025-09-05T19:11:11.719967] [INFO ] [MAIN ] DBI: Loaded 33447 primary data records. [2025-09-05T19:11:12.248986] [INFO ] [MAIN ] DB: Generated 871 derivative records from 25349 primary records. [2025-09-05T19:11:12.260338] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-05T19:11:12.262250] [INFO ] [MAIN ] Derivative Progress: 505/2117 symbols completed. DB took 0.9s. Estimated remaining: 7m 60s. Rate: 201.6 symbols/min [2025-09-05T19:11:12.262705] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:12.273782] [INFO ] [MAIN ] DAY: Generated 1352 derivative records from 37678 primary records. [2025-09-05T19:11:12.290315] [INFO ] [MAIN ] DBL: Loaded 7210 primary data records. [2025-09-05T19:11:12.359918] [INFO ] [MAIN ] DBI: Generated 1352 derivative records from 33447 primary records. [2025-09-05T19:11:12.325053] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-05T19:11:12.410123] [INFO ] [MAIN ] Derivative Progress: 506/2117 symbols completed. DAY took 1.1s. Estimated remaining: 7m 59s. Rate: 201.8 symbols/min [2025-09-05T19:11:12.416793] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:12.427538] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-05T19:11:12.445527] [INFO ] [MAIN ] Derivative Progress: 507/2117 symbols completed. DBI took 1.1s. Estimated remaining: 7m 58s. Rate: 202.1 symbols/min [2025-09-05T19:11:12.473608] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:12.619175] [INFO ] [MAIN ] DCI: Loaded 18306 primary data records. [2025-09-05T19:11:12.664049] [INFO ] [MAIN ] DBRG: Loaded 24029 primary data records. [2025-09-05T19:11:12.925582] [INFO ] [MAIN ] DBL: Generated 1352 derivative records from 7210 primary records. [2025-09-05T19:11:13.123312] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-05T19:11:13.126369] [INFO ] [MAIN ] Derivative Progress: 508/2117 symbols completed. DBL took 0.9s. Estimated remaining: 7m 59s. Rate: 201.6 symbols/min [2025-09-05T19:11:13.145285] [INFO ] [MAIN ] DCI: Generated 871 derivative records from 18306 primary records. [2025-09-05T19:11:13.152271] [INFO ] [MAIN ] DBRG: Generated 871 derivative records from 24029 primary records. [2025-09-05T19:11:13.167718] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-05T19:11:13.170423] [INFO ] [MAIN ] Derivative Progress: 509/2117 symbols completed. DCI took 0.7s. Estimated remaining: 7m 58s. Rate: 201.9 symbols/min [2025-09-05T19:11:13.171325] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-05T19:11:13.173100] [INFO ] [MAIN ] Derivative Progress: 510/2117 symbols completed. DBRG took 0.8s. Estimated remaining: 7m 57s. Rate: 202.3 symbols/min [2025-09-05T19:11:13.173864] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:13.173793] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:13.174056] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:13.185661] [INFO ] [MAIN ] DCO: Loaded 8056 primary data records. [2025-09-05T19:11:13.306557] [INFO ] [MAIN ] DD: Loaded 25605 primary data records. [2025-09-05T19:11:13.520816] [INFO ] [MAIN ] DDD: Loaded 38118 primary data records. [2025-09-05T19:11:14.055674] [INFO ] [MAIN ] DCO: Generated 871 derivative records from 8056 primary records. [2025-09-05T19:11:14.068200] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-05T19:11:14.069876] [INFO ] [MAIN ] Derivative Progress: 511/2117 symbols completed. DCO took 0.9s. Estimated remaining: 7m 58s. Rate: 201.5 symbols/min [2025-09-05T19:11:14.077070] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:14.078341] [INFO ] [MAIN ] DD: Generated 871 derivative records from 25605 primary records. [2025-09-05T19:11:14.089091] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-05T19:11:14.092924] [INFO ] [MAIN ] Derivative Progress: 512/2117 symbols completed. DD took 0.9s. Estimated remaining: 7m 57s. Rate: 201.9 symbols/min [2025-09-05T19:11:14.093233] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:14.113343] [INFO ] [MAIN ] DDD: Generated 1352 derivative records from 38118 primary records. [2025-09-05T19:11:14.125602] [INFO ] [MAIN ] DDS: Loaded 6230 primary data records. [2025-09-05T19:11:14.138063] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-05T19:11:14.157782] [INFO ] [MAIN ] Derivative Progress: 513/2117 symbols completed. DDD took 1.0s. Estimated remaining: 7m 56s. Rate: 202.2 symbols/min [2025-09-05T19:11:14.197539] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:14.204791] [INFO ] [MAIN ] DDL: Loaded 26555 primary data records. [2025-09-05T19:11:14.302775] [INFO ] [MAIN ] DDT: Loaded 969 primary data records. [2025-09-05T19:11:14.919506] [INFO ] [MAIN ] DDS: Generated 871 derivative records from 6230 primary records. [2025-09-05T19:11:14.931896] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-05T19:11:14.940272] [INFO ] [MAIN ] Derivative Progress: 514/2117 symbols completed. DDS took 0.8s. Estimated remaining: 7m 57s. Rate: 201.6 symbols/min [2025-09-05T19:11:14.941194] [INFO ] [MAIN ] DDT: Generated 870 derivative records from 969 primary records. [2025-09-05T19:11:14.951719] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:14.958682] [INFO ] [MAIN ] DDL: Generated 1352 derivative records from 26555 primary records. [2025-09-05T19:11:14.959967] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-05T19:11:14.962473] [INFO ] [MAIN ] Derivative Progress: 515/2117 symbols completed. DDT took 0.8s. Estimated remaining: 7m 56s. Rate: 201.9 symbols/min [2025-09-05T19:11:14.962715] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:14.975265] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-05T19:11:14.977738] [INFO ] [MAIN ] Derivative Progress: 516/2117 symbols completed. DDL took 0.9s. Estimated remaining: 7m 55s. Rate: 202.3 symbols/min [2025-09-05T19:11:14.978033] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:15.006813] [INFO ] [MAIN ] DEA: Loaded 18577 primary data records. [2025-09-05T19:11:15.039228] [INFO ] [MAIN ] DE: Loaded 22953 primary data records. [2025-09-05T19:11:15.314730] [INFO ] [MAIN ] DEC: Loaded 22204 primary data records. [2025-09-05T19:11:15.788937] [INFO ] [MAIN ] DEA: Generated 871 derivative records from 18577 primary records. [2025-09-05T19:11:15.805608] [INFO ] [MAIN ] DE: Generated 871 derivative records from 22953 primary records. [2025-09-05T19:11:15.813356] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-05T19:11:15.816181] [INFO ] [MAIN ] Derivative Progress: 517/2117 symbols completed. DEA took 0.9s. Estimated remaining: 7m 56s. Rate: 201.6 symbols/min [2025-09-05T19:11:15.816610] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:15.819687] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-05T19:11:15.821614] [INFO ] [MAIN ] Derivative Progress: 518/2117 symbols completed. DE took 0.9s. Estimated remaining: 7m 55s. Rate: 202.0 symbols/min [2025-09-05T19:11:15.821839] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:15.834798] [INFO ] [MAIN ] DEC: Generated 1352 derivative records from 22204 primary records. [2025-09-05T19:11:15.855561] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-05T19:11:15.858117] [INFO ] [MAIN ] Derivative Progress: 519/2117 symbols completed. DEC took 0.9s. Estimated remaining: 7m 54s. Rate: 202.3 symbols/min [2025-09-05T19:11:15.863932] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:15.882884] [INFO ] [MAIN ] DECK: Loaded 25901 primary data records. [2025-09-05T19:11:15.883428] [INFO ] [MAIN ] DEI: Loaded 23138 primary data records. [2025-09-05T19:11:16.218103] [INFO ] [MAIN ] DELL: Loaded 26110 primary data records. [2025-09-05T19:11:16.691457] [INFO ] [MAIN ] DECK: Generated 871 derivative records from 25901 primary records. [2025-09-05T19:11:16.709487] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-05T19:11:16.706950] [INFO ] [MAIN ] DEI: Generated 871 derivative records from 23138 primary records. [2025-09-05T19:11:16.711126] [INFO ] [MAIN ] Derivative Progress: 520/2117 symbols completed. DECK took 0.9s. Estimated remaining: 7m 55s. Rate: 201.6 symbols/min [2025-09-05T19:11:16.712138] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:16.730111] [INFO ] [MAIN ] DELL: Generated 871 derivative records from 26110 primary records. [2025-09-05T19:11:16.732037] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-05T19:11:16.739783] [INFO ] [MAIN ] Derivative Progress: 521/2117 symbols completed. DEI took 0.9s. Estimated remaining: 7m 54s. Rate: 201.9 symbols/min [2025-09-05T19:11:16.747065] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:16.748656] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-05T19:11:16.750422] [INFO ] [MAIN ] Derivative Progress: 522/2117 symbols completed. DELL took 0.9s. Estimated remaining: 7m 53s. Rate: 202.3 symbols/min [2025-09-05T19:11:16.750999] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:16.761683] [INFO ] [MAIN ] DEO: Loaded 23994 primary data records. [2025-09-05T19:11:16.838495] [INFO ] [MAIN ] DFP: Loaded 5710 primary data records. [2025-09-05T19:11:16.884962] [INFO ] [MAIN ] DFIN: Loaded 9921 primary data records. [2025-09-05T19:11:17.572097] [INFO ] [MAIN ] DFP: Generated 871 derivative records from 5710 primary records. [2025-09-05T19:11:17.579873] [INFO ] [MAIN ] DEO: Generated 871 derivative records from 23994 primary records. [2025-09-05T19:11:17.599153] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-05T19:11:17.602155] [INFO ] [MAIN ] Derivative Progress: 523/2117 symbols completed. DFP took 0.9s. Estimated remaining: 7m 54s. Rate: 201.6 symbols/min [2025-09-05T19:11:17.610985] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-05T19:11:17.610776] [INFO ] [MAIN ] DFIN: Generated 871 derivative records from 9921 primary records. [2025-09-05T19:11:17.612691] [INFO ] [MAIN ] Derivative Progress: 524/2117 symbols completed. DEO took 0.9s. Estimated remaining: 7m 53s. Rate: 202.0 symbols/min [2025-09-05T19:11:17.621026] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-05T19:11:17.622605] [INFO ] [MAIN ] Derivative Progress: 525/2117 symbols completed. DFIN took 0.9s. Estimated remaining: 7m 52s. Rate: 202.3 symbols/min [2025-09-05T19:11:17.623106] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:17.623270] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:17.623229] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:17.636627] [INFO ] [MAIN ] DHF: Loaded 10826 primary data records. [2025-09-05T19:11:17.763018] [INFO ] [MAIN ] DGX: Loaded 21452 primary data records. [2025-09-05T19:11:17.799890] [INFO ] [MAIN ] DG: Loaded 25788 primary data records. [2025-09-05T19:11:18.447144] [INFO ] [MAIN ] DHF: Generated 871 derivative records from 10826 primary records. [2025-09-05T19:11:18.473941] [INFO ] [MAIN ] DGX: Generated 871 derivative records from 21452 primary records. [2025-09-05T19:11:18.466578] [INFO ] [MAIN ] DG: Generated 871 derivative records from 25788 primary records. [2025-09-05T19:11:18.475173] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-05T19:11:18.477465] [INFO ] [MAIN ] Derivative Progress: 526/2117 symbols completed. DHF took 0.9s. Estimated remaining: 7m 53s. Rate: 201.6 symbols/min [2025-09-05T19:11:18.477848] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:18.493465] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-05T19:11:18.495749] [INFO ] [MAIN ] Derivative Progress: 527/2117 symbols completed. DGX took 0.9s. Estimated remaining: 7m 52s. Rate: 202.0 symbols/min [2025-09-05T19:11:18.496346] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:18.496901] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-05T19:11:18.498978] [INFO ] [MAIN ] Derivative Progress: 528/2117 symbols completed. DG took 0.9s. Estimated remaining: 7m 51s. Rate: 202.3 symbols/min [2025-09-05T19:11:18.499240] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:18.535154] [INFO ] [MAIN ] DHI: Loaded 25937 primary data records. [2025-09-05T19:11:18.589471] [INFO ] [MAIN ] DHT: Loaded 22836 primary data records. [2025-09-05T19:11:18.680817] [INFO ] [MAIN ] DHR: Loaded 25865 primary data records. [2025-09-05T19:11:19.364002] [INFO ] [MAIN ] DHI: Generated 871 derivative records from 25937 primary records. [2025-09-05T19:11:19.365815] [INFO ] [MAIN ] DHT: Generated 871 derivative records from 22836 primary records. [2025-09-05T19:11:19.390039] [INFO ] [MAIN ] DHR: Generated 871 derivative records from 25865 primary records. [2025-09-05T19:11:19.388943] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-05T19:11:19.390544] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-05T19:11:19.392435] [INFO ] [MAIN ] Derivative Progress: 529/2117 symbols completed. DHT took 0.9s. Estimated remaining: 7m 53s. Rate: 201.6 symbols/min [2025-09-05T19:11:19.394536] [INFO ] [MAIN ] Derivative Progress: 530/2117 symbols completed. DHI took 0.9s. Estimated remaining: 7m 51s. Rate: 202.0 symbols/min [2025-09-05T19:11:19.400681] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:19.394618] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:19.403619] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-05T19:11:19.405692] [INFO ] [MAIN ] Derivative Progress: 531/2117 symbols completed. DHR took 0.9s. Estimated remaining: 7m 50s. Rate: 202.3 symbols/min [2025-09-05T19:11:19.406123] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:19.412347] [INFO ] [MAIN ] DHX: Loaded 5386 primary data records. [2025-09-05T19:11:19.544910] [INFO ] [MAIN ] DIN: Loaded 17551 primary data records. [2025-09-05T19:11:19.726624] [INFO ] [MAIN ] DINO: Loaded 25652 primary data records. [2025-09-05T19:11:20.172559] [INFO ] [MAIN ] DHX: Generated 871 derivative records from 5386 primary records. [2025-09-05T19:11:20.193110] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-05T19:11:20.192295] [INFO ] [MAIN ] DIN: Generated 871 derivative records from 17551 primary records. [2025-09-05T19:11:20.194771] [INFO ] [MAIN ] Derivative Progress: 532/2117 symbols completed. DHX took 0.8s. Estimated remaining: 7m 51s. Rate: 201.7 symbols/min [2025-09-05T19:11:20.195403] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:20.205477] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-05T19:11:20.208717] [INFO ] [MAIN ] Derivative Progress: 533/2117 symbols completed. DIN took 0.8s. Estimated remaining: 7m 50s. Rate: 202.1 symbols/min [2025-09-05T19:11:20.208975] [INFO ] [MAIN ] DIVY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:20.218138] [INFO ] [MAIN ] DIVY: Loaded 489 primary data records. [2025-09-05T19:11:20.219234] [INFO ] [MAIN ] DINO: Generated 871 derivative records from 25652 primary records. [2025-09-05T19:11:20.339305] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-05T19:11:20.341141] [INFO ] [MAIN ] Derivative Progress: 534/2117 symbols completed. DINO took 0.9s. Estimated remaining: 7m 50s. Rate: 202.3 symbols/min [2025-09-05T19:11:20.347570] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:20.426964] [INFO ] [MAIN ] DIS: Loaded 26158 primary data records. [2025-09-05T19:11:20.738271] [INFO ] [MAIN ] DK: Loaded 24056 primary data records. [2025-09-05T19:11:20.869232] [INFO ] [MAIN ] DIVY: Generated 860 derivative records from 489 primary records. [2025-09-05T19:11:20.990815] [INFO ] [MAIN ] DIVY: Successfully saved derivative data. [2025-09-05T19:11:20.993179] [INFO ] [MAIN ] Derivative Progress: 535/2117 symbols completed. DIVY took 0.8s. Estimated remaining: 7m 50s. Rate: 201.8 symbols/min [2025-09-05T19:11:21.000156] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:21.001821] [INFO ] [MAIN ] DIS: Generated 871 derivative records from 26158 primary records. [2025-09-05T19:11:21.011515] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-05T19:11:21.015839] [INFO ] [MAIN ] Derivative Progress: 536/2117 symbols completed. DIS took 0.8s. Estimated remaining: 7m 49s. Rate: 202.2 symbols/min [2025-09-05T19:11:21.016271] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:21.021013] [INFO ] [MAIN ] DKL: Loaded 7096 primary data records. [2025-09-05T19:11:21.140697] [INFO ] [MAIN ] DK: Generated 871 derivative records from 24056 primary records. [2025-09-05T19:11:21.227763] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-05T19:11:21.235857] [INFO ] [MAIN ] Derivative Progress: 537/2117 symbols completed. DK took 0.9s. Estimated remaining: 7m 49s. Rate: 202.3 symbols/min [2025-09-05T19:11:21.236617] [INFO ] [MAIN ] DKS: Loaded 24343 primary data records. [2025-09-05T19:11:21.236843] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:21.452104] [INFO ] [MAIN ] DLB: Loaded 14675 primary data records. [2025-09-05T19:11:21.789604] [INFO ] [MAIN ] DKL: Generated 871 derivative records from 7096 primary records. [2025-09-05T19:11:21.799580] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-05T19:11:21.801200] [INFO ] [MAIN ] Derivative Progress: 538/2117 symbols completed. DKL took 0.8s. Estimated remaining: 7m 49s. Rate: 201.9 symbols/min [2025-09-05T19:11:21.811884] [INFO ] [MAIN ] DKS: Generated 871 derivative records from 24343 primary records. [2025-09-05T19:11:21.821878] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-05T19:11:21.823748] [INFO ] [MAIN ] Derivative Progress: 539/2117 symbols completed. DKS took 0.8s. Estimated remaining: 7m 48s. Rate: 202.3 symbols/min [2025-09-05T19:11:21.833556] [INFO ] [MAIN ] DLB: Generated 871 derivative records from 14675 primary records. [2025-09-05T19:11:21.841555] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-05T19:11:21.843137] [INFO ] [MAIN ] Derivative Progress: 540/2117 symbols completed. DLB took 0.6s. Estimated remaining: 7m 47s. Rate: 202.6 symbols/min [2025-09-05T19:11:21.843559] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:21.843759] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:21.843790] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:21.849174] [INFO ] [MAIN ] DLNG: Loaded 2379 primary data records. [2025-09-05T19:11:21.968006] [INFO ] [MAIN ] DLX: Loaded 14145 primary data records. [2025-09-05T19:11:22.135859] [INFO ] [MAIN ] DLR: Loaded 24434 primary data records. [2025-09-05T19:11:22.622113] [INFO ] [MAIN ] DLNG: Generated 871 derivative records from 2379 primary records. [2025-09-05T19:11:22.637275] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-05T19:11:22.638517] [INFO ] [MAIN ] Derivative Progress: 541/2117 symbols completed. DLNG took 0.8s. Estimated remaining: 7m 48s. Rate: 202.0 symbols/min [2025-09-05T19:11:22.635616] [INFO ] [MAIN ] DLX: Generated 871 derivative records from 14145 primary records. [2025-09-05T19:11:22.638746] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:22.658499] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-05T19:11:22.661068] [INFO ] [MAIN ] Derivative Progress: 542/2117 symbols completed. DLX took 0.8s. Estimated remaining: 7m 47s. Rate: 202.3 symbols/min [2025-09-05T19:11:22.659379] [INFO ] [MAIN ] DLR: Generated 871 derivative records from 24434 primary records. [2025-09-05T19:11:22.665859] [INFO ] [MAIN ] DLY: Loaded 9549 primary data records. [2025-09-05T19:11:22.661301] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:22.709029] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-05T19:11:22.749793] [INFO ] [MAIN ] Derivative Progress: 543/2117 symbols completed. DLR took 0.9s. Estimated remaining: 7m 46s. Rate: 202.6 symbols/min [2025-09-05T19:11:22.777957] [INFO ] [MAIN ] DMA: Loaded 2232 primary data records. [2025-09-05T19:11:22.777767] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:23.030975] [INFO ] [MAIN ] DMB: Loaded 5243 primary data records. [2025-09-05T19:11:23.422662] [INFO ] [MAIN ] DLY: Generated 871 derivative records from 9549 primary records. [2025-09-05T19:11:23.442262] [INFO ] [MAIN ] DMA: Generated 870 derivative records from 2232 primary records. [2025-09-05T19:11:23.443758] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-05T19:11:23.445339] [INFO ] [MAIN ] Derivative Progress: 544/2117 symbols completed. DLY took 0.8s. Estimated remaining: 7m 47s. Rate: 202.1 symbols/min [2025-09-05T19:11:23.451455] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:23.453882] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-05T19:11:23.455783] [INFO ] [MAIN ] Derivative Progress: 545/2117 symbols completed. DMA took 0.8s. Estimated remaining: 7m 46s. Rate: 202.5 symbols/min [2025-09-05T19:11:23.456138] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:23.463245] [INFO ] [MAIN ] DMO: Loaded 4808 primary data records. [2025-09-05T19:11:23.470528] [INFO ] [MAIN ] DMB: Generated 871 derivative records from 5243 primary records. [2025-09-05T19:11:23.605238] [INFO ] [MAIN ] DNA: Loaded 23545 primary data records. [2025-09-05T19:11:23.626885] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-05T19:11:23.672313] [INFO ] [MAIN ] Derivative Progress: 546/2117 symbols completed. DMB took 0.9s. Estimated remaining: 7m 45s. Rate: 202.6 symbols/min [2025-09-05T19:11:23.750991] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:24.029374] [INFO ] [MAIN ] DNOW: Loaded 21086 primary data records. [2025-09-05T19:11:24.023085] [INFO ] [MAIN ] DMO: Generated 871 derivative records from 4808 primary records. [2025-09-05T19:11:24.043242] [INFO ] [MAIN ] DNA: Generated 871 derivative records from 23545 primary records. [2025-09-05T19:11:24.128591] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-05T19:11:24.140414] [INFO ] [MAIN ] Derivative Progress: 547/2117 symbols completed. DMO took 0.7s. Estimated remaining: 7m 46s. Rate: 202.3 symbols/min [2025-09-05T19:11:24.161054] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-05T19:11:24.161209] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:24.163134] [INFO ] [MAIN ] Derivative Progress: 548/2117 symbols completed. DNA took 0.7s. Estimated remaining: 7m 44s. Rate: 202.7 symbols/min [2025-09-05T19:11:24.168559] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:24.312283] [INFO ] [MAIN ] DNP: Loaded 15531 primary data records. [2025-09-05T19:11:24.475213] [INFO ] [MAIN ] DOC: Loaded 25961 primary data records. [2025-09-05T19:11:24.702524] [INFO ] [MAIN ] DNOW: Generated 871 derivative records from 21086 primary records. [2025-09-05T19:11:24.864219] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-05T19:11:24.866234] [INFO ] [MAIN ] Derivative Progress: 549/2117 symbols completed. DNOW took 1.1s. Estimated remaining: 7m 45s. Rate: 202.2 symbols/min [2025-09-05T19:11:24.867281] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:24.877217] [INFO ] [MAIN ] DNP: Generated 871 derivative records from 15531 primary records. [2025-09-05T19:11:24.889454] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-05T19:11:24.891421] [INFO ] [MAIN ] Derivative Progress: 550/2117 symbols completed. DNP took 0.7s. Estimated remaining: 7m 44s. Rate: 202.5 symbols/min [2025-09-05T19:11:24.891769] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:24.906128] [INFO ] [MAIN ] DOC: Generated 871 derivative records from 25961 primary records. [2025-09-05T19:11:24.928406] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-05T19:11:24.930161] [INFO ] [MAIN ] Derivative Progress: 551/2117 symbols completed. DOC took 0.8s. Estimated remaining: 7m 43s. Rate: 202.8 symbols/min [2025-09-05T19:11:24.930533] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:24.955071] [INFO ] [MAIN ] DOCN: Loaded 38128 primary data records. [2025-09-05T19:11:25.079717] [INFO ] [MAIN ] DOLE: Loaded 18063 primary data records. [2025-09-05T19:11:25.083498] [INFO ] [MAIN ] DOCS: Loaded 38565 primary data records. [2025-09-05T19:11:25.754201] [INFO ] [MAIN ] DOCN: Generated 1352 derivative records from 38128 primary records. [2025-09-05T19:11:25.775795] [INFO ] [MAIN ] DOLE: Generated 871 derivative records from 18063 primary records. [2025-09-05T19:11:25.778287] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-05T19:11:25.784198] [INFO ] [MAIN ] Derivative Progress: 552/2117 symbols completed. DOCN took 0.9s. Estimated remaining: 7m 45s. Rate: 202.1 symbols/min [2025-09-05T19:11:25.795199] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:25.796235] [INFO ] [MAIN ] DOCS: Generated 1351 derivative records from 38565 primary records. [2025-09-05T19:11:25.798502] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-05T19:11:25.800269] [INFO ] [MAIN ] Derivative Progress: 553/2117 symbols completed. DOLE took 0.9s. Estimated remaining: 7m 43s. Rate: 202.5 symbols/min [2025-09-05T19:11:25.811979] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-05T19:11:25.815324] [INFO ] [MAIN ] Derivative Progress: 554/2117 symbols completed. DOCS took 0.9s. Estimated remaining: 7m 42s. Rate: 202.8 symbols/min [2025-09-05T19:11:25.831475] [INFO ] [MAIN ] DOV: Loaded 21671 primary data records. [2025-09-05T19:11:26.069086] [INFO ] [MAIN ] DOV: Generated 871 derivative records from 21671 primary records. [2025-09-05T19:11:26.077497] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-05T19:11:26.078501] [INFO ] [MAIN ] Derivative Progress: 555/2117 symbols completed. DOV took 0.3s. Estimated remaining: 7m 42s. Rate: 202.9 symbols/min [2025-09-05T19:11:26.079058] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:26.079258] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:26.079216] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:26.089559] [INFO ] [MAIN ] DPG: Loaded 6497 primary data records. [2025-09-05T19:11:26.212767] [INFO ] [MAIN ] DQ: Loaded 21111 primary data records. [2025-09-05T19:11:26.462309] [INFO ] [MAIN ] DOW: Loaded 26103 primary data records. [2025-09-05T19:11:26.867748] [INFO ] [MAIN ] DPG: Generated 871 derivative records from 6497 primary records. [2025-09-05T19:11:26.879063] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-05T19:11:26.880732] [INFO ] [MAIN ] Derivative Progress: 556/2117 symbols completed. DPG took 0.8s. Estimated remaining: 7m 43s. Rate: 202.3 symbols/min [2025-09-05T19:11:26.881004] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:26.895856] [INFO ] [MAIN ] DQ: Generated 871 derivative records from 21111 primary records. [2025-09-05T19:11:26.917299] [INFO ] [MAIN ] DOW: Generated 871 derivative records from 26103 primary records. [2025-09-05T19:11:26.932235] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-05T19:11:26.932903] [INFO ] [MAIN ] DRD: Loaded 17653 primary data records. [2025-09-05T19:11:26.935182] [INFO ] [MAIN ] Derivative Progress: 557/2117 symbols completed. DQ took 0.9s. Estimated remaining: 7m 42s. Rate: 202.5 symbols/min [2025-09-05T19:11:26.935675] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:26.995783] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-05T19:11:27.018585] [INFO ] [MAIN ] Derivative Progress: 558/2117 symbols completed. DOW took 0.9s. Estimated remaining: 7m 41s. Rate: 202.8 symbols/min [2025-09-05T19:11:27.042483] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:27.201679] [INFO ] [MAIN ] DRI: Loaded 22362 primary data records. [2025-09-05T19:11:27.202059] [INFO ] [MAIN ] DRLL: Loaded 6696 primary data records. [2025-09-05T19:11:27.772780] [INFO ] [MAIN ] DRD: Generated 871 derivative records from 17653 primary records. [2025-09-05T19:11:27.783717] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-05T19:11:27.785078] [INFO ] [MAIN ] Derivative Progress: 559/2117 symbols completed. DRD took 0.9s. Estimated remaining: 7m 42s. Rate: 202.2 symbols/min [2025-09-05T19:11:27.785382] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:27.801850] [INFO ] [MAIN ] DRI: Generated 871 derivative records from 22362 primary records. [2025-09-05T19:11:27.823556] [INFO ] [MAIN ] DSL: Loaded 13668 primary data records. [2025-09-05T19:11:27.855962] [INFO ] [MAIN ] DRLL: Generated 1351 derivative records from 6696 primary records. [2025-09-05T19:11:27.929683] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-05T19:11:27.951320] [INFO ] [MAIN ] Derivative Progress: 560/2117 symbols completed. DRI took 1.0s. Estimated remaining: 7m 42s. Rate: 202.4 symbols/min [2025-09-05T19:11:27.956031] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:27.980388] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-05T19:11:28.016608] [INFO ] [MAIN ] DSMC: Loaded 737 primary data records. [2025-09-05T19:11:28.019149] [INFO ] [MAIN ] Derivative Progress: 561/2117 symbols completed. DRLL took 1.0s. Estimated remaining: 7m 41s. Rate: 202.7 symbols/min [2025-09-05T19:11:28.073960] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:28.309325] [INFO ] [MAIN ] DSX: Loaded 11674 primary data records. [2025-09-05T19:11:28.533980] [INFO ] [MAIN ] DSL: Generated 871 derivative records from 13668 primary records. [2025-09-05T19:11:28.653700] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-05T19:11:28.655854] [INFO ] [MAIN ] Derivative Progress: 562/2117 symbols completed. DSL took 0.9s. Estimated remaining: 7m 41s. Rate: 202.3 symbols/min [2025-09-05T19:11:28.657431] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:28.667595] [INFO ] [MAIN ] DSMC: Generated 870 derivative records from 737 primary records. [2025-09-05T19:11:28.675820] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-05T19:11:28.679279] [INFO ] [MAIN ] Derivative Progress: 563/2117 symbols completed. DSMC took 0.7s. Estimated remaining: 7m 40s. Rate: 202.6 symbols/min [2025-09-05T19:11:28.679783] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:28.687207] [INFO ] [MAIN ] DSX: Generated 871 derivative records from 11674 primary records. [2025-09-05T19:11:28.705574] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-05T19:11:28.715479] [INFO ] [MAIN ] Derivative Progress: 564/2117 symbols completed. DSX took 0.6s. Estimated remaining: 7m 39s. Rate: 202.9 symbols/min [2025-09-05T19:11:28.718026] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:28.718631] [INFO ] [MAIN ] DT: Loaded 25599 primary data records. [2025-09-05T19:11:28.718874] [INFO ] [MAIN ] DTB: Loaded 2650 primary data records. [2025-09-05T19:11:29.177672] [INFO ] [MAIN ] DTE: Loaded 36089 primary data records. [2025-09-05T19:11:29.517221] [INFO ] [MAIN ] DTB: Generated 871 derivative records from 2650 primary records. [2025-09-05T19:11:29.529319] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-05T19:11:29.531060] [INFO ] [MAIN ] Derivative Progress: 565/2117 symbols completed. DTB took 0.9s. Estimated remaining: 7m 40s. Rate: 202.3 symbols/min [2025-09-05T19:11:29.537889] [INFO ] [MAIN ] DTF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:29.539391] [INFO ] [MAIN ] DT: Generated 871 derivative records from 25599 primary records. [2025-09-05T19:11:29.549491] [INFO ] [MAIN ] DTF: Loaded 898 primary data records. [2025-09-05T19:11:29.619893] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-05T19:11:29.638427] [INFO ] [MAIN ] Derivative Progress: 566/2117 symbols completed. DT took 1.0s. Estimated remaining: 7m 40s. Rate: 202.5 symbols/min [2025-09-05T19:11:29.645528] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:29.691176] [INFO ] [MAIN ] DTE: Generated 1352 derivative records from 36089 primary records. [2025-09-05T19:11:29.747609] [INFO ] [MAIN ] DTG: Loaded 4233 primary data records. [2025-09-05T19:11:30.028966] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-05T19:11:30.035844] [INFO ] [MAIN ] Derivative Progress: 567/2117 symbols completed. DTE took 1.3s. Estimated remaining: 7m 40s. Rate: 202.4 symbols/min [2025-09-05T19:11:30.179614] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:30.202184] [INFO ] [MAIN ] DTF: Generated 1343 derivative records from 898 primary records. [2025-09-05T19:11:30.226477] [INFO ] [MAIN ] DTF: Successfully saved derivative data. [2025-09-05T19:11:30.228934] [INFO ] [MAIN ] Derivative Progress: 568/2117 symbols completed. DTF took 0.7s. Estimated remaining: 7m 39s. Rate: 202.5 symbols/min [2025-09-05T19:11:30.239860] [INFO ] [MAIN ] DTG: Generated 1352 derivative records from 4233 primary records. [2025-09-05T19:11:30.264047] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-05T19:11:30.263963] [INFO ] [MAIN ] DTM: Loaded 32894 primary data records. [2025-09-05T19:11:30.266833] [INFO ] [MAIN ] Derivative Progress: 569/2117 symbols completed. DTG took 0.6s. Estimated remaining: 7m 38s. Rate: 202.8 symbols/min [2025-09-05T19:11:30.557668] [INFO ] [MAIN ] DTM: Generated 1351 derivative records from 32894 primary records. [2025-09-05T19:11:30.570575] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-05T19:11:30.573445] [INFO ] [MAIN ] Derivative Progress: 570/2117 symbols completed. DTM took 0.4s. Estimated remaining: 7m 38s. Rate: 202.8 symbols/min [2025-09-05T19:11:30.573932] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:30.574570] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:30.574438] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:30.585313] [INFO ] [MAIN ] DTW: Loaded 3647 primary data records. [2025-09-05T19:11:30.588593] [INFO ] [MAIN ] DUKB: Loaded 4913 primary data records. [2025-09-05T19:11:31.186817] [INFO ] [MAIN ] DUK: Loaded 40254 primary data records. [2025-09-05T19:11:31.515295] [INFO ] [MAIN ] DUKB: Generated 1351 derivative records from 4913 primary records. [2025-09-05T19:11:31.525827] [INFO ] [MAIN ] DTW: Generated 1351 derivative records from 3647 primary records. [2025-09-05T19:11:31.551293] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-05T19:11:31.554352] [INFO ] [MAIN ] Derivative Progress: 571/2117 symbols completed. DTW took 1.0s. Estimated remaining: 7m 39s. Rate: 202.0 symbols/min [2025-09-05T19:11:31.551937] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-05T19:11:31.557322] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:31.557505] [INFO ] [MAIN ] Derivative Progress: 572/2117 symbols completed. DUKB took 1.0s. Estimated remaining: 7m 38s. Rate: 202.3 symbols/min [2025-09-05T19:11:31.558212] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:31.572153] [INFO ] [MAIN ] DUK: Generated 1352 derivative records from 40254 primary records. [2025-09-05T19:11:31.585572] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-05T19:11:31.587925] [INFO ] [MAIN ] Derivative Progress: 573/2117 symbols completed. DUK took 1.0s. Estimated remaining: 7m 37s. Rate: 202.7 symbols/min [2025-09-05T19:11:31.600466] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:31.610933] [INFO ] [MAIN ] DVA: Loaded 19984 primary data records. [2025-09-05T19:11:31.619201] [INFO ] [MAIN ] DV: Loaded 24639 primary data records. [2025-09-05T19:11:31.874460] [INFO ] [MAIN ] DVN: Loaded 26072 primary data records. [2025-09-05T19:11:32.425950] [INFO ] [MAIN ] DV: Generated 871 derivative records from 24639 primary records. [2025-09-05T19:11:32.435518] [INFO ] [MAIN ] DVA: Generated 871 derivative records from 19984 primary records. [2025-09-05T19:11:32.452581] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-05T19:11:32.456044] [INFO ] [MAIN ] Derivative Progress: 574/2117 symbols completed. DV took 0.9s. Estimated remaining: 7m 38s. Rate: 202.0 symbols/min [2025-09-05T19:11:32.456967] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:32.457537] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-05T19:11:32.459871] [INFO ] [MAIN ] Derivative Progress: 575/2117 symbols completed. DVA took 0.9s. Estimated remaining: 7m 37s. Rate: 202.3 symbols/min [2025-09-05T19:11:32.460685] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:32.469203] [INFO ] [MAIN ] DVN: Generated 871 derivative records from 26072 primary records. [2025-09-05T19:11:32.478102] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-05T19:11:32.479912] [INFO ] [MAIN ] Derivative Progress: 576/2117 symbols completed. DVN took 0.9s. Estimated remaining: 7m 36s. Rate: 202.6 symbols/min [2025-09-05T19:11:32.480248] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:32.502694] [INFO ] [MAIN ] DXYZ: Loaded 17158 primary data records. [2025-09-05T19:11:32.594745] [INFO ] [MAIN ] DXC: Loaded 24399 primary data records. [2025-09-05T19:11:32.626392] [INFO ] [MAIN ] DY: Loaded 13392 primary data records. [2025-09-05T19:11:33.299319] [INFO ] [MAIN ] DXYZ: Generated 870 derivative records from 17158 primary records. [2025-09-05T19:11:33.317853] [INFO ] [MAIN ] DXC: Generated 871 derivative records from 24399 primary records. [2025-09-05T19:11:33.325214] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-05T19:11:33.330732] [INFO ] [MAIN ] Derivative Progress: 577/2117 symbols completed. DXYZ took 0.9s. Estimated remaining: 7m 37s. Rate: 202.0 symbols/min [2025-09-05T19:11:33.332588] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:33.333425] [INFO ] [MAIN ] DY: Generated 871 derivative records from 13392 primary records. [2025-09-05T19:11:33.342168] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-05T19:11:33.344229] [INFO ] [MAIN ] Derivative Progress: 578/2117 symbols completed. DXC took 0.9s. Estimated remaining: 7m 36s. Rate: 202.3 symbols/min [2025-09-05T19:11:33.344636] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:33.346222] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-05T19:11:33.348065] [INFO ] [MAIN ] Derivative Progress: 579/2117 symbols completed. DY took 0.9s. Estimated remaining: 7m 35s. Rate: 202.7 symbols/min [2025-09-05T19:11:33.348379] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:33.361268] [INFO ] [MAIN ] EAI: Loaded 2927 primary data records. [2025-09-05T19:11:33.486009] [INFO ] [MAIN ] E: Loaded 25782 primary data records. [2025-09-05T19:11:33.555823] [INFO ] [MAIN ] EAF: Loaded 21303 primary data records. [2025-09-05T19:11:34.179607] [INFO ] [MAIN ] EAI: Generated 1352 derivative records from 2927 primary records. [2025-09-05T19:11:34.201338] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-05T19:11:34.203527] [INFO ] [MAIN ] Derivative Progress: 580/2117 symbols completed. EAI took 0.9s. Estimated remaining: 7m 37s. Rate: 202.0 symbols/min [2025-09-05T19:11:34.203861] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:34.201194] [INFO ] [MAIN ] EAF: Generated 871 derivative records from 21303 primary records. [2025-09-05T19:11:34.215082] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-05T19:11:34.217192] [INFO ] [MAIN ] Derivative Progress: 581/2117 symbols completed. EAF took 0.9s. Estimated remaining: 7m 35s. Rate: 202.3 symbols/min [2025-09-05T19:11:34.220769] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:34.232239] [INFO ] [MAIN ] E: Generated 1352 derivative records from 25782 primary records. [2025-09-05T19:11:34.237545] [INFO ] [MAIN ] EARN: Loaded 12190 primary data records. [2025-09-05T19:11:34.382363] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-05T19:11:34.412500] [INFO ] [MAIN ] Derivative Progress: 582/2117 symbols completed. E took 1.1s. Estimated remaining: 7m 35s. Rate: 202.5 symbols/min [2025-09-05T19:11:34.439203] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:34.505374] [INFO ] [MAIN ] EAT: Loaded 23812 primary data records. [2025-09-05T19:11:34.702438] [INFO ] [MAIN ] EB: Loaded 17877 primary data records. [2025-09-05T19:11:34.881428] [INFO ] [MAIN ] EARN: Generated 871 derivative records from 12190 primary records. [2025-09-05T19:11:35.017028] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-05T19:11:35.019014] [INFO ] [MAIN ] Derivative Progress: 583/2117 symbols completed. EARN took 0.8s. Estimated remaining: 7m 35s. Rate: 202.1 symbols/min [2025-09-05T19:11:35.032542] [INFO ] [MAIN ] EAT: Generated 871 derivative records from 23812 primary records. [2025-09-05T19:11:35.044192] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-05T19:11:35.046085] [INFO ] [MAIN ] Derivative Progress: 584/2117 symbols completed. EAT took 0.8s. Estimated remaining: 7m 34s. Rate: 202.4 symbols/min [2025-09-05T19:11:35.053216] [INFO ] [MAIN ] EB: Generated 871 derivative records from 17877 primary records. [2025-09-05T19:11:35.061445] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-05T19:11:35.063094] [INFO ] [MAIN ] Derivative Progress: 585/2117 symbols completed. EB took 0.6s. Estimated remaining: 7m 33s. Rate: 202.7 symbols/min [2025-09-05T19:11:35.063543] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:35.063787] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:35.063998] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:35.075215] [INFO ] [MAIN ] EBF: Loaded 9119 primary data records. [2025-09-05T19:11:35.216109] [INFO ] [MAIN ] EBR: Loaded 20586 primary data records. [2025-09-05T19:11:35.210085] [INFO ] [MAIN ] EBS: Loaded 23058 primary data records. [2025-09-05T19:11:35.884412] [INFO ] [MAIN ] EBF: Generated 871 derivative records from 9119 primary records. [2025-09-05T19:11:35.904950] [INFO ] [MAIN ] EBS: Generated 871 derivative records from 23058 primary records. [2025-09-05T19:11:35.907150] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-05T19:11:35.920237] [INFO ] [MAIN ] Derivative Progress: 586/2117 symbols completed. EBF took 0.9s. Estimated remaining: 7m 35s. Rate: 202.1 symbols/min [2025-09-05T19:11:35.920969] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:35.922266] [INFO ] [MAIN ] EBR: Generated 871 derivative records from 20586 primary records. [2025-09-05T19:11:35.930201] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-05T19:11:35.932094] [INFO ] [MAIN ] Derivative Progress: 587/2117 symbols completed. EBS took 0.9s. Estimated remaining: 7m 34s. Rate: 202.4 symbols/min [2025-09-05T19:11:35.932571] [INFO ] [MAIN ] ECCC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:35.934850] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-05T19:11:35.936564] [INFO ] [MAIN ] Derivative Progress: 588/2117 symbols completed. EBR took 0.9s. Estimated remaining: 7m 32s. Rate: 202.8 symbols/min [2025-09-05T19:11:35.936866] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:35.938580] [INFO ] [MAIN ] ECCC: Loaded 402 primary data records. [2025-09-05T19:11:36.040924] [INFO ] [MAIN ] ECCU: Loaded 1057 primary data records. [2025-09-05T19:11:36.114509] [INFO ] [MAIN ] ECC: Loaded 20846 primary data records. [2025-09-05T19:11:36.682144] [INFO ] [MAIN ] ECCC: Generated 871 derivative records from 402 primary records. [2025-09-05T19:11:36.690316] [INFO ] [MAIN ] ECCC: Successfully saved derivative data. [2025-09-05T19:11:36.691686] [INFO ] [MAIN ] Derivative Progress: 589/2117 symbols completed. ECCC took 0.8s. Estimated remaining: 7m 33s. Rate: 202.2 symbols/min [2025-09-05T19:11:36.691923] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:36.703257] [INFO ] [MAIN ] ECCU: Generated 871 derivative records from 1057 primary records. [2025-09-05T19:11:36.715103] [INFO ] [MAIN ] ECC: Generated 871 derivative records from 20846 primary records. [2025-09-05T19:11:36.735138] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-05T19:11:36.735500] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-09-05T19:11:36.735871] [INFO ] [MAIN ] ECG: Loaded 15002 primary data records. [2025-09-05T19:11:36.737836] [INFO ] [MAIN ] Derivative Progress: 590/2117 symbols completed. ECCU took 0.8s. Estimated remaining: 7m 32s. Rate: 202.5 symbols/min [2025-09-05T19:11:36.738095] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:36.740150] [INFO ] [MAIN ] Derivative Progress: 591/2117 symbols completed. ECC took 0.8s. Estimated remaining: 7m 31s. Rate: 202.9 symbols/min [2025-09-05T19:11:36.740373] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:37.004193] [INFO ] [MAIN ] ECL: Loaded 22161 primary data records. [2025-09-05T19:11:37.005280] [INFO ] [MAIN ] ECVT: Loaded 20782 primary data records. [2025-09-05T19:11:37.496133] [INFO ] [MAIN ] ECG: Generated 871 derivative records from 15002 primary records. [2025-09-05T19:11:37.509022] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-05T19:11:37.516979] [INFO ] [MAIN ] Derivative Progress: 592/2117 symbols completed. ECG took 0.8s. Estimated remaining: 7m 32s. Rate: 202.3 symbols/min [2025-09-05T19:11:37.518067] [INFO ] [MAIN ] ECVT: Generated 871 derivative records from 20782 primary records. [2025-09-05T19:11:37.519708] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:37.535755] [INFO ] [MAIN ] ECL: Generated 871 derivative records from 22161 primary records. [2025-09-05T19:11:37.536782] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-05T19:11:37.539178] [INFO ] [MAIN ] Derivative Progress: 593/2117 symbols completed. ECVT took 0.8s. Estimated remaining: 7m 31s. Rate: 202.6 symbols/min [2025-09-05T19:11:37.539362] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:37.559603] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-05T19:11:37.560045] [INFO ] [MAIN ] EDD: Loaded 13657 primary data records. [2025-09-05T19:11:37.561785] [INFO ] [MAIN ] Derivative Progress: 594/2117 symbols completed. ECL took 0.8s. Estimated remaining: 7m 30s. Rate: 202.9 symbols/min [2025-09-05T19:11:37.567314] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:37.597160] [INFO ] [MAIN ] EDF: Loaded 5904 primary data records. [2025-09-05T19:11:37.785870] [INFO ] [MAIN ] EDN: Loaded 8255 primary data records. [2025-09-05T19:11:38.408869] [INFO ] [MAIN ] EDD: Generated 871 derivative records from 13657 primary records. [2025-09-05T19:11:38.442490] [INFO ] [MAIN ] EDF: Generated 871 derivative records from 5904 primary records. [2025-09-05T19:11:38.444721] [INFO ] [MAIN ] EDN: Generated 871 derivative records from 8255 primary records. [2025-09-05T19:11:38.468174] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-05T19:11:38.469474] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-05T19:11:38.472523] [INFO ] [MAIN ] Derivative Progress: 595/2117 symbols completed. EDD took 1.0s. Estimated remaining: 7m 32s. Rate: 202.2 symbols/min [2025-09-05T19:11:38.472905] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:38.475569] [INFO ] [MAIN ] Derivative Progress: 596/2117 symbols completed. EDN took 0.9s. Estimated remaining: 7m 31s. Rate: 202.6 symbols/min [2025-09-05T19:11:38.475927] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:38.470422] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-05T19:11:38.479313] [INFO ] [MAIN ] Derivative Progress: 597/2117 symbols completed. EDF took 0.9s. Estimated remaining: 7m 29s. Rate: 202.9 symbols/min [2025-09-05T19:11:38.479746] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:38.483997] [INFO ] [MAIN ] EEA: Loaded 1381 primary data records. [2025-09-05T19:11:38.699465] [INFO ] [MAIN ] EDU: Loaded 21330 primary data records. [2025-09-05T19:11:38.707609] [INFO ] [MAIN ] EE: Loaded 24674 primary data records. [2025-09-05T19:11:39.646150] [INFO ] [MAIN ] EEA: Generated 871 derivative records from 1381 primary records. [2025-09-05T19:11:39.660893] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-05T19:11:39.663536] [INFO ] [MAIN ] Derivative Progress: 598/2117 symbols completed. EEA took 1.2s. Estimated remaining: 7m 31s. Rate: 201.9 symbols/min [2025-09-05T19:11:39.674321] [INFO ] [MAIN ] EDU: Generated 871 derivative records from 21330 primary records. [2025-09-05T19:11:39.684240] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-05T19:11:39.687527] [INFO ] [MAIN ] Derivative Progress: 599/2117 symbols completed. EDU took 1.2s. Estimated remaining: 7m 30s. Rate: 202.2 symbols/min [2025-09-05T19:11:39.698270] [INFO ] [MAIN ] EE: Generated 1352 derivative records from 24674 primary records. [2025-09-05T19:11:39.712294] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-05T19:11:39.714921] [INFO ] [MAIN ] Derivative Progress: 600/2117 symbols completed. EE took 1.2s. Estimated remaining: 7m 29s. Rate: 202.5 symbols/min [2025-09-05T19:11:39.715520] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:39.715617] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:39.715423] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:39.725747] [INFO ] [MAIN ] EEX: Loaded 4456 primary data records. [2025-09-05T19:11:39.807100] [INFO ] [MAIN ] EFR: Loaded 7293 primary data records. [2025-09-05T19:11:39.980835] [INFO ] [MAIN ] EFC: Loaded 22032 primary data records. [2025-09-05T19:11:40.512966] [INFO ] [MAIN ] EEX: Generated 871 derivative records from 4456 primary records. [2025-09-05T19:11:40.532194] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-05T19:11:40.531628] [INFO ] [MAIN ] EFR: Generated 871 derivative records from 7293 primary records. [2025-09-05T19:11:40.533866] [INFO ] [MAIN ] Derivative Progress: 601/2117 symbols completed. EEX took 0.8s. Estimated remaining: 7m 31s. Rate: 201.9 symbols/min [2025-09-05T19:11:40.534451] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:40.554276] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-05T19:11:40.554150] [INFO ] [MAIN ] EFC: Generated 871 derivative records from 22032 primary records. [2025-09-05T19:11:40.560207] [INFO ] [MAIN ] Derivative Progress: 602/2117 symbols completed. EFR took 0.8s. Estimated remaining: 7m 30s. Rate: 202.2 symbols/min [2025-09-05T19:11:40.558562] [INFO ] [MAIN ] EFT: Loaded 6074 primary data records. [2025-09-05T19:11:40.566311] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:40.624433] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-05T19:11:40.653984] [INFO ] [MAIN ] Derivative Progress: 603/2117 symbols completed. EFC took 0.9s. Estimated remaining: 7m 29s. Rate: 202.4 symbols/min [2025-09-05T19:11:40.669692] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:40.827300] [INFO ] [MAIN ] EFX: Loaded 21348 primary data records. [2025-09-05T19:11:40.834801] [INFO ] [MAIN ] EFXT: Loaded 14010 primary data records. [2025-09-05T19:11:41.352601] [INFO ] [MAIN ] EFT: Generated 871 derivative records from 6074 primary records. [2025-09-05T19:11:41.363918] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-05T19:11:41.365588] [INFO ] [MAIN ] Derivative Progress: 604/2117 symbols completed. EFT took 0.8s. Estimated remaining: 7m 29s. Rate: 202.0 symbols/min [2025-09-05T19:11:41.366035] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:41.383287] [INFO ] [MAIN ] EFX: Generated 871 derivative records from 21348 primary records. [2025-09-05T19:11:41.384346] [INFO ] [MAIN ] EFXT: Generated 871 derivative records from 14010 primary records. [2025-09-05T19:11:41.408894] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-05T19:11:41.410523] [INFO ] [MAIN ] Derivative Progress: 605/2117 symbols completed. EFX took 0.8s. Estimated remaining: 7m 29s. Rate: 202.3 symbols/min [2025-09-05T19:11:41.410978] [INFO ] [MAIN ] EG: Loaded 12840 primary data records. [2025-09-05T19:11:41.408528] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-05T19:11:41.445388] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:41.450616] [INFO ] [MAIN ] Derivative Progress: 606/2117 symbols completed. EFXT took 0.7s. Estimated remaining: 7m 28s. Rate: 202.5 symbols/min [2025-09-05T19:11:41.462055] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:41.665851] [INFO ] [MAIN ] EGP: Loaded 14619 primary data records. [2025-09-05T19:11:41.732181] [INFO ] [MAIN ] EGO: Loaded 24846 primary data records. [2025-09-05T19:11:42.167966] [INFO ] [MAIN ] EG: Generated 871 derivative records from 12840 primary records. [2025-09-05T19:11:42.180398] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-05T19:11:42.182897] [INFO ] [MAIN ] Derivative Progress: 607/2117 symbols completed. EG took 0.8s. Estimated remaining: 7m 28s. Rate: 202.1 symbols/min [2025-09-05T19:11:42.183807] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:42.194828] [INFO ] [MAIN ] EGP: Generated 871 derivative records from 14619 primary records. [2025-09-05T19:11:42.217986] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-05T19:11:42.219819] [INFO ] [MAIN ] Derivative Progress: 608/2117 symbols completed. EGP took 0.8s. Estimated remaining: 7m 27s. Rate: 202.4 symbols/min [2025-09-05T19:11:42.221120] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:42.220815] [INFO ] [MAIN ] EGO: Generated 871 derivative records from 24846 primary records. [2025-09-05T19:11:42.237599] [INFO ] [MAIN ] EGY: Loaded 19875 primary data records. [2025-09-05T19:11:42.239102] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-05T19:11:42.251814] [INFO ] [MAIN ] Derivative Progress: 609/2117 symbols completed. EGO took 0.8s. Estimated remaining: 7m 26s. Rate: 202.6 symbols/min [2025-09-05T19:11:42.252131] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:42.365090] [INFO ] [MAIN ] EHAB: Loaded 15541 primary data records. [2025-09-05T19:11:42.604030] [INFO ] [MAIN ] EHC: Loaded 20100 primary data records. [2025-09-05T19:11:42.989114] [INFO ] [MAIN ] EGY: Generated 871 derivative records from 19875 primary records. [2025-09-05T19:11:43.009369] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-05T19:11:43.011699] [INFO ] [MAIN ] Derivative Progress: 610/2117 symbols completed. EGY took 0.8s. Estimated remaining: 7m 27s. Rate: 202.1 symbols/min [2025-09-05T19:11:43.012419] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:43.021093] [INFO ] [MAIN ] EHAB: Generated 871 derivative records from 15541 primary records. [2025-09-05T19:11:43.032319] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-05T19:11:43.033982] [INFO ] [MAIN ] Derivative Progress: 611/2117 symbols completed. EHAB took 0.8s. Estimated remaining: 7m 26s. Rate: 202.4 symbols/min [2025-09-05T19:11:43.037987] [INFO ] [MAIN ] EHI: Loaded 7783 primary data records. [2025-09-05T19:11:43.037744] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:43.126596] [INFO ] [MAIN ] EHC: Generated 871 derivative records from 20100 primary records. [2025-09-05T19:11:43.156261] [INFO ] [MAIN ] EIC: Loaded 12025 primary data records. [2025-09-05T19:11:43.327090] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-05T19:11:43.433678] [INFO ] [MAIN ] Derivative Progress: 612/2117 symbols completed. EHC took 1.2s. Estimated remaining: 7m 26s. Rate: 202.3 symbols/min [2025-09-05T19:11:43.434823] [INFO ] [MAIN ] EICA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:43.508738] [INFO ] [MAIN ] EICA: Loaded 440 primary data records. [2025-09-05T19:11:43.879560] [INFO ] [MAIN ] EHI: Generated 1352 derivative records from 7783 primary records. [2025-09-05T19:11:43.900574] [INFO ] [MAIN ] EIC: Generated 871 derivative records from 12025 primary records. [2025-09-05T19:11:43.902784] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-05T19:11:43.907441] [INFO ] [MAIN ] Derivative Progress: 613/2117 symbols completed. EHI took 0.9s. Estimated remaining: 7m 26s. Rate: 202.1 symbols/min [2025-09-05T19:11:43.923096] [INFO ] [MAIN ] EICA: Generated 868 derivative records from 440 primary records. [2025-09-05T19:11:43.923455] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-05T19:11:43.925184] [INFO ] [MAIN ] Derivative Progress: 614/2117 symbols completed. EIC took 0.9s. Estimated remaining: 7m 25s. Rate: 202.4 symbols/min [2025-09-05T19:11:43.931956] [INFO ] [MAIN ] EICA: Successfully saved derivative data. [2025-09-05T19:11:43.933652] [INFO ] [MAIN ] Derivative Progress: 615/2117 symbols completed. EICA took 0.5s. Estimated remaining: 7m 24s. Rate: 202.8 symbols/min [2025-09-05T19:11:43.934083] [INFO ] [MAIN ] EICB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:43.934342] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:43.934832] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:43.942866] [INFO ] [MAIN ] EICB: Loaded 1087 primary data records. [2025-09-05T19:11:44.059820] [INFO ] [MAIN ] EIG: Loaded 10355 primary data records. [2025-09-05T19:11:44.218077] [INFO ] [MAIN ] EIX: Loaded 25963 primary data records. [2025-09-05T19:11:44.697719] [INFO ] [MAIN ] EICB: Generated 865 derivative records from 1087 primary records. [2025-09-05T19:11:44.708483] [INFO ] [MAIN ] EICB: Successfully saved derivative data. [2025-09-05T19:11:44.710123] [INFO ] [MAIN ] Derivative Progress: 616/2117 symbols completed. EICB took 0.8s. Estimated remaining: 7m 25s. Rate: 202.2 symbols/min [2025-09-05T19:11:44.710663] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:44.718431] [INFO ] [MAIN ] EIG: Generated 871 derivative records from 10355 primary records. [2025-09-05T19:11:44.730295] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-05T19:11:44.732494] [INFO ] [MAIN ] Derivative Progress: 617/2117 symbols completed. EIG took 0.8s. Estimated remaining: 7m 24s. Rate: 202.5 symbols/min [2025-09-05T19:11:44.740131] [INFO ] [MAIN ] EIX: Generated 871 derivative records from 25963 primary records. [2025-09-05T19:11:44.740423] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:44.767090] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-05T19:11:44.769462] [INFO ] [MAIN ] Derivative Progress: 618/2117 symbols completed. EIX took 0.8s. Estimated remaining: 7m 23s. Rate: 202.8 symbols/min [2025-09-05T19:11:44.770985] [INFO ] [MAIN ] EL: Loaded 25998 primary data records. [2025-09-05T19:11:44.771279] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:44.878777] [INFO ] [MAIN ] ELC: Loaded 1818 primary data records. [2025-09-05T19:11:45.147388] [INFO ] [MAIN ] ELAN: Loaded 40096 primary data records. [2025-09-05T19:11:45.584162] [INFO ] [MAIN ] EL: Generated 871 derivative records from 25998 primary records. [2025-09-05T19:11:45.595980] [INFO ] [MAIN ] ELC: Generated 871 derivative records from 1818 primary records. [2025-09-05T19:11:45.612806] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-05T19:11:45.614534] [INFO ] [MAIN ] Derivative Progress: 619/2117 symbols completed. EL took 0.9s. Estimated remaining: 7m 25s. Rate: 202.2 symbols/min [2025-09-05T19:11:45.615565] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-05T19:11:45.617559] [INFO ] [MAIN ] Derivative Progress: 620/2117 symbols completed. ELC took 0.8s. Estimated remaining: 7m 23s. Rate: 202.5 symbols/min [2025-09-05T19:11:45.615828] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:45.617876] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:45.632353] [INFO ] [MAIN ] ELAN: Generated 1352 derivative records from 40096 primary records. [2025-09-05T19:11:45.645234] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-05T19:11:45.647748] [INFO ] [MAIN ] Derivative Progress: 621/2117 symbols completed. ELAN took 0.9s. Estimated remaining: 7m 23s. Rate: 202.8 symbols/min [2025-09-05T19:11:45.648045] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:45.676785] [INFO ] [MAIN ] ELF: Loaded 25263 primary data records. [2025-09-05T19:11:45.800241] [INFO ] [MAIN ] ELME: Loaded 29083 primary data records. [2025-09-05T19:11:45.799375] [INFO ] [MAIN ] ELP: Loaded 12856 primary data records. [2025-09-05T19:11:46.510753] [INFO ] [MAIN ] ELF: Generated 871 derivative records from 25263 primary records. [2025-09-05T19:11:46.519087] [INFO ] [MAIN ] ELP: Generated 871 derivative records from 12856 primary records. [2025-09-05T19:11:46.536602] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-05T19:11:46.536417] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-05T19:11:46.538772] [INFO ] [MAIN ] Derivative Progress: 622/2117 symbols completed. ELF took 0.9s. Estimated remaining: 7m 24s. Rate: 202.2 symbols/min [2025-09-05T19:11:46.542014] [INFO ] [MAIN ] Derivative Progress: 623/2117 symbols completed. ELP took 0.9s. Estimated remaining: 7m 23s. Rate: 202.5 symbols/min [2025-09-05T19:11:46.542092] [INFO ] [MAIN ] EMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:46.542567] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:46.557006] [INFO ] [MAIN ] ELME: Generated 1352 derivative records from 29083 primary records. [2025-09-05T19:11:46.573264] [INFO ] [MAIN ] EMA: Loaded 6613 primary data records. [2025-09-05T19:11:46.579818] [INFO ] [MAIN ] EMD: Loaded 10140 primary data records. [2025-09-05T19:11:46.633325] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-05T19:11:46.663410] [INFO ] [MAIN ] Derivative Progress: 624/2117 symbols completed. ELME took 1.0s. Estimated remaining: 7m 22s. Rate: 202.7 symbols/min [2025-09-05T19:11:46.778272] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:47.071941] [INFO ] [MAIN ] EME: Loaded 13721 primary data records. [2025-09-05T19:11:47.343298] [INFO ] [MAIN ] EMD: Generated 871 derivative records from 10140 primary records. [2025-09-05T19:11:47.345447] [INFO ] [MAIN ] EMA: Generated 910 derivative records from 6613 primary records. [2025-09-05T19:11:47.355107] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-05T19:11:47.362509] [INFO ] [MAIN ] Derivative Progress: 625/2117 symbols completed. EMD took 0.8s. Estimated remaining: 7m 23s. Rate: 202.2 symbols/min [2025-09-05T19:11:47.363944] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:47.365916] [INFO ] [MAIN ] EMA: Successfully saved derivative data. [2025-09-05T19:11:47.367547] [INFO ] [MAIN ] Derivative Progress: 626/2117 symbols completed. EMA took 0.8s. Estimated remaining: 7m 22s. Rate: 202.6 symbols/min [2025-09-05T19:11:47.368130] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:47.370917] [INFO ] [MAIN ] EMF: Loaded 1561 primary data records. [2025-09-05T19:11:47.481840] [INFO ] [MAIN ] EME: Generated 871 derivative records from 13721 primary records. [2025-09-05T19:11:47.644879] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-05T19:11:47.653363] [INFO ] [MAIN ] EMN: Loaded 24543 primary data records. [2025-09-05T19:11:47.655249] [INFO ] [MAIN ] Derivative Progress: 627/2117 symbols completed. EME took 0.9s. Estimated remaining: 7m 21s. Rate: 202.6 symbols/min [2025-09-05T19:11:47.655691] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:47.709878] [INFO ] [MAIN ] EMP: Loaded 1399 primary data records. [2025-09-05T19:11:48.163753] [INFO ] [MAIN ] EMF: Generated 871 derivative records from 1561 primary records. [2025-09-05T19:11:48.175084] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-05T19:11:48.176963] [INFO ] [MAIN ] Derivative Progress: 628/2117 symbols completed. EMF took 0.8s. Estimated remaining: 7m 22s. Rate: 202.3 symbols/min [2025-09-05T19:11:48.188011] [INFO ] [MAIN ] EMN: Generated 871 derivative records from 24543 primary records. [2025-09-05T19:11:48.205441] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-05T19:11:48.206150] [INFO ] [MAIN ] EMP: Generated 871 derivative records from 1399 primary records. [2025-09-05T19:11:48.207966] [INFO ] [MAIN ] Derivative Progress: 629/2117 symbols completed. EMN took 0.8s. Estimated remaining: 7m 21s. Rate: 202.6 symbols/min [2025-09-05T19:11:48.215842] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-05T19:11:48.217625] [INFO ] [MAIN ] Derivative Progress: 630/2117 symbols completed. EMP took 0.6s. Estimated remaining: 7m 20s. Rate: 202.9 symbols/min [2025-09-05T19:11:48.218092] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:48.218318] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:48.218231] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:48.222989] [INFO ] [MAIN ] ENFY: Loaded 2047 primary data records. [2025-09-05T19:11:48.445273] [INFO ] [MAIN ] ENB: Loaded 25972 primary data records. [2025-09-05T19:11:48.505027] [INFO ] [MAIN ] EMR: Loaded 25773 primary data records. [2025-09-05T19:11:49.027569] [INFO ] [MAIN ] ENFY: Generated 871 derivative records from 2047 primary records. [2025-09-05T19:11:49.038577] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-05T19:11:49.040487] [INFO ] [MAIN ] Derivative Progress: 631/2117 symbols completed. ENFY took 0.8s. Estimated remaining: 7m 21s. Rate: 202.3 symbols/min [2025-09-05T19:11:49.040912] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:49.054705] [INFO ] [MAIN ] ENB: Generated 871 derivative records from 25972 primary records. [2025-09-05T19:11:49.067450] [INFO ] [MAIN ] EMR: Generated 871 derivative records from 25773 primary records. [2025-09-05T19:11:49.090633] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-05T19:11:49.091204] [INFO ] [MAIN ] ENIC: Loaded 17638 primary data records. [2025-09-05T19:11:49.093382] [INFO ] [MAIN ] Derivative Progress: 632/2117 symbols completed. ENB took 0.9s. Estimated remaining: 7m 20s. Rate: 202.6 symbols/min [2025-09-05T19:11:49.093852] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:49.126274] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-05T19:11:49.152321] [INFO ] [MAIN ] Derivative Progress: 633/2117 symbols completed. EMR took 0.9s. Estimated remaining: 7m 19s. Rate: 202.9 symbols/min [2025-09-05T19:11:49.161898] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:49.186258] [INFO ] [MAIN ] ENO: Loaded 865 primary data records. [2025-09-05T19:11:49.481514] [INFO ] [MAIN ] ENOV: Loaded 23057 primary data records. [2025-09-05T19:11:49.928453] [INFO ] [MAIN ] ENIC: Generated 871 derivative records from 17638 primary records. [2025-09-05T19:11:49.940362] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-05T19:11:49.942083] [INFO ] [MAIN ] Derivative Progress: 634/2117 symbols completed. ENIC took 0.9s. Estimated remaining: 7m 20s. Rate: 202.3 symbols/min [2025-09-05T19:11:49.942485] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:49.952734] [INFO ] [MAIN ] ENO: Generated 871 derivative records from 865 primary records. [2025-09-05T19:11:49.961013] [INFO ] [MAIN ] ENOV: Generated 871 derivative records from 23057 primary records. [2025-09-05T19:11:49.974319] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-05T19:11:49.976666] [INFO ] [MAIN ] Derivative Progress: 635/2117 symbols completed. ENO took 0.9s. Estimated remaining: 7m 19s. Rate: 202.6 symbols/min [2025-09-05T19:11:49.977322] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:49.985070] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-05T19:11:49.986836] [INFO ] [MAIN ] Derivative Progress: 636/2117 symbols completed. ENOV took 0.8s. Estimated remaining: 7m 18s. Rate: 202.9 symbols/min [2025-09-05T19:11:49.987039] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:50.001400] [INFO ] [MAIN ] ENR: Loaded 22030 primary data records. [2025-09-05T19:11:50.107163] [INFO ] [MAIN ] ENS: Loaded 14431 primary data records. [2025-09-05T19:11:50.123213] [INFO ] [MAIN ] EOD: Loaded 11296 primary data records. [2025-09-05T19:11:50.799461] [INFO ] [MAIN ] ENR: Generated 871 derivative records from 22030 primary records. [2025-09-05T19:11:50.809867] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-05T19:11:50.811777] [INFO ] [MAIN ] Derivative Progress: 637/2117 symbols completed. ENR took 0.9s. Estimated remaining: 7m 19s. Rate: 202.4 symbols/min [2025-09-05T19:11:50.812158] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:50.823464] [INFO ] [MAIN ] ENS: Generated 871 derivative records from 14431 primary records. [2025-09-05T19:11:50.844234] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-05T19:11:50.845351] [INFO ] [MAIN ] EOD: Generated 1352 derivative records from 11296 primary records. [2025-09-05T19:11:50.847165] [INFO ] [MAIN ] Derivative Progress: 638/2117 symbols completed. ENS took 0.9s. Estimated remaining: 7m 18s. Rate: 202.6 symbols/min [2025-09-05T19:11:50.848352] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:50.875156] [INFO ] [MAIN ] EOS: Loaded 6851 primary data records. [2025-09-05T19:11:50.874870] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-05T19:11:50.915540] [INFO ] [MAIN ] Derivative Progress: 639/2117 symbols completed. EOD took 0.9s. Estimated remaining: 7m 17s. Rate: 202.9 symbols/min [2025-09-05T19:11:50.962261] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:50.963537] [INFO ] [MAIN ] EOG: Loaded 25843 primary data records. [2025-09-05T19:11:51.099873] [INFO ] [MAIN ] EOT: Loaded 5055 primary data records. [2025-09-05T19:11:51.688466] [INFO ] [MAIN ] EOS: Generated 871 derivative records from 6851 primary records. [2025-09-05T19:11:51.707406] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-05T19:11:51.716737] [INFO ] [MAIN ] EOG: Generated 871 derivative records from 25843 primary records. [2025-09-05T19:11:51.715851] [INFO ] [MAIN ] Derivative Progress: 640/2117 symbols completed. EOS took 0.9s. Estimated remaining: 7m 18s. Rate: 202.3 symbols/min [2025-09-05T19:11:51.717782] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:51.727277] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-05T19:11:51.729191] [INFO ] [MAIN ] Derivative Progress: 641/2117 symbols completed. EOG took 0.9s. Estimated remaining: 7m 17s. Rate: 202.6 symbols/min [2025-09-05T19:11:51.731442] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:51.742473] [INFO ] [MAIN ] EOT: Generated 1352 derivative records from 5055 primary records. [2025-09-05T19:11:51.767037] [INFO ] [MAIN ] EPAM: Loaded 17875 primary data records. [2025-09-05T19:11:51.767183] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-05T19:11:51.770168] [INFO ] [MAIN ] Derivative Progress: 642/2117 symbols completed. EOT took 0.8s. Estimated remaining: 7m 16s. Rate: 202.9 symbols/min [2025-09-05T19:11:51.783671] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:51.925782] [INFO ] [MAIN ] EPC: Loaded 30005 primary data records. [2025-09-05T19:11:52.105981] [INFO ] [MAIN ] EPD: Loaded 26011 primary data records. [2025-09-05T19:11:52.602662] [INFO ] [MAIN ] EPAM: Generated 871 derivative records from 17875 primary records. [2025-09-05T19:11:52.614086] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-05T19:11:52.615894] [INFO ] [MAIN ] Derivative Progress: 643/2117 symbols completed. EPAM took 0.9s. Estimated remaining: 7m 17s. Rate: 202.3 symbols/min [2025-09-05T19:11:52.630213] [INFO ] [MAIN ] EPC: Generated 1352 derivative records from 30005 primary records. [2025-09-05T19:11:52.638614] [INFO ] [MAIN ] EPD: Generated 871 derivative records from 26011 primary records. [2025-09-05T19:11:52.658100] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-05T19:11:52.660769] [INFO ] [MAIN ] Derivative Progress: 644/2117 symbols completed. EPC took 0.9s. Estimated remaining: 7m 16s. Rate: 202.6 symbols/min [2025-09-05T19:11:52.661381] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-05T19:11:52.663124] [INFO ] [MAIN ] Derivative Progress: 645/2117 symbols completed. EPD took 0.9s. Estimated remaining: 7m 15s. Rate: 202.9 symbols/min [2025-09-05T19:11:52.663569] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:52.663789] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:52.663740] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:52.674531] [INFO ] [MAIN ] EQBK: Loaded 8273 primary data records. [2025-09-05T19:11:52.818163] [INFO ] [MAIN ] EPR: Loaded 21899 primary data records. [2025-09-05T19:11:52.818077] [INFO ] [MAIN ] EPRT: Loaded 23258 primary data records. [2025-09-05T19:11:53.527004] [INFO ] [MAIN ] EPR: Generated 871 derivative records from 21899 primary records. [2025-09-05T19:11:53.526063] [INFO ] [MAIN ] EQBK: Generated 1352 derivative records from 8273 primary records. [2025-09-05T19:11:53.553005] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-05T19:11:53.555261] [INFO ] [MAIN ] Derivative Progress: 646/2117 symbols completed. EPR took 0.9s. Estimated remaining: 7m 16s. Rate: 202.3 symbols/min [2025-09-05T19:11:53.556184] [INFO ] [MAIN ] EPRT: Generated 871 derivative records from 23258 primary records. [2025-09-05T19:11:53.556622] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:53.567418] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-05T19:11:53.569601] [INFO ] [MAIN ] Derivative Progress: 647/2117 symbols completed. EPRT took 0.9s. Estimated remaining: 7m 15s. Rate: 202.6 symbols/min [2025-09-05T19:11:53.567901] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-05T19:11:53.572089] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:53.572167] [INFO ] [MAIN ] Derivative Progress: 648/2117 symbols completed. EQBK took 0.9s. Estimated remaining: 7m 14s. Rate: 202.9 symbols/min [2025-09-05T19:11:53.572555] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:53.605048] [INFO ] [MAIN ] EQH: Loaded 25515 primary data records. [2025-09-05T19:11:53.733118] [INFO ] [MAIN ] EQNR: Loaded 25720 primary data records. [2025-09-05T19:11:53.902201] [INFO ] [MAIN ] EQR: Loaded 38772 primary data records. [2025-09-05T19:11:54.407474] [INFO ] [MAIN ] EQH: Generated 871 derivative records from 25515 primary records. [2025-09-05T19:11:54.424317] [INFO ] [MAIN ] EQNR: Generated 871 derivative records from 25720 primary records. [2025-09-05T19:11:54.426782] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-05T19:11:54.428298] [INFO ] [MAIN ] Derivative Progress: 649/2117 symbols completed. EQH took 0.9s. Estimated remaining: 7m 15s. Rate: 202.3 symbols/min [2025-09-05T19:11:54.435795] [INFO ] [MAIN ] EQS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:54.437444] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-05T19:11:54.439335] [INFO ] [MAIN ] Derivative Progress: 650/2117 symbols completed. EQNR took 0.9s. Estimated remaining: 7m 14s. Rate: 202.6 symbols/min [2025-09-05T19:11:54.439752] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:54.445384] [INFO ] [MAIN ] EQS: Loaded 1395 primary data records. [2025-09-05T19:11:54.487800] [INFO ] [MAIN ] EQR: Generated 1352 derivative records from 38772 primary records. [2025-09-05T19:11:54.667997] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-05T19:11:54.729021] [INFO ] [MAIN ] Derivative Progress: 651/2117 symbols completed. EQR took 1.2s. Estimated remaining: 7m 14s. Rate: 202.6 symbols/min [2025-09-05T19:11:54.730278] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:54.750136] [INFO ] [MAIN ] EQV: Loaded 1552 primary data records. [2025-09-05T19:11:54.751141] [INFO ] [MAIN ] EQT: Loaded 40425 primary data records. [2025-09-05T19:11:55.218309] [INFO ] [MAIN ] EQS: Generated 866 derivative records from 1395 primary records. [2025-09-05T19:11:55.319375] [INFO ] [MAIN ] EQS: Successfully saved derivative data. [2025-09-05T19:11:55.321180] [INFO ] [MAIN ] Derivative Progress: 652/2117 symbols completed. EQS took 0.9s. Estimated remaining: 7m 15s. Rate: 202.3 symbols/min [2025-09-05T19:11:55.323199] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:55.339479] [INFO ] [MAIN ] EQV: Generated 871 derivative records from 1552 primary records. [2025-09-05T19:11:55.354516] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-05T19:11:55.356275] [INFO ] [MAIN ] Derivative Progress: 653/2117 symbols completed. EQV took 0.6s. Estimated remaining: 7m 14s. Rate: 202.6 symbols/min [2025-09-05T19:11:55.356693] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:55.368957] [INFO ] [MAIN ] ERJ: Loaded 24842 primary data records. [2025-09-05T19:11:55.400542] [INFO ] [MAIN ] EQT: Generated 1352 derivative records from 40425 primary records. [2025-09-05T19:11:55.503700] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-05T19:11:55.561743] [INFO ] [MAIN ] ERO: Loaded 19896 primary data records. [2025-09-05T19:11:55.553751] [INFO ] [MAIN ] Derivative Progress: 654/2117 symbols completed. EQT took 1.1s. Estimated remaining: 7m 13s. Rate: 202.7 symbols/min [2025-09-05T19:11:55.589906] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:55.908825] [INFO ] [MAIN ] ES: Loaded 25432 primary data records. [2025-09-05T19:11:56.011072] [INFO ] [MAIN ] ERJ: Generated 871 derivative records from 24842 primary records. [2025-09-05T19:11:56.186752] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-05T19:11:56.196702] [INFO ] [MAIN ] Derivative Progress: 655/2117 symbols completed. ERJ took 0.9s. Estimated remaining: 7m 14s. Rate: 202.3 symbols/min [2025-09-05T19:11:56.199022] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:56.209920] [INFO ] [MAIN ] ERO: Generated 871 derivative records from 19896 primary records. [2025-09-05T19:11:56.225245] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-05T19:11:56.229811] [INFO ] [MAIN ] ESAB: Loaded 12252 primary data records. [2025-09-05T19:11:56.262415] [INFO ] [MAIN ] Derivative Progress: 656/2117 symbols completed. ERO took 0.9s. Estimated remaining: 7m 13s. Rate: 202.5 symbols/min [2025-09-05T19:11:56.295514] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:56.356334] [INFO ] [MAIN ] ES: Generated 871 derivative records from 25432 primary records. [2025-09-05T19:11:56.496158] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-05T19:11:56.497889] [INFO ] [MAIN ] Derivative Progress: 657/2117 symbols completed. ES took 0.9s. Estimated remaining: 7m 12s. Rate: 202.6 symbols/min [2025-09-05T19:11:56.498550] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:56.508556] [INFO ] [MAIN ] ESRT: Loaded 22814 primary data records. [2025-09-05T19:11:56.622047] [INFO ] [MAIN ] ESS: Loaded 14947 primary data records. [2025-09-05T19:11:56.917613] [INFO ] [MAIN ] ESAB: Generated 871 derivative records from 12252 primary records. [2025-09-05T19:11:57.012545] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-05T19:11:57.014383] [INFO ] [MAIN ] Derivative Progress: 658/2117 symbols completed. ESAB took 0.8s. Estimated remaining: 7m 13s. Rate: 202.4 symbols/min [2025-09-05T19:11:57.026385] [INFO ] [MAIN ] ESRT: Generated 871 derivative records from 22814 primary records. [2025-09-05T19:11:57.035521] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-05T19:11:57.038561] [INFO ] [MAIN ] Derivative Progress: 659/2117 symbols completed. ESRT took 0.7s. Estimated remaining: 7m 12s. Rate: 202.7 symbols/min [2025-09-05T19:11:57.046069] [INFO ] [MAIN ] ESS: Generated 871 derivative records from 14947 primary records. [2025-09-05T19:11:57.054404] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-05T19:11:57.056120] [INFO ] [MAIN ] Derivative Progress: 660/2117 symbols completed. ESS took 0.6s. Estimated remaining: 7m 11s. Rate: 203.0 symbols/min [2025-09-05T19:11:57.056780] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:57.056596] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:57.056918] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:57.066484] [INFO ] [MAIN ] ETB: Loaded 5226 primary data records. [2025-09-05T19:11:57.256555] [INFO ] [MAIN ] ESTC: Loaded 24375 primary data records. [2025-09-05T19:11:57.278763] [INFO ] [MAIN ] ET: Loaded 26163 primary data records. [2025-09-05T19:11:57.892593] [INFO ] [MAIN ] ETB: Generated 871 derivative records from 5226 primary records. [2025-09-05T19:11:57.903902] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-05T19:11:57.905391] [INFO ] [MAIN ] Derivative Progress: 661/2117 symbols completed. ETB took 0.8s. Estimated remaining: 7m 12s. Rate: 202.4 symbols/min [2025-09-05T19:11:57.905852] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:57.918719] [INFO ] [MAIN ] ESTC: Generated 871 derivative records from 24375 primary records. [2025-09-05T19:11:57.926364] [INFO ] [MAIN ] ET: Generated 871 derivative records from 26163 primary records. [2025-09-05T19:11:57.955972] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-05T19:11:57.958076] [INFO ] [MAIN ] Derivative Progress: 662/2117 symbols completed. ET took 0.9s. Estimated remaining: 7m 11s. Rate: 202.6 symbols/min [2025-09-05T19:11:57.958994] [INFO ] [MAIN ] ETD: Loaded 20842 primary data records. [2025-09-05T19:11:57.956343] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-05T19:11:57.959348] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:57.998279] [INFO ] [MAIN ] Derivative Progress: 663/2117 symbols completed. ESTC took 0.9s. Estimated remaining: 7m 10s. Rate: 202.9 symbols/min [2025-09-05T19:11:58.016666] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:58.163257] [INFO ] [MAIN ] ETG: Loaded 12850 primary data records. [2025-09-05T19:11:58.309537] [INFO ] [MAIN ] ETJ: Loaded 11856 primary data records. [2025-09-05T19:11:58.869501] [INFO ] [MAIN ] ETD: Generated 1352 derivative records from 20842 primary records. [2025-09-05T19:11:58.887476] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-05T19:11:58.889917] [INFO ] [MAIN ] Derivative Progress: 664/2117 symbols completed. ETD took 1.0s. Estimated remaining: 7m 11s. Rate: 202.3 symbols/min [2025-09-05T19:11:58.890409] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:58.902004] [INFO ] [MAIN ] ETG: Generated 1352 derivative records from 12850 primary records. [2025-09-05T19:11:58.928065] [INFO ] [MAIN ] ETJ: Generated 1352 derivative records from 11856 primary records. [2025-09-05T19:11:58.928202] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-05T19:11:58.931633] [INFO ] [MAIN ] Derivative Progress: 665/2117 symbols completed. ETG took 1.0s. Estimated remaining: 7m 10s. Rate: 202.5 symbols/min [2025-09-05T19:11:58.931993] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:58.948221] [INFO ] [MAIN ] ETO: Loaded 3314 primary data records. [2025-09-05T19:11:58.981798] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-05T19:11:59.034608] [INFO ] [MAIN ] Derivative Progress: 666/2117 symbols completed. ETJ took 1.0s. Estimated remaining: 7m 9s. Rate: 202.7 symbols/min [2025-09-05T19:11:59.071017] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:59.159387] [INFO ] [MAIN ] ETN: Loaded 39691 primary data records. [2025-09-05T19:11:59.368302] [INFO ] [MAIN ] ETR: Loaded 25779 primary data records. [2025-09-05T19:11:59.778154] [INFO ] [MAIN ] ETO: Generated 871 derivative records from 3314 primary records. [2025-09-05T19:11:59.789293] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-05T19:11:59.791354] [INFO ] [MAIN ] Derivative Progress: 667/2117 symbols completed. ETO took 0.9s. Estimated remaining: 7m 10s. Rate: 202.3 symbols/min [2025-09-05T19:11:59.791918] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:59.812032] [INFO ] [MAIN ] ETN: Generated 1352 derivative records from 39691 primary records. [2025-09-05T19:11:59.817571] [INFO ] [MAIN ] ETV: Loaded 9900 primary data records. [2025-09-05T19:11:59.862554] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-05T19:11:59.882801] [INFO ] [MAIN ] ETR: Generated 871 derivative records from 25779 primary records. [2025-09-05T19:11:59.885313] [INFO ] [MAIN ] Derivative Progress: 668/2117 symbols completed. ETN took 1.0s. Estimated remaining: 7m 9s. Rate: 202.5 symbols/min [2025-09-05T19:11:59.926185] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:11:59.973466] [INFO ] [MAIN ] ETX: Loaded 3276 primary data records. [2025-09-05T19:12:00.062731] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-05T19:12:00.113223] [INFO ] [MAIN ] Derivative Progress: 669/2117 symbols completed. ETR took 1.0s. Estimated remaining: 7m 9s. Rate: 202.5 symbols/min [2025-09-05T19:12:00.218498] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:00.327103] [INFO ] [MAIN ] ETY: Loaded 10488 primary data records. [2025-09-05T19:12:00.634367] [INFO ] [MAIN ] ETV: Generated 871 derivative records from 9900 primary records. [2025-09-05T19:12:00.653562] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-05T19:12:00.655298] [INFO ] [MAIN ] Derivative Progress: 670/2117 symbols completed. ETV took 0.9s. Estimated remaining: 7m 9s. Rate: 202.3 symbols/min [2025-09-05T19:12:00.663733] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:00.664690] [INFO ] [MAIN ] ETX: Generated 871 derivative records from 3276 primary records. [2025-09-05T19:12:00.677372] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-05T19:12:00.679272] [INFO ] [MAIN ] Derivative Progress: 671/2117 symbols completed. ETX took 0.8s. Estimated remaining: 7m 8s. Rate: 202.6 symbols/min [2025-09-05T19:12:00.683985] [INFO ] [MAIN ] EVC: Loaded 8983 primary data records. [2025-09-05T19:12:00.683739] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:00.918507] [INFO ] [MAIN ] ETY: Generated 871 derivative records from 10488 primary records. [2025-09-05T19:12:00.879871] [INFO ] [MAIN ] EVEX: Loaded 16690 primary data records. [2025-09-05T19:12:01.059122] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-05T19:12:01.072931] [INFO ] [MAIN ] Derivative Progress: 672/2117 symbols completed. ETY took 0.9s. Estimated remaining: 7m 8s. Rate: 202.5 symbols/min [2025-09-05T19:12:01.084231] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:01.219263] [INFO ] [MAIN ] EVF: Loaded 4765 primary data records. [2025-09-05T19:12:01.260785] [INFO ] [MAIN ] EVC: Generated 871 derivative records from 8983 primary records. [2025-09-05T19:12:01.420203] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-05T19:12:01.426068] [INFO ] [MAIN ] Derivative Progress: 673/2117 symbols completed. EVC took 0.8s. Estimated remaining: 7m 8s. Rate: 202.4 symbols/min [2025-09-05T19:12:01.493130] [INFO ] [MAIN ] EVEX: Generated 871 derivative records from 16690 primary records. [2025-09-05T19:12:01.503253] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-05T19:12:01.505425] [INFO ] [MAIN ] Derivative Progress: 674/2117 symbols completed. EVEX took 0.8s. Estimated remaining: 7m 7s. Rate: 202.6 symbols/min [2025-09-05T19:12:01.517264] [INFO ] [MAIN ] EVF: Generated 871 derivative records from 4765 primary records. [2025-09-05T19:12:01.524969] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-05T19:12:01.526330] [INFO ] [MAIN ] Derivative Progress: 675/2117 symbols completed. EVF took 0.4s. Estimated remaining: 7m 6s. Rate: 202.9 symbols/min [2025-09-05T19:12:01.526838] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:01.526945] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:01.527155] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:01.534682] [INFO ] [MAIN ] EVG: Loaded 2931 primary data records. [2025-09-05T19:12:01.557236] [INFO ] [MAIN ] EVN: Loaded 5340 primary data records. [2025-09-05T19:12:01.934605] [INFO ] [MAIN ] EVH: Loaded 37157 primary data records. [2025-09-05T19:12:02.370312] [INFO ] [MAIN ] EVG: Generated 871 derivative records from 2931 primary records. [2025-09-05T19:12:02.369685] [INFO ] [MAIN ] EVN: Generated 871 derivative records from 5340 primary records. [2025-09-05T19:12:02.385689] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-05T19:12:02.388022] [INFO ] [MAIN ] Derivative Progress: 676/2117 symbols completed. EVN took 0.9s. Estimated remaining: 7m 7s. Rate: 202.3 symbols/min [2025-09-05T19:12:02.388749] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-05T19:12:02.390191] [INFO ] [MAIN ] Derivative Progress: 677/2117 symbols completed. EVG took 0.9s. Estimated remaining: 7m 6s. Rate: 202.6 symbols/min [2025-09-05T19:12:02.391044] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:02.391109] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:02.406561] [INFO ] [MAIN ] EVT: Loaded 8311 primary data records. [2025-09-05T19:12:02.453364] [INFO ] [MAIN ] EVH: Generated 1352 derivative records from 37157 primary records. [2025-09-05T19:12:02.524426] [INFO ] [MAIN ] EVR: Loaded 15729 primary data records. [2025-09-05T19:12:02.710222] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-05T19:12:02.770307] [INFO ] [MAIN ] Derivative Progress: 678/2117 symbols completed. EVH took 1.2s. Estimated remaining: 7m 6s. Rate: 202.6 symbols/min [2025-09-05T19:12:02.786548] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:02.954383] [INFO ] [MAIN ] EVTC: Loaded 12636 primary data records. [2025-09-05T19:12:03.078614] [INFO ] [MAIN ] EVT: Generated 871 derivative records from 8311 primary records. [2025-09-05T19:12:03.213723] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-05T19:12:03.215564] [INFO ] [MAIN ] Derivative Progress: 679/2117 symbols completed. EVT took 0.8s. Estimated remaining: 7m 6s. Rate: 202.4 symbols/min [2025-09-05T19:12:03.216116] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:03.224800] [INFO ] [MAIN ] EVR: Generated 871 derivative records from 15729 primary records. [2025-09-05T19:12:03.236852] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-05T19:12:03.238742] [INFO ] [MAIN ] Derivative Progress: 680/2117 symbols completed. EVR took 0.8s. Estimated remaining: 7m 5s. Rate: 202.7 symbols/min [2025-09-05T19:12:03.239202] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:03.260797] [INFO ] [MAIN ] EVTC: Generated 871 derivative records from 12636 primary records. [2025-09-05T19:12:03.272088] [INFO ] [MAIN ] EVTR: Loaded 11480 primary data records. [2025-09-05T19:12:03.301211] [INFO ] [MAIN ] EVTL: Loaded 21822 primary data records. [2025-09-05T19:12:03.387408] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-05T19:12:03.415483] [INFO ] [MAIN ] Derivative Progress: 681/2117 symbols completed. EVTC took 0.6s. Estimated remaining: 7m 5s. Rate: 202.8 symbols/min [2025-09-05T19:12:03.441461] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:03.769392] [INFO ] [MAIN ] EW: Loaded 25861 primary data records. [2025-09-05T19:12:04.028848] [INFO ] [MAIN ] EVTR: Generated 871 derivative records from 11480 primary records. [2025-09-05T19:12:04.029755] [INFO ] [MAIN ] EVTL: Generated 871 derivative records from 21822 primary records. [2025-09-05T19:12:04.048015] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-05T19:12:04.048981] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-05T19:12:04.050611] [INFO ] [MAIN ] Derivative Progress: 682/2117 symbols completed. EVTL took 0.8s. Estimated remaining: 7m 5s. Rate: 202.5 symbols/min [2025-09-05T19:12:04.052309] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:04.052514] [INFO ] [MAIN ] Derivative Progress: 683/2117 symbols completed. EVTR took 0.8s. Estimated remaining: 7m 4s. Rate: 202.8 symbols/min [2025-09-05T19:12:04.054583] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:04.067024] [INFO ] [MAIN ] EW: Generated 871 derivative records from 25861 primary records. [2025-09-05T19:12:04.080472] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-05T19:12:04.089347] [INFO ] [MAIN ] Derivative Progress: 684/2117 symbols completed. EW took 0.7s. Estimated remaining: 7m 4s. Rate: 203.0 symbols/min [2025-09-05T19:12:04.090061] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:04.097394] [INFO ] [MAIN ] EXG: Loaded 16681 primary data records. [2025-09-05T19:12:04.219226] [INFO ] [MAIN ] EXK: Loaded 25773 primary data records. [2025-09-05T19:12:04.224497] [INFO ] [MAIN ] EXP: Loaded 14641 primary data records. [2025-09-05T19:12:04.842093] [INFO ] [MAIN ] EXG: Generated 871 derivative records from 16681 primary records. [2025-09-05T19:12:04.860495] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-05T19:12:04.861268] [INFO ] [MAIN ] EXK: Generated 871 derivative records from 25773 primary records. [2025-09-05T19:12:04.862953] [INFO ] [MAIN ] Derivative Progress: 685/2117 symbols completed. EXG took 0.8s. Estimated remaining: 7m 4s. Rate: 202.5 symbols/min [2025-09-05T19:12:04.864426] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:04.880604] [INFO ] [MAIN ] EXP: Generated 871 derivative records from 14641 primary records. [2025-09-05T19:12:04.881623] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-05T19:12:04.883434] [INFO ] [MAIN ] Derivative Progress: 686/2117 symbols completed. EXK took 0.8s. Estimated remaining: 7m 3s. Rate: 202.8 symbols/min [2025-09-05T19:12:04.889763] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:04.893245] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-05T19:12:04.894996] [INFO ] [MAIN ] Derivative Progress: 687/2117 symbols completed. EXP took 0.8s. Estimated remaining: 7m 2s. Rate: 203.1 symbols/min [2025-09-05T19:12:04.895331] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:04.923173] [INFO ] [MAIN ] FAF: Loaded 20541 primary data records. [2025-09-05T19:12:04.961883] [INFO ] [MAIN ] EXR: Loaded 22270 primary data records. [2025-09-05T19:12:05.117471] [INFO ] [MAIN ] FBIN: Loaded 24442 primary data records. [2025-09-05T19:12:05.720428] [INFO ] [MAIN ] FAF: Generated 871 derivative records from 20541 primary records. [2025-09-05T19:12:05.737214] [INFO ] [MAIN ] EXR: Generated 871 derivative records from 22270 primary records. [2025-09-05T19:12:05.750943] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-05T19:12:05.753580] [INFO ] [MAIN ] Derivative Progress: 688/2117 symbols completed. FAF took 0.9s. Estimated remaining: 7m 3s. Rate: 202.5 symbols/min [2025-09-05T19:12:05.751923] [INFO ] [MAIN ] FBIN: Generated 871 derivative records from 24442 primary records. [2025-09-05T19:12:05.761398] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-05T19:12:05.763158] [INFO ] [MAIN ] Derivative Progress: 689/2117 symbols completed. EXR took 0.9s. Estimated remaining: 7m 2s. Rate: 202.8 symbols/min [2025-09-05T19:12:05.764993] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-05T19:12:05.766588] [INFO ] [MAIN ] Derivative Progress: 690/2117 symbols completed. FBIN took 0.9s. Estimated remaining: 7m 2s. Rate: 203.1 symbols/min [2025-09-05T19:12:05.767004] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:05.767121] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:05.767241] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:05.793926] [INFO ] [MAIN ] FBK: Loaded 13800 primary data records. [2025-09-05T19:12:05.871934] [INFO ] [MAIN ] FBRT: Loaded 16574 primary data records. [2025-09-05T19:12:05.958406] [INFO ] [MAIN ] FBP: Loaded 22195 primary data records. [2025-09-05T19:12:06.543851] [INFO ] [MAIN ] FBK: Generated 871 derivative records from 13800 primary records. [2025-09-05T19:12:06.553396] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-05T19:12:06.557851] [INFO ] [MAIN ] Derivative Progress: 691/2117 symbols completed. FBK took 0.8s. Estimated remaining: 7m 2s. Rate: 202.6 symbols/min [2025-09-05T19:12:06.558287] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:06.565444] [INFO ] [MAIN ] FBP: Generated 871 derivative records from 22195 primary records. [2025-09-05T19:12:06.573501] [INFO ] [MAIN ] FBRT: Generated 871 derivative records from 16574 primary records. [2025-09-05T19:12:06.594636] [INFO ] [MAIN ] FC: Loaded 7578 primary data records. [2025-09-05T19:12:06.595217] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-05T19:12:06.595587] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-05T19:12:06.608319] [INFO ] [MAIN ] Derivative Progress: 692/2117 symbols completed. FBRT took 0.8s. Estimated remaining: 7m 1s. Rate: 202.9 symbols/min [2025-09-05T19:12:06.619591] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:06.630243] [INFO ] [MAIN ] Derivative Progress: 693/2117 symbols completed. FBP took 0.8s. Estimated remaining: 7m 1s. Rate: 203.1 symbols/min [2025-09-05T19:12:06.663226] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:06.796255] [INFO ] [MAIN ] FCN: Loaded 11800 primary data records. [2025-09-05T19:12:06.945945] [INFO ] [MAIN ] FCF: Loaded 29435 primary data records. [2025-09-05T19:12:07.384455] [INFO ] [MAIN ] FC: Generated 871 derivative records from 7578 primary records. [2025-09-05T19:12:07.396131] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-05T19:12:07.397993] [INFO ] [MAIN ] Derivative Progress: 694/2117 symbols completed. FC took 0.8s. Estimated remaining: 7m 1s. Rate: 202.7 symbols/min [2025-09-05T19:12:07.400537] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:07.409379] [INFO ] [MAIN ] FCN: Generated 871 derivative records from 11800 primary records. [2025-09-05T19:12:07.421450] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-05T19:12:07.427924] [INFO ] [MAIN ] Derivative Progress: 695/2117 symbols completed. FCN took 0.8s. Estimated remaining: 7m 0s. Rate: 202.9 symbols/min [2025-09-05T19:12:07.434080] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:07.439003] [INFO ] [MAIN ] FCF: Generated 1352 derivative records from 29435 primary records. [2025-09-05T19:12:07.459239] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-05T19:12:07.461904] [INFO ] [MAIN ] Derivative Progress: 696/2117 symbols completed. FCF took 0.9s. Estimated remaining: 6m 60s. Rate: 203.2 symbols/min [2025-09-05T19:12:07.462903] [INFO ] [MAIN ] FCPT: Loaded 17276 primary data records. [2025-09-05T19:12:07.463183] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:07.624518] [INFO ] [MAIN ] FCX: Loaded 26074 primary data records. [2025-09-05T19:12:07.625331] [INFO ] [MAIN ] FDP: Loaded 14340 primary data records. [2025-09-05T19:12:08.270549] [INFO ] [MAIN ] FCPT: Generated 871 derivative records from 17276 primary records. [2025-09-05T19:12:08.282840] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-05T19:12:08.284760] [INFO ] [MAIN ] Derivative Progress: 697/2117 symbols completed. FCPT took 0.9s. Estimated remaining: 7m 0s. Rate: 202.7 symbols/min [2025-09-05T19:12:08.285058] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:08.299770] [INFO ] [MAIN ] FDP: Generated 871 derivative records from 14340 primary records. [2025-09-05T19:12:08.299130] [INFO ] [MAIN ] FCX: Generated 871 derivative records from 26074 primary records. [2025-09-05T19:12:08.318408] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-05T19:12:08.320973] [INFO ] [MAIN ] Derivative Progress: 698/2117 symbols completed. FCX took 0.9s. Estimated remaining: 6m 60s. Rate: 202.9 symbols/min [2025-09-05T19:12:08.321675] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-05T19:12:08.321369] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:08.328579] [INFO ] [MAIN ] Derivative Progress: 699/2117 symbols completed. FDP took 0.9s. Estimated remaining: 6m 59s. Rate: 203.2 symbols/min [2025-09-05T19:12:08.329166] [INFO ] [MAIN ] FDS: Loaded 12346 primary data records. [2025-09-05T19:12:08.329536] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:08.604997] [INFO ] [MAIN ] FDX: Loaded 25002 primary data records. [2025-09-05T19:12:08.735436] [INFO ] [MAIN ] FE: Loaded 40235 primary data records. [2025-09-05T19:12:09.048259] [INFO ] [MAIN ] FDS: Generated 871 derivative records from 12346 primary records. [2025-09-05T19:12:09.145895] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-05T19:12:09.149467] [INFO ] [MAIN ] Derivative Progress: 700/2117 symbols completed. FDS took 0.9s. Estimated remaining: 6m 59s. Rate: 202.7 symbols/min [2025-09-05T19:12:09.150127] [INFO ] [MAIN ] FENG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:09.161542] [INFO ] [MAIN ] FDX: Generated 871 derivative records from 25002 primary records. [2025-09-05T19:12:09.173916] [INFO ] [MAIN ] FENG: Loaded 610 primary data records. [2025-09-05T19:12:09.221518] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-05T19:12:09.266302] [INFO ] [MAIN ] Derivative Progress: 701/2117 symbols completed. FDX took 0.9s. Estimated remaining: 6m 59s. Rate: 202.9 symbols/min [2025-09-05T19:12:09.292080] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:09.355734] [INFO ] [MAIN ] FE: Generated 1352 derivative records from 40235 primary records. [2025-09-05T19:12:09.464140] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-05T19:12:09.468847] [INFO ] [MAIN ] Derivative Progress: 702/2117 symbols completed. FE took 1.1s. Estimated remaining: 6m 58s. Rate: 203.0 symbols/min [2025-09-05T19:12:09.477676] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:09.478947] [INFO ] [MAIN ] FERG: Loaded 22958 primary data records. [2025-09-05T19:12:09.574544] [INFO ] [MAIN ] FET: Loaded 6489 primary data records. [2025-09-05T19:12:09.889126] [INFO ] [MAIN ] FENG: Generated 868 derivative records from 610 primary records. [2025-09-05T19:12:09.992816] [INFO ] [MAIN ] FENG: Successfully saved derivative data. [2025-09-05T19:12:09.995337] [INFO ] [MAIN ] Derivative Progress: 703/2117 symbols completed. FENG took 0.8s. Estimated remaining: 6m 58s. Rate: 202.7 symbols/min [2025-09-05T19:12:10.009310] [INFO ] [MAIN ] FERG: Generated 871 derivative records from 22958 primary records. [2025-09-05T19:12:10.019479] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-05T19:12:10.020988] [INFO ] [MAIN ] Derivative Progress: 704/2117 symbols completed. FERG took 0.7s. Estimated remaining: 6m 58s. Rate: 203.0 symbols/min [2025-09-05T19:12:10.027823] [INFO ] [MAIN ] FET: Generated 871 derivative records from 6489 primary records. [2025-09-05T19:12:10.035458] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-05T19:12:10.037295] [INFO ] [MAIN ] Derivative Progress: 705/2117 symbols completed. FET took 0.6s. Estimated remaining: 6m 57s. Rate: 203.3 symbols/min [2025-09-05T19:12:10.037769] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:10.037888] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:10.038122] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:10.042901] [INFO ] [MAIN ] FFA: Loaded 2294 primary data records. [2025-09-05T19:12:10.149478] [INFO ] [MAIN ] FFC: Loaded 8225 primary data records. [2025-09-05T19:12:10.156912] [INFO ] [MAIN ] FF: Loaded 11474 primary data records. [2025-09-05T19:12:10.775461] [INFO ] [MAIN ] FFA: Generated 871 derivative records from 2294 primary records. [2025-09-05T19:12:10.787348] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-05T19:12:10.804634] [INFO ] [MAIN ] Derivative Progress: 706/2117 symbols completed. FFA took 0.8s. Estimated remaining: 6m 57s. Rate: 202.8 symbols/min [2025-09-05T19:12:10.801538] [INFO ] [MAIN ] FFC: Generated 871 derivative records from 8225 primary records. [2025-09-05T19:12:10.813340] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:10.815298] [INFO ] [MAIN ] FF: Generated 871 derivative records from 11474 primary records. [2025-09-05T19:12:10.828633] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-05T19:12:10.832382] [INFO ] [MAIN ] Derivative Progress: 707/2117 symbols completed. FFC took 0.8s. Estimated remaining: 6m 57s. Rate: 203.1 symbols/min [2025-09-05T19:12:10.832827] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:10.834580] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-05T19:12:10.837817] [INFO ] [MAIN ] Derivative Progress: 708/2117 symbols completed. FF took 0.8s. Estimated remaining: 6m 56s. Rate: 203.4 symbols/min [2025-09-05T19:12:10.838306] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:10.854865] [INFO ] [MAIN ] FGN: Loaded 2882 primary data records. [2025-09-05T19:12:10.978617] [INFO ] [MAIN ] FFWM: Loaded 27302 primary data records. [2025-09-05T19:12:10.979373] [INFO ] [MAIN ] FG: Loaded 16188 primary data records. [2025-09-05T19:12:11.737975] [INFO ] [MAIN ] FGN: Generated 1352 derivative records from 2882 primary records. [2025-09-05T19:12:11.758209] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-05T19:12:11.763800] [INFO ] [MAIN ] Derivative Progress: 709/2117 symbols completed. FGN took 0.9s. Estimated remaining: 6m 57s. Rate: 202.7 symbols/min [2025-09-05T19:12:11.764609] [INFO ] [MAIN ] FFWM: Generated 1352 derivative records from 27302 primary records. [2025-09-05T19:12:11.766264] [INFO ] [MAIN ] FGSN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:11.792047] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-05T19:12:11.789907] [INFO ] [MAIN ] FG: Generated 1352 derivative records from 16188 primary records. [2025-09-05T19:12:11.792296] [INFO ] [MAIN ] FGSN: Loaded 2532 primary data records. [2025-09-05T19:12:11.815698] [INFO ] [MAIN ] Derivative Progress: 710/2117 symbols completed. FFWM took 1.0s. Estimated remaining: 6m 56s. Rate: 203.0 symbols/min [2025-09-05T19:12:11.851267] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:11.915869] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-05T19:12:11.934477] [INFO ] [MAIN ] Derivative Progress: 711/2117 symbols completed. FG took 1.1s. Estimated remaining: 6m 55s. Rate: 203.1 symbols/min [2025-09-05T19:12:11.961030] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:12.066447] [INFO ] [MAIN ] FHI: Loaded 30811 primary data records. [2025-09-05T19:12:12.256629] [INFO ] [MAIN ] FGSN: Generated 868 derivative records from 2532 primary records. [2025-09-05T19:12:12.388572] [INFO ] [MAIN ] FHN: Loaded 40146 primary data records. [2025-09-05T19:12:12.452966] [INFO ] [MAIN ] FGSN: Successfully saved derivative data. [2025-09-05T19:12:12.463457] [INFO ] [MAIN ] Derivative Progress: 712/2117 symbols completed. FGSN took 0.7s. Estimated remaining: 6m 55s. Rate: 202.9 symbols/min [2025-09-05T19:12:12.485958] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:12.689666] [INFO ] [MAIN ] FHI: Generated 1352 derivative records from 30811 primary records. [2025-09-05T19:12:12.715160] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-05T19:12:12.729124] [INFO ] [MAIN ] Derivative Progress: 713/2117 symbols completed. FHI took 0.9s. Estimated remaining: 6m 55s. Rate: 202.9 symbols/min [2025-09-05T19:12:12.729488] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:12.732024] [INFO ] [MAIN ] FI: Loaded 40371 primary data records. [2025-09-05T19:12:12.832578] [INFO ] [MAIN ] FHN: Generated 1352 derivative records from 40146 primary records. [2025-09-05T19:12:12.859385] [INFO ] [MAIN ] FICO: Loaded 11358 primary data records. [2025-09-05T19:12:13.129482] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-05T19:12:13.131799] [INFO ] [MAIN ] Derivative Progress: 714/2117 symbols completed. FHN took 1.2s. Estimated remaining: 6m 55s. Rate: 202.8 symbols/min [2025-09-05T19:12:13.143315] [INFO ] [MAIN ] FIG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:13.319623] [INFO ] [MAIN ] FIG: Loaded 9875 primary data records. [2025-09-05T19:12:13.513228] [INFO ] [MAIN ] FI: Generated 1352 derivative records from 40371 primary records. [2025-09-05T19:12:13.558470] [INFO ] [MAIN ] FICO: Generated 871 derivative records from 11358 primary records. [2025-09-05T19:12:13.566581] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-05T19:12:13.570240] [INFO ] [MAIN ] Derivative Progress: 715/2117 symbols completed. FI took 1.1s. Estimated remaining: 6m 55s. Rate: 202.7 symbols/min [2025-09-05T19:12:13.570851] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:13.578620] [INFO ] [MAIN ] FIG: Generated 329 derivative records from 9875 primary records. [2025-09-05T19:12:13.578894] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-05T19:12:13.580332] [INFO ] [MAIN ] Derivative Progress: 716/2117 symbols completed. FICO took 0.9s. Estimated remaining: 6m 54s. Rate: 203.0 symbols/min [2025-09-05T19:12:13.581458] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:13.585456] [INFO ] [MAIN ] FIG: Successfully saved derivative data. [2025-09-05T19:12:13.586353] [INFO ] [MAIN ] Derivative Progress: 717/2117 symbols completed. FIG took 0.4s. Estimated remaining: 6m 53s. Rate: 203.3 symbols/min [2025-09-05T19:12:13.586564] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:13.593730] [INFO ] [MAIN ] FINS: Loaded 3932 primary data records. [2025-09-05T19:12:13.730895] [INFO ] [MAIN ] FIGS: Loaded 23886 primary data records. [2025-09-05T19:12:13.758335] [INFO ] [MAIN ] FIHL: Loaded 29533 primary data records. [2025-09-05T19:12:14.371180] [INFO ] [MAIN ] FINS: Generated 871 derivative records from 3932 primary records. [2025-09-05T19:12:14.381886] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-05T19:12:14.384830] [INFO ] [MAIN ] Derivative Progress: 718/2117 symbols completed. FINS took 0.8s. Estimated remaining: 6m 54s. Rate: 202.8 symbols/min [2025-09-05T19:12:14.392237] [INFO ] [MAIN ] FIGS: Generated 871 derivative records from 23886 primary records. [2025-09-05T19:12:14.402258] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-05T19:12:14.403762] [INFO ] [MAIN ] Derivative Progress: 719/2117 symbols completed. FIGS took 0.8s. Estimated remaining: 6m 53s. Rate: 203.0 symbols/min [2025-09-05T19:12:14.413662] [INFO ] [MAIN ] FIHL: Generated 1352 derivative records from 29533 primary records. [2025-09-05T19:12:14.425395] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-05T19:12:14.429670] [INFO ] [MAIN ] Derivative Progress: 720/2117 symbols completed. FIHL took 0.8s. Estimated remaining: 6m 52s. Rate: 203.3 symbols/min [2025-09-05T19:12:14.430103] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:14.430228] [INFO ] [MAIN ] FIXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:14.430798] [INFO ] [MAIN ] FL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:14.434254] [INFO ] [MAIN ] FIXT: Loaded 1533 primary data records. [2025-09-05T19:12:14.638488] [INFO ] [MAIN ] FL: Loaded 24740 primary data records. [2025-09-05T19:12:14.637611] [INFO ] [MAIN ] FINV: Loaded 22734 primary data records. [2025-09-05T19:12:15.165952] [INFO ] [MAIN ] FIXT: Generated 740 derivative records from 1533 primary records. [2025-09-05T19:12:15.175028] [INFO ] [MAIN ] FIXT: Successfully saved derivative data. [2025-09-05T19:12:15.176311] [INFO ] [MAIN ] Derivative Progress: 721/2117 symbols completed. FIXT took 0.7s. Estimated remaining: 6m 53s. Rate: 202.9 symbols/min [2025-09-05T19:12:15.176778] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:15.188994] [INFO ] [MAIN ] FINV: Generated 871 derivative records from 22734 primary records. [2025-09-05T19:12:15.196890] [INFO ] [MAIN ] FLC: Loaded 2788 primary data records. [2025-09-05T19:12:15.208745] [INFO ] [MAIN ] FL: Generated 871 derivative records from 24740 primary records. [2025-09-05T19:12:15.315283] [INFO ] [MAIN ] FL: Successfully saved derivative data. [2025-09-05T19:12:15.317161] [INFO ] [MAIN ] Derivative Progress: 722/2117 symbols completed. FL took 0.9s. Estimated remaining: 6m 52s. Rate: 203.0 symbols/min [2025-09-05T19:12:15.315691] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-05T19:12:15.332788] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:15.337961] [INFO ] [MAIN ] Derivative Progress: 723/2117 symbols completed. FINV took 0.9s. Estimated remaining: 6m 51s. Rate: 203.3 symbols/min [2025-09-05T19:12:15.432688] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:15.476424] [INFO ] [MAIN ] FLC: Generated 871 derivative records from 2788 primary records. [2025-09-05T19:12:15.487081] [INFO ] [MAIN ] FLG: Loaded 25839 primary data records. [2025-09-05T19:12:15.571341] [INFO ] [MAIN ] FLNG: Loaded 25167 primary data records. [2025-09-05T19:12:15.593936] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-05T19:12:15.667495] [INFO ] [MAIN ] Derivative Progress: 724/2117 symbols completed. FLC took 0.5s. Estimated remaining: 6m 51s. Rate: 203.2 symbols/min [2025-09-05T19:12:15.718454] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:16.070307] [INFO ] [MAIN ] FLG: Generated 871 derivative records from 25839 primary records. [2025-09-05T19:12:16.073554] [INFO ] [MAIN ] FLO: Loaded 25250 primary data records. [2025-09-05T19:12:16.163228] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-05T19:12:16.186171] [INFO ] [MAIN ] Derivative Progress: 725/2117 symbols completed. FLG took 0.9s. Estimated remaining: 6m 51s. Rate: 203.0 symbols/min [2025-09-05T19:12:16.186542] [INFO ] [MAIN ] FLOC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:16.325401] [INFO ] [MAIN ] FLNG: Generated 1352 derivative records from 25167 primary records. [2025-09-05T19:12:16.338772] [INFO ] [MAIN ] FLOC: Loaded 13570 primary data records. [2025-09-05T19:12:16.452872] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-05T19:12:16.455296] [INFO ] [MAIN ] Derivative Progress: 726/2117 symbols completed. FLNG took 1.1s. Estimated remaining: 6m 51s. Rate: 203.1 symbols/min [2025-09-05T19:12:16.472033] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:16.597516] [INFO ] [MAIN ] FLO: Generated 871 derivative records from 25250 primary records. [2025-09-05T19:12:16.616251] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-05T19:12:16.617704] [INFO ] [MAIN ] Derivative Progress: 727/2117 symbols completed. FLO took 0.9s. Estimated remaining: 6m 50s. Rate: 203.2 symbols/min [2025-09-05T19:12:16.626082] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:16.627098] [INFO ] [MAIN ] FLR: Loaded 25854 primary data records. [2025-09-05T19:12:16.746016] [INFO ] [MAIN ] FLOC: Generated 871 derivative records from 13570 primary records. [2025-09-05T19:12:16.908370] [INFO ] [MAIN ] FLOC: Successfully saved derivative data. [2025-09-05T19:12:16.909927] [INFO ] [MAIN ] Derivative Progress: 728/2117 symbols completed. FLOC took 0.7s. Estimated remaining: 6m 50s. Rate: 203.2 symbols/min [2025-09-05T19:12:16.910180] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:16.912906] [INFO ] [MAIN ] FLS: Loaded 37585 primary data records. [2025-09-05T19:12:17.199614] [INFO ] [MAIN ] FLUT: Loaded 24708 primary data records. [2025-09-05T19:12:17.297368] [INFO ] [MAIN ] FLR: Generated 871 derivative records from 25854 primary records. [2025-09-05T19:12:17.343219] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-05T19:12:17.344732] [INFO ] [MAIN ] Derivative Progress: 729/2117 symbols completed. FLR took 0.9s. Estimated remaining: 6m 50s. Rate: 203.1 symbols/min [2025-09-05T19:12:17.388520] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:17.489834] [INFO ] [MAIN ] FLS: Generated 1352 derivative records from 37585 primary records. [2025-09-05T19:12:17.494694] [INFO ] [MAIN ] FLXR: Loaded 10236 primary data records. [2025-09-05T19:12:17.609621] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-05T19:12:17.627444] [INFO ] [MAIN ] Derivative Progress: 730/2117 symbols completed. FLS took 1.0s. Estimated remaining: 6m 50s. Rate: 203.1 symbols/min [2025-09-05T19:12:17.685894] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:17.750493] [INFO ] [MAIN ] FLUT: Generated 871 derivative records from 24708 primary records. [2025-09-05T19:12:17.760950] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-05T19:12:17.762777] [INFO ] [MAIN ] Derivative Progress: 731/2117 symbols completed. FLUT took 0.9s. Estimated remaining: 6m 49s. Rate: 203.2 symbols/min [2025-09-05T19:12:17.764817] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:17.790463] [INFO ] [MAIN ] FMN: Loaded 4009 primary data records. [2025-09-05T19:12:17.791499] [INFO ] [MAIN ] FMC: Loaded 24971 primary data records. [2025-09-05T19:12:17.843402] [INFO ] [MAIN ] FLXR: Generated 871 derivative records from 10236 primary records. [2025-09-05T19:12:18.110228] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-05T19:12:18.232626] [INFO ] [MAIN ] Derivative Progress: 732/2117 symbols completed. FLXR took 0.9s. Estimated remaining: 6m 49s. Rate: 203.1 symbols/min [2025-09-05T19:12:18.263540] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:18.351775] [INFO ] [MAIN ] FMS: Loaded 22604 primary data records. [2025-09-05T19:12:18.412769] [INFO ] [MAIN ] FMC: Generated 871 derivative records from 24971 primary records. [2025-09-05T19:12:18.405031] [INFO ] [MAIN ] FMN: Generated 1352 derivative records from 4009 primary records. [2025-09-05T19:12:18.507507] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-05T19:12:18.549209] [INFO ] [MAIN ] Derivative Progress: 733/2117 symbols completed. FMC took 0.9s. Estimated remaining: 6m 49s. Rate: 203.0 symbols/min [2025-09-05T19:12:18.706613] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-05T19:12:18.708901] [INFO ] [MAIN ] Derivative Progress: 734/2117 symbols completed. FMN took 0.9s. Estimated remaining: 6m 48s. Rate: 203.2 symbols/min [2025-09-05T19:12:18.728035] [INFO ] [MAIN ] FMS: Generated 1352 derivative records from 22604 primary records. [2025-09-05T19:12:18.740246] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-05T19:12:18.742404] [INFO ] [MAIN ] Derivative Progress: 735/2117 symbols completed. FMS took 0.5s. Estimated remaining: 6m 48s. Rate: 203.4 symbols/min [2025-09-05T19:12:18.743363] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:18.743206] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:18.743544] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:18.777373] [INFO ] [MAIN ] FN: Loaded 18374 primary data records. [2025-09-05T19:12:18.870340] [INFO ] [MAIN ] FNB: Loaded 25454 primary data records. [2025-09-05T19:12:18.876889] [INFO ] [MAIN ] FMX: Loaded 19747 primary data records. [2025-09-05T19:12:19.583928] [INFO ] [MAIN ] FN: Generated 871 derivative records from 18374 primary records. [2025-09-05T19:12:19.601863] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-05T19:12:19.601786] [INFO ] [MAIN ] FNB: Generated 871 derivative records from 25454 primary records. [2025-09-05T19:12:19.603293] [INFO ] [MAIN ] Derivative Progress: 736/2117 symbols completed. FN took 0.9s. Estimated remaining: 6m 48s. Rate: 202.9 symbols/min [2025-09-05T19:12:19.610719] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:19.613416] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-05T19:12:19.615107] [INFO ] [MAIN ] Derivative Progress: 737/2117 symbols completed. FNB took 0.9s. Estimated remaining: 6m 48s. Rate: 203.1 symbols/min [2025-09-05T19:12:19.616711] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:19.624300] [INFO ] [MAIN ] FMX: Generated 871 derivative records from 19747 primary records. [2025-09-05T19:12:19.633058] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-05T19:12:19.641130] [INFO ] [MAIN ] Derivative Progress: 738/2117 symbols completed. FMX took 0.9s. Estimated remaining: 6m 47s. Rate: 203.4 symbols/min [2025-09-05T19:12:19.641480] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:19.653152] [INFO ] [MAIN ] FND: Loaded 25144 primary data records. [2025-09-05T19:12:19.779698] [INFO ] [MAIN ] FNF: Loaded 23768 primary data records. [2025-09-05T19:12:19.827416] [INFO ] [MAIN ] FNV: Loaded 21744 primary data records. [2025-09-05T19:12:20.394781] [INFO ] [MAIN ] FND: Generated 871 derivative records from 25144 primary records. [2025-09-05T19:12:20.405111] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-05T19:12:20.407105] [INFO ] [MAIN ] Derivative Progress: 739/2117 symbols completed. FND took 0.8s. Estimated remaining: 6m 47s. Rate: 203.0 symbols/min [2025-09-05T19:12:20.408867] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:20.417390] [INFO ] [MAIN ] FNV: Generated 871 derivative records from 21744 primary records. [2025-09-05T19:12:20.426174] [INFO ] [MAIN ] FNF: Generated 871 derivative records from 23768 primary records. [2025-09-05T19:12:20.435820] [INFO ] [MAIN ] FOA: Loaded 5826 primary data records. [2025-09-05T19:12:20.437280] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-05T19:12:20.438850] [INFO ] [MAIN ] Derivative Progress: 740/2117 symbols completed. FNV took 0.8s. Estimated remaining: 6m 47s. Rate: 203.2 symbols/min [2025-09-05T19:12:20.455552] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:20.529399] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-05T19:12:20.550518] [INFO ] [MAIN ] Derivative Progress: 741/2117 symbols completed. FNF took 0.9s. Estimated remaining: 6m 46s. Rate: 203.4 symbols/min [2025-09-05T19:12:20.553981] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:20.606154] [INFO ] [MAIN ] FOR: Loaded 9067 primary data records. [2025-09-05T19:12:20.933796] [INFO ] [MAIN ] FOUR: Loaded 23784 primary data records. [2025-09-05T19:12:21.182837] [INFO ] [MAIN ] FOA: Generated 871 derivative records from 5826 primary records. [2025-09-05T19:12:21.196367] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-05T19:12:21.205220] [INFO ] [MAIN ] Derivative Progress: 742/2117 symbols completed. FOA took 0.8s. Estimated remaining: 6m 46s. Rate: 203.0 symbols/min [2025-09-05T19:12:21.203763] [INFO ] [MAIN ] FOR: Generated 871 derivative records from 9067 primary records. [2025-09-05T19:12:21.205580] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:21.219949] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-05T19:12:21.221736] [INFO ] [MAIN ] Derivative Progress: 743/2117 symbols completed. FOR took 0.8s. Estimated remaining: 6m 46s. Rate: 203.3 symbols/min [2025-09-05T19:12:21.228314] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:21.233560] [INFO ] [MAIN ] FOUR: Generated 871 derivative records from 23784 primary records. [2025-09-05T19:12:21.234854] [INFO ] [MAIN ] FPF: Loaded 8935 primary data records. [2025-09-05T19:12:21.297176] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-05T19:12:21.321102] [INFO ] [MAIN ] Derivative Progress: 744/2117 symbols completed. FOUR took 0.8s. Estimated remaining: 6m 45s. Rate: 203.5 symbols/min [2025-09-05T19:12:21.309292] [INFO ] [MAIN ] FPH: Loaded 9366 primary data records. [2025-09-05T19:12:21.371592] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:21.551075] [INFO ] [MAIN ] FPI: Loaded 15106 primary data records. [2025-09-05T19:12:22.018287] [INFO ] [MAIN ] FPF: Generated 871 derivative records from 8935 primary records. [2025-09-05T19:12:22.030382] [INFO ] [MAIN ] FPH: Generated 871 derivative records from 9366 primary records. [2025-09-05T19:12:22.041788] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-05T19:12:22.044465] [INFO ] [MAIN ] Derivative Progress: 745/2117 symbols completed. FPF took 0.8s. Estimated remaining: 6m 45s. Rate: 203.1 symbols/min [2025-09-05T19:12:22.045297] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-05T19:12:22.047100] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:22.047138] [INFO ] [MAIN ] Derivative Progress: 746/2117 symbols completed. FPH took 0.8s. Estimated remaining: 6m 45s. Rate: 203.4 symbols/min [2025-09-05T19:12:22.047784] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:22.057779] [INFO ] [MAIN ] FPI: Generated 871 derivative records from 15106 primary records. [2025-09-05T19:12:22.078183] [INFO ] [MAIN ] FRGE: Loaded 6995 primary data records. [2025-09-05T19:12:22.077905] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-05T19:12:22.079829] [INFO ] [MAIN ] Derivative Progress: 747/2117 symbols completed. FPI took 0.7s. Estimated remaining: 6m 44s. Rate: 203.6 symbols/min [2025-09-05T19:12:22.109539] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:22.192784] [INFO ] [MAIN ] FR: Loaded 22389 primary data records. [2025-09-05T19:12:22.456876] [INFO ] [MAIN ] FRO: Loaded 25053 primary data records. [2025-09-05T19:12:22.821823] [INFO ] [MAIN ] FRGE: Generated 871 derivative records from 6995 primary records. [2025-09-05T19:12:22.835719] [INFO ] [MAIN ] FR: Generated 871 derivative records from 22389 primary records. [2025-09-05T19:12:22.840442] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-05T19:12:22.845824] [INFO ] [MAIN ] Derivative Progress: 748/2117 symbols completed. FRGE took 0.8s. Estimated remaining: 6m 44s. Rate: 203.2 symbols/min [2025-09-05T19:12:22.850118] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-05T19:12:22.852211] [INFO ] [MAIN ] Derivative Progress: 749/2117 symbols completed. FR took 0.8s. Estimated remaining: 6m 43s. Rate: 203.4 symbols/min [2025-09-05T19:12:22.859466] [INFO ] [MAIN ] FRO: Generated 871 derivative records from 25053 primary records. [2025-09-05T19:12:22.867502] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-05T19:12:22.869047] [INFO ] [MAIN ] Derivative Progress: 750/2117 symbols completed. FRO took 0.8s. Estimated remaining: 6m 43s. Rate: 203.7 symbols/min [2025-09-05T19:12:22.869419] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:22.869476] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:22.869574] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:22.914836] [INFO ] [MAIN ] FSLY: Loaded 24832 primary data records. [2025-09-05T19:12:22.913940] [INFO ] [MAIN ] FSK: Loaded 23452 primary data records. [2025-09-05T19:12:23.086827] [INFO ] [MAIN ] FRT: Loaded 31754 primary data records. [2025-09-05T19:12:23.667889] [INFO ] [MAIN ] FSLY: Generated 871 derivative records from 24832 primary records. [2025-09-05T19:12:23.685734] [INFO ] [MAIN ] FSK: Generated 871 derivative records from 23452 primary records. [2025-09-05T19:12:23.686671] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-05T19:12:23.688234] [INFO ] [MAIN ] Derivative Progress: 751/2117 symbols completed. FSLY took 0.8s. Estimated remaining: 6m 43s. Rate: 203.2 symbols/min [2025-09-05T19:12:23.688710] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:23.701436] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-05T19:12:23.712239] [INFO ] [MAIN ] Derivative Progress: 752/2117 symbols completed. FSK took 0.8s. Estimated remaining: 6m 43s. Rate: 203.5 symbols/min [2025-09-05T19:12:23.713480] [INFO ] [MAIN ] FRT: Generated 1352 derivative records from 31754 primary records. [2025-09-05T19:12:23.713681] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:23.736731] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-05T19:12:23.740078] [INFO ] [MAIN ] Derivative Progress: 753/2117 symbols completed. FRT took 0.9s. Estimated remaining: 6m 42s. Rate: 203.7 symbols/min [2025-09-05T19:12:23.748451] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:23.750502] [INFO ] [MAIN ] FSM: Loaded 25823 primary data records. [2025-09-05T19:12:23.870893] [INFO ] [MAIN ] FT: Loaded 3125 primary data records. [2025-09-05T19:12:23.966371] [INFO ] [MAIN ] FSS: Loaded 25981 primary data records. [2025-09-05T19:12:24.577699] [INFO ] [MAIN ] FSM: Generated 871 derivative records from 25823 primary records. [2025-09-05T19:12:24.585375] [INFO ] [MAIN ] FT: Generated 871 derivative records from 3125 primary records. [2025-09-05T19:12:24.600202] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-05T19:12:24.602133] [INFO ] [MAIN ] Derivative Progress: 754/2117 symbols completed. FT took 0.9s. Estimated remaining: 6m 43s. Rate: 203.2 symbols/min [2025-09-05T19:12:24.602585] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:24.602802] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-05T19:12:24.604255] [INFO ] [MAIN ] Derivative Progress: 755/2117 symbols completed. FSM took 0.9s. Estimated remaining: 6m 42s. Rate: 203.4 symbols/min [2025-09-05T19:12:24.604695] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:24.617972] [INFO ] [MAIN ] FSS: Generated 1352 derivative records from 25981 primary records. [2025-09-05T19:12:24.643585] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-05T19:12:24.646127] [INFO ] [MAIN ] Derivative Progress: 756/2117 symbols completed. FSS took 0.9s. Estimated remaining: 6m 41s. Rate: 203.7 symbols/min [2025-09-05T19:12:24.646440] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:24.664286] [INFO ] [MAIN ] FTI: Loaded 25808 primary data records. [2025-09-05T19:12:24.685840] [INFO ] [MAIN ] FTK: Loaded 24813 primary data records. [2025-09-05T19:12:24.931906] [INFO ] [MAIN ] FTS: Loaded 20802 primary data records. [2025-09-05T19:12:25.441789] [INFO ] [MAIN ] FTI: Generated 871 derivative records from 25808 primary records. [2025-09-05T19:12:25.463696] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-05T19:12:25.463332] [INFO ] [MAIN ] FTK: Generated 1352 derivative records from 24813 primary records. [2025-09-05T19:12:25.464914] [INFO ] [MAIN ] Derivative Progress: 757/2117 symbols completed. FTI took 0.9s. Estimated remaining: 6m 42s. Rate: 203.2 symbols/min [2025-09-05T19:12:25.467141] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:25.484405] [INFO ] [MAIN ] FTS: Generated 871 derivative records from 20802 primary records. [2025-09-05T19:12:25.487658] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-05T19:12:25.494703] [INFO ] [MAIN ] Derivative Progress: 758/2117 symbols completed. FTK took 0.9s. Estimated remaining: 6m 41s. Rate: 203.4 symbols/min [2025-09-05T19:12:25.496785] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:25.498962] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-05T19:12:25.500738] [INFO ] [MAIN ] Derivative Progress: 759/2117 symbols completed. FTS took 0.9s. Estimated remaining: 6m 40s. Rate: 203.7 symbols/min [2025-09-05T19:12:25.501078] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:25.516500] [INFO ] [MAIN ] FVR: Loaded 11150 primary data records. [2025-09-05T19:12:25.674402] [INFO ] [MAIN ] FTV: Loaded 39920 primary data records. [2025-09-05T19:12:25.815814] [INFO ] [MAIN ] FUN: Loaded 38921 primary data records. [2025-09-05T19:12:26.355532] [INFO ] [MAIN ] FVR: Generated 871 derivative records from 11150 primary records. [2025-09-05T19:12:26.364897] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-05T19:12:26.366312] [INFO ] [MAIN ] Derivative Progress: 760/2117 symbols completed. FVR took 0.9s. Estimated remaining: 6m 41s. Rate: 203.2 symbols/min [2025-09-05T19:12:26.366706] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:26.381528] [INFO ] [MAIN ] FTV: Generated 1352 derivative records from 39920 primary records. [2025-09-05T19:12:26.400688] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-05T19:12:26.409994] [INFO ] [MAIN ] Derivative Progress: 761/2117 symbols completed. FTV took 0.9s. Estimated remaining: 6m 40s. Rate: 203.4 symbols/min [2025-09-05T19:12:26.411019] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:26.412416] [INFO ] [MAIN ] FVRR: Loaded 19780 primary data records. [2025-09-05T19:12:26.466607] [INFO ] [MAIN ] FUN: Generated 1352 derivative records from 38921 primary records. [2025-09-05T19:12:26.546464] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-05T19:12:26.549073] [INFO ] [MAIN ] Derivative Progress: 762/2117 symbols completed. FUN took 1.1s. Estimated remaining: 6m 39s. Rate: 203.6 symbols/min [2025-09-05T19:12:26.565477] [INFO ] [MAIN ] GAB: Loaded 12526 primary data records. [2025-09-05T19:12:26.554671] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:26.829715] [INFO ] [MAIN ] GAM: Loaded 2941 primary data records. [2025-09-05T19:12:27.259057] [INFO ] [MAIN ] FVRR: Generated 871 derivative records from 19780 primary records. [2025-09-05T19:12:27.269290] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-05T19:12:27.270775] [INFO ] [MAIN ] Derivative Progress: 763/2117 symbols completed. FVRR took 0.9s. Estimated remaining: 6m 40s. Rate: 203.2 symbols/min [2025-09-05T19:12:27.280180] [INFO ] [MAIN ] GAB: Generated 871 derivative records from 12526 primary records. [2025-09-05T19:12:27.289926] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-05T19:12:27.292285] [INFO ] [MAIN ] Derivative Progress: 764/2117 symbols completed. GAB took 0.9s. Estimated remaining: 6m 39s. Rate: 203.4 symbols/min [2025-09-05T19:12:27.303710] [INFO ] [MAIN ] GAM: Generated 1352 derivative records from 2941 primary records. [2025-09-05T19:12:27.314362] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-05T19:12:27.316855] [INFO ] [MAIN ] Derivative Progress: 765/2117 symbols completed. GAM took 0.8s. Estimated remaining: 6m 38s. Rate: 203.7 symbols/min [2025-09-05T19:12:27.317257] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:27.317508] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:27.317356] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:27.347440] [INFO ] [MAIN ] GATX: Loaded 13466 primary data records. [2025-09-05T19:12:27.438213] [INFO ] [MAIN ] GBCI: Loaded 19966 primary data records. [2025-09-05T19:12:27.465932] [INFO ] [MAIN ] GAP: Loaded 26030 primary data records. [2025-09-05T19:12:28.156137] [INFO ] [MAIN ] GBCI: Generated 871 derivative records from 19966 primary records. [2025-09-05T19:12:28.157153] [INFO ] [MAIN ] GATX: Generated 1352 derivative records from 13466 primary records. [2025-09-05T19:12:28.176865] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-05T19:12:28.179680] [INFO ] [MAIN ] Derivative Progress: 766/2117 symbols completed. GBCI took 0.9s. Estimated remaining: 6m 39s. Rate: 203.1 symbols/min [2025-09-05T19:12:28.183024] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-05T19:12:28.180242] [INFO ] [MAIN ] GBLI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:28.191179] [INFO ] [MAIN ] Derivative Progress: 767/2117 symbols completed. GATX took 0.9s. Estimated remaining: 6m 38s. Rate: 203.4 symbols/min [2025-09-05T19:12:28.192091] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:28.193323] [INFO ] [MAIN ] GAP: Generated 871 derivative records from 26030 primary records. [2025-09-05T19:12:28.196902] [INFO ] [MAIN ] GBLI: Loaded 753 primary data records. [2025-09-05T19:12:28.280572] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-05T19:12:28.327772] [INFO ] [MAIN ] Derivative Progress: 768/2117 symbols completed. GAP took 1.0s. Estimated remaining: 6m 38s. Rate: 203.5 symbols/min [2025-09-05T19:12:28.328898] [INFO ] [MAIN ] GBTG: Loaded 19183 primary data records. [2025-09-05T19:12:28.329233] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:28.701403] [INFO ] [MAIN ] GBX: Loaded 22091 primary data records. [2025-09-05T19:12:29.137703] [INFO ] [MAIN ] GBTG: Generated 871 derivative records from 19183 primary records. [2025-09-05T19:12:29.137025] [INFO ] [MAIN ] GBLI: Generated 1352 derivative records from 753 primary records. [2025-09-05T19:12:29.157776] [INFO ] [MAIN ] GBLI: Successfully saved derivative data. [2025-09-05T19:12:29.159908] [INFO ] [MAIN ] Derivative Progress: 769/2117 symbols completed. GBLI took 1.0s. Estimated remaining: 6m 38s. Rate: 203.1 symbols/min [2025-09-05T19:12:29.160287] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-05T19:12:29.162185] [INFO ] [MAIN ] Derivative Progress: 770/2117 symbols completed. GBTG took 1.0s. Estimated remaining: 6m 37s. Rate: 203.3 symbols/min [2025-09-05T19:12:29.162592] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:29.162853] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:29.181892] [INFO ] [MAIN ] GBX: Generated 1352 derivative records from 22091 primary records. [2025-09-05T19:12:29.191427] [INFO ] [MAIN ] GCO: Loaded 11056 primary data records. [2025-09-05T19:12:29.226422] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-05T19:12:29.272179] [INFO ] [MAIN ] Derivative Progress: 771/2117 symbols completed. GBX took 0.9s. Estimated remaining: 6m 37s. Rate: 203.5 symbols/min [2025-09-05T19:12:29.298945] [INFO ] [MAIN ] GCI: Loaded 21398 primary data records. [2025-09-05T19:12:29.320413] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:29.685501] [INFO ] [MAIN ] GD: Loaded 22431 primary data records. [2025-09-05T19:12:30.003745] [INFO ] [MAIN ] GCO: Generated 871 derivative records from 11056 primary records. [2025-09-05T19:12:30.023488] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-05T19:12:30.025089] [INFO ] [MAIN ] Derivative Progress: 772/2117 symbols completed. GCO took 0.9s. Estimated remaining: 6m 37s. Rate: 203.1 symbols/min [2025-09-05T19:12:30.026119] [INFO ] [MAIN ] GCI: Generated 871 derivative records from 21398 primary records. [2025-09-05T19:12:30.026530] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:30.036365] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-05T19:12:30.038354] [INFO ] [MAIN ] Derivative Progress: 773/2117 symbols completed. GCI took 0.9s. Estimated remaining: 6m 37s. Rate: 203.3 symbols/min [2025-09-05T19:12:30.038716] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:30.043033] [INFO ] [MAIN ] GDIV: Loaded 1505 primary data records. [2025-09-05T19:12:30.140146] [INFO ] [MAIN ] GD: Generated 871 derivative records from 22431 primary records. [2025-09-05T19:12:30.169924] [INFO ] [MAIN ] GDDY: Loaded 24352 primary data records. [2025-09-05T19:12:30.429853] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-05T19:12:30.462126] [INFO ] [MAIN ] Derivative Progress: 774/2117 symbols completed. GD took 1.1s. Estimated remaining: 6m 37s. Rate: 203.2 symbols/min [2025-09-05T19:12:30.497395] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:30.561857] [INFO ] [MAIN ] GDL: Loaded 1841 primary data records. [2025-09-05T19:12:30.702465] [INFO ] [MAIN ] GDIV: Generated 870 derivative records from 1505 primary records. [2025-09-05T19:12:30.771581] [INFO ] [MAIN ] GDDY: Generated 871 derivative records from 24352 primary records. [2025-09-05T19:12:30.861245] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-05T19:12:30.869165] [INFO ] [MAIN ] Derivative Progress: 775/2117 symbols completed. GDIV took 0.8s. Estimated remaining: 6m 36s. Rate: 203.1 symbols/min [2025-09-05T19:12:30.871568] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-05T19:12:30.871992] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:30.873601] [INFO ] [MAIN ] Derivative Progress: 776/2117 symbols completed. GDDY took 0.8s. Estimated remaining: 6m 36s. Rate: 203.4 symbols/min [2025-09-05T19:12:30.874259] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:30.881539] [INFO ] [MAIN ] GDO: Loaded 2985 primary data records. [2025-09-05T19:12:31.000702] [INFO ] [MAIN ] GDOT: Loaded 18382 primary data records. [2025-09-05T19:12:31.267842] [INFO ] [MAIN ] GDL: Generated 1352 derivative records from 1841 primary records. [2025-09-05T19:12:31.396435] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-05T19:12:31.399185] [INFO ] [MAIN ] Derivative Progress: 777/2117 symbols completed. GDL took 0.9s. Estimated remaining: 6m 36s. Rate: 203.2 symbols/min [2025-09-05T19:12:31.399523] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:31.419827] [INFO ] [MAIN ] GDO: Generated 871 derivative records from 2985 primary records. [2025-09-05T19:12:31.434706] [INFO ] [MAIN ] GDV: Loaded 15066 primary data records. [2025-09-05T19:12:31.454754] [INFO ] [MAIN ] GDOT: Generated 871 derivative records from 18382 primary records. [2025-09-05T19:12:31.523981] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-05T19:12:31.518492] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-05T19:12:31.548292] [INFO ] [MAIN ] Derivative Progress: 778/2117 symbols completed. GDO took 0.7s. Estimated remaining: 6m 35s. Rate: 203.3 symbols/min [2025-09-05T19:12:31.561081] [INFO ] [MAIN ] Derivative Progress: 779/2117 symbols completed. GDOT took 0.7s. Estimated remaining: 6m 34s. Rate: 203.6 symbols/min [2025-09-05T19:12:31.782052] [INFO ] [MAIN ] GDV: Generated 1352 derivative records from 15066 primary records. [2025-09-05T19:12:31.794314] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-05T19:12:31.796154] [INFO ] [MAIN ] Derivative Progress: 780/2117 symbols completed. GDV took 0.4s. Estimated remaining: 6m 34s. Rate: 203.6 symbols/min [2025-09-05T19:12:31.796614] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:31.796695] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:31.797245] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:31.814806] [INFO ] [MAIN ] GEF: Loaded 11393 primary data records. [2025-09-05T19:12:31.909908] [INFO ] [MAIN ] GEL: Loaded 17337 primary data records. [2025-09-05T19:12:32.103829] [INFO ] [MAIN ] GE: Loaded 26099 primary data records. [2025-09-05T19:12:32.575269] [INFO ] [MAIN ] GEF: Generated 871 derivative records from 11393 primary records. [2025-09-05T19:12:32.584848] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-05T19:12:32.587580] [INFO ] [MAIN ] Derivative Progress: 781/2117 symbols completed. GEF took 0.8s. Estimated remaining: 6m 35s. Rate: 203.2 symbols/min [2025-09-05T19:12:32.588713] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:32.604548] [INFO ] [MAIN ] GE: Generated 871 derivative records from 26099 primary records. [2025-09-05T19:12:32.605442] [INFO ] [MAIN ] GEL: Generated 871 derivative records from 17337 primary records. [2025-09-05T19:12:32.630864] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-05T19:12:32.630951] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-05T19:12:32.632683] [INFO ] [MAIN ] Derivative Progress: 782/2117 symbols completed. GE took 0.8s. Estimated remaining: 6m 34s. Rate: 203.4 symbols/min [2025-09-05T19:12:32.634580] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:32.634496] [INFO ] [MAIN ] Derivative Progress: 783/2117 symbols completed. GEL took 0.8s. Estimated remaining: 6m 33s. Rate: 203.6 symbols/min [2025-09-05T19:12:32.634859] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:32.651048] [INFO ] [MAIN ] GEO: Loaded 25258 primary data records. [2025-09-05T19:12:32.805832] [INFO ] [MAIN ] GETY: Loaded 17129 primary data records. [2025-09-05T19:12:32.800092] [INFO ] [MAIN ] GES: Loaded 18321 primary data records. [2025-09-05T19:12:33.394302] [INFO ] [MAIN ] GEO: Generated 871 derivative records from 25258 primary records. [2025-09-05T19:12:33.420370] [INFO ] [MAIN ] GES: Generated 871 derivative records from 18321 primary records. [2025-09-05T19:12:33.421180] [INFO ] [MAIN ] GETY: Generated 871 derivative records from 17129 primary records. [2025-09-05T19:12:33.423606] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-05T19:12:33.424900] [INFO ] [MAIN ] Derivative Progress: 784/2117 symbols completed. GEO took 0.8s. Estimated remaining: 6m 34s. Rate: 203.2 symbols/min [2025-09-05T19:12:33.436240] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:33.440716] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-05T19:12:33.440365] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-05T19:12:33.442479] [INFO ] [MAIN ] Derivative Progress: 785/2117 symbols completed. GETY took 0.8s. Estimated remaining: 6m 33s. Rate: 203.5 symbols/min [2025-09-05T19:12:33.444306] [INFO ] [MAIN ] Derivative Progress: 786/2117 symbols completed. GES took 0.8s. Estimated remaining: 6m 32s. Rate: 203.7 symbols/min [2025-09-05T19:12:33.444403] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:33.444716] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:33.454384] [INFO ] [MAIN ] GFR: Loaded 5655 primary data records. [2025-09-05T19:12:33.608930] [INFO ] [MAIN ] GFF: Loaded 23268 primary data records. [2025-09-05T19:12:33.798664] [INFO ] [MAIN ] GGB: Loaded 38666 primary data records. [2025-09-05T19:12:34.375553] [INFO ] [MAIN ] GFR: Generated 1352 derivative records from 5655 primary records. [2025-09-05T19:12:34.390057] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-05T19:12:34.393594] [INFO ] [MAIN ] Derivative Progress: 787/2117 symbols completed. GFR took 0.9s. Estimated remaining: 6m 33s. Rate: 203.1 symbols/min [2025-09-05T19:12:34.395329] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:34.407063] [INFO ] [MAIN ] GFF: Generated 1352 derivative records from 23268 primary records. [2025-09-05T19:12:34.434514] [INFO ] [MAIN ] GGB: Generated 1352 derivative records from 38666 primary records. [2025-09-05T19:12:34.437103] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-05T19:12:34.440389] [INFO ] [MAIN ] Derivative Progress: 788/2117 symbols completed. GFF took 1.0s. Estimated remaining: 6m 32s. Rate: 203.4 symbols/min [2025-09-05T19:12:34.450198] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:34.459018] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-05T19:12:34.461380] [INFO ] [MAIN ] Derivative Progress: 789/2117 symbols completed. GGB took 1.0s. Estimated remaining: 6m 31s. Rate: 203.6 symbols/min [2025-09-05T19:12:34.462412] [INFO ] [MAIN ] GGG: Loaded 19081 primary data records. [2025-09-05T19:12:34.462941] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:34.566435] [INFO ] [MAIN ] GGT: Loaded 6937 primary data records. [2025-09-05T19:12:34.688981] [INFO ] [MAIN ] GHC: Loaded 2084 primary data records. [2025-09-05T19:12:35.215293] [INFO ] [MAIN ] GGG: Generated 871 derivative records from 19081 primary records. [2025-09-05T19:12:35.233073] [INFO ] [MAIN ] GGT: Generated 871 derivative records from 6937 primary records. [2025-09-05T19:12:35.233893] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-05T19:12:35.236061] [INFO ] [MAIN ] Derivative Progress: 790/2117 symbols completed. GGG took 0.8s. Estimated remaining: 6m 32s. Rate: 203.2 symbols/min [2025-09-05T19:12:35.241894] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:35.244704] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-05T19:12:35.247475] [INFO ] [MAIN ] Derivative Progress: 791/2117 symbols completed. GGT took 0.8s. Estimated remaining: 6m 31s. Rate: 203.4 symbols/min [2025-09-05T19:12:35.248720] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:35.261499] [INFO ] [MAIN ] GHI: Loaded 3621 primary data records. [2025-09-05T19:12:35.262306] [INFO ] [MAIN ] GHC: Generated 1352 derivative records from 2084 primary records. [2025-09-05T19:12:35.379670] [INFO ] [MAIN ] GHM: Loaded 10440 primary data records. [2025-09-05T19:12:35.381746] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-05T19:12:35.384243] [INFO ] [MAIN ] Derivative Progress: 792/2117 symbols completed. GHC took 0.9s. Estimated remaining: 6m 31s. Rate: 203.6 symbols/min [2025-09-05T19:12:35.384762] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:35.700396] [INFO ] [MAIN ] GHY: Loaded 15557 primary data records. [2025-09-05T19:12:36.080989] [INFO ] [MAIN ] GHI: Generated 871 derivative records from 3621 primary records. [2025-09-05T19:12:36.092781] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-05T19:12:36.100036] [INFO ] [MAIN ] Derivative Progress: 793/2117 symbols completed. GHI took 0.9s. Estimated remaining: 6m 31s. Rate: 203.2 symbols/min [2025-09-05T19:12:36.104999] [INFO ] [MAIN ] GHM: Generated 1352 derivative records from 10440 primary records. [2025-09-05T19:12:36.119201] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-05T19:12:36.121559] [INFO ] [MAIN ] Derivative Progress: 794/2117 symbols completed. GHM took 0.9s. Estimated remaining: 6m 30s. Rate: 203.4 symbols/min [2025-09-05T19:12:36.131792] [INFO ] [MAIN ] GHY: Generated 1352 derivative records from 15557 primary records. [2025-09-05T19:12:36.143725] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-05T19:12:36.145978] [INFO ] [MAIN ] Derivative Progress: 795/2117 symbols completed. GHY took 0.8s. Estimated remaining: 6m 29s. Rate: 203.7 symbols/min [2025-09-05T19:12:36.146367] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:36.146549] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:36.146517] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:36.162518] [INFO ] [MAIN ] GIC: Loaded 10113 primary data records. [2025-09-05T19:12:36.277396] [INFO ] [MAIN ] GIB: Loaded 15429 primary data records. [2025-09-05T19:12:36.380179] [INFO ] [MAIN ] GIL: Loaded 20676 primary data records. [2025-09-05T19:12:37.021584] [INFO ] [MAIN ] GIC: Generated 1352 derivative records from 10113 primary records. [2025-09-05T19:12:37.023129] [INFO ] [MAIN ] GIB: Generated 871 derivative records from 15429 primary records. [2025-09-05T19:12:37.050903] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-05T19:12:37.050406] [INFO ] [MAIN ] GIL: Generated 871 derivative records from 20676 primary records. [2025-09-05T19:12:37.054058] [INFO ] [MAIN ] Derivative Progress: 796/2117 symbols completed. GIB took 0.9s. Estimated remaining: 6m 30s. Rate: 203.1 symbols/min [2025-09-05T19:12:37.054489] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:37.064729] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-05T19:12:37.066798] [INFO ] [MAIN ] Derivative Progress: 797/2117 symbols completed. GIL took 0.9s. Estimated remaining: 6m 29s. Rate: 203.4 symbols/min [2025-09-05T19:12:37.067780] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-05T19:12:37.070005] [INFO ] [MAIN ] Derivative Progress: 798/2117 symbols completed. GIC took 0.9s. Estimated remaining: 6m 29s. Rate: 203.6 symbols/min [2025-09-05T19:12:37.068023] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:37.070195] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:37.093771] [INFO ] [MAIN ] GIS: Loaded 26065 primary data records. [2025-09-05T19:12:37.231058] [INFO ] [MAIN ] GKOS: Loaded 20439 primary data records. [2025-09-05T19:12:37.232305] [INFO ] [MAIN ] GL: Loaded 28634 primary data records. [2025-09-05T19:12:37.877712] [INFO ] [MAIN ] GIS: Generated 871 derivative records from 26065 primary records. [2025-09-05T19:12:37.895577] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-05T19:12:37.897859] [INFO ] [MAIN ] Derivative Progress: 799/2117 symbols completed. GIS took 0.8s. Estimated remaining: 6m 29s. Rate: 203.2 symbols/min [2025-09-05T19:12:37.896554] [INFO ] [MAIN ] GKOS: Generated 871 derivative records from 20439 primary records. [2025-09-05T19:12:37.898317] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:37.919637] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-05T19:12:37.921515] [INFO ] [MAIN ] Derivative Progress: 800/2117 symbols completed. GKOS took 0.9s. Estimated remaining: 6m 28s. Rate: 203.4 symbols/min [2025-09-05T19:12:37.922358] [INFO ] [MAIN ] GL: Generated 1352 derivative records from 28634 primary records. [2025-09-05T19:12:37.922673] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:37.938204] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-05T19:12:37.940708] [INFO ] [MAIN ] Derivative Progress: 801/2117 symbols completed. GL took 0.9s. Estimated remaining: 6m 28s. Rate: 203.6 symbols/min [2025-09-05T19:12:37.941141] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:37.989015] [INFO ] [MAIN ] GLW: Loaded 26022 primary data records. [2025-09-05T19:12:38.001168] [INFO ] [MAIN ] GM: Loaded 26100 primary data records. [2025-09-05T19:12:38.050250] [INFO ] [MAIN ] GLOB: Loaded 35686 primary data records. [2025-09-05T19:12:38.767609] [INFO ] [MAIN ] GLW: Generated 871 derivative records from 26022 primary records. [2025-09-05T19:12:38.769109] [INFO ] [MAIN ] GM: Generated 871 derivative records from 26100 primary records. [2025-09-05T19:12:38.798500] [INFO ] [MAIN ] GLOB: Generated 1352 derivative records from 35686 primary records. [2025-09-05T19:12:38.800059] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-05T19:12:38.801532] [INFO ] [MAIN ] Derivative Progress: 802/2117 symbols completed. GM took 0.9s. Estimated remaining: 6m 28s. Rate: 203.2 symbols/min [2025-09-05T19:12:38.801729] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-05T19:12:38.802775] [INFO ] [MAIN ] Derivative Progress: 803/2117 symbols completed. GLW took 0.9s. Estimated remaining: 6m 28s. Rate: 203.4 symbols/min [2025-09-05T19:12:38.802916] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:38.803472] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:38.823148] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-05T19:12:38.825975] [INFO ] [MAIN ] Derivative Progress: 804/2117 symbols completed. GLOB took 0.9s. Estimated remaining: 6m 27s. Rate: 203.6 symbols/min [2025-09-05T19:12:38.830819] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:38.845200] [INFO ] [MAIN ] GMRE: Loaded 18824 primary data records. [2025-09-05T19:12:38.948313] [INFO ] [MAIN ] GMED: Loaded 23260 primary data records. [2025-09-05T19:12:39.154259] [INFO ] [MAIN ] GNK: Loaded 30387 primary data records. [2025-09-05T19:12:39.675702] [INFO ] [MAIN ] GMRE: Generated 871 derivative records from 18824 primary records. [2025-09-05T19:12:39.687072] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-05T19:12:39.695414] [INFO ] [MAIN ] Derivative Progress: 805/2117 symbols completed. GMRE took 0.9s. Estimated remaining: 6m 27s. Rate: 203.1 symbols/min [2025-09-05T19:12:39.694380] [INFO ] [MAIN ] GMED: Generated 871 derivative records from 23260 primary records. [2025-09-05T19:12:39.696227] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:39.704882] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-05T19:12:39.706825] [INFO ] [MAIN ] Derivative Progress: 806/2117 symbols completed. GMED took 0.9s. Estimated remaining: 6m 27s. Rate: 203.4 symbols/min [2025-09-05T19:12:39.708187] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:39.711478] [INFO ] [MAIN ] GNT: Loaded 3913 primary data records. [2025-09-05T19:12:39.874405] [INFO ] [MAIN ] GNK: Generated 1352 derivative records from 30387 primary records. [2025-09-05T19:12:39.964945] [INFO ] [MAIN ] GOLF: Loaded 23917 primary data records. [2025-09-05T19:12:40.098145] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-05T19:12:40.163328] [INFO ] [MAIN ] Derivative Progress: 807/2117 symbols completed. GNK took 1.3s. Estimated remaining: 6m 27s. Rate: 203.3 symbols/min [2025-09-05T19:12:40.168355] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:40.266395] [INFO ] [MAIN ] GNT: Generated 871 derivative records from 3913 primary records. [2025-09-05T19:12:40.283920] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-05T19:12:40.285087] [INFO ] [MAIN ] Derivative Progress: 808/2117 symbols completed. GNT took 0.6s. Estimated remaining: 6m 26s. Rate: 203.4 symbols/min [2025-09-05T19:12:40.299549] [INFO ] [MAIN ] GOTU: Loaded 28321 primary data records. [2025-09-05T19:12:40.385635] [INFO ] [MAIN ] GOLF: Generated 1352 derivative records from 23917 primary records. [2025-09-05T19:12:40.489106] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-05T19:12:40.500180] [INFO ] [MAIN ] Derivative Progress: 809/2117 symbols completed. GOLF took 0.8s. Estimated remaining: 6m 26s. Rate: 203.5 symbols/min [2025-09-05T19:12:40.621319] [INFO ] [MAIN ] GOTU: Generated 1352 derivative records from 28321 primary records. [2025-09-05T19:12:40.633155] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-05T19:12:40.634963] [INFO ] [MAIN ] Derivative Progress: 810/2117 symbols completed. GOTU took 0.5s. Estimated remaining: 6m 25s. Rate: 203.6 symbols/min [2025-09-05T19:12:40.635678] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:40.635610] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:40.635799] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:40.648513] [INFO ] [MAIN ] GPI: Loaded 10627 primary data records. [2025-09-05T19:12:40.793615] [INFO ] [MAIN ] GPC: Loaded 21829 primary data records. [2025-09-05T19:12:40.850356] [INFO ] [MAIN ] GPK: Loaded 25651 primary data records. [2025-09-05T19:12:41.437037] [INFO ] [MAIN ] GPI: Generated 1352 derivative records from 10627 primary records. [2025-09-05T19:12:41.450454] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-05T19:12:41.453995] [INFO ] [MAIN ] Derivative Progress: 811/2117 symbols completed. GPI took 0.8s. Estimated remaining: 6m 26s. Rate: 203.2 symbols/min [2025-09-05T19:12:41.454356] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:41.463741] [INFO ] [MAIN ] GPK: Generated 871 derivative records from 25651 primary records. [2025-09-05T19:12:41.470404] [INFO ] [MAIN ] GPC: Generated 871 derivative records from 21829 primary records. [2025-09-05T19:12:41.498438] [INFO ] [MAIN ] GPMT: Loaded 12824 primary data records. [2025-09-05T19:12:41.492731] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-05T19:12:41.498149] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-05T19:12:41.520967] [INFO ] [MAIN ] Derivative Progress: 812/2117 symbols completed. GPC took 0.9s. Estimated remaining: 6m 25s. Rate: 203.4 symbols/min [2025-09-05T19:12:41.522753] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:41.537352] [INFO ] [MAIN ] Derivative Progress: 813/2117 symbols completed. GPK took 0.9s. Estimated remaining: 6m 24s. Rate: 203.6 symbols/min [2025-09-05T19:12:41.558772] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:41.754181] [INFO ] [MAIN ] GPOR: Loaded 11088 primary data records. [2025-09-05T19:12:41.875798] [INFO ] [MAIN ] GPN: Loaded 25068 primary data records. [2025-09-05T19:12:42.223832] [INFO ] [MAIN ] GPMT: Generated 871 derivative records from 12824 primary records. [2025-09-05T19:12:42.292479] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-05T19:12:42.294603] [INFO ] [MAIN ] Derivative Progress: 814/2117 symbols completed. GPMT took 0.8s. Estimated remaining: 6m 25s. Rate: 203.2 symbols/min [2025-09-05T19:12:42.295352] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:42.308018] [INFO ] [MAIN ] GPOR: Generated 871 derivative records from 11088 primary records. [2025-09-05T19:12:42.323135] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-05T19:12:42.330766] [INFO ] [MAIN ] Derivative Progress: 815/2117 symbols completed. GPOR took 0.8s. Estimated remaining: 6m 24s. Rate: 203.4 symbols/min [2025-09-05T19:12:42.337124] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:42.338047] [INFO ] [MAIN ] GPN: Generated 871 derivative records from 25068 primary records. [2025-09-05T19:12:42.339001] [INFO ] [MAIN ] GPRK: Loaded 18128 primary data records. [2025-09-05T19:12:42.458674] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-05T19:12:42.476217] [INFO ] [MAIN ] Derivative Progress: 816/2117 symbols completed. GPN took 1.0s. Estimated remaining: 6m 24s. Rate: 203.5 symbols/min [2025-09-05T19:12:42.503024] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:42.548213] [INFO ] [MAIN ] GRBK: Loaded 20283 primary data records. [2025-09-05T19:12:42.669375] [INFO ] [MAIN ] GRC: Loaded 4079 primary data records. [2025-09-05T19:12:43.153470] [INFO ] [MAIN ] GPRK: Generated 871 derivative records from 18128 primary records. [2025-09-05T19:12:43.165289] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-05T19:12:43.166807] [INFO ] [MAIN ] Derivative Progress: 817/2117 symbols completed. GPRK took 0.9s. Estimated remaining: 6m 24s. Rate: 203.2 symbols/min [2025-09-05T19:12:43.167300] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:43.181911] [INFO ] [MAIN ] GRC: Generated 871 derivative records from 4079 primary records. [2025-09-05T19:12:43.196845] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-05T19:12:43.198503] [INFO ] [MAIN ] Derivative Progress: 818/2117 symbols completed. GRC took 0.7s. Estimated remaining: 6m 23s. Rate: 203.4 symbols/min [2025-09-05T19:12:43.199311] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:43.199085] [INFO ] [MAIN ] GRDN: Loaded 10086 primary data records. [2025-09-05T19:12:43.221407] [INFO ] [MAIN ] GRBK: Generated 1352 derivative records from 20283 primary records. [2025-09-05T19:12:43.478962] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-05T19:12:43.497026] [INFO ] [MAIN ] Derivative Progress: 819/2117 symbols completed. GRBK took 1.2s. Estimated remaining: 6m 23s. Rate: 203.4 symbols/min [2025-09-05T19:12:43.498201] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:43.500901] [INFO ] [MAIN ] GRND: Loaded 37697 primary data records. [2025-09-05T19:12:43.712111] [INFO ] [MAIN ] GRNT: Loaded 16953 primary data records. [2025-09-05T19:12:43.930426] [INFO ] [MAIN ] GRDN: Generated 871 derivative records from 10086 primary records. [2025-09-05T19:12:44.068587] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-05T19:12:44.070525] [INFO ] [MAIN ] Derivative Progress: 820/2117 symbols completed. GRDN took 0.9s. Estimated remaining: 6m 23s. Rate: 203.2 symbols/min [2025-09-05T19:12:44.071523] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:44.087575] [INFO ] [MAIN ] GRND: Generated 1352 derivative records from 37697 primary records. [2025-09-05T19:12:44.091176] [INFO ] [MAIN ] GROV: Loaded 4998 primary data records. [2025-09-05T19:12:44.211880] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-05T19:12:44.235609] [INFO ] [MAIN ] Derivative Progress: 821/2117 symbols completed. GRND took 1.0s. Estimated remaining: 6m 22s. Rate: 203.3 symbols/min [2025-09-05T19:12:44.241683] [INFO ] [MAIN ] GRNT: Generated 871 derivative records from 16953 primary records. [2025-09-05T19:12:44.256330] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:44.354737] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-05T19:12:44.356899] [INFO ] [MAIN ] Derivative Progress: 822/2117 symbols completed. GRNT took 0.9s. Estimated remaining: 6m 22s. Rate: 203.4 symbols/min [2025-09-05T19:12:44.354911] [INFO ] [MAIN ] GRX: Loaded 3124 primary data records. [2025-09-05T19:12:44.357617] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:44.684905] [INFO ] [MAIN ] GROV: Generated 871 derivative records from 4998 primary records. [2025-09-05T19:12:44.703280] [INFO ] [MAIN ] GS: Loaded 24913 primary data records. [2025-09-05T19:12:44.704471] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-05T19:12:44.717530] [INFO ] [MAIN ] Derivative Progress: 823/2117 symbols completed. GROV took 0.6s. Estimated remaining: 6m 22s. Rate: 203.4 symbols/min [2025-09-05T19:12:44.960070] [INFO ] [MAIN ] GRX: Generated 1352 derivative records from 3124 primary records. [2025-09-05T19:12:44.973660] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-05T19:12:44.976427] [INFO ] [MAIN ] Derivative Progress: 824/2117 symbols completed. GRX took 0.7s. Estimated remaining: 6m 21s. Rate: 203.4 symbols/min [2025-09-05T19:12:44.986951] [INFO ] [MAIN ] GS: Generated 871 derivative records from 24913 primary records. [2025-09-05T19:12:44.995192] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-05T19:12:44.996566] [INFO ] [MAIN ] Derivative Progress: 825/2117 symbols completed. GS took 0.6s. Estimated remaining: 6m 21s. Rate: 203.7 symbols/min [2025-09-05T19:12:44.997079] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:44.997196] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:44.997738] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:45.016607] [INFO ] [MAIN ] GSL: Loaded 16112 primary data records. [2025-09-05T19:12:45.154905] [INFO ] [MAIN ] GSK: Loaded 25926 primary data records. [2025-09-05T19:12:45.156570] [INFO ] [MAIN ] GSBD: Loaded 28931 primary data records. [2025-09-05T19:12:45.826764] [INFO ] [MAIN ] GSL: Generated 871 derivative records from 16112 primary records. [2025-09-05T19:12:45.835373] [INFO ] [MAIN ] GSK: Generated 871 derivative records from 25926 primary records. [2025-09-05T19:12:45.848505] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-05T19:12:45.851186] [INFO ] [MAIN ] Derivative Progress: 826/2117 symbols completed. GSL took 0.9s. Estimated remaining: 6m 21s. Rate: 203.2 symbols/min [2025-09-05T19:12:45.851941] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:45.854054] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-05T19:12:45.855875] [INFO ] [MAIN ] Derivative Progress: 827/2117 symbols completed. GSK took 0.9s. Estimated remaining: 6m 20s. Rate: 203.4 symbols/min [2025-09-05T19:12:45.856430] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:45.869562] [INFO ] [MAIN ] GSBD: Generated 1352 derivative records from 28931 primary records. [2025-09-05T19:12:45.894146] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-05T19:12:45.896773] [INFO ] [MAIN ] Derivative Progress: 828/2117 symbols completed. GSBD took 0.9s. Estimated remaining: 6m 20s. Rate: 203.6 symbols/min [2025-09-05T19:12:45.904724] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:45.905369] [INFO ] [MAIN ] GTES: Loaded 24148 primary data records. [2025-09-05T19:12:45.982308] [INFO ] [MAIN ] GTLS: Loaded 22397 primary data records. [2025-09-05T19:12:46.207116] [INFO ] [MAIN ] GTN: Loaded 21929 primary data records. [2025-09-05T19:12:46.652966] [INFO ] [MAIN ] GTES: Generated 871 derivative records from 24148 primary records. [2025-09-05T19:12:46.663924] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-05T19:12:46.665450] [INFO ] [MAIN ] Derivative Progress: 829/2117 symbols completed. GTES took 0.8s. Estimated remaining: 6m 20s. Rate: 203.2 symbols/min [2025-09-05T19:12:46.665718] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:46.677600] [INFO ] [MAIN ] GTLS: Generated 871 derivative records from 22397 primary records. [2025-09-05T19:12:46.693582] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-05T19:12:46.706941] [INFO ] [MAIN ] GTY: Loaded 14209 primary data records. [2025-09-05T19:12:46.700346] [INFO ] [MAIN ] Derivative Progress: 830/2117 symbols completed. GTLS took 0.8s. Estimated remaining: 6m 20s. Rate: 203.5 symbols/min [2025-09-05T19:12:46.707751] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:46.708616] [INFO ] [MAIN ] GTN: Generated 871 derivative records from 21929 primary records. [2025-09-05T19:12:46.821945] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-05T19:12:46.823879] [INFO ] [MAIN ] Derivative Progress: 831/2117 symbols completed. GTN took 0.9s. Estimated remaining: 6m 19s. Rate: 203.6 symbols/min [2025-09-05T19:12:46.867292] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:46.959968] [INFO ] [MAIN ] GUG: Loaded 9287 primary data records. [2025-09-05T19:12:47.080520] [INFO ] [MAIN ] GWH: Loaded 12776 primary data records. [2025-09-05T19:12:47.442459] [INFO ] [MAIN ] GTY: Generated 871 derivative records from 14209 primary records. [2025-09-05T19:12:47.576393] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-05T19:12:47.577801] [INFO ] [MAIN ] Derivative Progress: 832/2117 symbols completed. GTY took 0.9s. Estimated remaining: 6m 19s. Rate: 203.2 symbols/min [2025-09-05T19:12:47.579058] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:47.600385] [INFO ] [MAIN ] GUG: Generated 1352 derivative records from 9287 primary records. [2025-09-05T19:12:47.633720] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-05T19:12:47.636378] [INFO ] [MAIN ] Derivative Progress: 833/2117 symbols completed. GUG took 0.9s. Estimated remaining: 6m 19s. Rate: 203.4 symbols/min [2025-09-05T19:12:47.646814] [INFO ] [MAIN ] GWRE: Loaded 30290 primary data records. [2025-09-05T19:12:47.647237] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:47.653675] [INFO ] [MAIN ] GWH: Generated 1352 derivative records from 12776 primary records. [2025-09-05T19:12:47.772206] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-05T19:12:47.778846] [INFO ] [MAIN ] Derivative Progress: 834/2117 symbols completed. GWH took 0.9s. Estimated remaining: 6m 18s. Rate: 203.5 symbols/min [2025-09-05T19:12:47.776323] [INFO ] [MAIN ] GWW: Loaded 9619 primary data records. [2025-09-05T19:12:47.800913] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:48.193686] [INFO ] [MAIN ] GXO: Loaded 22052 primary data records. [2025-09-05T19:12:48.472082] [INFO ] [MAIN ] GWRE: Generated 1352 derivative records from 30290 primary records. [2025-09-05T19:12:48.472920] [INFO ] [MAIN ] GWW: Generated 871 derivative records from 9619 primary records. [2025-09-05T19:12:48.494442] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-05T19:12:48.496473] [INFO ] [MAIN ] Derivative Progress: 835/2117 symbols completed. GWW took 0.9s. Estimated remaining: 6m 19s. Rate: 203.2 symbols/min [2025-09-05T19:12:48.497034] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:48.498829] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-05T19:12:48.502068] [INFO ] [MAIN ] Derivative Progress: 836/2117 symbols completed. GWRE took 0.9s. Estimated remaining: 6m 18s. Rate: 203.4 symbols/min [2025-09-05T19:12:48.502292] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:48.506547] [INFO ] [MAIN ] GYLD: Loaded 849 primary data records. [2025-09-05T19:12:48.514259] [INFO ] [MAIN ] GXO: Generated 871 derivative records from 22052 primary records. [2025-09-05T19:12:48.678954] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-05T19:12:48.713874] [INFO ] [MAIN ] Derivative Progress: 837/2117 symbols completed. GXO took 0.9s. Estimated remaining: 6m 17s. Rate: 203.5 symbols/min [2025-09-05T19:12:48.771246] [INFO ] [MAIN ] H: Loaded 21561 primary data records. [2025-09-05T19:12:48.771468] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:49.038381] [INFO ] [MAIN ] HAE: Loaded 28360 primary data records. [2025-09-05T19:12:49.137181] [INFO ] [MAIN ] GYLD: Generated 870 derivative records from 849 primary records. [2025-09-05T19:12:49.237543] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-05T19:12:49.242408] [INFO ] [MAIN ] Derivative Progress: 838/2117 symbols completed. GYLD took 0.7s. Estimated remaining: 6m 17s. Rate: 203.3 symbols/min [2025-09-05T19:12:49.342759] [INFO ] [MAIN ] H: Generated 871 derivative records from 21561 primary records. [2025-09-05T19:12:49.352838] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-05T19:12:49.354529] [INFO ] [MAIN ] Derivative Progress: 839/2117 symbols completed. H took 0.9s. Estimated remaining: 6m 17s. Rate: 203.5 symbols/min [2025-09-05T19:12:49.370157] [INFO ] [MAIN ] HAE: Generated 1352 derivative records from 28360 primary records. [2025-09-05T19:12:49.382223] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-05T19:12:49.384374] [INFO ] [MAIN ] Derivative Progress: 840/2117 symbols completed. HAE took 0.6s. Estimated remaining: 6m 16s. Rate: 203.7 symbols/min [2025-09-05T19:12:49.384955] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:49.385155] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:49.385024] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:49.424864] [INFO ] [MAIN ] HAFN: Loaded 20183 primary data records. [2025-09-05T19:12:49.433572] [INFO ] [MAIN ] HAYW: Loaded 23656 primary data records. [2025-09-05T19:12:49.476610] [INFO ] [MAIN ] HASI: Loaded 23261 primary data records. [2025-09-05T19:12:50.209058] [INFO ] [MAIN ] HAYW: Generated 871 derivative records from 23656 primary records. [2025-09-05T19:12:50.209715] [INFO ] [MAIN ] HAFN: Generated 871 derivative records from 20183 primary records. [2025-09-05T19:12:50.222426] [INFO ] [MAIN ] HASI: Generated 871 derivative records from 23261 primary records. [2025-09-05T19:12:50.241421] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-05T19:12:50.243810] [INFO ] [MAIN ] Derivative Progress: 841/2117 symbols completed. HAFN took 0.9s. Estimated remaining: 6m 17s. Rate: 203.2 symbols/min [2025-09-05T19:12:50.244594] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-05T19:12:50.241965] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-05T19:12:50.245850] [INFO ] [MAIN ] Derivative Progress: 842/2117 symbols completed. HAYW took 0.9s. Estimated remaining: 6m 16s. Rate: 203.5 symbols/min [2025-09-05T19:12:50.247841] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:50.247765] [INFO ] [MAIN ] Derivative Progress: 843/2117 symbols completed. HASI took 0.9s. Estimated remaining: 6m 15s. Rate: 203.7 symbols/min [2025-09-05T19:12:50.248007] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:50.248270] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:50.316070] [INFO ] [MAIN ] HBI: Loaded 39860 primary data records. [2025-09-05T19:12:50.417626] [INFO ] [MAIN ] HBM: Loaded 39784 primary data records. [2025-09-05T19:12:50.439498] [INFO ] [MAIN ] HCA: Loaded 35686 primary data records. [2025-09-05T19:12:51.170981] [INFO ] [MAIN ] HBI: Generated 1352 derivative records from 39860 primary records. [2025-09-05T19:12:51.188431] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-05T19:12:51.196334] [INFO ] [MAIN ] Derivative Progress: 844/2117 symbols completed. HBI took 1.0s. Estimated remaining: 6m 16s. Rate: 203.2 symbols/min [2025-09-05T19:12:51.201503] [INFO ] [MAIN ] HCA: Generated 1352 derivative records from 35686 primary records. [2025-09-05T19:12:51.201738] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:51.227667] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-05T19:12:51.228527] [INFO ] [MAIN ] HBM: Generated 1352 derivative records from 39784 primary records. [2025-09-05T19:12:51.231028] [INFO ] [MAIN ] Derivative Progress: 845/2117 symbols completed. HCA took 1.0s. Estimated remaining: 6m 15s. Rate: 203.4 symbols/min [2025-09-05T19:12:51.231760] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:51.258744] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-05T19:12:51.267456] [INFO ] [MAIN ] Derivative Progress: 846/2117 symbols completed. HBM took 1.0s. Estimated remaining: 6m 15s. Rate: 203.6 symbols/min [2025-09-05T19:12:51.259217] [INFO ] [MAIN ] HCI: Loaded 7219 primary data records. [2025-09-05T19:12:51.269046] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:51.281106] [INFO ] [MAIN ] HCC: Loaded 22094 primary data records. [2025-09-05T19:12:51.668429] [INFO ] [MAIN ] HDB: Loaded 24661 primary data records. [2025-09-05T19:12:52.024515] [INFO ] [MAIN ] HCI: Generated 871 derivative records from 7219 primary records. [2025-09-05T19:12:52.033172] [INFO ] [MAIN ] HCC: Generated 871 derivative records from 22094 primary records. [2025-09-05T19:12:52.041517] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-05T19:12:52.043620] [INFO ] [MAIN ] Derivative Progress: 847/2117 symbols completed. HCI took 0.8s. Estimated remaining: 6m 15s. Rate: 203.2 symbols/min [2025-09-05T19:12:52.049946] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:52.061836] [INFO ] [MAIN ] HDB: Generated 871 derivative records from 24661 primary records. [2025-09-05T19:12:52.061917] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-05T19:12:52.063790] [INFO ] [MAIN ] Derivative Progress: 848/2117 symbols completed. HCC took 0.9s. Estimated remaining: 6m 14s. Rate: 203.4 symbols/min [2025-09-05T19:12:52.064344] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:52.079117] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-05T19:12:52.080814] [INFO ] [MAIN ] Derivative Progress: 849/2117 symbols completed. HDB took 0.8s. Estimated remaining: 6m 14s. Rate: 203.6 symbols/min [2025-09-05T19:12:52.081087] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:52.096606] [INFO ] [MAIN ] HE: Loaded 23608 primary data records. [2025-09-05T19:12:52.158659] [INFO ] [MAIN ] HEI: Loaded 15020 primary data records. [2025-09-05T19:12:52.505808] [INFO ] [MAIN ] HESM: Loaded 36242 primary data records. [2025-09-05T19:12:52.924721] [INFO ] [MAIN ] HE: Generated 871 derivative records from 23608 primary records. [2025-09-05T19:12:52.934696] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-05T19:12:52.936001] [INFO ] [MAIN ] Derivative Progress: 850/2117 symbols completed. HE took 0.9s. Estimated remaining: 6m 14s. Rate: 203.2 symbols/min [2025-09-05T19:12:52.937402] [INFO ] [MAIN ] HFND: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:52.946768] [INFO ] [MAIN ] HEI: Generated 871 derivative records from 15020 primary records. [2025-09-05T19:12:52.949504] [INFO ] [MAIN ] HFND: Loaded 640 primary data records. [2025-09-05T19:12:53.061746] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-05T19:12:53.065127] [INFO ] [MAIN ] Derivative Progress: 851/2117 symbols completed. HEI took 1.0s. Estimated remaining: 6m 14s. Rate: 203.3 symbols/min [2025-09-05T19:12:53.071539] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:53.134745] [INFO ] [MAIN ] HESM: Generated 1352 derivative records from 36242 primary records. [2025-09-05T19:12:53.234441] [INFO ] [MAIN ] HFRO: Loaded 8429 primary data records. [2025-09-05T19:12:53.306856] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-05T19:12:53.344794] [INFO ] [MAIN ] Derivative Progress: 852/2117 symbols completed. HESM took 1.3s. Estimated remaining: 6m 13s. Rate: 203.3 symbols/min [2025-09-05T19:12:53.362145] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:53.566530] [INFO ] [MAIN ] HFND: Generated 866 derivative records from 640 primary records. [2025-09-05T19:12:53.565161] [INFO ] [MAIN ] HGER: Loaded 9748 primary data records. [2025-09-05T19:12:53.633830] [INFO ] [MAIN ] HFND: Successfully saved derivative data. [2025-09-05T19:12:53.662129] [INFO ] [MAIN ] Derivative Progress: 853/2117 symbols completed. HFND took 0.7s. Estimated remaining: 6m 13s. Rate: 203.3 symbols/min [2025-09-05T19:12:53.916670] [INFO ] [MAIN ] HFRO: Generated 871 derivative records from 8429 primary records. [2025-09-05T19:12:54.007171] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-05T19:12:54.009425] [INFO ] [MAIN ] Derivative Progress: 854/2117 symbols completed. HFRO took 0.9s. Estimated remaining: 6m 13s. Rate: 203.3 symbols/min [2025-09-05T19:12:54.040003] [INFO ] [MAIN ] HGER: Generated 1352 derivative records from 9748 primary records. [2025-09-05T19:12:54.056588] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-05T19:12:54.059829] [INFO ] [MAIN ] Derivative Progress: 855/2117 symbols completed. HGER took 0.7s. Estimated remaining: 6m 12s. Rate: 203.5 symbols/min [2025-09-05T19:12:54.060833] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:54.060599] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:54.061507] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:54.073625] [INFO ] [MAIN ] HGLB: Loaded 6920 primary data records. [2025-09-05T19:12:54.183850] [INFO ] [MAIN ] HGTY: Loaded 6696 primary data records. [2025-09-05T19:12:54.206043] [INFO ] [MAIN ] HHH: Loaded 16581 primary data records. [2025-09-05T19:12:55.029406] [INFO ] [MAIN ] HGLB: Generated 1352 derivative records from 6920 primary records. [2025-09-05T19:12:55.059531] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-05T19:12:55.058988] [INFO ] [MAIN ] HHH: Generated 871 derivative records from 16581 primary records. [2025-09-05T19:12:55.061352] [INFO ] [MAIN ] Derivative Progress: 856/2117 symbols completed. HGLB took 1.0s. Estimated remaining: 6m 13s. Rate: 202.9 symbols/min [2025-09-05T19:12:55.057805] [INFO ] [MAIN ] HGTY: Generated 871 derivative records from 6696 primary records. [2025-09-05T19:12:55.062859] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:55.078389] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-05T19:12:55.080534] [INFO ] [MAIN ] Derivative Progress: 857/2117 symbols completed. HGTY took 1.0s. Estimated remaining: 6m 12s. Rate: 203.1 symbols/min [2025-09-05T19:12:55.080622] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-05T19:12:55.080934] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:55.082734] [INFO ] [MAIN ] Derivative Progress: 858/2117 symbols completed. HHH took 1.0s. Estimated remaining: 6m 11s. Rate: 203.4 symbols/min [2025-09-05T19:12:55.083151] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:55.106875] [INFO ] [MAIN ] HI: Loaded 26707 primary data records. [2025-09-05T19:12:55.223342] [INFO ] [MAIN ] HII: Loaded 15373 primary data records. [2025-09-05T19:12:55.386939] [INFO ] [MAIN ] HIG: Loaded 24878 primary data records. [2025-09-05T19:12:55.925677] [INFO ] [MAIN ] HII: Generated 871 derivative records from 15373 primary records. [2025-09-05T19:12:55.925042] [INFO ] [MAIN ] HI: Generated 1352 derivative records from 26707 primary records. [2025-09-05T19:12:55.947101] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-05T19:12:55.949550] [INFO ] [MAIN ] Derivative Progress: 859/2117 symbols completed. HII took 0.9s. Estimated remaining: 6m 12s. Rate: 202.9 symbols/min [2025-09-05T19:12:55.950441] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-05T19:12:55.950374] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:55.952219] [INFO ] [MAIN ] Derivative Progress: 860/2117 symbols completed. HI took 0.9s. Estimated remaining: 6m 11s. Rate: 203.1 symbols/min [2025-09-05T19:12:55.952490] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:55.960459] [INFO ] [MAIN ] HIG: Generated 871 derivative records from 24878 primary records. [2025-09-05T19:12:55.971893] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-05T19:12:55.973549] [INFO ] [MAIN ] Derivative Progress: 861/2117 symbols completed. HIG took 0.9s. Estimated remaining: 6m 11s. Rate: 203.4 symbols/min [2025-09-05T19:12:55.973898] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:55.979485] [INFO ] [MAIN ] HIO: Loaded 10924 primary data records. [2025-09-05T19:12:56.159420] [INFO ] [MAIN ] HIPO: Loaded 10942 primary data records. [2025-09-05T19:12:56.179941] [INFO ] [MAIN ] HIMS: Loaded 26188 primary data records. [2025-09-05T19:12:56.717431] [INFO ] [MAIN ] HIO: Generated 871 derivative records from 10924 primary records. [2025-09-05T19:12:56.728286] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-05T19:12:56.729754] [INFO ] [MAIN ] Derivative Progress: 862/2117 symbols completed. HIO took 0.8s. Estimated remaining: 6m 11s. Rate: 203.0 symbols/min [2025-09-05T19:12:56.730093] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:56.741328] [INFO ] [MAIN ] HIPO: Generated 871 derivative records from 10942 primary records. [2025-09-05T19:12:56.756993] [INFO ] [MAIN ] HIMS: Generated 871 derivative records from 26188 primary records. [2025-09-05T19:12:56.764328] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-05T19:12:56.766322] [INFO ] [MAIN ] Derivative Progress: 863/2117 symbols completed. HIPO took 0.8s. Estimated remaining: 6m 10s. Rate: 203.2 symbols/min [2025-09-05T19:12:56.766506] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:56.783206] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-05T19:12:56.785190] [INFO ] [MAIN ] HIW: Loaded 21281 primary data records. [2025-09-05T19:12:56.784577] [INFO ] [MAIN ] Derivative Progress: 864/2117 symbols completed. HIMS took 0.8s. Estimated remaining: 6m 10s. Rate: 203.4 symbols/min [2025-09-05T19:12:56.787461] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:56.859246] [INFO ] [MAIN ] HIX: Loaded 9755 primary data records. [2025-09-05T19:12:56.960198] [INFO ] [MAIN ] HKD: Loaded 9440 primary data records. [2025-09-05T19:12:57.500502] [INFO ] [MAIN ] HIW: Generated 871 derivative records from 21281 primary records. [2025-09-05T19:12:57.523670] [INFO ] [MAIN ] HKD: Generated 871 derivative records from 9440 primary records. [2025-09-05T19:12:57.524298] [INFO ] [MAIN ] HIX: Generated 871 derivative records from 9755 primary records. [2025-09-05T19:12:57.538122] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-05T19:12:57.540141] [INFO ] [MAIN ] Derivative Progress: 865/2117 symbols completed. HIW took 0.8s. Estimated remaining: 6m 10s. Rate: 203.1 symbols/min [2025-09-05T19:12:57.540522] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:57.542546] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-05T19:12:57.544723] [INFO ] [MAIN ] Derivative Progress: 866/2117 symbols completed. HKD took 0.8s. Estimated remaining: 6m 9s. Rate: 203.3 symbols/min [2025-09-05T19:12:57.545247] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:57.545215] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-05T19:12:57.546633] [INFO ] [MAIN ] Derivative Progress: 867/2117 symbols completed. HIX took 0.8s. Estimated remaining: 6m 9s. Rate: 203.5 symbols/min [2025-09-05T19:12:57.547010] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:57.568673] [INFO ] [MAIN ] HLIO: Loaded 14846 primary data records. [2025-09-05T19:12:57.628381] [INFO ] [MAIN ] HLI: Loaded 14839 primary data records. [2025-09-05T19:12:57.926073] [INFO ] [MAIN ] HL: Loaded 40416 primary data records. [2025-09-05T19:12:58.376057] [INFO ] [MAIN ] HLIO: Generated 871 derivative records from 14846 primary records. [2025-09-05T19:12:58.386762] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-05T19:12:58.389667] [INFO ] [MAIN ] Derivative Progress: 868/2117 symbols completed. HLIO took 0.8s. Estimated remaining: 6m 9s. Rate: 203.1 symbols/min [2025-09-05T19:12:58.398177] [INFO ] [MAIN ] HLI: Generated 871 derivative records from 14839 primary records. [2025-09-05T19:12:58.407658] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-05T19:12:58.409235] [INFO ] [MAIN ] Derivative Progress: 869/2117 symbols completed. HLI took 0.9s. Estimated remaining: 6m 8s. Rate: 203.3 symbols/min [2025-09-05T19:12:58.421458] [INFO ] [MAIN ] HL: Generated 1352 derivative records from 40416 primary records. [2025-09-05T19:12:58.433614] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-05T19:12:58.436046] [INFO ] [MAIN ] Derivative Progress: 870/2117 symbols completed. HL took 0.9s. Estimated remaining: 6m 8s. Rate: 203.5 symbols/min [2025-09-05T19:12:58.436562] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:58.436964] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:58.437293] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:58.453591] [INFO ] [MAIN ] HLLY: Loaded 15701 primary data records. [2025-09-05T19:12:58.611502] [INFO ] [MAIN ] HLN: Loaded 25771 primary data records. [2025-09-05T19:12:58.633829] [INFO ] [MAIN ] HLT: Loaded 24283 primary data records. [2025-09-05T19:12:59.252381] [INFO ] [MAIN ] HLLY: Generated 871 derivative records from 15701 primary records. [2025-09-05T19:12:59.273385] [INFO ] [MAIN ] HLT: Generated 871 derivative records from 24283 primary records. [2025-09-05T19:12:59.273799] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-05T19:12:59.283562] [INFO ] [MAIN ] Derivative Progress: 871/2117 symbols completed. HLLY took 0.8s. Estimated remaining: 6m 8s. Rate: 203.1 symbols/min [2025-09-05T19:12:59.281362] [INFO ] [MAIN ] HLN: Generated 871 derivative records from 25771 primary records. [2025-09-05T19:12:59.284303] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:59.300820] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-05T19:12:59.303261] [INFO ] [MAIN ] Derivative Progress: 872/2117 symbols completed. HLN took 0.9s. Estimated remaining: 6m 7s. Rate: 203.3 symbols/min [2025-09-05T19:12:59.304156] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:59.305144] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-05T19:12:59.307147] [INFO ] [MAIN ] Derivative Progress: 873/2117 symbols completed. HLT took 0.9s. Estimated remaining: 6m 7s. Rate: 203.5 symbols/min [2025-09-05T19:12:59.307482] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:12:59.332790] [INFO ] [MAIN ] HMN: Loaded 11231 primary data records. [2025-09-05T19:12:59.437399] [INFO ] [MAIN ] HLX: Loaded 23155 primary data records. [2025-09-05T19:12:59.585706] [INFO ] [MAIN ] HMC: Loaded 22602 primary data records. [2025-09-05T19:13:00.086407] [INFO ] [MAIN ] HMN: Generated 871 derivative records from 11231 primary records. [2025-09-05T19:13:00.087600] [INFO ] [MAIN ] HLX: Generated 871 derivative records from 23155 primary records. [2025-09-05T19:13:00.110734] [INFO ] [MAIN ] HMC: Generated 871 derivative records from 22602 primary records. [2025-09-05T19:13:00.113351] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-05T19:13:00.114017] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-05T19:13:00.115452] [INFO ] [MAIN ] Derivative Progress: 874/2117 symbols completed. HLX took 0.8s. Estimated remaining: 6m 7s. Rate: 203.1 symbols/min [2025-09-05T19:13:00.120936] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:00.122392] [INFO ] [MAIN ] Derivative Progress: 875/2117 symbols completed. HMN took 0.8s. Estimated remaining: 6m 6s. Rate: 203.3 symbols/min [2025-09-05T19:13:00.124449] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:00.125949] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-05T19:13:00.127855] [INFO ] [MAIN ] Derivative Progress: 876/2117 symbols completed. HMC took 0.8s. Estimated remaining: 6m 6s. Rate: 203.6 symbols/min [2025-09-05T19:13:00.128145] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:00.174084] [INFO ] [MAIN ] HOMB: Loaded 21028 primary data records. [2025-09-05T19:13:00.174781] [INFO ] [MAIN ] HOG: Loaded 24491 primary data records. [2025-09-05T19:13:00.389173] [INFO ] [MAIN ] HMY: Loaded 39937 primary data records. [2025-09-05T19:13:01.003828] [INFO ] [MAIN ] HOG: Generated 871 derivative records from 24491 primary records. [2025-09-05T19:13:01.020193] [INFO ] [MAIN ] HOMB: Generated 871 derivative records from 21028 primary records. [2025-09-05T19:13:01.030747] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-05T19:13:01.032553] [INFO ] [MAIN ] Derivative Progress: 877/2117 symbols completed. HOG took 0.9s. Estimated remaining: 6m 6s. Rate: 203.1 symbols/min [2025-09-05T19:13:01.033339] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:01.033294] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-05T19:13:01.034811] [INFO ] [MAIN ] Derivative Progress: 878/2117 symbols completed. HOMB took 0.9s. Estimated remaining: 6m 6s. Rate: 203.3 symbols/min [2025-09-05T19:13:01.035141] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:01.052978] [INFO ] [MAIN ] HMY: Generated 1352 derivative records from 39937 primary records. [2025-09-05T19:13:01.068894] [INFO ] [MAIN ] HOV: Loaded 7996 primary data records. [2025-09-05T19:13:01.154459] [INFO ] [MAIN ] HOUS: Loaded 21453 primary data records. [2025-09-05T19:13:01.231809] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-05T19:13:01.276133] [INFO ] [MAIN ] Derivative Progress: 879/2117 symbols completed. HMY took 1.2s. Estimated remaining: 6m 5s. Rate: 203.4 symbols/min [2025-09-05T19:13:01.298455] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:01.589961] [INFO ] [MAIN ] HP: Loaded 25172 primary data records. [2025-09-05T19:13:01.700163] [INFO ] [MAIN ] HOV: Generated 871 derivative records from 7996 primary records. [2025-09-05T19:13:01.769129] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-05T19:13:01.785083] [INFO ] [MAIN ] Derivative Progress: 880/2117 symbols completed. HOV took 0.7s. Estimated remaining: 6m 5s. Rate: 203.2 symbols/min [2025-09-05T19:13:01.806999] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:01.877414] [INFO ] [MAIN ] HOUS: Generated 871 derivative records from 21453 primary records. [2025-09-05T19:13:01.887625] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-05T19:13:01.889213] [INFO ] [MAIN ] Derivative Progress: 881/2117 symbols completed. HOUS took 0.9s. Estimated remaining: 6m 5s. Rate: 203.3 symbols/min [2025-09-05T19:13:01.890540] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:01.912563] [INFO ] [MAIN ] HPP: Loaded 25253 primary data records. [2025-09-05T19:13:01.948153] [INFO ] [MAIN ] HP: Generated 871 derivative records from 25172 primary records. [2025-09-05T19:13:02.061525] [INFO ] [MAIN ] HPQ: Loaded 26046 primary data records. [2025-09-05T19:13:02.085996] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-05T19:13:02.092737] [INFO ] [MAIN ] Derivative Progress: 882/2117 symbols completed. HP took 0.8s. Estimated remaining: 6m 4s. Rate: 203.4 symbols/min [2025-09-05T19:13:02.201719] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:02.400174] [INFO ] [MAIN ] HPS: Loaded 5703 primary data records. [2025-09-05T19:13:02.702222] [INFO ] [MAIN ] HPP: Generated 871 derivative records from 25253 primary records. [2025-09-05T19:13:02.712780] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-05T19:13:02.714443] [INFO ] [MAIN ] Derivative Progress: 883/2117 symbols completed. HPP took 0.9s. Estimated remaining: 6m 4s. Rate: 203.2 symbols/min [2025-09-05T19:13:02.724261] [INFO ] [MAIN ] HPQ: Generated 871 derivative records from 26046 primary records. [2025-09-05T19:13:02.734470] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-05T19:13:02.736008] [INFO ] [MAIN ] Derivative Progress: 884/2117 symbols completed. HPQ took 0.8s. Estimated remaining: 6m 4s. Rate: 203.4 symbols/min [2025-09-05T19:13:02.743901] [INFO ] [MAIN ] HPS: Generated 871 derivative records from 5703 primary records. [2025-09-05T19:13:02.752170] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-05T19:13:02.753765] [INFO ] [MAIN ] Derivative Progress: 885/2117 symbols completed. HPS took 0.6s. Estimated remaining: 6m 3s. Rate: 203.6 symbols/min [2025-09-05T19:13:02.754278] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:02.754493] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:02.754455] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:02.774303] [INFO ] [MAIN ] HQL: Loaded 12005 primary data records. [2025-09-05T19:13:02.904145] [INFO ] [MAIN ] HQH: Loaded 19310 primary data records. [2025-09-05T19:13:02.905058] [INFO ] [MAIN ] HR: Loaded 25316 primary data records. [2025-09-05T19:13:03.665373] [INFO ] [MAIN ] HR: Generated 871 derivative records from 25316 primary records. [2025-09-05T19:13:03.673305] [INFO ] [MAIN ] HQL: Generated 1352 derivative records from 12005 primary records. [2025-09-05T19:13:03.683544] [INFO ] [MAIN ] HQH: Generated 1352 derivative records from 19310 primary records. [2025-09-05T19:13:03.718609] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-05T19:13:03.721538] [INFO ] [MAIN ] Derivative Progress: 886/2117 symbols completed. HR took 1.0s. Estimated remaining: 6m 4s. Rate: 203.1 symbols/min [2025-09-05T19:13:03.722633] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:03.724752] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-05T19:13:03.729074] [INFO ] [MAIN ] Derivative Progress: 887/2117 symbols completed. HQH took 1.0s. Estimated remaining: 6m 3s. Rate: 203.3 symbols/min [2025-09-05T19:13:03.729780] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:03.732683] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-05T19:13:03.735727] [INFO ] [MAIN ] Derivative Progress: 888/2117 symbols completed. HQL took 1.0s. Estimated remaining: 6m 2s. Rate: 203.5 symbols/min [2025-09-05T19:13:03.736180] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:03.766035] [INFO ] [MAIN ] HSHP: Loaded 10641 primary data records. [2025-09-05T19:13:03.766725] [INFO ] [MAIN ] HRB: Loaded 23394 primary data records. [2025-09-05T19:13:04.034653] [INFO ] [MAIN ] HRL: Loaded 39961 primary data records. [2025-09-05T19:13:04.607021] [INFO ] [MAIN ] HRB: Generated 871 derivative records from 23394 primary records. [2025-09-05T19:13:04.617236] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-05T19:13:04.618581] [INFO ] [MAIN ] Derivative Progress: 889/2117 symbols completed. HRB took 0.9s. Estimated remaining: 6m 3s. Rate: 203.1 symbols/min [2025-09-05T19:13:04.629214] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:04.634755] [INFO ] [MAIN ] HSHP: Generated 1352 derivative records from 10641 primary records. [2025-09-05T19:13:04.653597] [INFO ] [MAIN ] HRL: Generated 1352 derivative records from 39961 primary records. [2025-09-05T19:13:04.670953] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-05T19:13:04.672654] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-05T19:13:04.675203] [INFO ] [MAIN ] Derivative Progress: 890/2117 symbols completed. HRL took 0.9s. Estimated remaining: 6m 2s. Rate: 203.2 symbols/min [2025-09-05T19:13:04.677993] [INFO ] [MAIN ] Derivative Progress: 891/2117 symbols completed. HSHP took 0.9s. Estimated remaining: 6m 2s. Rate: 203.5 symbols/min [2025-09-05T19:13:04.677925] [INFO ] [MAIN ] HTB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:04.678598] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:04.685370] [INFO ] [MAIN ] HTB: Loaded 5192 primary data records. [2025-09-05T19:13:04.788431] [INFO ] [MAIN ] HTD: Loaded 10024 primary data records. [2025-09-05T19:13:04.992812] [INFO ] [MAIN ] HSY: Loaded 38106 primary data records. [2025-09-05T19:13:05.567112] [INFO ] [MAIN ] HTB: Generated 1352 derivative records from 5192 primary records. [2025-09-05T19:13:05.567949] [INFO ] [MAIN ] HTD: Generated 1352 derivative records from 10024 primary records. [2025-09-05T19:13:05.595937] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-05T19:13:05.602161] [INFO ] [MAIN ] Derivative Progress: 892/2117 symbols completed. HTD took 0.9s. Estimated remaining: 6m 2s. Rate: 203.0 symbols/min [2025-09-05T19:13:05.603274] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:05.603717] [INFO ] [MAIN ] HTB: Successfully saved derivative data. [2025-09-05T19:13:05.606306] [INFO ] [MAIN ] Derivative Progress: 893/2117 symbols completed. HTB took 0.9s. Estimated remaining: 6m 1s. Rate: 203.2 symbols/min [2025-09-05T19:13:05.617733] [INFO ] [MAIN ] HSY: Generated 1352 derivative records from 38106 primary records. [2025-09-05T19:13:05.616894] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:05.636388] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-05T19:13:05.638823] [INFO ] [MAIN ] Derivative Progress: 894/2117 symbols completed. HSY took 1.0s. Estimated remaining: 6m 1s. Rate: 203.4 symbols/min [2025-09-05T19:13:05.639126] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:05.647950] [INFO ] [MAIN ] HTH: Loaded 16696 primary data records. [2025-09-05T19:13:05.803879] [INFO ] [MAIN ] HUBS: Loaded 19175 primary data records. [2025-09-05T19:13:05.871789] [INFO ] [MAIN ] HUN: Loaded 25804 primary data records. [2025-09-05T19:13:06.444090] [INFO ] [MAIN ] HTH: Generated 871 derivative records from 16696 primary records. [2025-09-05T19:13:06.456490] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-05T19:13:06.457964] [INFO ] [MAIN ] Derivative Progress: 895/2117 symbols completed. HTH took 0.9s. Estimated remaining: 6m 1s. Rate: 203.0 symbols/min [2025-09-05T19:13:06.464757] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:06.465696] [INFO ] [MAIN ] HUBS: Generated 871 derivative records from 19175 primary records. [2025-09-05T19:13:06.477226] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-05T19:13:06.487960] [INFO ] [MAIN ] Derivative Progress: 896/2117 symbols completed. HUBS took 0.9s. Estimated remaining: 6m 1s. Rate: 203.2 symbols/min [2025-09-05T19:13:06.489072] [INFO ] [MAIN ] HUN: Generated 871 derivative records from 25804 primary records. [2025-09-05T19:13:06.489408] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:06.504343] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-05T19:13:06.506072] [INFO ] [MAIN ] Derivative Progress: 897/2117 symbols completed. HUN took 0.9s. Estimated remaining: 5m 60s. Rate: 203.4 symbols/min [2025-09-05T19:13:06.506268] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:06.515681] [INFO ] [MAIN ] HUYA: Loaded 21586 primary data records. [2025-09-05T19:13:06.653438] [INFO ] [MAIN ] HXL: Loaded 22092 primary data records. [2025-09-05T19:13:06.814486] [INFO ] [MAIN ] HWM: Loaded 39958 primary data records. [2025-09-05T19:13:07.304282] [INFO ] [MAIN ] HUYA: Generated 871 derivative records from 21586 primary records. [2025-09-05T19:13:07.314952] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-05T19:13:07.322212] [INFO ] [MAIN ] Derivative Progress: 898/2117 symbols completed. HUYA took 0.9s. Estimated remaining: 6m 0s. Rate: 203.0 symbols/min [2025-09-05T19:13:07.323137] [INFO ] [MAIN ] HXL: Generated 871 derivative records from 22092 primary records. [2025-09-05T19:13:07.332673] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-05T19:13:07.334352] [INFO ] [MAIN ] Derivative Progress: 899/2117 symbols completed. HXL took 0.8s. Estimated remaining: 5m 60s. Rate: 203.2 symbols/min [2025-09-05T19:13:07.347339] [INFO ] [MAIN ] HWM: Generated 1352 derivative records from 39958 primary records. [2025-09-05T19:13:07.359427] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-05T19:13:07.362796] [INFO ] [MAIN ] Derivative Progress: 900/2117 symbols completed. HWM took 0.9s. Estimated remaining: 5m 59s. Rate: 203.4 symbols/min [2025-09-05T19:13:07.363391] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:07.363316] [INFO ] [MAIN ] HYBX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:07.363267] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:07.366381] [INFO ] [MAIN ] HYBX: Loaded 258 primary data records. [2025-09-05T19:13:07.459689] [INFO ] [MAIN ] HYI: Loaded 6704 primary data records. [2025-09-05T19:13:07.478715] [INFO ] [MAIN ] HY: Loaded 7342 primary data records. [2025-09-05T19:13:08.179211] [INFO ] [MAIN ] HYBX: Generated 871 derivative records from 258 primary records. [2025-09-05T19:13:08.186629] [INFO ] [MAIN ] HYBX: Successfully saved derivative data. [2025-09-05T19:13:08.187924] [INFO ] [MAIN ] Derivative Progress: 901/2117 symbols completed. HYBX took 0.8s. Estimated remaining: 5m 59s. Rate: 203.0 symbols/min [2025-09-05T19:13:08.188557] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:08.203895] [INFO ] [MAIN ] HYI: Generated 1352 derivative records from 6704 primary records. [2025-09-05T19:13:08.234887] [INFO ] [MAIN ] HY: Generated 1352 derivative records from 7342 primary records. [2025-09-05T19:13:08.236143] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-05T19:13:08.239406] [INFO ] [MAIN ] Derivative Progress: 902/2117 symbols completed. HYI took 0.9s. Estimated remaining: 5m 59s. Rate: 203.2 symbols/min [2025-09-05T19:13:08.253720] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:08.259860] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-05T19:13:08.259773] [INFO ] [MAIN ] HZO: Loaded 21809 primary data records. [2025-09-05T19:13:08.262792] [INFO ] [MAIN ] Derivative Progress: 903/2117 symbols completed. HY took 0.9s. Estimated remaining: 5m 58s. Rate: 203.4 symbols/min [2025-09-05T19:13:08.274322] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:08.602065] [INFO ] [MAIN ] IBM: Loaded 26054 primary data records. [2025-09-05T19:13:08.603994] [INFO ] [MAIN ] IAG: Loaded 40236 primary data records. [2025-09-05T19:13:09.134776] [INFO ] [MAIN ] HZO: Generated 1352 derivative records from 21809 primary records. [2025-09-05T19:13:09.149986] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-05T19:13:09.152525] [INFO ] [MAIN ] Derivative Progress: 904/2117 symbols completed. HZO took 1.0s. Estimated remaining: 5m 59s. Rate: 203.0 symbols/min [2025-09-05T19:13:09.152990] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:09.166094] [INFO ] [MAIN ] IBM: Generated 871 derivative records from 26054 primary records. [2025-09-05T19:13:09.184298] [INFO ] [MAIN ] IAG: Generated 1352 derivative records from 40236 primary records. [2025-09-05T19:13:09.193075] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-05T19:13:09.194955] [INFO ] [MAIN ] Derivative Progress: 905/2117 symbols completed. IBM took 0.9s. Estimated remaining: 5m 58s. Rate: 203.2 symbols/min [2025-09-05T19:13:09.200658] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:09.206872] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-05T19:13:09.216475] [INFO ] [MAIN ] Derivative Progress: 906/2117 symbols completed. IAG took 1.0s. Estimated remaining: 5m 57s. Rate: 203.4 symbols/min [2025-09-05T19:13:09.217953] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:09.218618] [INFO ] [MAIN ] IBN: Loaded 25572 primary data records. [2025-09-05T19:13:09.367949] [INFO ] [MAIN ] IBP: Loaded 22158 primary data records. [2025-09-05T19:13:09.603614] [INFO ] [MAIN ] IBTA: Loaded 26929 primary data records. [2025-09-05T19:13:10.049874] [INFO ] [MAIN ] IBN: Generated 871 derivative records from 25572 primary records. [2025-09-05T19:13:10.060154] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-05T19:13:10.061452] [INFO ] [MAIN ] Derivative Progress: 907/2117 symbols completed. IBN took 0.9s. Estimated remaining: 5m 58s. Rate: 203.0 symbols/min [2025-09-05T19:13:10.061960] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:10.075714] [INFO ] [MAIN ] IBP: Generated 1352 derivative records from 22158 primary records. [2025-09-05T19:13:10.091011] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-05T19:13:10.093407] [INFO ] [MAIN ] Derivative Progress: 908/2117 symbols completed. IBP took 0.9s. Estimated remaining: 5m 57s. Rate: 203.2 symbols/min [2025-09-05T19:13:10.099588] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:10.112399] [INFO ] [MAIN ] IBTA: Generated 1352 derivative records from 26929 primary records. [2025-09-05T19:13:10.125413] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-05T19:13:10.135434] [INFO ] [MAIN ] Derivative Progress: 909/2117 symbols completed. IBTA took 0.9s. Estimated remaining: 5m 56s. Rate: 203.4 symbols/min [2025-09-05T19:13:10.137326] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:10.137440] [INFO ] [MAIN ] ICE: Loaded 25580 primary data records. [2025-09-05T19:13:10.260029] [INFO ] [MAIN ] ICL: Loaded 18397 primary data records. [2025-09-05T19:13:10.372114] [INFO ] [MAIN ] IDA: Loaded 16388 primary data records. [2025-09-05T19:13:10.951802] [INFO ] [MAIN ] ICE: Generated 871 derivative records from 25580 primary records. [2025-09-05T19:13:10.967100] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-05T19:13:10.969351] [INFO ] [MAIN ] Derivative Progress: 910/2117 symbols completed. ICE took 0.9s. Estimated remaining: 5m 57s. Rate: 203.0 symbols/min [2025-09-05T19:13:10.970071] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:10.984413] [INFO ] [MAIN ] ICL: Generated 871 derivative records from 18397 primary records. [2025-09-05T19:13:10.996539] [INFO ] [MAIN ] IDA: Generated 871 derivative records from 16388 primary records. [2025-09-05T19:13:10.995381] [INFO ] [MAIN ] IDE: Loaded 4509 primary data records. [2025-09-05T19:13:11.045853] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-05T19:13:11.051501] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-05T19:13:11.058410] [INFO ] [MAIN ] Derivative Progress: 911/2117 symbols completed. ICL took 1.0s. Estimated remaining: 5m 56s. Rate: 203.1 symbols/min [2025-09-05T19:13:11.066809] [INFO ] [MAIN ] Derivative Progress: 912/2117 symbols completed. IDA took 0.9s. Estimated remaining: 5m 56s. Rate: 203.3 symbols/min [2025-09-05T19:13:11.066746] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:11.091896] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:11.213197] [INFO ] [MAIN ] IDT: Loaded 8959 primary data records. [2025-09-05T19:13:11.359484] [INFO ] [MAIN ] IFN: Loaded 14114 primary data records. [2025-09-05T19:13:11.807380] [INFO ] [MAIN ] IDE: Generated 871 derivative records from 4509 primary records. [2025-09-05T19:13:11.819698] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-05T19:13:11.823062] [INFO ] [MAIN ] Derivative Progress: 913/2117 symbols completed. IDE took 0.9s. Estimated remaining: 5m 56s. Rate: 203.0 symbols/min [2025-09-05T19:13:11.830623] [INFO ] [MAIN ] IDT: Generated 871 derivative records from 8959 primary records. [2025-09-05T19:13:11.839872] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-05T19:13:11.841375] [INFO ] [MAIN ] Derivative Progress: 914/2117 symbols completed. IDT took 0.8s. Estimated remaining: 5m 55s. Rate: 203.2 symbols/min [2025-09-05T19:13:11.852666] [INFO ] [MAIN ] IFN: Generated 1352 derivative records from 14114 primary records. [2025-09-05T19:13:11.864694] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-05T19:13:11.867192] [INFO ] [MAIN ] Derivative Progress: 915/2117 symbols completed. IFN took 0.8s. Estimated remaining: 5m 55s. Rate: 203.4 symbols/min [2025-09-05T19:13:11.867882] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:11.867845] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:11.868001] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:11.879081] [INFO ] [MAIN ] IGA: Loaded 7202 primary data records. [2025-09-05T19:13:11.940779] [INFO ] [MAIN ] IGD: Loaded 9582 primary data records. [2025-09-05T19:13:12.024202] [INFO ] [MAIN ] IFS: Loaded 10821 primary data records. [2025-09-05T19:13:12.643826] [INFO ] [MAIN ] IGD: Generated 871 derivative records from 9582 primary records. [2025-09-05T19:13:12.656064] [INFO ] [MAIN ] IGA: Generated 1352 derivative records from 7202 primary records. [2025-09-05T19:13:12.663591] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-05T19:13:12.665285] [INFO ] [MAIN ] Derivative Progress: 916/2117 symbols completed. IGD took 0.8s. Estimated remaining: 5m 55s. Rate: 203.0 symbols/min [2025-09-05T19:13:12.666365] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:12.678738] [INFO ] [MAIN ] IFS: Generated 871 derivative records from 10821 primary records. [2025-09-05T19:13:12.690116] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-05T19:13:12.693661] [INFO ] [MAIN ] Derivative Progress: 917/2117 symbols completed. IGA took 0.8s. Estimated remaining: 5m 54s. Rate: 203.2 symbols/min [2025-09-05T19:13:12.697012] [INFO ] [MAIN ] IGI: Loaded 2271 primary data records. [2025-09-05T19:13:12.708656] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:12.718240] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-05T19:13:12.743873] [INFO ] [MAIN ] Derivative Progress: 918/2117 symbols completed. IFS took 0.9s. Estimated remaining: 5m 54s. Rate: 203.4 symbols/min [2025-09-05T19:13:12.772618] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:12.900271] [INFO ] [MAIN ] IH: Loaded 1635 primary data records. [2025-09-05T19:13:12.910530] [INFO ] [MAIN ] IGR: Loaded 15441 primary data records. [2025-09-05T19:13:13.491742] [INFO ] [MAIN ] IGI: Generated 871 derivative records from 2271 primary records. [2025-09-05T19:13:13.500068] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-05T19:13:13.501511] [INFO ] [MAIN ] Derivative Progress: 919/2117 symbols completed. IGI took 0.8s. Estimated remaining: 5m 54s. Rate: 203.0 symbols/min [2025-09-05T19:13:13.502061] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:13.509143] [INFO ] [MAIN ] IHD: Loaded 3083 primary data records. [2025-09-05T19:13:13.521937] [INFO ] [MAIN ] IGR: Generated 871 derivative records from 15441 primary records. [2025-09-05T19:13:13.543714] [INFO ] [MAIN ] IH: Generated 870 derivative records from 1635 primary records. [2025-09-05T19:13:13.651930] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-05T19:13:13.669435] [INFO ] [MAIN ] Derivative Progress: 920/2117 symbols completed. IH took 0.9s. Estimated remaining: 5m 54s. Rate: 203.1 symbols/min [2025-09-05T19:13:13.684789] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:13.716371] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-05T19:13:13.777393] [INFO ] [MAIN ] Derivative Progress: 921/2117 symbols completed. IGR took 1.1s. Estimated remaining: 5m 53s. Rate: 203.3 symbols/min [2025-09-05T19:13:13.778179] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:13.793717] [INFO ] [MAIN ] IHG: Loaded 11292 primary data records. [2025-09-05T19:13:13.842732] [INFO ] [MAIN ] IHD: Generated 871 derivative records from 3083 primary records. [2025-09-05T19:13:13.901948] [INFO ] [MAIN ] IHS: Loaded 18869 primary data records. [2025-09-05T19:13:13.969331] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-05T19:13:13.980905] [INFO ] [MAIN ] Derivative Progress: 922/2117 symbols completed. IHD took 0.5s. Estimated remaining: 5m 53s. Rate: 203.4 symbols/min [2025-09-05T19:13:14.152890] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:14.240245] [INFO ] [MAIN ] IIF: Loaded 2647 primary data records. [2025-09-05T19:13:14.545008] [INFO ] [MAIN ] IHG: Generated 871 derivative records from 11292 primary records. [2025-09-05T19:13:14.557802] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-05T19:13:14.559199] [INFO ] [MAIN ] Derivative Progress: 923/2117 symbols completed. IHG took 0.9s. Estimated remaining: 5m 53s. Rate: 203.1 symbols/min [2025-09-05T19:13:14.559551] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:14.567461] [INFO ] [MAIN ] IHS: Generated 871 derivative records from 18869 primary records. [2025-09-05T19:13:14.579748] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-05T19:13:14.581457] [INFO ] [MAIN ] Derivative Progress: 924/2117 symbols completed. IHS took 0.8s. Estimated remaining: 5m 52s. Rate: 203.3 symbols/min [2025-09-05T19:13:14.581753] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:14.586663] [INFO ] [MAIN ] IIIN: Loaded 7481 primary data records. [2025-09-05T19:13:14.693781] [INFO ] [MAIN ] IIF: Generated 871 derivative records from 2647 primary records. [2025-09-05T19:13:14.701223] [INFO ] [MAIN ] IIM: Loaded 7774 primary data records. [2025-09-05T19:13:14.854138] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-05T19:13:14.896738] [INFO ] [MAIN ] Derivative Progress: 925/2117 symbols completed. IIF took 0.8s. Estimated remaining: 5m 52s. Rate: 203.3 symbols/min [2025-09-05T19:13:14.897184] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:15.098189] [INFO ] [MAIN ] IIPR: Loaded 14084 primary data records. [2025-09-05T19:13:15.237125] [INFO ] [MAIN ] IIIN: Generated 871 derivative records from 7481 primary records. [2025-09-05T19:13:15.363493] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-05T19:13:15.365871] [INFO ] [MAIN ] Derivative Progress: 926/2117 symbols completed. IIIN took 0.8s. Estimated remaining: 5m 52s. Rate: 203.2 symbols/min [2025-09-05T19:13:15.364476] [INFO ] [MAIN ] IIM: Generated 871 derivative records from 7774 primary records. [2025-09-05T19:13:15.366794] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:15.377845] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-05T19:13:15.379534] [INFO ] [MAIN ] Derivative Progress: 927/2117 symbols completed. IIM took 0.8s. Estimated remaining: 5m 51s. Rate: 203.4 symbols/min [2025-09-05T19:13:15.380315] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:15.409331] [INFO ] [MAIN ] IIPR: Generated 871 derivative records from 14084 primary records. [2025-09-05T19:13:15.408282] [INFO ] [MAIN ] IMAX: Loaded 20980 primary data records. [2025-09-05T19:13:15.533719] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-05T19:13:15.552095] [INFO ] [MAIN ] Derivative Progress: 928/2117 symbols completed. IIPR took 0.7s. Estimated remaining: 5m 51s. Rate: 203.5 symbols/min [2025-09-05T19:13:15.671048] [INFO ] [MAIN ] INFA: Loaded 37786 primary data records. [2025-09-05T19:13:15.953754] [INFO ] [MAIN ] IMAX: Generated 871 derivative records from 20980 primary records. [2025-09-05T19:13:15.963457] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-05T19:13:15.964799] [INFO ] [MAIN ] Derivative Progress: 929/2117 symbols completed. IMAX took 0.6s. Estimated remaining: 5m 50s. Rate: 203.4 symbols/min [2025-09-05T19:13:15.978616] [INFO ] [MAIN ] INFA: Generated 1352 derivative records from 37786 primary records. [2025-09-05T19:13:15.990613] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-05T19:13:15.993835] [INFO ] [MAIN ] Derivative Progress: 930/2117 symbols completed. INFA took 0.6s. Estimated remaining: 5m 50s. Rate: 203.6 symbols/min [2025-09-05T19:13:15.994278] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:15.994351] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:15.994495] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:16.022090] [INFO ] [MAIN ] INGM: Loaded 13159 primary data records. [2025-09-05T19:13:16.128410] [INFO ] [MAIN ] INFY: Loaded 26008 primary data records. [2025-09-05T19:13:16.218346] [INFO ] [MAIN ] ING: Loaded 24510 primary data records. [2025-09-05T19:13:16.791123] [INFO ] [MAIN ] INGM: Generated 871 derivative records from 13159 primary records. [2025-09-05T19:13:16.801948] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-05T19:13:16.803356] [INFO ] [MAIN ] Derivative Progress: 931/2117 symbols completed. INGM took 0.8s. Estimated remaining: 5m 50s. Rate: 203.2 symbols/min [2025-09-05T19:13:16.809746] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:16.810506] [INFO ] [MAIN ] INFY: Generated 871 derivative records from 26008 primary records. [2025-09-05T19:13:16.826559] [INFO ] [MAIN ] ING: Generated 871 derivative records from 24510 primary records. [2025-09-05T19:13:16.828064] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-05T19:13:16.829628] [INFO ] [MAIN ] Derivative Progress: 932/2117 symbols completed. INFY took 0.8s. Estimated remaining: 5m 50s. Rate: 203.4 symbols/min [2025-09-05T19:13:16.830387] [INFO ] [MAIN ] INR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:16.843171] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-05T19:13:16.844935] [INFO ] [MAIN ] Derivative Progress: 933/2117 symbols completed. ING took 0.9s. Estimated remaining: 5m 49s. Rate: 203.6 symbols/min [2025-09-05T19:13:16.845241] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:16.855912] [INFO ] [MAIN ] INGR: Loaded 15662 primary data records. [2025-09-05T19:13:16.946105] [INFO ] [MAIN ] INR: Loaded 13209 primary data records. [2025-09-05T19:13:17.113733] [INFO ] [MAIN ] INSP: Loaded 19106 primary data records. [2025-09-05T19:13:17.587880] [INFO ] [MAIN ] INGR: Generated 871 derivative records from 15662 primary records. [2025-09-05T19:13:17.597608] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-05T19:13:17.599077] [INFO ] [MAIN ] Derivative Progress: 934/2117 symbols completed. INGR took 0.8s. Estimated remaining: 5m 49s. Rate: 203.3 symbols/min [2025-09-05T19:13:17.599478] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:17.610345] [INFO ] [MAIN ] INR: Generated 871 derivative records from 13209 primary records. [2025-09-05T19:13:17.629333] [INFO ] [MAIN ] INSP: Generated 871 derivative records from 19106 primary records. [2025-09-05T19:13:17.628455] [INFO ] [MAIN ] INR: Successfully saved derivative data. [2025-09-05T19:13:17.637501] [INFO ] [MAIN ] Derivative Progress: 935/2117 symbols completed. INR took 0.8s. Estimated remaining: 5m 49s. Rate: 203.5 symbols/min [2025-09-05T19:13:17.637708] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:17.657312] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-05T19:13:17.660982] [INFO ] [MAIN ] INVX: Loaded 22558 primary data records. [2025-09-05T19:13:17.660172] [INFO ] [MAIN ] Derivative Progress: 936/2117 symbols completed. INSP took 0.8s. Estimated remaining: 5m 48s. Rate: 203.7 symbols/min [2025-09-05T19:13:17.672601] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:17.954979] [INFO ] [MAIN ] IONQ: Loaded 40528 primary data records. [2025-09-05T19:13:17.989563] [INFO ] [MAIN ] IOT: Loaded 26028 primary data records. [2025-09-05T19:13:18.489011] [INFO ] [MAIN ] INVX: Generated 1352 derivative records from 22558 primary records. [2025-09-05T19:13:18.505485] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-05T19:13:18.508109] [INFO ] [MAIN ] Derivative Progress: 937/2117 symbols completed. INVX took 0.9s. Estimated remaining: 5m 48s. Rate: 203.3 symbols/min [2025-09-05T19:13:18.508538] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:18.521462] [INFO ] [MAIN ] IOT: Generated 871 derivative records from 26028 primary records. [2025-09-05T19:13:18.546269] [INFO ] [MAIN ] IONQ: Generated 1352 derivative records from 40528 primary records. [2025-09-05T19:13:18.562172] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-05T19:13:18.564610] [INFO ] [MAIN ] Derivative Progress: 938/2117 symbols completed. IOT took 0.9s. Estimated remaining: 5m 48s. Rate: 203.5 symbols/min [2025-09-05T19:13:18.573879] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-05T19:13:18.576240] [INFO ] [MAIN ] Derivative Progress: 939/2117 symbols completed. IONQ took 0.9s. Estimated remaining: 5m 47s. Rate: 203.7 symbols/min [2025-09-05T19:13:18.577364] [INFO ] [MAIN ] IP: Loaded 25810 primary data records. [2025-09-05T19:13:18.576331] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:18.577607] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:18.753962] [INFO ] [MAIN ] IQI: Loaded 9082 primary data records. [2025-09-05T19:13:18.756350] [INFO ] [MAIN ] IPI: Loaded 15859 primary data records. [2025-09-05T19:13:19.403977] [INFO ] [MAIN ] IP: Generated 871 derivative records from 25810 primary records. [2025-09-05T19:13:19.416942] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-05T19:13:19.418397] [INFO ] [MAIN ] Derivative Progress: 940/2117 symbols completed. IP took 0.9s. Estimated remaining: 5m 47s. Rate: 203.3 symbols/min [2025-09-05T19:13:19.418746] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:19.426811] [INFO ] [MAIN ] IQI: Generated 871 derivative records from 9082 primary records. [2025-09-05T19:13:19.437520] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-05T19:13:19.439385] [INFO ] [MAIN ] Derivative Progress: 941/2117 symbols completed. IQI took 0.9s. Estimated remaining: 5m 47s. Rate: 203.5 symbols/min [2025-09-05T19:13:19.445457] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:19.450118] [INFO ] [MAIN ] IPI: Generated 1352 derivative records from 15859 primary records. [2025-09-05T19:13:19.478356] [INFO ] [MAIN ] IQV: Loaded 24209 primary data records. [2025-09-05T19:13:19.479117] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-05T19:13:19.481781] [INFO ] [MAIN ] Derivative Progress: 942/2117 symbols completed. IPI took 0.9s. Estimated remaining: 5m 46s. Rate: 203.6 symbols/min [2025-09-05T19:13:19.531850] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:19.599981] [INFO ] [MAIN ] IR: Loaded 25416 primary data records. [2025-09-05T19:13:19.859572] [INFO ] [MAIN ] IRM: Loaded 23453 primary data records. [2025-09-05T19:13:20.260374] [INFO ] [MAIN ] IQV: Generated 871 derivative records from 24209 primary records. [2025-09-05T19:13:20.271960] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-05T19:13:20.273466] [INFO ] [MAIN ] Derivative Progress: 943/2117 symbols completed. IQV took 0.9s. Estimated remaining: 5m 47s. Rate: 203.3 symbols/min [2025-09-05T19:13:20.280541] [INFO ] [MAIN ] IR: Generated 871 derivative records from 25416 primary records. [2025-09-05T19:13:20.291907] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-05T19:13:20.293752] [INFO ] [MAIN ] Derivative Progress: 944/2117 symbols completed. IR took 0.9s. Estimated remaining: 5m 46s. Rate: 203.5 symbols/min [2025-09-05T19:13:20.300779] [INFO ] [MAIN ] IRM: Generated 871 derivative records from 23453 primary records. [2025-09-05T19:13:20.309437] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-05T19:13:20.311245] [INFO ] [MAIN ] Derivative Progress: 945/2117 symbols completed. IRM took 0.8s. Estimated remaining: 5m 45s. Rate: 203.7 symbols/min [2025-09-05T19:13:20.311682] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:20.311804] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:20.312548] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:20.324810] [INFO ] [MAIN ] ISD: Loaded 7286 primary data records. [2025-09-05T19:13:20.365211] [INFO ] [MAIN ] IRS: Loaded 10614 primary data records. [2025-09-05T19:13:20.810868] [INFO ] [MAIN ] IRT: Loaded 37998 primary data records. [2025-09-05T19:13:21.101932] [INFO ] [MAIN ] ISD: Generated 871 derivative records from 7286 primary records. [2025-09-05T19:13:21.120967] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-05T19:13:21.123233] [INFO ] [MAIN ] Derivative Progress: 946/2117 symbols completed. ISD took 0.8s. Estimated remaining: 5m 46s. Rate: 203.3 symbols/min [2025-09-05T19:13:21.121980] [INFO ] [MAIN ] IRS: Generated 871 derivative records from 10614 primary records. [2025-09-05T19:13:21.123784] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:21.133173] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-05T19:13:21.134908] [INFO ] [MAIN ] Derivative Progress: 947/2117 symbols completed. IRS took 0.8s. Estimated remaining: 5m 45s. Rate: 203.5 symbols/min [2025-09-05T19:13:21.135272] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:21.148619] [INFO ] [MAIN ] IRT: Generated 1352 derivative records from 37998 primary records. [2025-09-05T19:13:21.177587] [INFO ] [MAIN ] ITGR: Loaded 13573 primary data records. [2025-09-05T19:13:21.189836] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-05T19:13:21.211538] [INFO ] [MAIN ] Derivative Progress: 948/2117 symbols completed. IRT took 0.9s. Estimated remaining: 5m 44s. Rate: 203.7 symbols/min [2025-09-05T19:13:21.265442] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:21.291372] [INFO ] [MAIN ] IT: Loaded 30866 primary data records. [2025-09-05T19:13:21.650431] [INFO ] [MAIN ] ITT: Loaded 24843 primary data records. [2025-09-05T19:13:22.021683] [INFO ] [MAIN ] ITGR: Generated 871 derivative records from 13573 primary records. [2025-09-05T19:13:22.030682] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-05T19:13:22.032211] [INFO ] [MAIN ] Derivative Progress: 949/2117 symbols completed. ITGR took 0.9s. Estimated remaining: 5m 45s. Rate: 203.3 symbols/min [2025-09-05T19:13:22.034903] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:22.045631] [INFO ] [MAIN ] IT: Generated 1351 derivative records from 30866 primary records. [2025-09-05T19:13:22.060927] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-05T19:13:22.063466] [INFO ] [MAIN ] Derivative Progress: 950/2117 symbols completed. IT took 0.9s. Estimated remaining: 5m 44s. Rate: 203.5 symbols/min [2025-09-05T19:13:22.063742] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:22.082152] [INFO ] [MAIN ] ITT: Generated 1352 derivative records from 24843 primary records. [2025-09-05T19:13:22.110040] [INFO ] [MAIN ] ITUB: Loaded 25887 primary data records. [2025-09-05T19:13:22.104495] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-05T19:13:22.144722] [INFO ] [MAIN ] Derivative Progress: 951/2117 symbols completed. ITT took 0.9s. Estimated remaining: 5m 44s. Rate: 203.6 symbols/min [2025-09-05T19:13:22.194233] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:22.223139] [INFO ] [MAIN ] ITW: Loaded 21838 primary data records. [2025-09-05T19:13:22.549232] [INFO ] [MAIN ] IVR: Loaded 22874 primary data records. [2025-09-05T19:13:22.861199] [INFO ] [MAIN ] ITUB: Generated 871 derivative records from 25887 primary records. [2025-09-05T19:13:22.871872] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-05T19:13:22.880161] [INFO ] [MAIN ] Derivative Progress: 952/2117 symbols completed. ITUB took 0.8s. Estimated remaining: 5m 44s. Rate: 203.3 symbols/min [2025-09-05T19:13:22.878892] [INFO ] [MAIN ] ITW: Generated 871 derivative records from 21838 primary records. [2025-09-05T19:13:22.880565] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:22.890780] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-05T19:13:22.893066] [INFO ] [MAIN ] Derivative Progress: 953/2117 symbols completed. ITW took 0.8s. Estimated remaining: 5m 43s. Rate: 203.5 symbols/min [2025-09-05T19:13:22.894572] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:22.907073] [INFO ] [MAIN ] IVR: Generated 871 derivative records from 22874 primary records. [2025-09-05T19:13:22.916626] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-05T19:13:22.922003] [INFO ] [MAIN ] IVT: Loaded 14770 primary data records. [2025-09-05T19:13:22.923684] [INFO ] [MAIN ] Derivative Progress: 954/2117 symbols completed. IVR took 0.7s. Estimated remaining: 5m 43s. Rate: 203.7 symbols/min [2025-09-05T19:13:22.954602] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:23.063921] [INFO ] [MAIN ] IVZ: Loaded 25730 primary data records. [2025-09-05T19:13:23.296934] [INFO ] [MAIN ] IX: Loaded 17473 primary data records. [2025-09-05T19:13:23.708033] [INFO ] [MAIN ] IVT: Generated 871 derivative records from 14770 primary records. [2025-09-05T19:13:23.718463] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-05T19:13:23.720201] [INFO ] [MAIN ] Derivative Progress: 955/2117 symbols completed. IVT took 0.8s. Estimated remaining: 5m 43s. Rate: 203.3 symbols/min [2025-09-05T19:13:23.720490] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:23.732595] [INFO ] [MAIN ] IVZ: Generated 871 derivative records from 25730 primary records. [2025-09-05T19:13:23.741216] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-05T19:13:23.743438] [INFO ] [MAIN ] Derivative Progress: 956/2117 symbols completed. IVZ took 0.8s. Estimated remaining: 5m 42s. Rate: 203.5 symbols/min [2025-09-05T19:13:23.744433] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:23.764985] [INFO ] [MAIN ] IX: Generated 1352 derivative records from 17473 primary records. [2025-09-05T19:13:23.782716] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-05T19:13:23.794517] [INFO ] [MAIN ] Derivative Progress: 957/2117 symbols completed. IX took 0.8s. Estimated remaining: 5m 42s. Rate: 203.7 symbols/min [2025-09-05T19:13:23.794835] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:23.796063] [INFO ] [MAIN ] J: Loaded 30001 primary data records. [2025-09-05T19:13:23.866277] [INFO ] [MAIN ] JBI: Loaded 20386 primary data records. [2025-09-05T19:13:24.233730] [INFO ] [MAIN ] JBL: Loaded 23683 primary data records. [2025-09-05T19:13:24.625105] [INFO ] [MAIN ] J: Generated 1352 derivative records from 30001 primary records. [2025-09-05T19:13:24.624383] [INFO ] [MAIN ] JBI: Generated 871 derivative records from 20386 primary records. [2025-09-05T19:13:24.645852] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-05T19:13:24.650334] [INFO ] [MAIN ] Derivative Progress: 958/2117 symbols completed. J took 0.9s. Estimated remaining: 5m 42s. Rate: 203.3 symbols/min [2025-09-05T19:13:24.651255] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-05T19:13:24.653068] [INFO ] [MAIN ] Derivative Progress: 959/2117 symbols completed. JBI took 0.9s. Estimated remaining: 5m 41s. Rate: 203.5 symbols/min [2025-09-05T19:13:24.660071] [INFO ] [MAIN ] JBL: Generated 871 derivative records from 23683 primary records. [2025-09-05T19:13:24.667972] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-05T19:13:24.669542] [INFO ] [MAIN ] Derivative Progress: 960/2117 symbols completed. JBL took 0.9s. Estimated remaining: 5m 41s. Rate: 203.7 symbols/min [2025-09-05T19:13:24.669908] [INFO ] [MAIN ] JBS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:24.670059] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:24.670616] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:24.675830] [INFO ] [MAIN ] JCE: Loaded 3247 primary data records. [2025-09-05T19:13:24.880939] [INFO ] [MAIN ] JBS: Loaded 21793 primary data records. [2025-09-05T19:13:24.967234] [INFO ] [MAIN ] JCI: Loaded 25977 primary data records. [2025-09-05T19:13:25.413776] [INFO ] [MAIN ] JCE: Generated 871 derivative records from 3247 primary records. [2025-09-05T19:13:25.424344] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-05T19:13:25.427830] [INFO ] [MAIN ] Derivative Progress: 961/2117 symbols completed. JCE took 0.8s. Estimated remaining: 5m 41s. Rate: 203.4 symbols/min [2025-09-05T19:13:25.428163] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:25.435689] [INFO ] [MAIN ] JCI: Generated 871 derivative records from 25977 primary records. [2025-09-05T19:13:25.446246] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-05T19:13:25.447981] [INFO ] [MAIN ] Derivative Progress: 962/2117 symbols completed. JCI took 0.8s. Estimated remaining: 5m 40s. Rate: 203.6 symbols/min [2025-09-05T19:13:25.454391] [INFO ] [MAIN ] JBS: Generated 741 derivative records from 21793 primary records. [2025-09-05T19:13:25.454513] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:25.462205] [INFO ] [MAIN ] JBS: Successfully saved derivative data. [2025-09-05T19:13:25.469723] [INFO ] [MAIN ] Derivative Progress: 963/2117 symbols completed. JBS took 0.8s. Estimated remaining: 5m 40s. Rate: 203.8 symbols/min [2025-09-05T19:13:25.470084] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:25.489142] [INFO ] [MAIN ] JEF: Loaded 23972 primary data records. [2025-09-05T19:13:25.488219] [INFO ] [MAIN ] JEQ: Loaded 3943 primary data records. [2025-09-05T19:13:25.670567] [INFO ] [MAIN ] JELD: Loaded 21785 primary data records. [2025-09-05T19:13:26.216475] [INFO ] [MAIN ] JEF: Generated 871 derivative records from 23972 primary records. [2025-09-05T19:13:26.234105] [INFO ] [MAIN ] JEQ: Generated 870 derivative records from 3943 primary records. [2025-09-05T19:13:26.233392] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-05T19:13:26.236740] [INFO ] [MAIN ] Derivative Progress: 964/2117 symbols completed. JEF took 0.8s. Estimated remaining: 5m 40s. Rate: 203.4 symbols/min [2025-09-05T19:13:26.237354] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:26.250502] [INFO ] [MAIN ] JELD: Generated 871 derivative records from 21785 primary records. [2025-09-05T19:13:26.253060] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-05T19:13:26.254892] [INFO ] [MAIN ] Derivative Progress: 965/2117 symbols completed. JEQ took 0.8s. Estimated remaining: 5m 39s. Rate: 203.6 symbols/min [2025-09-05T19:13:26.260897] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:26.262601] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-05T19:13:26.264571] [INFO ] [MAIN ] Derivative Progress: 966/2117 symbols completed. JELD took 0.8s. Estimated remaining: 5m 39s. Rate: 203.9 symbols/min [2025-09-05T19:13:26.264935] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:26.275182] [INFO ] [MAIN ] JGH: Loaded 5548 primary data records. [2025-09-05T19:13:26.301280] [INFO ] [MAIN ] JFR: Loaded 14665 primary data records. [2025-09-05T19:13:26.708386] [INFO ] [MAIN ] JHG: Loaded 36097 primary data records. [2025-09-05T19:13:27.107209] [INFO ] [MAIN ] JGH: Generated 871 derivative records from 5548 primary records. [2025-09-05T19:13:27.125513] [INFO ] [MAIN ] JFR: Generated 871 derivative records from 14665 primary records. [2025-09-05T19:13:27.126966] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-05T19:13:27.129061] [INFO ] [MAIN ] Derivative Progress: 967/2117 symbols completed. JGH took 0.9s. Estimated remaining: 5m 39s. Rate: 203.4 symbols/min [2025-09-05T19:13:27.129534] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:27.138157] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-05T19:13:27.140502] [INFO ] [MAIN ] Derivative Progress: 968/2117 symbols completed. JFR took 0.9s. Estimated remaining: 5m 39s. Rate: 203.6 symbols/min [2025-09-05T19:13:27.140997] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:27.143719] [INFO ] [MAIN ] JHI: Loaded 2470 primary data records. [2025-09-05T19:13:27.228961] [INFO ] [MAIN ] JHS: Loaded 2176 primary data records. [2025-09-05T19:13:27.223744] [INFO ] [MAIN ] JHG: Generated 1352 derivative records from 36097 primary records. [2025-09-05T19:13:27.475109] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-05T19:13:27.574045] [INFO ] [MAIN ] Derivative Progress: 969/2117 symbols completed. JHG took 1.3s. Estimated remaining: 5m 38s. Rate: 203.5 symbols/min [2025-09-05T19:13:27.627057] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:27.757244] [INFO ] [MAIN ] JHI: Generated 1352 derivative records from 2470 primary records. [2025-09-05T19:13:27.779330] [INFO ] [MAIN ] JHX: Loaded 25892 primary data records. [2025-09-05T19:13:27.799900] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-05T19:13:27.825560] [INFO ] [MAIN ] Derivative Progress: 970/2117 symbols completed. JHI took 0.7s. Estimated remaining: 5m 38s. Rate: 203.6 symbols/min [2025-09-05T19:13:27.826901] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:27.826666] [INFO ] [MAIN ] JHS: Generated 1352 derivative records from 2176 primary records. [2025-09-05T19:13:27.922943] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-05T19:13:27.941224] [INFO ] [MAIN ] Derivative Progress: 971/2117 symbols completed. JHS took 0.8s. Estimated remaining: 5m 38s. Rate: 203.7 symbols/min [2025-09-05T19:13:27.960495] [INFO ] [MAIN ] JILL: Loaded 7946 primary data records. [2025-09-05T19:13:27.962781] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:28.314748] [INFO ] [MAIN ] JKS: Loaded 29339 primary data records. [2025-09-05T19:13:28.471467] [INFO ] [MAIN ] JHX: Generated 871 derivative records from 25892 primary records. [2025-09-05T19:13:28.605732] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-05T19:13:28.609062] [INFO ] [MAIN ] Derivative Progress: 972/2117 symbols completed. JHX took 1.0s. Estimated remaining: 5m 38s. Rate: 203.4 symbols/min [2025-09-05T19:13:28.609991] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:28.618788] [INFO ] [MAIN ] JILL: Generated 871 derivative records from 7946 primary records. [2025-09-05T19:13:28.629755] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-05T19:13:28.631562] [INFO ] [MAIN ] Derivative Progress: 973/2117 symbols completed. JILL took 0.8s. Estimated remaining: 5m 37s. Rate: 203.6 symbols/min [2025-09-05T19:13:28.655534] [INFO ] [MAIN ] JKS: Generated 1352 derivative records from 29339 primary records. [2025-09-05T19:13:28.664461] [INFO ] [MAIN ] JLL: Loaded 24615 primary data records. [2025-09-05T19:13:28.780760] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-05T19:13:28.794078] [INFO ] [MAIN ] Derivative Progress: 974/2117 symbols completed. JKS took 0.8s. Estimated remaining: 5m 37s. Rate: 203.7 symbols/min [2025-09-05T19:13:28.961888] [INFO ] [MAIN ] JLL: Generated 1352 derivative records from 24615 primary records. [2025-09-05T19:13:28.973973] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-05T19:13:28.976031] [INFO ] [MAIN ] Derivative Progress: 975/2117 symbols completed. JLL took 0.4s. Estimated remaining: 5m 36s. Rate: 203.8 symbols/min [2025-09-05T19:13:28.976497] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:28.976759] [INFO ] [MAIN ] JMM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:28.976664] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:28.983511] [INFO ] [MAIN ] JLS: Loaded 1847 primary data records. [2025-09-05T19:13:28.981964] [INFO ] [MAIN ] JMM: Loaded 1580 primary data records. [2025-09-05T19:13:29.275853] [INFO ] [MAIN ] JMIA: Loaded 24952 primary data records. [2025-09-05T19:13:29.808110] [INFO ] [MAIN ] JLS: Generated 871 derivative records from 1847 primary records. [2025-09-05T19:13:29.829128] [INFO ] [MAIN ] JMM: Generated 1352 derivative records from 1580 primary records. [2025-09-05T19:13:29.832130] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-05T19:13:29.839193] [INFO ] [MAIN ] Derivative Progress: 976/2117 symbols completed. JLS took 0.9s. Estimated remaining: 5m 37s. Rate: 203.4 symbols/min [2025-09-05T19:13:29.849151] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:29.851152] [INFO ] [MAIN ] JMM: Successfully saved derivative data. [2025-09-05T19:13:29.853681] [INFO ] [MAIN ] Derivative Progress: 977/2117 symbols completed. JMM took 0.9s. Estimated remaining: 5m 36s. Rate: 203.6 symbols/min [2025-09-05T19:13:29.851048] [INFO ] [MAIN ] JMIA: Generated 871 derivative records from 24952 primary records. [2025-09-05T19:13:29.854736] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:29.863393] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-05T19:13:29.865342] [INFO ] [MAIN ] Derivative Progress: 978/2117 symbols completed. JMIA took 0.9s. Estimated remaining: 5m 35s. Rate: 203.8 symbols/min [2025-09-05T19:13:29.865716] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:29.869928] [INFO ] [MAIN ] JPI: Loaded 2201 primary data records. [2025-09-05T19:13:30.072239] [INFO ] [MAIN ] JNJ: Loaded 26124 primary data records. [2025-09-05T19:13:30.174623] [INFO ] [MAIN ] JOBY: Loaded 40549 primary data records. [2025-09-05T19:13:30.663485] [INFO ] [MAIN ] JPI: Generated 871 derivative records from 2201 primary records. [2025-09-05T19:13:30.675130] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-05T19:13:30.677372] [INFO ] [MAIN ] Derivative Progress: 979/2117 symbols completed. JPI took 0.8s. Estimated remaining: 5m 36s. Rate: 203.4 symbols/min [2025-09-05T19:13:30.677938] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:30.688635] [INFO ] [MAIN ] JNJ: Generated 871 derivative records from 26124 primary records. [2025-09-05T19:13:30.709342] [INFO ] [MAIN ] JOBY: Generated 1352 derivative records from 40549 primary records. [2025-09-05T19:13:30.710415] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-05T19:13:30.717507] [INFO ] [MAIN ] Derivative Progress: 980/2117 symbols completed. JNJ took 0.9s. Estimated remaining: 5m 35s. Rate: 203.6 symbols/min [2025-09-05T19:13:30.725552] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:30.741328] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-05T19:13:30.744046] [INFO ] [MAIN ] Derivative Progress: 981/2117 symbols completed. JOBY took 0.9s. Estimated remaining: 5m 34s. Rate: 203.8 symbols/min [2025-09-05T19:13:30.744934] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:30.744700] [INFO ] [MAIN ] JPM: Loaded 26165 primary data records. [2025-09-05T19:13:30.852033] [INFO ] [MAIN ] JQC: Loaded 15958 primary data records. [2025-09-05T19:13:30.862823] [INFO ] [MAIN ] JRI: Loaded 7257 primary data records. [2025-09-05T19:13:31.481080] [INFO ] [MAIN ] JPM: Generated 871 derivative records from 26165 primary records. [2025-09-05T19:13:31.490887] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-05T19:13:31.492769] [INFO ] [MAIN ] Derivative Progress: 982/2117 symbols completed. JPM took 0.8s. Estimated remaining: 5m 35s. Rate: 203.5 symbols/min [2025-09-05T19:13:31.493576] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:31.503605] [INFO ] [MAIN ] JRI: Generated 871 derivative records from 7257 primary records. [2025-09-05T19:13:31.510883] [INFO ] [MAIN ] JQC: Generated 871 derivative records from 15958 primary records. [2025-09-05T19:13:31.533707] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-05T19:13:31.534001] [INFO ] [MAIN ] JRS: Loaded 8420 primary data records. [2025-09-05T19:13:31.556358] [INFO ] [MAIN ] Derivative Progress: 983/2117 symbols completed. JRI took 0.8s. Estimated remaining: 5m 34s. Rate: 203.6 symbols/min [2025-09-05T19:13:31.567263] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-05T19:13:31.601854] [INFO ] [MAIN ] Derivative Progress: 984/2117 symbols completed. JQC took 0.9s. Estimated remaining: 5m 34s. Rate: 203.8 symbols/min [2025-09-05T19:13:31.613814] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:31.607125] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:31.863397] [INFO ] [MAIN ] K: Loaded 24497 primary data records. [2025-09-05T19:13:32.008887] [INFO ] [MAIN ] JXN: Loaded 33952 primary data records. [2025-09-05T19:13:32.330078] [INFO ] [MAIN ] JRS: Generated 1351 derivative records from 8420 primary records. [2025-09-05T19:13:32.437184] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-05T19:13:32.440457] [INFO ] [MAIN ] Derivative Progress: 985/2117 symbols completed. JRS took 0.9s. Estimated remaining: 5m 34s. Rate: 203.4 symbols/min [2025-09-05T19:13:32.444313] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:32.453184] [INFO ] [MAIN ] K: Generated 871 derivative records from 24497 primary records. [2025-09-05T19:13:32.466956] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-05T19:13:32.468728] [INFO ] [MAIN ] Derivative Progress: 986/2117 symbols completed. K took 0.9s. Estimated remaining: 5m 33s. Rate: 203.6 symbols/min [2025-09-05T19:13:32.474188] [INFO ] [MAIN ] KAI: Loaded 10175 primary data records. [2025-09-05T19:13:32.474251] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:32.674459] [INFO ] [MAIN ] JXN: Generated 1352 derivative records from 33952 primary records. [2025-09-05T19:13:32.676804] [INFO ] [MAIN ] KAR: Loaded 19760 primary data records. [2025-09-05T19:13:32.875095] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-05T19:13:32.894032] [INFO ] [MAIN ] Derivative Progress: 987/2117 symbols completed. JXN took 1.3s. Estimated remaining: 5m 33s. Rate: 203.5 symbols/min [2025-09-05T19:13:32.895163] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:33.048918] [INFO ] [MAIN ] KB: Loaded 11863 primary data records. [2025-09-05T19:13:33.192830] [INFO ] [MAIN ] KAI: Generated 1352 derivative records from 10175 primary records. [2025-09-05T19:13:33.311187] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-05T19:13:33.314098] [INFO ] [MAIN ] Derivative Progress: 988/2117 symbols completed. KAI took 0.9s. Estimated remaining: 5m 33s. Rate: 203.4 symbols/min [2025-09-05T19:13:33.327186] [INFO ] [MAIN ] KAR: Generated 871 derivative records from 19760 primary records. [2025-09-05T19:13:33.337928] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-05T19:13:33.340728] [INFO ] [MAIN ] Derivative Progress: 989/2117 symbols completed. KAR took 0.9s. Estimated remaining: 5m 32s. Rate: 203.6 symbols/min [2025-09-05T19:13:33.348254] [INFO ] [MAIN ] KB: Generated 871 derivative records from 11863 primary records. [2025-09-05T19:13:33.356301] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-05T19:13:33.357977] [INFO ] [MAIN ] Derivative Progress: 990/2117 symbols completed. KB took 0.5s. Estimated remaining: 5m 32s. Rate: 203.8 symbols/min [2025-09-05T19:13:33.358668] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:33.358946] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:33.358876] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:33.370203] [INFO ] [MAIN ] KBDC: Loaded 9008 primary data records. [2025-09-05T19:13:33.526530] [INFO ] [MAIN ] KBR: Loaded 23389 primary data records. [2025-09-05T19:13:33.571562] [INFO ] [MAIN ] KBH: Loaded 23839 primary data records. [2025-09-05T19:13:34.128082] [INFO ] [MAIN ] KBDC: Generated 871 derivative records from 9008 primary records. [2025-09-05T19:13:34.138370] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-05T19:13:34.139751] [INFO ] [MAIN ] Derivative Progress: 991/2117 symbols completed. KBDC took 0.8s. Estimated remaining: 5m 32s. Rate: 203.5 symbols/min [2025-09-05T19:13:34.140123] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:34.151528] [INFO ] [MAIN ] KBH: Generated 871 derivative records from 23839 primary records. [2025-09-05T19:13:34.166890] [INFO ] [MAIN ] KBR: Generated 871 derivative records from 23389 primary records. [2025-09-05T19:13:34.176819] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-05T19:13:34.184939] [INFO ] [MAIN ] Derivative Progress: 992/2117 symbols completed. KBH took 0.8s. Estimated remaining: 5m 31s. Rate: 203.7 symbols/min [2025-09-05T19:13:34.186726] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-05T19:13:34.186654] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:34.188320] [INFO ] [MAIN ] Derivative Progress: 993/2117 symbols completed. KBR took 0.8s. Estimated remaining: 5m 31s. Rate: 203.9 symbols/min [2025-09-05T19:13:34.189245] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:34.200976] [INFO ] [MAIN ] KD: Loaded 25420 primary data records. [2025-09-05T19:13:34.330372] [INFO ] [MAIN ] KEX: Loaded 17777 primary data records. [2025-09-05T19:13:34.616523] [INFO ] [MAIN ] KEP: Loaded 24769 primary data records. [2025-09-05T19:13:35.039912] [INFO ] [MAIN ] KD: Generated 871 derivative records from 25420 primary records. [2025-09-05T19:13:35.050886] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-05T19:13:35.052430] [INFO ] [MAIN ] Derivative Progress: 994/2117 symbols completed. KD took 0.9s. Estimated remaining: 5m 31s. Rate: 203.5 symbols/min [2025-09-05T19:13:35.052767] [INFO ] [MAIN ] KEY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:35.059987] [INFO ] [MAIN ] KEX: Generated 871 derivative records from 17777 primary records. [2025-09-05T19:13:35.069695] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-05T19:13:35.071768] [INFO ] [MAIN ] Derivative Progress: 995/2117 symbols completed. KEX took 0.9s. Estimated remaining: 5m 31s. Rate: 203.7 symbols/min [2025-09-05T19:13:35.072153] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:35.086990] [INFO ] [MAIN ] KEP: Generated 1352 derivative records from 24769 primary records. [2025-09-05T19:13:35.112730] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-05T19:13:35.123301] [INFO ] [MAIN ] Derivative Progress: 996/2117 symbols completed. KEP took 0.9s. Estimated remaining: 5m 30s. Rate: 203.8 symbols/min [2025-09-05T19:13:35.130822] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:35.129823] [INFO ] [MAIN ] KEY: Loaded 26018 primary data records. [2025-09-05T19:13:35.131590] [INFO ] [MAIN ] KEYS: Loaded 20416 primary data records. [2025-09-05T19:13:35.239389] [INFO ] [MAIN ] KF: Loaded 1097 primary data records. [2025-09-05T19:13:35.847757] [INFO ] [MAIN ] KEYS: Generated 871 derivative records from 20416 primary records. [2025-09-05T19:13:35.860050] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-05T19:13:35.861499] [INFO ] [MAIN ] Derivative Progress: 997/2117 symbols completed. KEYS took 0.8s. Estimated remaining: 5m 30s. Rate: 203.5 symbols/min [2025-09-05T19:13:35.862018] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:35.875555] [INFO ] [MAIN ] KF: Generated 870 derivative records from 1097 primary records. [2025-09-05T19:13:35.876332] [INFO ] [MAIN ] KEY: Generated 871 derivative records from 26018 primary records. [2025-09-05T19:13:35.884211] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-05T19:13:35.892726] [INFO ] [MAIN ] Derivative Progress: 998/2117 symbols completed. KF took 0.8s. Estimated remaining: 5m 30s. Rate: 203.7 symbols/min [2025-09-05T19:13:35.894557] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:35.901688] [INFO ] [MAIN ] KFRC: Loaded 9935 primary data records. [2025-09-05T19:13:35.915449] [INFO ] [MAIN ] KEY: Successfully saved derivative data. [2025-09-05T19:13:35.926681] [INFO ] [MAIN ] Derivative Progress: 999/2117 symbols completed. KEY took 0.9s. Estimated remaining: 5m 29s. Rate: 203.9 symbols/min [2025-09-05T19:13:35.957864] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:35.957723] [INFO ] [MAIN ] KFS: Loaded 6405 primary data records. [2025-09-05T19:13:36.249184] [INFO ] [MAIN ] KFY: Loaded 14309 primary data records. [2025-09-05T19:13:36.673998] [INFO ] [MAIN ] KFRC: Generated 871 derivative records from 9935 primary records. [2025-09-05T19:13:36.691775] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-05T19:13:36.696129] [INFO ] [MAIN ] KFS: Generated 1352 derivative records from 6405 primary records. [2025-09-05T19:13:36.698134] [INFO ] [MAIN ] Derivative Progress: 1000/2117 symbols completed. KFRC took 0.8s. Estimated remaining: 5m 29s. Rate: 203.6 symbols/min [2025-09-05T19:13:36.705810] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:36.717293] [INFO ] [MAIN ] KFY: Generated 871 derivative records from 14309 primary records. [2025-09-05T19:13:36.720072] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-05T19:13:36.722533] [INFO ] [MAIN ] Derivative Progress: 1001/2117 symbols completed. KFS took 0.8s. Estimated remaining: 5m 29s. Rate: 203.7 symbols/min [2025-09-05T19:13:36.728574] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:36.731914] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-05T19:13:36.733832] [INFO ] [MAIN ] Derivative Progress: 1002/2117 symbols completed. KFY took 0.8s. Estimated remaining: 5m 28s. Rate: 203.9 symbols/min [2025-09-05T19:13:36.734259] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:36.767504] [INFO ] [MAIN ] KGC: Loaded 26076 primary data records. [2025-09-05T19:13:36.768870] [INFO ] [MAIN ] KGS: Loaded 22368 primary data records. [2025-09-05T19:13:36.960777] [INFO ] [MAIN ] KIM: Loaded 25674 primary data records. [2025-09-05T19:13:37.550238] [INFO ] [MAIN ] KGC: Generated 871 derivative records from 26076 primary records. [2025-09-05T19:13:37.557101] [INFO ] [MAIN ] KGS: Generated 871 derivative records from 22368 primary records. [2025-09-05T19:13:37.580759] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-05T19:13:37.583007] [INFO ] [MAIN ] Derivative Progress: 1003/2117 symbols completed. KGC took 0.9s. Estimated remaining: 5m 28s. Rate: 203.6 symbols/min [2025-09-05T19:13:37.583557] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-05T19:13:37.581431] [INFO ] [MAIN ] KIM: Generated 871 derivative records from 25674 primary records. [2025-09-05T19:13:37.585867] [INFO ] [MAIN ] Derivative Progress: 1004/2117 symbols completed. KGS took 0.9s. Estimated remaining: 5m 28s. Rate: 203.8 symbols/min [2025-09-05T19:13:37.593335] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-05T19:13:37.594834] [INFO ] [MAIN ] Derivative Progress: 1005/2117 symbols completed. KIM took 0.9s. Estimated remaining: 5m 27s. Rate: 204.0 symbols/min [2025-09-05T19:13:37.595328] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:37.595388] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:37.595289] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:37.604077] [INFO ] [MAIN ] KKRS: Loaded 2497 primary data records. [2025-09-05T19:13:37.709818] [INFO ] [MAIN ] KIO: Loaded 10638 primary data records. [2025-09-05T19:13:37.959120] [INFO ] [MAIN ] KKR: Loaded 25928 primary data records. [2025-09-05T19:13:38.343040] [INFO ] [MAIN ] KKRS: Generated 871 derivative records from 2497 primary records. [2025-09-05T19:13:38.352530] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-05T19:13:38.354496] [INFO ] [MAIN ] Derivative Progress: 1006/2117 symbols completed. KKRS took 0.8s. Estimated remaining: 5m 27s. Rate: 203.6 symbols/min [2025-09-05T19:13:38.355785] [INFO ] [MAIN ] KKRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:38.363576] [INFO ] [MAIN ] KIO: Generated 871 derivative records from 10638 primary records. [2025-09-05T19:13:38.379935] [INFO ] [MAIN ] KKRT: Loaded 7339 primary data records. [2025-09-05T19:13:38.379635] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-05T19:13:38.392907] [INFO ] [MAIN ] Derivative Progress: 1007/2117 symbols completed. KIO took 0.8s. Estimated remaining: 5m 27s. Rate: 203.8 symbols/min [2025-09-05T19:13:38.436774] [INFO ] [MAIN ] KKR: Generated 871 derivative records from 25928 primary records. [2025-09-05T19:13:38.436017] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:38.553502] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-05T19:13:38.601383] [INFO ] [MAIN ] Derivative Progress: 1008/2117 symbols completed. KKR took 1.0s. Estimated remaining: 5m 26s. Rate: 203.9 symbols/min [2025-09-05T19:13:38.665054] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:38.665696] [INFO ] [MAIN ] KLC: Loaded 17033 primary data records. [2025-09-05T19:13:38.931429] [INFO ] [MAIN ] KLG: Loaded 31300 primary data records. [2025-09-05T19:13:39.051150] [INFO ] [MAIN ] KKRT: Generated 871 derivative records from 7339 primary records. [2025-09-05T19:13:39.226795] [INFO ] [MAIN ] KKRT: Successfully saved derivative data. [2025-09-05T19:13:39.229999] [INFO ] [MAIN ] Derivative Progress: 1009/2117 symbols completed. KKRT took 0.9s. Estimated remaining: 5m 26s. Rate: 203.6 symbols/min [2025-09-05T19:13:39.231312] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:39.239334] [INFO ] [MAIN ] KLC: Generated 871 derivative records from 17033 primary records. [2025-09-05T19:13:39.244056] [INFO ] [MAIN ] KMPB: Loaded 2601 primary data records. [2025-09-05T19:13:39.350941] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-05T19:13:39.366547] [INFO ] [MAIN ] Derivative Progress: 1010/2117 symbols completed. KLC took 0.9s. Estimated remaining: 5m 26s. Rate: 203.7 symbols/min [2025-09-05T19:13:39.382301] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:39.580999] [INFO ] [MAIN ] KLG: Generated 1352 derivative records from 31300 primary records. [2025-09-05T19:13:39.608869] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-05T19:13:39.611345] [INFO ] [MAIN ] Derivative Progress: 1011/2117 symbols completed. KLG took 0.9s. Estimated remaining: 5m 26s. Rate: 203.8 symbols/min [2025-09-05T19:13:39.612317] [INFO ] [MAIN ] KMPR: Loaded 20203 primary data records. [2025-09-05T19:13:39.612615] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:39.753177] [INFO ] [MAIN ] KMPB: Generated 1352 derivative records from 2601 primary records. [2025-09-05T19:13:39.879245] [INFO ] [MAIN ] KMT: Loaded 20766 primary data records. [2025-09-05T19:13:39.940235] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-05T19:13:39.942892] [INFO ] [MAIN ] Derivative Progress: 1012/2117 symbols completed. KMPB took 0.7s. Estimated remaining: 5m 25s. Rate: 203.8 symbols/min [2025-09-05T19:13:39.957471] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:40.148324] [INFO ] [MAIN ] KMPR: Generated 871 derivative records from 20203 primary records. [2025-09-05T19:13:40.158260] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-05T19:13:40.160069] [INFO ] [MAIN ] Derivative Progress: 1013/2117 symbols completed. KMPR took 0.8s. Estimated remaining: 5m 25s. Rate: 203.8 symbols/min [2025-09-05T19:13:40.160271] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:40.174448] [INFO ] [MAIN ] KMX: Loaded 40074 primary data records. [2025-09-05T19:13:40.303255] [INFO ] [MAIN ] KMT: Generated 871 derivative records from 20766 primary records. [2025-09-05T19:13:40.469910] [INFO ] [MAIN ] KN: Loaded 28792 primary data records. [2025-09-05T19:13:40.522383] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-05T19:13:40.545562] [INFO ] [MAIN ] Derivative Progress: 1014/2117 symbols completed. KMT took 0.9s. Estimated remaining: 5m 25s. Rate: 203.7 symbols/min [2025-09-05T19:13:40.545804] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:40.778178] [INFO ] [MAIN ] KNF: Loaded 27079 primary data records. [2025-09-05T19:13:40.779058] [INFO ] [MAIN ] KMX: Generated 1352 derivative records from 40074 primary records. [2025-09-05T19:13:40.906248] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-05T19:13:40.940209] [INFO ] [MAIN ] Derivative Progress: 1015/2117 symbols completed. KMX took 1.0s. Estimated remaining: 5m 25s. Rate: 203.7 symbols/min [2025-09-05T19:13:40.950930] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:41.079163] [INFO ] [MAIN ] KNOP: Loaded 6842 primary data records. [2025-09-05T19:13:41.078551] [INFO ] [MAIN ] KN: Generated 1352 derivative records from 28792 primary records. [2025-09-05T19:13:41.205204] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-05T19:13:41.244818] [INFO ] [MAIN ] Derivative Progress: 1016/2117 symbols completed. KN took 1.1s. Estimated remaining: 5m 24s. Rate: 203.7 symbols/min [2025-09-05T19:13:41.356209] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:41.379381] [INFO ] [MAIN ] KNSL: Loaded 9242 primary data records. [2025-09-05T19:13:41.380130] [INFO ] [MAIN ] KNF: Generated 1352 derivative records from 27079 primary records. [2025-09-05T19:13:41.511889] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-05T19:13:41.525150] [INFO ] [MAIN ] Derivative Progress: 1017/2117 symbols completed. KNF took 1.0s. Estimated remaining: 5m 24s. Rate: 203.7 symbols/min [2025-09-05T19:13:41.592352] [INFO ] [MAIN ] KNOP: Generated 1352 derivative records from 6842 primary records. [2025-09-05T19:13:41.581652] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:41.655687] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-05T19:13:41.658298] [INFO ] [MAIN ] Derivative Progress: 1018/2117 symbols completed. KNOP took 0.7s. Estimated remaining: 5m 24s. Rate: 203.8 symbols/min [2025-09-05T19:13:41.672074] [INFO ] [MAIN ] KNSL: Generated 871 derivative records from 9242 primary records. [2025-09-05T19:13:41.689973] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-05T19:13:41.691511] [INFO ] [MAIN ] Derivative Progress: 1019/2117 symbols completed. KNSL took 0.3s. Estimated remaining: 5m 23s. Rate: 204.0 symbols/min [2025-09-05T19:13:41.703712] [INFO ] [MAIN ] KNTK: Loaded 35309 primary data records. [2025-09-05T19:13:42.026494] [INFO ] [MAIN ] KNTK: Generated 1352 derivative records from 35309 primary records. [2025-09-05T19:13:42.038442] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-05T19:13:42.040528] [INFO ] [MAIN ] Derivative Progress: 1020/2117 symbols completed. KNTK took 0.5s. Estimated remaining: 5m 23s. Rate: 203.9 symbols/min [2025-09-05T19:13:42.041093] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:42.041304] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:42.041461] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:42.095051] [INFO ] [MAIN ] KODK: Loaded 32938 primary data records. [2025-09-05T19:13:42.177474] [INFO ] [MAIN ] KNX: Loaded 39479 primary data records. [2025-09-05T19:13:42.223196] [INFO ] [MAIN ] KO: Loaded 40558 primary data records. [2025-09-05T19:13:42.931215] [INFO ] [MAIN ] KODK: Generated 1352 derivative records from 32938 primary records. [2025-09-05T19:13:42.957704] [INFO ] [MAIN ] KO: Generated 1352 derivative records from 40558 primary records. [2025-09-05T19:13:42.957829] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-05T19:13:42.968885] [INFO ] [MAIN ] Derivative Progress: 1021/2117 symbols completed. KODK took 0.9s. Estimated remaining: 5m 23s. Rate: 203.5 symbols/min [2025-09-05T19:13:42.970751] [INFO ] [MAIN ] KNX: Generated 1352 derivative records from 39479 primary records. [2025-09-05T19:13:42.976904] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:42.996271] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-05T19:13:42.999145] [INFO ] [MAIN ] Derivative Progress: 1022/2117 symbols completed. KNX took 1.0s. Estimated remaining: 5m 23s. Rate: 203.7 symbols/min [2025-09-05T19:13:43.003735] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:43.003546] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-05T19:13:43.006134] [INFO ] [MAIN ] Derivative Progress: 1023/2117 symbols completed. KO took 1.0s. Estimated remaining: 5m 22s. Rate: 203.9 symbols/min [2025-09-05T19:13:43.006610] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:43.013499] [INFO ] [MAIN ] KOF: Loaded 12848 primary data records. [2025-09-05T19:13:43.016985] [INFO ] [MAIN ] KORE: Loaded 1552 primary data records. [2025-09-05T19:13:43.223734] [INFO ] [MAIN ] KOP: Loaded 7750 primary data records. [2025-09-05T19:13:43.812097] [INFO ] [MAIN ] KOF: Generated 871 derivative records from 12848 primary records. [2025-09-05T19:13:43.840976] [INFO ] [MAIN ] KOP: Generated 871 derivative records from 7750 primary records. [2025-09-05T19:13:43.842310] [INFO ] [MAIN ] KORE: Generated 1352 derivative records from 1552 primary records. [2025-09-05T19:13:43.841447] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-05T19:13:43.849679] [INFO ] [MAIN ] Derivative Progress: 1024/2117 symbols completed. KOF took 0.9s. Estimated remaining: 5m 22s. Rate: 203.5 symbols/min [2025-09-05T19:13:43.853713] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-05T19:13:43.855687] [INFO ] [MAIN ] Derivative Progress: 1025/2117 symbols completed. KOP took 0.9s. Estimated remaining: 5m 22s. Rate: 203.7 symbols/min [2025-09-05T19:13:43.853923] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:43.862838] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:43.869902] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-05T19:13:43.872614] [INFO ] [MAIN ] Derivative Progress: 1026/2117 symbols completed. KORE took 0.9s. Estimated remaining: 5m 21s. Rate: 203.9 symbols/min [2025-09-05T19:13:43.873090] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:43.920079] [INFO ] [MAIN ] KOS: Loaded 25742 primary data records. [2025-09-05T19:13:44.030030] [INFO ] [MAIN ] KR: Loaded 26056 primary data records. [2025-09-05T19:13:44.221812] [INFO ] [MAIN ] KRC: Loaded 36229 primary data records. [2025-09-05T19:13:44.750585] [INFO ] [MAIN ] KOS: Generated 871 derivative records from 25742 primary records. [2025-09-05T19:13:44.766933] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-05T19:13:44.768925] [INFO ] [MAIN ] Derivative Progress: 1027/2117 symbols completed. KOS took 0.9s. Estimated remaining: 5m 21s. Rate: 203.5 symbols/min [2025-09-05T19:13:44.769096] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:44.767744] [INFO ] [MAIN ] KR: Generated 871 derivative records from 26056 primary records. [2025-09-05T19:13:44.778468] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-05T19:13:44.779922] [INFO ] [MAIN ] Derivative Progress: 1028/2117 symbols completed. KR took 0.9s. Estimated remaining: 5m 21s. Rate: 203.7 symbols/min [2025-09-05T19:13:44.780221] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:44.794460] [INFO ] [MAIN ] KRC: Generated 1352 derivative records from 36229 primary records. [2025-09-05T19:13:44.820864] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-05T19:13:44.823369] [INFO ] [MAIN ] Derivative Progress: 1029/2117 symbols completed. KRC took 1.0s. Estimated remaining: 5m 20s. Rate: 203.8 symbols/min [2025-09-05T19:13:44.824162] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:44.842275] [INFO ] [MAIN ] KREF: Loaded 28025 primary data records. [2025-09-05T19:13:44.842763] [INFO ] [MAIN ] KRG: Loaded 23518 primary data records. [2025-09-05T19:13:45.056848] [INFO ] [MAIN ] KRO: Loaded 12966 primary data records. [2025-09-05T19:13:45.612634] [INFO ] [MAIN ] KRG: Generated 871 derivative records from 23518 primary records. [2025-09-05T19:13:45.625890] [INFO ] [MAIN ] KREF: Generated 1352 derivative records from 28025 primary records. [2025-09-05T19:13:45.646881] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-05T19:13:45.648414] [INFO ] [MAIN ] Derivative Progress: 1030/2117 symbols completed. KRG took 0.9s. Estimated remaining: 5m 21s. Rate: 203.5 symbols/min [2025-09-05T19:13:45.640080] [INFO ] [MAIN ] KRO: Generated 871 derivative records from 12966 primary records. [2025-09-05T19:13:45.652210] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:45.662765] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-05T19:13:45.664888] [INFO ] [MAIN ] Derivative Progress: 1031/2117 symbols completed. KRO took 0.8s. Estimated remaining: 5m 20s. Rate: 203.7 symbols/min [2025-09-05T19:13:45.663261] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-05T19:13:45.667406] [INFO ] [MAIN ] Derivative Progress: 1032/2117 symbols completed. KREF took 0.9s. Estimated remaining: 5m 19s. Rate: 203.9 symbols/min [2025-09-05T19:13:45.667357] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:45.667853] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:45.724480] [INFO ] [MAIN ] KRP: Loaded 27643 primary data records. [2025-09-05T19:13:45.725189] [INFO ] [MAIN ] KT: Loaded 21504 primary data records. [2025-09-05T19:13:46.024467] [INFO ] [MAIN ] KSS: Loaded 40363 primary data records. [2025-09-05T19:13:46.710702] [INFO ] [MAIN ] KRP: Generated 1352 derivative records from 27643 primary records. [2025-09-05T19:13:46.717068] [INFO ] [MAIN ] KT: Generated 871 derivative records from 21504 primary records. [2025-09-05T19:13:46.737416] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-05T19:13:46.744136] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-05T19:13:46.746821] [INFO ] [MAIN ] Derivative Progress: 1033/2117 symbols completed. KT took 1.1s. Estimated remaining: 5m 20s. Rate: 203.3 symbols/min [2025-09-05T19:13:46.749900] [INFO ] [MAIN ] Derivative Progress: 1034/2117 symbols completed. KRP took 1.1s. Estimated remaining: 5m 19s. Rate: 203.5 symbols/min [2025-09-05T19:13:46.769705] [INFO ] [MAIN ] KSS: Generated 1352 derivative records from 40363 primary records. [2025-09-05T19:13:46.789293] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-05T19:13:46.793098] [INFO ] [MAIN ] Derivative Progress: 1035/2117 symbols completed. KSS took 1.1s. Estimated remaining: 5m 19s. Rate: 203.7 symbols/min [2025-09-05T19:13:46.793973] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:46.794359] [INFO ] [MAIN ] KUKE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:46.794601] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:46.800440] [INFO ] [MAIN ] KUKE: Loaded 1363 primary data records. [2025-09-05T19:13:46.855453] [INFO ] [MAIN ] KTF: Loaded 9434 primary data records. [2025-09-05T19:13:47.064258] [INFO ] [MAIN ] KTB: Loaded 20105 primary data records. [2025-09-05T19:13:47.830025] [INFO ] [MAIN ] KUKE: Generated 870 derivative records from 1363 primary records. [2025-09-05T19:13:47.838123] [INFO ] [MAIN ] KTB: Generated 871 derivative records from 20105 primary records. [2025-09-05T19:13:47.858996] [INFO ] [MAIN ] KTF: Generated 1352 derivative records from 9434 primary records. [2025-09-05T19:13:47.863868] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-05T19:13:47.868101] [INFO ] [MAIN ] KUKE: Successfully saved derivative data. [2025-09-05T19:13:47.866918] [INFO ] [MAIN ] Derivative Progress: 1036/2117 symbols completed. KTB took 1.1s. Estimated remaining: 5m 19s. Rate: 203.2 symbols/min [2025-09-05T19:13:47.869821] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:47.876272] [INFO ] [MAIN ] Derivative Progress: 1037/2117 symbols completed. KUKE took 1.1s. Estimated remaining: 5m 19s. Rate: 203.4 symbols/min [2025-09-05T19:13:47.879013] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:47.882135] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-05T19:13:47.885216] [INFO ] [MAIN ] Derivative Progress: 1038/2117 symbols completed. KTF took 1.1s. Estimated remaining: 5m 18s. Rate: 203.6 symbols/min [2025-09-05T19:13:47.885716] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:47.920170] [INFO ] [MAIN ] KVUE: Loaded 26039 primary data records. [2025-09-05T19:13:48.016926] [INFO ] [MAIN ] KW: Loaded 19313 primary data records. [2025-09-05T19:13:48.023113] [INFO ] [MAIN ] KVYO: Loaded 24052 primary data records. [2025-09-05T19:13:48.690206] [INFO ] [MAIN ] KVUE: Generated 871 derivative records from 26039 primary records. [2025-09-05T19:13:48.702595] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-05T19:13:48.704512] [INFO ] [MAIN ] Derivative Progress: 1039/2117 symbols completed. KVUE took 0.8s. Estimated remaining: 5m 18s. Rate: 203.2 symbols/min [2025-09-05T19:13:48.712100] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:48.713756] [INFO ] [MAIN ] KW: Generated 871 derivative records from 19313 primary records. [2025-09-05T19:13:48.723280] [INFO ] [MAIN ] KVYO: Generated 870 derivative records from 24052 primary records. [2025-09-05T19:13:48.738617] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-05T19:13:48.746804] [INFO ] [MAIN ] Derivative Progress: 1040/2117 symbols completed. KVYO took 0.9s. Estimated remaining: 5m 18s. Rate: 203.4 symbols/min [2025-09-05T19:13:48.745043] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-05T19:13:48.748733] [INFO ] [MAIN ] Derivative Progress: 1041/2117 symbols completed. KW took 0.9s. Estimated remaining: 5m 17s. Rate: 203.6 symbols/min [2025-09-05T19:13:48.749016] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:48.747213] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:48.757565] [INFO ] [MAIN ] KWR: Loaded 12943 primary data records. [2025-09-05T19:13:48.947141] [INFO ] [MAIN ] KYN: Loaded 23037 primary data records. [2025-09-05T19:13:48.949794] [INFO ] [MAIN ] L: Loaded 20458 primary data records. [2025-09-05T19:13:49.621723] [INFO ] [MAIN ] KWR: Generated 1352 derivative records from 12943 primary records. [2025-09-05T19:13:49.636538] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-05T19:13:49.639182] [INFO ] [MAIN ] Derivative Progress: 1042/2117 symbols completed. KWR took 0.9s. Estimated remaining: 5m 17s. Rate: 203.2 symbols/min [2025-09-05T19:13:49.642471] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:49.650797] [INFO ] [MAIN ] L: Generated 871 derivative records from 20458 primary records. [2025-09-05T19:13:49.662452] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-05T19:13:49.664345] [INFO ] [MAIN ] Derivative Progress: 1043/2117 symbols completed. L took 0.9s. Estimated remaining: 5m 17s. Rate: 203.4 symbols/min [2025-09-05T19:13:49.670782] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:49.683934] [INFO ] [MAIN ] KYN: Generated 1352 derivative records from 23037 primary records. [2025-09-05T19:13:49.698801] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-05T19:13:49.709049] [INFO ] [MAIN ] Derivative Progress: 1044/2117 symbols completed. KYN took 1.0s. Estimated remaining: 5m 16s. Rate: 203.5 symbols/min [2025-09-05T19:13:49.709384] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:49.710450] [INFO ] [MAIN ] LAC: Loaded 25479 primary data records. [2025-09-05T19:13:49.781860] [INFO ] [MAIN ] LANV: Loaded 1442 primary data records. [2025-09-05T19:13:49.920040] [INFO ] [MAIN ] LAD: Loaded 17556 primary data records. [2025-09-05T19:13:50.513914] [INFO ] [MAIN ] LAC: Generated 871 derivative records from 25479 primary records. [2025-09-05T19:13:50.520824] [INFO ] [MAIN ] LANV: Generated 869 derivative records from 1442 primary records. [2025-09-05T19:13:50.536224] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-05T19:13:50.535936] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-05T19:13:50.537584] [INFO ] [MAIN ] Derivative Progress: 1045/2117 symbols completed. LAC took 0.9s. Estimated remaining: 5m 17s. Rate: 203.2 symbols/min [2025-09-05T19:13:50.539244] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:50.539283] [INFO ] [MAIN ] Derivative Progress: 1046/2117 symbols completed. LANV took 0.8s. Estimated remaining: 5m 16s. Rate: 203.4 symbols/min [2025-09-05T19:13:50.541347] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:50.552826] [INFO ] [MAIN ] LAD: Generated 1351 derivative records from 17556 primary records. [2025-09-05T19:13:50.571891] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-05T19:13:50.572218] [INFO ] [MAIN ] LAW: Loaded 10619 primary data records. [2025-09-05T19:13:50.574692] [INFO ] [MAIN ] Derivative Progress: 1047/2117 symbols completed. LAD took 0.9s. Estimated remaining: 5m 15s. Rate: 203.5 symbols/min [2025-09-05T19:13:50.586144] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:50.743021] [INFO ] [MAIN ] LBRT: Loaded 25687 primary data records. [2025-09-05T19:13:51.035358] [INFO ] [MAIN ] LC: Loaded 36169 primary data records. [2025-09-05T19:13:51.436498] [INFO ] [MAIN ] LAW: Generated 1352 derivative records from 10619 primary records. [2025-09-05T19:13:51.437536] [INFO ] [MAIN ] LBRT: Generated 871 derivative records from 25687 primary records. [2025-09-05T19:13:51.458455] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-05T19:13:51.459208] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-05T19:13:51.461605] [INFO ] [MAIN ] Derivative Progress: 1048/2117 symbols completed. LAW took 0.9s. Estimated remaining: 5m 16s. Rate: 203.2 symbols/min [2025-09-05T19:13:51.464018] [INFO ] [MAIN ] Derivative Progress: 1049/2117 symbols completed. LBRT took 0.9s. Estimated remaining: 5m 15s. Rate: 203.3 symbols/min [2025-09-05T19:13:51.479662] [INFO ] [MAIN ] LC: Generated 1352 derivative records from 36169 primary records. [2025-09-05T19:13:51.491949] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-05T19:13:51.494465] [INFO ] [MAIN ] Derivative Progress: 1050/2117 symbols completed. LC took 0.9s. Estimated remaining: 5m 15s. Rate: 203.5 symbols/min [2025-09-05T19:13:51.495139] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:51.495228] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:51.495326] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:51.528372] [INFO ] [MAIN ] LDI: Loaded 21344 primary data records. [2025-09-05T19:13:51.648005] [INFO ] [MAIN ] LCII: Loaded 21580 primary data records. [2025-09-05T19:13:51.647332] [INFO ] [MAIN ] LDOS: Loaded 21233 primary data records. [2025-09-05T19:13:52.360701] [INFO ] [MAIN ] LDI: Generated 871 derivative records from 21344 primary records. [2025-09-05T19:13:52.371997] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-05T19:13:52.373445] [INFO ] [MAIN ] Derivative Progress: 1051/2117 symbols completed. LDI took 0.9s. Estimated remaining: 5m 15s. Rate: 203.1 symbols/min [2025-09-05T19:13:52.374031] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:52.391245] [INFO ] [MAIN ] LDOS: Generated 871 derivative records from 21233 primary records. [2025-09-05T19:13:52.395323] [INFO ] [MAIN ] LDP: Loaded 9823 primary data records. [2025-09-05T19:13:52.428407] [INFO ] [MAIN ] LCII: Generated 1352 derivative records from 21580 primary records. [2025-09-05T19:13:52.528113] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-05T19:13:52.547033] [INFO ] [MAIN ] Derivative Progress: 1052/2117 symbols completed. LDOS took 1.1s. Estimated remaining: 5m 14s. Rate: 203.2 symbols/min [2025-09-05T19:13:52.587326] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-05T19:13:52.590314] [INFO ] [MAIN ] Derivative Progress: 1053/2117 symbols completed. LCII took 1.1s. Estimated remaining: 5m 14s. Rate: 203.4 symbols/min [2025-09-05T19:13:52.693106] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:52.692575] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:52.724795] [INFO ] [MAIN ] LEA: Loaded 20252 primary data records. [2025-09-05T19:13:52.773959] [INFO ] [MAIN ] LEG: Loaded 24192 primary data records. [2025-09-05T19:13:52.773237] [INFO ] [MAIN ] LDP: Generated 1352 derivative records from 9823 primary records. [2025-09-05T19:13:53.089876] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-05T19:13:53.109412] [INFO ] [MAIN ] Derivative Progress: 1054/2117 symbols completed. LDP took 0.7s. Estimated remaining: 5m 14s. Rate: 203.2 symbols/min [2025-09-05T19:13:53.113481] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:53.253412] [INFO ] [MAIN ] LEA: Generated 871 derivative records from 20252 primary records. [2025-09-05T19:13:53.280806] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-05T19:13:53.280495] [INFO ] [MAIN ] LEN: Loaded 25818 primary data records. [2025-09-05T19:13:53.283235] [INFO ] [MAIN ] Derivative Progress: 1055/2117 symbols completed. LEA took 0.7s. Estimated remaining: 5m 13s. Rate: 203.3 symbols/min [2025-09-05T19:13:53.281820] [INFO ] [MAIN ] LEG: Generated 871 derivative records from 24192 primary records. [2025-09-05T19:13:53.283508] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:53.398735] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-05T19:13:53.405378] [INFO ] [MAIN ] Derivative Progress: 1056/2117 symbols completed. LEG took 0.8s. Estimated remaining: 5m 13s. Rate: 203.4 symbols/min [2025-09-05T19:13:53.430923] [INFO ] [MAIN ] LEO: Loaded 13109 primary data records. [2025-09-05T19:13:53.477591] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:53.825482] [INFO ] [MAIN ] LEN: Generated 871 derivative records from 25818 primary records. [2025-09-05T19:13:53.853804] [INFO ] [MAIN ] LEVI: Loaded 38828 primary data records. [2025-09-05T19:13:53.851354] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-05T19:13:53.855386] [INFO ] [MAIN ] Derivative Progress: 1057/2117 symbols completed. LEN took 0.7s. Estimated remaining: 5m 13s. Rate: 203.3 symbols/min [2025-09-05T19:13:53.857134] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:53.909803] [INFO ] [MAIN ] LEO: Generated 1352 derivative records from 13109 primary records. [2025-09-05T19:13:54.015746] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-05T19:13:54.028451] [INFO ] [MAIN ] Derivative Progress: 1058/2117 symbols completed. LEO took 0.7s. Estimated remaining: 5m 12s. Rate: 203.4 symbols/min [2025-09-05T19:13:54.097045] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:54.097932] [INFO ] [MAIN ] LH: Loaded 29196 primary data records. [2025-09-05T19:13:54.392411] [INFO ] [MAIN ] LHX: Loaded 23386 primary data records. [2025-09-05T19:13:54.640129] [INFO ] [MAIN ] LEVI: Generated 1352 derivative records from 38828 primary records. [2025-09-05T19:13:54.793505] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-05T19:13:54.795555] [INFO ] [MAIN ] Derivative Progress: 1059/2117 symbols completed. LEVI took 1.3s. Estimated remaining: 5m 13s. Rate: 203.1 symbols/min [2025-09-05T19:13:54.796222] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:54.814718] [INFO ] [MAIN ] LH: Generated 1352 derivative records from 29196 primary records. [2025-09-05T19:13:54.840163] [INFO ] [MAIN ] LHX: Generated 871 derivative records from 23386 primary records. [2025-09-05T19:13:54.840472] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-05T19:13:54.840905] [INFO ] [MAIN ] LII: Loaded 12661 primary data records. [2025-09-05T19:13:54.843771] [INFO ] [MAIN ] Derivative Progress: 1060/2117 symbols completed. LH took 1.0s. Estimated remaining: 5m 12s. Rate: 203.3 symbols/min [2025-09-05T19:13:54.870152] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:54.882095] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-05T19:13:54.922064] [INFO ] [MAIN ] Derivative Progress: 1061/2117 symbols completed. LHX took 0.9s. Estimated remaining: 5m 12s. Rate: 203.4 symbols/min [2025-09-05T19:13:54.933587] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:55.037045] [INFO ] [MAIN ] LITB: Loaded 1314 primary data records. [2025-09-05T19:13:55.205302] [INFO ] [MAIN ] LION: Loaded 24098 primary data records. [2025-09-05T19:13:55.530450] [INFO ] [MAIN ] LII: Generated 871 derivative records from 12661 primary records. [2025-09-05T19:13:55.595918] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-05T19:13:55.597666] [INFO ] [MAIN ] Derivative Progress: 1062/2117 symbols completed. LII took 0.8s. Estimated remaining: 5m 12s. Rate: 203.2 symbols/min [2025-09-05T19:13:55.598296] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:55.609495] [INFO ] [MAIN ] LITB: Generated 871 derivative records from 1314 primary records. [2025-09-05T19:13:55.618668] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-05T19:13:55.620119] [INFO ] [MAIN ] Derivative Progress: 1063/2117 symbols completed. LITB took 0.7s. Estimated remaining: 5m 11s. Rate: 203.3 symbols/min [2025-09-05T19:13:55.634585] [INFO ] [MAIN ] LION: Generated 871 derivative records from 24098 primary records. [2025-09-05T19:13:55.643088] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-05T19:13:55.652237] [INFO ] [MAIN ] Derivative Progress: 1064/2117 symbols completed. LION took 0.8s. Estimated remaining: 5m 10s. Rate: 203.5 symbols/min [2025-09-05T19:13:55.653024] [INFO ] [MAIN ] LLY: Loaded 25830 primary data records. [2025-09-05T19:13:55.894002] [INFO ] [MAIN ] LLY: Generated 871 derivative records from 25830 primary records. [2025-09-05T19:13:55.902674] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-05T19:13:55.903905] [INFO ] [MAIN ] Derivative Progress: 1065/2117 symbols completed. LLY took 0.3s. Estimated remaining: 5m 10s. Rate: 203.5 symbols/min [2025-09-05T19:13:55.904625] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:55.904978] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:55.904762] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:55.909607] [INFO ] [MAIN ] LND: Loaded 2434 primary data records. [2025-09-05T19:13:56.174696] [INFO ] [MAIN ] LNC: Loaded 24921 primary data records. [2025-09-05T19:13:56.223771] [INFO ] [MAIN ] LNG: Loaded 38848 primary data records. [2025-09-05T19:13:56.707278] [INFO ] [MAIN ] LND: Generated 871 derivative records from 2434 primary records. [2025-09-05T19:13:56.718396] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-05T19:13:56.720525] [INFO ] [MAIN ] Derivative Progress: 1066/2117 symbols completed. LND took 0.8s. Estimated remaining: 5m 10s. Rate: 203.2 symbols/min [2025-09-05T19:13:56.721257] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:56.728960] [INFO ] [MAIN ] LNC: Generated 871 derivative records from 24921 primary records. [2025-09-05T19:13:56.737865] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-05T19:13:56.741213] [INFO ] [MAIN ] Derivative Progress: 1067/2117 symbols completed. LNC took 0.8s. Estimated remaining: 5m 10s. Rate: 203.4 symbols/min [2025-09-05T19:13:56.741468] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:56.758285] [INFO ] [MAIN ] LNN: Loaded 8498 primary data records. [2025-09-05T19:13:56.758190] [INFO ] [MAIN ] LNG: Generated 1352 derivative records from 38848 primary records. [2025-09-05T19:13:56.883822] [INFO ] [MAIN ] LOAR: Loaded 20648 primary data records. [2025-09-05T19:13:56.977350] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-05T19:13:57.024781] [INFO ] [MAIN ] Derivative Progress: 1068/2117 symbols completed. LNG took 1.1s. Estimated remaining: 5m 9s. Rate: 203.4 symbols/min [2025-09-05T19:13:57.052825] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:57.296029] [INFO ] [MAIN ] LOB: Loaded 12208 primary data records. [2025-09-05T19:13:57.600971] [INFO ] [MAIN ] LNN: Generated 1352 derivative records from 8498 primary records. [2025-09-05T19:13:57.622543] [INFO ] [MAIN ] LOAR: Generated 870 derivative records from 20648 primary records. [2025-09-05T19:13:57.634883] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-05T19:13:57.638946] [INFO ] [MAIN ] Derivative Progress: 1069/2117 symbols completed. LNN took 0.9s. Estimated remaining: 5m 9s. Rate: 203.2 symbols/min [2025-09-05T19:13:57.640064] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:57.639660] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-05T19:13:57.648356] [INFO ] [MAIN ] Derivative Progress: 1070/2117 symbols completed. LOAR took 0.9s. Estimated remaining: 5m 9s. Rate: 203.4 symbols/min [2025-09-05T19:13:57.649199] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:57.651415] [INFO ] [MAIN ] LOB: Generated 871 derivative records from 12208 primary records. [2025-09-05T19:13:57.654098] [INFO ] [MAIN ] LOCL: Loaded 2298 primary data records. [2025-09-05T19:13:57.746916] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-05T19:13:57.770903] [INFO ] [MAIN ] Derivative Progress: 1071/2117 symbols completed. LOB took 0.7s. Estimated remaining: 5m 8s. Rate: 203.5 symbols/min [2025-09-05T19:13:57.795002] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:57.801070] [INFO ] [MAIN ] LOMA: Loaded 22920 primary data records. [2025-09-05T19:13:58.240613] [INFO ] [MAIN ] LOW: Loaded 39903 primary data records. [2025-09-05T19:13:58.375479] [INFO ] [MAIN ] LOCL: Generated 1352 derivative records from 2298 primary records. [2025-09-05T19:13:58.534764] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-05T19:13:58.537602] [INFO ] [MAIN ] Derivative Progress: 1072/2117 symbols completed. LOCL took 0.9s. Estimated remaining: 5m 9s. Rate: 203.2 symbols/min [2025-09-05T19:13:58.539842] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:58.552369] [INFO ] [MAIN ] LOMA: Generated 1352 derivative records from 22920 primary records. [2025-09-05T19:13:58.572103] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-05T19:13:58.574812] [INFO ] [MAIN ] Derivative Progress: 1073/2117 symbols completed. LOMA took 0.9s. Estimated remaining: 5m 8s. Rate: 203.3 symbols/min [2025-09-05T19:13:58.575269] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:58.585633] [INFO ] [MAIN ] LPG: Loaded 19146 primary data records. [2025-09-05T19:13:58.668746] [INFO ] [MAIN ] LOW: Generated 1352 derivative records from 39903 primary records. [2025-09-05T19:13:58.703975] [INFO ] [MAIN ] LPL: Loaded 13531 primary data records. [2025-09-05T19:13:58.957695] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-05T19:13:58.976070] [INFO ] [MAIN ] Derivative Progress: 1074/2117 symbols completed. LOW took 1.2s. Estimated remaining: 5m 8s. Rate: 203.3 symbols/min [2025-09-05T19:13:58.981884] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:59.120474] [INFO ] [MAIN ] LPG: Generated 871 derivative records from 19146 primary records. [2025-09-05T19:13:59.147404] [INFO ] [MAIN ] LPX: Loaded 30030 primary data records. [2025-09-05T19:13:59.149294] [INFO ] [MAIN ] LPL: Generated 871 derivative records from 13531 primary records. [2025-09-05T19:13:59.149369] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-05T19:13:59.161798] [INFO ] [MAIN ] Derivative Progress: 1075/2117 symbols completed. LPG took 0.6s. Estimated remaining: 5m 7s. Rate: 203.3 symbols/min [2025-09-05T19:13:59.191000] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:59.260669] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-05T19:13:59.262112] [INFO ] [MAIN ] Derivative Progress: 1076/2117 symbols completed. LPL took 0.7s. Estimated remaining: 5m 7s. Rate: 203.5 symbols/min [2025-09-05T19:13:59.262288] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:13:59.451355] [INFO ] [MAIN ] LRN: Loaded 30022 primary data records. [2025-09-05T19:13:59.577971] [INFO ] [MAIN ] LSPD: Loaded 32005 primary data records. [2025-09-05T19:14:00.010603] [INFO ] [MAIN ] LPX: Generated 1352 derivative records from 30030 primary records. [2025-09-05T19:14:00.123011] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-05T19:14:00.125136] [INFO ] [MAIN ] Derivative Progress: 1077/2117 symbols completed. LPX took 1.1s. Estimated remaining: 5m 7s. Rate: 203.1 symbols/min [2025-09-05T19:14:00.128067] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:00.140814] [INFO ] [MAIN ] LRN: Generated 1352 derivative records from 30022 primary records. [2025-09-05T19:14:00.161748] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-05T19:14:00.164807] [INFO ] [MAIN ] Derivative Progress: 1078/2117 symbols completed. LRN took 1.0s. Estimated remaining: 5m 7s. Rate: 203.3 symbols/min [2025-09-05T19:14:00.176158] [INFO ] [MAIN ] LSPD: Generated 1352 derivative records from 32005 primary records. [2025-09-05T19:14:00.196835] [INFO ] [MAIN ] LTC: Loaded 22871 primary data records. [2025-09-05T19:14:00.300595] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-05T19:14:00.308378] [INFO ] [MAIN ] Derivative Progress: 1079/2117 symbols completed. LSPD took 1.0s. Estimated remaining: 5m 6s. Rate: 203.3 symbols/min [2025-09-05T19:14:00.477632] [INFO ] [MAIN ] LTC: Generated 1352 derivative records from 22871 primary records. [2025-09-05T19:14:00.489779] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-05T19:14:00.491742] [INFO ] [MAIN ] Derivative Progress: 1080/2117 symbols completed. LTC took 0.4s. Estimated remaining: 5m 6s. Rate: 203.4 symbols/min [2025-09-05T19:14:00.492292] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:00.492391] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:00.492875] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:00.516011] [INFO ] [MAIN ] LTM: Loaded 19129 primary data records. [2025-09-05T19:14:00.665126] [INFO ] [MAIN ] LTH: Loaded 39061 primary data records. [2025-09-05T19:14:00.687000] [INFO ] [MAIN ] LU: Loaded 36870 primary data records. [2025-09-05T19:14:01.358532] [INFO ] [MAIN ] LTM: Generated 871 derivative records from 19129 primary records. [2025-09-05T19:14:01.369574] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-05T19:14:01.371532] [INFO ] [MAIN ] Derivative Progress: 1081/2117 symbols completed. LTM took 0.9s. Estimated remaining: 5m 6s. Rate: 203.0 symbols/min [2025-09-05T19:14:01.372132] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:01.391493] [INFO ] [MAIN ] LUCK: Loaded 11121 primary data records. [2025-09-05T19:14:01.426714] [INFO ] [MAIN ] LU: Generated 1352 derivative records from 36870 primary records. [2025-09-05T19:14:01.502303] [INFO ] [MAIN ] LTH: Generated 1352 derivative records from 39061 primary records. [2025-09-05T19:14:01.625526] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-05T19:14:01.629571] [INFO ] [MAIN ] Derivative Progress: 1082/2117 symbols completed. LTH took 1.1s. Estimated remaining: 5m 6s. Rate: 203.1 symbols/min [2025-09-05T19:14:01.629684] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-05T19:14:01.629973] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:01.689039] [INFO ] [MAIN ] Derivative Progress: 1083/2117 symbols completed. LU took 1.2s. Estimated remaining: 5m 5s. Rate: 203.2 symbols/min [2025-09-05T19:14:01.690152] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:01.707496] [INFO ] [MAIN ] LUCK: Generated 871 derivative records from 11121 primary records. [2025-09-05T19:14:01.724827] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-09-05T19:14:01.726183] [INFO ] [MAIN ] Derivative Progress: 1084/2117 symbols completed. LUCK took 0.4s. Estimated remaining: 5m 5s. Rate: 203.4 symbols/min [2025-09-05T19:14:01.726593] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:01.748718] [INFO ] [MAIN ] LUV: Loaded 26062 primary data records. [2025-09-05T19:14:01.871559] [INFO ] [MAIN ] LUMN: Loaded 40390 primary data records. [2025-09-05T19:14:01.962479] [INFO ] [MAIN ] LVS: Loaded 25962 primary data records. [2025-09-05T19:14:02.601513] [INFO ] [MAIN ] LUV: Generated 871 derivative records from 26062 primary records. [2025-09-05T19:14:02.613610] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-05T19:14:02.615589] [INFO ] [MAIN ] Derivative Progress: 1085/2117 symbols completed. LUV took 0.9s. Estimated remaining: 5m 5s. Rate: 203.0 symbols/min [2025-09-05T19:14:02.616199] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:02.635599] [INFO ] [MAIN ] LVS: Generated 871 derivative records from 25962 primary records. [2025-09-05T19:14:02.650113] [INFO ] [MAIN ] LVWR: Loaded 14668 primary data records. [2025-09-05T19:14:02.651956] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-05T19:14:02.653979] [INFO ] [MAIN ] Derivative Progress: 1086/2117 symbols completed. LVS took 0.9s. Estimated remaining: 5m 4s. Rate: 203.2 symbols/min [2025-09-05T19:14:02.684120] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:02.699425] [INFO ] [MAIN ] LUMN: Generated 1352 derivative records from 40390 primary records. [2025-09-05T19:14:02.829989] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-05T19:14:02.869264] [INFO ] [MAIN ] Derivative Progress: 1087/2117 symbols completed. LUMN took 1.2s. Estimated remaining: 5m 4s. Rate: 203.2 symbols/min [2025-09-05T19:14:02.871474] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:02.971205] [INFO ] [MAIN ] LW: Loaded 24685 primary data records. [2025-09-05T19:14:03.059618] [INFO ] [MAIN ] LXFR: Loaded 8183 primary data records. [2025-09-05T19:14:03.488628] [INFO ] [MAIN ] LVWR: Generated 1352 derivative records from 14668 primary records. [2025-09-05T19:14:03.505627] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-05T19:14:03.507833] [INFO ] [MAIN ] Derivative Progress: 1088/2117 symbols completed. LVWR took 0.9s. Estimated remaining: 5m 4s. Rate: 203.0 symbols/min [2025-09-05T19:14:03.508273] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:03.520405] [INFO ] [MAIN ] LW: Generated 871 derivative records from 24685 primary records. [2025-09-05T19:14:03.533053] [INFO ] [MAIN ] LXFR: Generated 871 derivative records from 8183 primary records. [2025-09-05T19:14:03.536324] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-05T19:14:03.538331] [INFO ] [MAIN ] Derivative Progress: 1089/2117 symbols completed. LW took 0.9s. Estimated remaining: 5m 4s. Rate: 203.2 symbols/min [2025-09-05T19:14:03.538891] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:03.547740] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-05T19:14:03.550014] [INFO ] [MAIN ] Derivative Progress: 1090/2117 symbols completed. LXFR took 0.7s. Estimated remaining: 5m 3s. Rate: 203.4 symbols/min [2025-09-05T19:14:03.550320] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:03.578547] [INFO ] [MAIN ] LXU: Loaded 24684 primary data records. [2025-09-05T19:14:03.766300] [INFO ] [MAIN ] LXP: Loaded 38333 primary data records. [2025-09-05T19:14:03.793526] [INFO ] [MAIN ] LYB: Loaded 26014 primary data records. [2025-09-05T19:14:04.417004] [INFO ] [MAIN ] LXU: Generated 1352 derivative records from 24684 primary records. [2025-09-05T19:14:04.441235] [INFO ] [MAIN ] LYB: Generated 871 derivative records from 26014 primary records. [2025-09-05T19:14:04.447617] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-05T19:14:04.452889] [INFO ] [MAIN ] LXP: Generated 1352 derivative records from 38333 primary records. [2025-09-05T19:14:04.454885] [INFO ] [MAIN ] Derivative Progress: 1091/2117 symbols completed. LXU took 0.9s. Estimated remaining: 5m 3s. Rate: 203.0 symbols/min [2025-09-05T19:14:04.462252] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:04.473229] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-05T19:14:04.475383] [INFO ] [MAIN ] Derivative Progress: 1092/2117 symbols completed. LYB took 0.9s. Estimated remaining: 5m 3s. Rate: 203.1 symbols/min [2025-09-05T19:14:04.476300] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:04.478588] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-05T19:14:04.481094] [INFO ] [MAIN ] Derivative Progress: 1093/2117 symbols completed. LXP took 1.0s. Estimated remaining: 5m 2s. Rate: 203.3 symbols/min [2025-09-05T19:14:04.508813] [INFO ] [MAIN ] LYG: Loaded 25527 primary data records. [2025-09-05T19:14:04.616993] [INFO ] [MAIN ] LYV: Loaded 24669 primary data records. [2025-09-05T19:14:05.026391] [INFO ] [MAIN ] LYG: Generated 871 derivative records from 25527 primary records. [2025-09-05T19:14:05.035677] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-05T19:14:05.037800] [INFO ] [MAIN ] Derivative Progress: 1094/2117 symbols completed. LYG took 0.6s. Estimated remaining: 5m 2s. Rate: 203.2 symbols/min [2025-09-05T19:14:05.045014] [INFO ] [MAIN ] LYV: Generated 871 derivative records from 24669 primary records. [2025-09-05T19:14:05.053285] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-05T19:14:05.054834] [INFO ] [MAIN ] Derivative Progress: 1095/2117 symbols completed. LYV took 0.6s. Estimated remaining: 5m 2s. Rate: 203.3 symbols/min [2025-09-05T19:14:05.055373] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:05.055552] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:05.055590] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:05.090104] [INFO ] [MAIN ] LZB: Loaded 17581 primary data records. [2025-09-05T19:14:05.098890] [INFO ] [MAIN ] MA: Loaded 25439 primary data records. [2025-09-05T19:14:05.203607] [INFO ] [MAIN ] M: Loaded 25968 primary data records. [2025-09-05T19:14:05.825094] [INFO ] [MAIN ] LZB: Generated 871 derivative records from 17581 primary records. [2025-09-05T19:14:05.846869] [INFO ] [MAIN ] MA: Generated 871 derivative records from 25439 primary records. [2025-09-05T19:14:05.855777] [INFO ] [MAIN ] M: Generated 871 derivative records from 25968 primary records. [2025-09-05T19:14:05.856148] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-05T19:14:05.861974] [INFO ] [MAIN ] Derivative Progress: 1096/2117 symbols completed. LZB took 0.8s. Estimated remaining: 5m 2s. Rate: 203.0 symbols/min [2025-09-05T19:14:05.862254] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:05.876051] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-05T19:14:05.875938] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-05T19:14:05.877802] [INFO ] [MAIN ] Derivative Progress: 1097/2117 symbols completed. M took 0.8s. Estimated remaining: 5m 1s. Rate: 203.2 symbols/min [2025-09-05T19:14:05.879756] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:05.879671] [INFO ] [MAIN ] Derivative Progress: 1098/2117 symbols completed. MA took 0.8s. Estimated remaining: 5m 1s. Rate: 203.4 symbols/min [2025-09-05T19:14:05.880384] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:05.916612] [INFO ] [MAIN ] MAC: Loaded 23830 primary data records. [2025-09-05T19:14:05.918136] [INFO ] [MAIN ] MAIN: Loaded 19634 primary data records. [2025-09-05T19:14:05.984316] [INFO ] [MAIN ] MAGN: Loaded 17054 primary data records. [2025-09-05T19:14:06.671319] [INFO ] [MAIN ] MAIN: Generated 871 derivative records from 19634 primary records. [2025-09-05T19:14:06.680953] [INFO ] [MAIN ] MAC: Generated 871 derivative records from 23830 primary records. [2025-09-05T19:14:06.700685] [INFO ] [MAIN ] MAGN: Generated 871 derivative records from 17054 primary records. [2025-09-05T19:14:06.711162] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-05T19:14:06.713574] [INFO ] [MAIN ] Derivative Progress: 1099/2117 symbols completed. MAIN took 0.8s. Estimated remaining: 5m 1s. Rate: 203.0 symbols/min [2025-09-05T19:14:06.714475] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:06.710884] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-05T19:14:06.715070] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-05T19:14:06.716283] [INFO ] [MAIN ] Derivative Progress: 1100/2117 symbols completed. MAC took 0.9s. Estimated remaining: 5m 0s. Rate: 203.2 symbols/min [2025-09-05T19:14:06.718487] [INFO ] [MAIN ] Derivative Progress: 1101/2117 symbols completed. MAGN took 0.8s. Estimated remaining: 4m 60s. Rate: 203.4 symbols/min [2025-09-05T19:14:06.718429] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:06.718671] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:06.743675] [INFO ] [MAIN ] MAN: Loaded 21268 primary data records. [2025-09-05T19:14:06.847148] [INFO ] [MAIN ] MANU: Loaded 13196 primary data records. [2025-09-05T19:14:07.057613] [INFO ] [MAIN ] MAS: Loaded 39384 primary data records. [2025-09-05T19:14:07.532999] [INFO ] [MAIN ] MAN: Generated 871 derivative records from 21268 primary records. [2025-09-05T19:14:07.549661] [INFO ] [MAIN ] MANU: Generated 871 derivative records from 13196 primary records. [2025-09-05T19:14:07.557367] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-05T19:14:07.558864] [INFO ] [MAIN ] Derivative Progress: 1102/2117 symbols completed. MAN took 0.8s. Estimated remaining: 4m 60s. Rate: 203.1 symbols/min [2025-09-05T19:14:07.559075] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:07.560986] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-05T19:14:07.562552] [INFO ] [MAIN ] Derivative Progress: 1103/2117 symbols completed. MANU took 0.8s. Estimated remaining: 4m 59s. Rate: 203.2 symbols/min [2025-09-05T19:14:07.562915] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:07.583081] [INFO ] [MAIN ] MAS: Generated 1352 derivative records from 39384 primary records. [2025-09-05T19:14:07.608631] [INFO ] [MAIN ] MATX: Loaded 14703 primary data records. [2025-09-05T19:14:07.722501] [INFO ] [MAIN ] MATV: Loaded 27716 primary data records. [2025-09-05T19:14:07.709426] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-05T19:14:07.748260] [INFO ] [MAIN ] Derivative Progress: 1104/2117 symbols completed. MAS took 1.0s. Estimated remaining: 4m 59s. Rate: 203.3 symbols/min [2025-09-05T19:14:07.758207] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:08.205582] [INFO ] [MAIN ] MBC: Loaded 32212 primary data records. [2025-09-05T19:14:08.322601] [INFO ] [MAIN ] MATX: Generated 871 derivative records from 14703 primary records. [2025-09-05T19:14:08.408020] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-05T19:14:08.484755] [INFO ] [MAIN ] Derivative Progress: 1105/2117 symbols completed. MATX took 0.9s. Estimated remaining: 4m 59s. Rate: 203.0 symbols/min [2025-09-05T19:14:08.495981] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:08.510445] [INFO ] [MAIN ] MATV: Generated 1352 derivative records from 27716 primary records. [2025-09-05T19:14:08.530901] [INFO ] [MAIN ] MBI: Loaded 11702 primary data records. [2025-09-05T19:14:08.571157] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-05T19:14:08.592823] [INFO ] [MAIN ] Derivative Progress: 1106/2117 symbols completed. MATV took 1.0s. Estimated remaining: 4m 59s. Rate: 203.2 symbols/min [2025-09-05T19:14:08.615762] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:08.805040] [INFO ] [MAIN ] MBC: Generated 1351 derivative records from 32212 primary records. [2025-09-05T19:14:08.830368] [INFO ] [MAIN ] MC: Loaded 33546 primary data records. [2025-09-05T19:14:08.831766] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-05T19:14:08.846091] [INFO ] [MAIN ] Derivative Progress: 1107/2117 symbols completed. MBC took 1.1s. Estimated remaining: 4m 58s. Rate: 203.2 symbols/min [2025-09-05T19:14:08.872743] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:09.012451] [INFO ] [MAIN ] MCB: Loaded 4968 primary data records. [2025-09-05T19:14:09.064729] [INFO ] [MAIN ] MBI: Generated 871 derivative records from 11702 primary records. [2025-09-05T19:14:09.304117] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-05T19:14:09.369106] [INFO ] [MAIN ] Derivative Progress: 1108/2117 symbols completed. MBI took 0.9s. Estimated remaining: 4m 58s. Rate: 203.0 symbols/min [2025-09-05T19:14:09.395114] [INFO ] [MAIN ] MCB: Generated 871 derivative records from 4968 primary records. [2025-09-05T19:14:09.395756] [INFO ] [MAIN ] MC: Generated 1352 derivative records from 33546 primary records. [2025-09-05T19:14:09.414000] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-05T19:14:09.416142] [INFO ] [MAIN ] Derivative Progress: 1109/2117 symbols completed. MCB took 0.5s. Estimated remaining: 4m 58s. Rate: 203.2 symbols/min [2025-09-05T19:14:09.417253] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-05T19:14:09.419768] [INFO ] [MAIN ] Derivative Progress: 1110/2117 symbols completed. MC took 0.8s. Estimated remaining: 4m 57s. Rate: 203.4 symbols/min [2025-09-05T19:14:09.420273] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:09.420313] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:09.420431] [INFO ] [MAIN ] MCD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:09.425946] [INFO ] [MAIN ] MCI: Loaded 2816 primary data records. [2025-09-05T19:14:09.694597] [INFO ] [MAIN ] MCD: Loaded 26022 primary data records. [2025-09-05T19:14:09.695448] [INFO ] [MAIN ] MCK: Loaded 29327 primary data records. [2025-09-05T19:14:10.257460] [INFO ] [MAIN ] MCI: Generated 871 derivative records from 2816 primary records. [2025-09-05T19:14:10.270613] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-05T19:14:10.272926] [INFO ] [MAIN ] Derivative Progress: 1111/2117 symbols completed. MCI took 0.9s. Estimated remaining: 4m 57s. Rate: 203.0 symbols/min [2025-09-05T19:14:10.273294] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:10.283763] [INFO ] [MAIN ] MCN: Loaded 3868 primary data records. [2025-09-05T19:14:10.334432] [INFO ] [MAIN ] MCD: Generated 871 derivative records from 26022 primary records. [2025-09-05T19:14:10.429236] [INFO ] [MAIN ] MCK: Generated 1352 derivative records from 29327 primary records. [2025-09-05T19:14:10.429302] [INFO ] [MAIN ] MCD: Successfully saved derivative data. [2025-09-05T19:14:10.456604] [INFO ] [MAIN ] Derivative Progress: 1112/2117 symbols completed. MCD took 1.0s. Estimated remaining: 4m 57s. Rate: 203.1 symbols/min [2025-09-05T19:14:10.469429] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:10.563631] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-05T19:14:10.566323] [INFO ] [MAIN ] Derivative Progress: 1113/2117 symbols completed. MCK took 1.1s. Estimated remaining: 4m 56s. Rate: 203.2 symbols/min [2025-09-05T19:14:10.566690] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:10.577297] [INFO ] [MAIN ] MCO: Loaded 17978 primary data records. [2025-09-05T19:14:10.616145] [INFO ] [MAIN ] MCR: Loaded 4478 primary data records. [2025-09-05T19:14:10.802452] [INFO ] [MAIN ] MCN: Generated 871 derivative records from 3868 primary records. [2025-09-05T19:14:11.061318] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-05T19:14:11.063046] [INFO ] [MAIN ] Derivative Progress: 1114/2117 symbols completed. MCN took 0.8s. Estimated remaining: 4m 56s. Rate: 203.1 symbols/min [2025-09-05T19:14:11.064780] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:11.082496] [INFO ] [MAIN ] MCO: Generated 870 derivative records from 17978 primary records. [2025-09-05T19:14:11.087383] [INFO ] [MAIN ] MCS: Loaded 10447 primary data records. [2025-09-05T19:14:11.157749] [INFO ] [MAIN ] MCR: Generated 871 derivative records from 4478 primary records. [2025-09-05T19:14:11.180107] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-05T19:14:11.209583] [INFO ] [MAIN ] Derivative Progress: 1115/2117 symbols completed. MCO took 0.7s. Estimated remaining: 4m 56s. Rate: 203.2 symbols/min [2025-09-05T19:14:11.215324] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:11.242970] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-05T19:14:11.294094] [INFO ] [MAIN ] Derivative Progress: 1116/2117 symbols completed. MCR took 0.7s. Estimated remaining: 4m 55s. Rate: 203.3 symbols/min [2025-09-05T19:14:11.356825] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:11.366746] [INFO ] [MAIN ] MCY: Loaded 18510 primary data records. [2025-09-05T19:14:11.482302] [INFO ] [MAIN ] MD: Loaded 18731 primary data records. [2025-09-05T19:14:11.764911] [INFO ] [MAIN ] MCS: Generated 871 derivative records from 10447 primary records. [2025-09-05T19:14:11.894836] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-05T19:14:11.896908] [INFO ] [MAIN ] Derivative Progress: 1117/2117 symbols completed. MCS took 0.8s. Estimated remaining: 4m 55s. Rate: 203.1 symbols/min [2025-09-05T19:14:11.898474] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:11.904853] [INFO ] [MAIN ] MDST: Loaded 2879 primary data records. [2025-09-05T19:14:12.020978] [INFO ] [MAIN ] MCY: Generated 1351 derivative records from 18510 primary records. [2025-09-05T19:14:12.069867] [INFO ] [MAIN ] MD: Generated 871 derivative records from 18731 primary records. [2025-09-05T19:14:12.188104] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-05T19:14:12.190738] [INFO ] [MAIN ] Derivative Progress: 1118/2117 symbols completed. MD took 0.8s. Estimated remaining: 4m 55s. Rate: 203.1 symbols/min [2025-09-05T19:14:12.191374] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:12.192807] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-05T19:14:12.195618] [INFO ] [MAIN ] Derivative Progress: 1119/2117 symbols completed. MCY took 1.0s. Estimated remaining: 4m 55s. Rate: 203.3 symbols/min [2025-09-05T19:14:12.196339] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:12.210320] [INFO ] [MAIN ] MDST: Generated 870 derivative records from 2879 primary records. [2025-09-05T19:14:12.239039] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-05T19:14:12.241722] [INFO ] [MAIN ] Derivative Progress: 1120/2117 symbols completed. MDST took 0.3s. Estimated remaining: 4m 54s. Rate: 203.4 symbols/min [2025-09-05T19:14:12.249905] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:12.248887] [INFO ] [MAIN ] MDT: Loaded 26048 primary data records. [2025-09-05T19:14:12.250745] [INFO ] [MAIN ] MDU: Loaded 22931 primary data records. [2025-09-05T19:14:12.433229] [INFO ] [MAIN ] MDV: Loaded 6753 primary data records. [2025-09-05T19:14:13.082044] [INFO ] [MAIN ] MDU: Generated 871 derivative records from 22931 primary records. [2025-09-05T19:14:13.082699] [INFO ] [MAIN ] MDT: Generated 871 derivative records from 26048 primary records. [2025-09-05T19:14:13.100442] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-05T19:14:13.102236] [INFO ] [MAIN ] Derivative Progress: 1121/2117 symbols completed. MDT took 0.9s. Estimated remaining: 4m 54s. Rate: 203.1 symbols/min [2025-09-05T19:14:13.102939] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-05T19:14:13.102878] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:13.113369] [INFO ] [MAIN ] Derivative Progress: 1122/2117 symbols completed. MDU took 0.9s. Estimated remaining: 4m 54s. Rate: 203.3 symbols/min [2025-09-05T19:14:13.114072] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:13.114995] [INFO ] [MAIN ] MDV: Generated 1352 derivative records from 6753 primary records. [2025-09-05T19:14:13.130743] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-05T19:14:13.135463] [INFO ] [MAIN ] Derivative Progress: 1123/2117 symbols completed. MDV took 0.9s. Estimated remaining: 4m 53s. Rate: 203.4 symbols/min [2025-09-05T19:14:13.147742] [INFO ] [MAIN ] MEC: Loaded 12535 primary data records. [2025-09-05T19:14:13.148028] [INFO ] [MAIN ] MED: Loaded 10473 primary data records. [2025-09-05T19:14:13.665330] [INFO ] [MAIN ] MED: Generated 871 derivative records from 10473 primary records. [2025-09-05T19:14:13.685032] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-05T19:14:13.684975] [INFO ] [MAIN ] MEC: Generated 1352 derivative records from 12535 primary records. [2025-09-05T19:14:13.686617] [INFO ] [MAIN ] Derivative Progress: 1124/2117 symbols completed. MED took 0.6s. Estimated remaining: 4m 53s. Rate: 203.3 symbols/min [2025-09-05T19:14:13.698294] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-05T19:14:13.700231] [INFO ] [MAIN ] Derivative Progress: 1125/2117 symbols completed. MEC took 0.6s. Estimated remaining: 4m 53s. Rate: 203.5 symbols/min [2025-09-05T19:14:13.700734] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:13.700694] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:13.700830] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:13.719479] [INFO ] [MAIN ] MEGI: Loaded 10422 primary data records. [2025-09-05T19:14:13.834959] [INFO ] [MAIN ] MEI: Loaded 23440 primary data records. [2025-09-05T19:14:13.894069] [INFO ] [MAIN ] MEG: Loaded 23138 primary data records. [2025-09-05T19:14:14.518691] [INFO ] [MAIN ] MEGI: Generated 871 derivative records from 10422 primary records. [2025-09-05T19:14:14.531987] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-05T19:14:14.533442] [INFO ] [MAIN ] Derivative Progress: 1126/2117 symbols completed. MEGI took 0.8s. Estimated remaining: 4m 53s. Rate: 203.1 symbols/min [2025-09-05T19:14:14.543295] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:14.544830] [INFO ] [MAIN ] MEI: Generated 1352 derivative records from 23440 primary records. [2025-09-05T19:14:14.558410] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-05T19:14:14.561577] [INFO ] [MAIN ] Derivative Progress: 1127/2117 symbols completed. MEI took 0.9s. Estimated remaining: 4m 52s. Rate: 203.3 symbols/min [2025-09-05T19:14:14.561888] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:14.583436] [INFO ] [MAIN ] MEG: Generated 1352 derivative records from 23138 primary records. [2025-09-05T19:14:14.607100] [INFO ] [MAIN ] MET: Loaded 25849 primary data records. [2025-09-05T19:14:14.606440] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-05T19:14:14.651863] [INFO ] [MAIN ] Derivative Progress: 1128/2117 symbols completed. MEG took 1.0s. Estimated remaining: 4m 52s. Rate: 203.4 symbols/min [2025-09-05T19:14:14.725060] [INFO ] [MAIN ] MFA: Loaded 21507 primary data records. [2025-09-05T19:14:14.728519] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:14.900075] [INFO ] [MAIN ] MFAN: Loaded 1916 primary data records. [2025-09-05T19:14:15.415347] [INFO ] [MAIN ] MET: Generated 871 derivative records from 25849 primary records. [2025-09-05T19:14:15.431364] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-05T19:14:15.433403] [INFO ] [MAIN ] Derivative Progress: 1129/2117 symbols completed. MET took 0.9s. Estimated remaining: 4m 52s. Rate: 203.1 symbols/min [2025-09-05T19:14:15.433877] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:15.441181] [INFO ] [MAIN ] MFA: Generated 871 derivative records from 21507 primary records. [2025-09-05T19:14:15.451926] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-05T19:14:15.453615] [INFO ] [MAIN ] Derivative Progress: 1130/2117 symbols completed. MFA took 0.9s. Estimated remaining: 4m 51s. Rate: 203.3 symbols/min [2025-09-05T19:14:15.454752] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:15.458807] [INFO ] [MAIN ] MFAO: Loaded 1720 primary data records. [2025-09-05T19:14:15.497303] [INFO ] [MAIN ] MFAN: Generated 870 derivative records from 1916 primary records. [2025-09-05T19:14:15.575088] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-05T19:14:15.581961] [INFO ] [MAIN ] Derivative Progress: 1131/2117 symbols completed. MFAN took 0.9s. Estimated remaining: 4m 51s. Rate: 203.4 symbols/min [2025-09-05T19:14:15.587766] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:15.659327] [INFO ] [MAIN ] MFC: Loaded 24675 primary data records. [2025-09-05T19:14:16.049049] [INFO ] [MAIN ] MFG: Loaded 37422 primary data records. [2025-09-05T19:14:16.213595] [INFO ] [MAIN ] MFAO: Generated 870 derivative records from 1720 primary records. [2025-09-05T19:14:16.347533] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-05T19:14:16.351179] [INFO ] [MAIN ] Derivative Progress: 1132/2117 symbols completed. MFAO took 0.9s. Estimated remaining: 4m 51s. Rate: 203.1 symbols/min [2025-09-05T19:14:16.358201] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:16.359716] [INFO ] [MAIN ] MFC: Generated 871 derivative records from 24675 primary records. [2025-09-05T19:14:16.372678] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-05T19:14:16.376216] [INFO ] [MAIN ] MFM: Loaded 6496 primary data records. [2025-09-05T19:14:16.377867] [INFO ] [MAIN ] Derivative Progress: 1133/2117 symbols completed. MFC took 0.9s. Estimated remaining: 4m 50s. Rate: 203.3 symbols/min [2025-09-05T19:14:16.378232] [INFO ] [MAIN ] MFSB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:16.446434] [INFO ] [MAIN ] MFSB: Loaded 814 primary data records. [2025-09-05T19:14:16.582113] [INFO ] [MAIN ] MFG: Generated 1352 derivative records from 37422 primary records. [2025-09-05T19:14:16.883445] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-05T19:14:16.886196] [INFO ] [MAIN ] Derivative Progress: 1134/2117 symbols completed. MFG took 1.3s. Estimated remaining: 4m 50s. Rate: 203.1 symbols/min [2025-09-05T19:14:16.886597] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:16.894329] [INFO ] [MAIN ] MFSG: Loaded 2878 primary data records. [2025-09-05T19:14:17.025669] [INFO ] [MAIN ] MFM: Generated 871 derivative records from 6496 primary records. [2025-09-05T19:14:17.164731] [INFO ] [MAIN ] MFSB: Generated 858 derivative records from 814 primary records. [2025-09-05T19:14:17.167777] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-05T19:14:17.169991] [INFO ] [MAIN ] Derivative Progress: 1135/2117 symbols completed. MFM took 0.8s. Estimated remaining: 4m 50s. Rate: 203.1 symbols/min [2025-09-05T19:14:17.175247] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:17.178047] [INFO ] [MAIN ] MFSB: Successfully saved derivative data. [2025-09-05T19:14:17.179589] [INFO ] [MAIN ] Derivative Progress: 1136/2117 symbols completed. MFSB took 0.8s. Estimated remaining: 4m 49s. Rate: 203.3 symbols/min [2025-09-05T19:14:17.180176] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:17.194748] [INFO ] [MAIN ] MFSG: Generated 870 derivative records from 2878 primary records. [2025-09-05T19:14:17.200167] [INFO ] [MAIN ] MG: Loaded 7383 primary data records. [2025-09-05T19:14:17.322632] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-05T19:14:17.340402] [INFO ] [MAIN ] Derivative Progress: 1137/2117 symbols completed. MFSG took 0.5s. Estimated remaining: 4m 49s. Rate: 203.4 symbols/min [2025-09-05T19:14:17.353439] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:17.492743] [INFO ] [MAIN ] MGA: Loaded 37872 primary data records. [2025-09-05T19:14:17.502236] [INFO ] [MAIN ] MGF: Loaded 2132 primary data records. [2025-09-05T19:14:18.103276] [INFO ] [MAIN ] MG: Generated 871 derivative records from 7383 primary records. [2025-09-05T19:14:18.113287] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-05T19:14:18.115397] [INFO ] [MAIN ] Derivative Progress: 1138/2117 symbols completed. MG took 0.9s. Estimated remaining: 4m 49s. Rate: 203.1 symbols/min [2025-09-05T19:14:18.126068] [INFO ] [MAIN ] MGF: Generated 870 derivative records from 2132 primary records. [2025-09-05T19:14:18.135275] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-05T19:14:18.136817] [INFO ] [MAIN ] Derivative Progress: 1139/2117 symbols completed. MGF took 0.8s. Estimated remaining: 4m 49s. Rate: 203.3 symbols/min [2025-09-05T19:14:18.146926] [INFO ] [MAIN ] MGA: Generated 1352 derivative records from 37872 primary records. [2025-09-05T19:14:18.158717] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-05T19:14:18.161076] [INFO ] [MAIN ] Derivative Progress: 1140/2117 symbols completed. MGA took 1.0s. Estimated remaining: 4m 48s. Rate: 203.4 symbols/min [2025-09-05T19:14:18.161477] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:18.161698] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:18.161586] [INFO ] [MAIN ] MH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:18.167671] [INFO ] [MAIN ] MGRB: Loaded 1896 primary data records. [2025-09-05T19:14:18.166053] [INFO ] [MAIN ] MGRD: Loaded 1092 primary data records. [2025-09-05T19:14:18.354968] [INFO ] [MAIN ] MH: Loaded 9087 primary data records. [2025-09-05T19:14:18.867539] [INFO ] [MAIN ] MGRB: Generated 871 derivative records from 1896 primary records. [2025-09-05T19:14:18.872322] [INFO ] [MAIN ] MH: Generated 397 derivative records from 9087 primary records. [2025-09-05T19:14:18.891057] [INFO ] [MAIN ] MGRD: Generated 869 derivative records from 1092 primary records. [2025-09-05T19:14:18.891314] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-05T19:14:18.892946] [INFO ] [MAIN ] Derivative Progress: 1141/2117 symbols completed. MGRB took 0.7s. Estimated remaining: 4m 48s. Rate: 203.2 symbols/min [2025-09-05T19:14:18.893709] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:18.893973] [INFO ] [MAIN ] MH: Successfully saved derivative data. [2025-09-05T19:14:18.895044] [INFO ] [MAIN ] Derivative Progress: 1142/2117 symbols completed. MH took 0.7s. Estimated remaining: 4m 48s. Rate: 203.3 symbols/min [2025-09-05T19:14:18.895470] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:18.902570] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-05T19:14:18.906346] [INFO ] [MAIN ] Derivative Progress: 1143/2117 symbols completed. MGRD took 0.7s. Estimated remaining: 4m 47s. Rate: 203.5 symbols/min [2025-09-05T19:14:18.906588] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:18.916566] [INFO ] [MAIN ] MHD: Loaded 8895 primary data records. [2025-09-05T19:14:18.916340] [INFO ] [MAIN ] MHF: Loaded 6745 primary data records. [2025-09-05T19:14:19.473518] [INFO ] [MAIN ] MHK: Loaded 32031 primary data records. [2025-09-05T19:14:19.775488] [INFO ] [MAIN ] MHD: Generated 1352 derivative records from 8895 primary records. [2025-09-05T19:14:19.776191] [INFO ] [MAIN ] MHF: Generated 1352 derivative records from 6745 primary records. [2025-09-05T19:14:19.798360] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-05T19:14:19.801217] [INFO ] [MAIN ] Derivative Progress: 1144/2117 symbols completed. MHF took 0.9s. Estimated remaining: 4m 47s. Rate: 203.2 symbols/min [2025-09-05T19:14:19.802362] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:19.803855] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-05T19:14:19.806726] [INFO ] [MAIN ] Derivative Progress: 1145/2117 symbols completed. MHD took 0.9s. Estimated remaining: 4m 47s. Rate: 203.3 symbols/min [2025-09-05T19:14:19.807382] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:19.815341] [INFO ] [MAIN ] MHN: Loaded 5749 primary data records. [2025-09-05T19:14:19.900125] [INFO ] [MAIN ] MHK: Generated 1352 derivative records from 32031 primary records. [2025-09-05T19:14:19.942616] [INFO ] [MAIN ] MHO: Loaded 12139 primary data records. [2025-09-05T19:14:20.223994] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-05T19:14:20.232062] [INFO ] [MAIN ] Derivative Progress: 1146/2117 symbols completed. MHK took 1.3s. Estimated remaining: 4m 47s. Rate: 203.3 symbols/min [2025-09-05T19:14:20.242918] [INFO ] [MAIN ] MIAX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:20.410663] [INFO ] [MAIN ] MIAX: Loaded 5407 primary data records. [2025-09-05T19:14:20.636910] [INFO ] [MAIN ] MHN: Generated 1352 derivative records from 5749 primary records. [2025-09-05T19:14:20.651428] [INFO ] [MAIN ] MIAX: Generated 202 derivative records from 5407 primary records. [2025-09-05T19:14:20.662122] [INFO ] [MAIN ] MIAX: Successfully saved derivative data. [2025-09-05T19:14:20.669982] [INFO ] [MAIN ] Derivative Progress: 1147/2117 symbols completed. MIAX took 0.4s. Estimated remaining: 4m 46s. Rate: 203.2 symbols/min [2025-09-05T19:14:20.673288] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-05T19:14:20.673117] [INFO ] [MAIN ] MHO: Generated 871 derivative records from 12139 primary records. [2025-09-05T19:14:20.677438] [INFO ] [MAIN ] Derivative Progress: 1148/2117 symbols completed. MHN took 0.9s. Estimated remaining: 4m 46s. Rate: 203.3 symbols/min [2025-09-05T19:14:20.673347] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:20.678039] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:20.691106] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-05T19:14:20.693039] [INFO ] [MAIN ] Derivative Progress: 1149/2117 symbols completed. MHO took 0.9s. Estimated remaining: 4m 45s. Rate: 203.5 symbols/min [2025-09-05T19:14:20.693460] [INFO ] [MAIN ] MITN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:20.701099] [INFO ] [MAIN ] MITN: Loaded 555 primary data records. [2025-09-05T19:14:20.699109] [INFO ] [MAIN ] MIN: Loaded 8112 primary data records. [2025-09-05T19:14:21.064548] [INFO ] [MAIN ] MIR: Loaded 38272 primary data records. [2025-09-05T19:14:21.511251] [INFO ] [MAIN ] MITN: Generated 867 derivative records from 555 primary records. [2025-09-05T19:14:21.526672] [INFO ] [MAIN ] MITN: Successfully saved derivative data. [2025-09-05T19:14:21.528138] [INFO ] [MAIN ] Derivative Progress: 1150/2117 symbols completed. MITN took 0.8s. Estimated remaining: 4m 46s. Rate: 203.2 symbols/min [2025-09-05T19:14:21.525606] [INFO ] [MAIN ] MIN: Generated 871 derivative records from 8112 primary records. [2025-09-05T19:14:21.528326] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:21.537717] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-05T19:14:21.539333] [INFO ] [MAIN ] Derivative Progress: 1151/2117 symbols completed. MIN took 0.9s. Estimated remaining: 4m 45s. Rate: 203.4 symbols/min [2025-09-05T19:14:21.539795] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:21.560238] [INFO ] [MAIN ] MIY: Loaded 3145 primary data records. [2025-09-05T19:14:21.561114] [INFO ] [MAIN ] MIR: Generated 1352 derivative records from 38272 primary records. [2025-09-05T19:14:21.655790] [INFO ] [MAIN ] MITT: Loaded 16882 primary data records. [2025-09-05T19:14:21.870117] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-05T19:14:21.881074] [INFO ] [MAIN ] Derivative Progress: 1152/2117 symbols completed. MIR took 1.2s. Estimated remaining: 4m 45s. Rate: 203.3 symbols/min [2025-09-05T19:14:21.935588] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:22.130447] [INFO ] [MAIN ] MIY: Generated 871 derivative records from 3145 primary records. [2025-09-05T19:14:22.142180] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-05T19:14:22.153852] [INFO ] [MAIN ] Derivative Progress: 1153/2117 symbols completed. MIY took 0.6s. Estimated remaining: 4m 44s. Rate: 203.3 symbols/min [2025-09-05T19:14:22.155580] [INFO ] [MAIN ] MLI: Loaded 32800 primary data records. [2025-09-05T19:14:22.269323] [INFO ] [MAIN ] MITT: Generated 1352 derivative records from 16882 primary records. [2025-09-05T19:14:22.440628] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-05T19:14:22.443132] [INFO ] [MAIN ] Derivative Progress: 1154/2117 symbols completed. MITT took 0.9s. Estimated remaining: 4m 44s. Rate: 203.3 symbols/min [2025-09-05T19:14:22.462084] [INFO ] [MAIN ] MLI: Generated 1351 derivative records from 32800 primary records. [2025-09-05T19:14:22.474272] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-05T19:14:22.476456] [INFO ] [MAIN ] Derivative Progress: 1155/2117 symbols completed. MLI took 0.5s. Estimated remaining: 4m 44s. Rate: 203.5 symbols/min [2025-09-05T19:14:22.477029] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:22.477096] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:22.476934] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:22.481701] [INFO ] [MAIN ] MLP: Loaded 1294 primary data records. [2025-09-05T19:14:22.601619] [INFO ] [MAIN ] MLNK: Loaded 12900 primary data records. [2025-09-05T19:14:22.759299] [INFO ] [MAIN ] MLM: Loaded 22333 primary data records. [2025-09-05T19:14:23.315545] [INFO ] [MAIN ] MLP: Generated 871 derivative records from 1294 primary records. [2025-09-05T19:14:23.333661] [INFO ] [MAIN ] MLNK: Generated 871 derivative records from 12900 primary records. [2025-09-05T19:14:23.333895] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-05T19:14:23.336186] [INFO ] [MAIN ] Derivative Progress: 1156/2117 symbols completed. MLP took 0.9s. Estimated remaining: 4m 44s. Rate: 203.2 symbols/min [2025-09-05T19:14:23.336635] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:23.344746] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-05T19:14:23.346496] [INFO ] [MAIN ] Derivative Progress: 1157/2117 symbols completed. MLNK took 0.9s. Estimated remaining: 4m 43s. Rate: 203.3 symbols/min [2025-09-05T19:14:23.346869] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:23.356356] [INFO ] [MAIN ] MLR: Loaded 8705 primary data records. [2025-09-05T19:14:23.429508] [INFO ] [MAIN ] MLM: Generated 1351 derivative records from 22333 primary records. [2025-09-05T19:14:23.564703] [INFO ] [MAIN ] MMC: Loaded 25258 primary data records. [2025-09-05T19:14:23.572737] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-05T19:14:23.586691] [INFO ] [MAIN ] Derivative Progress: 1158/2117 symbols completed. MLM took 1.1s. Estimated remaining: 4m 43s. Rate: 203.4 symbols/min [2025-09-05T19:14:23.685152] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:23.847935] [INFO ] [MAIN ] MMD: Loaded 5128 primary data records. [2025-09-05T19:14:24.160966] [INFO ] [MAIN ] MLR: Generated 1352 derivative records from 8705 primary records. [2025-09-05T19:14:24.184282] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-05T19:14:24.185213] [INFO ] [MAIN ] MMC: Generated 871 derivative records from 25258 primary records. [2025-09-05T19:14:24.187885] [INFO ] [MAIN ] Derivative Progress: 1159/2117 symbols completed. MLR took 0.9s. Estimated remaining: 4m 43s. Rate: 203.2 symbols/min [2025-09-05T19:14:24.189012] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:24.198074] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-05T19:14:24.203838] [INFO ] [MAIN ] Derivative Progress: 1160/2117 symbols completed. MMC took 0.9s. Estimated remaining: 4m 42s. Rate: 203.4 symbols/min [2025-09-05T19:14:24.204186] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:24.212321] [INFO ] [MAIN ] MMD: Generated 871 derivative records from 5128 primary records. [2025-09-05T19:14:24.215963] [INFO ] [MAIN ] MMI: Loaded 7211 primary data records. [2025-09-05T19:14:24.333187] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-05T19:14:24.334993] [INFO ] [MAIN ] Derivative Progress: 1161/2117 symbols completed. MMD took 0.7s. Estimated remaining: 4m 42s. Rate: 203.4 symbols/min [2025-09-05T19:14:24.369530] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:24.414766] [INFO ] [MAIN ] MMS: Loaded 24721 primary data records. [2025-09-05T19:14:24.598292] [INFO ] [MAIN ] MMT: Loaded 8145 primary data records. [2025-09-05T19:14:25.043365] [INFO ] [MAIN ] MMI: Generated 871 derivative records from 7211 primary records. [2025-09-05T19:14:25.057241] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-05T19:14:25.059656] [INFO ] [MAIN ] Derivative Progress: 1162/2117 symbols completed. MMI took 0.9s. Estimated remaining: 4m 42s. Rate: 203.2 symbols/min [2025-09-05T19:14:25.060048] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:25.083929] [INFO ] [MAIN ] MMS: Generated 1352 derivative records from 24721 primary records. [2025-09-05T19:14:25.101222] [INFO ] [MAIN ] MMU: Loaded 12727 primary data records. [2025-09-05T19:14:25.155866] [INFO ] [MAIN ] MMT: Generated 1352 derivative records from 8145 primary records. [2025-09-05T19:14:25.197548] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-05T19:14:25.226785] [INFO ] [MAIN ] Derivative Progress: 1163/2117 symbols completed. MMS took 1.0s. Estimated remaining: 4m 42s. Rate: 203.3 symbols/min [2025-09-05T19:14:25.232248] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:25.245023] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-05T19:14:25.288121] [INFO ] [MAIN ] Derivative Progress: 1164/2117 symbols completed. MMT took 0.9s. Estimated remaining: 4m 41s. Rate: 203.4 symbols/min [2025-09-05T19:14:25.312914] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:25.454320] [INFO ] [MAIN ] MNR: Loaded 19112 primary data records. [2025-09-05T19:14:25.571475] [INFO ] [MAIN ] MNSO: Loaded 20327 primary data records. [2025-09-05T19:14:25.905529] [INFO ] [MAIN ] MMU: Generated 1352 derivative records from 12727 primary records. [2025-09-05T19:14:26.013201] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-05T19:14:26.015988] [INFO ] [MAIN ] Derivative Progress: 1165/2117 symbols completed. MMU took 1.0s. Estimated remaining: 4m 41s. Rate: 203.2 symbols/min [2025-09-05T19:14:26.017037] [INFO ] [MAIN ] MO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:26.035154] [INFO ] [MAIN ] MNR: Generated 1352 derivative records from 19112 primary records. [2025-09-05T19:14:26.043835] [INFO ] [MAIN ] MNSO: Generated 871 derivative records from 20327 primary records. [2025-09-05T19:14:26.063487] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-05T19:14:26.076197] [INFO ] [MAIN ] Derivative Progress: 1166/2117 symbols completed. MNR took 0.8s. Estimated remaining: 4m 41s. Rate: 203.3 symbols/min [2025-09-05T19:14:26.076828] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:26.078796] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-05T19:14:26.080627] [INFO ] [MAIN ] Derivative Progress: 1167/2117 symbols completed. MNSO took 0.8s. Estimated remaining: 4m 40s. Rate: 203.5 symbols/min [2025-09-05T19:14:26.081005] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:26.095928] [INFO ] [MAIN ] MO: Loaded 40494 primary data records. [2025-09-05T19:14:26.406303] [INFO ] [MAIN ] MODG: Loaded 38965 primary data records. [2025-09-05T19:14:26.420669] [INFO ] [MAIN ] MOD: Loaded 34004 primary data records. [2025-09-05T19:14:26.985941] [INFO ] [MAIN ] MO: Generated 1352 derivative records from 40494 primary records. [2025-09-05T19:14:27.005040] [INFO ] [MAIN ] MO: Successfully saved derivative data. [2025-09-05T19:14:27.007979] [INFO ] [MAIN ] Derivative Progress: 1168/2117 symbols completed. MO took 1.0s. Estimated remaining: 4m 40s. Rate: 203.1 symbols/min [2025-09-05T19:14:27.034954] [INFO ] [MAIN ] MOD: Generated 1351 derivative records from 34004 primary records. [2025-09-05T19:14:27.036208] [INFO ] [MAIN ] MODG: Generated 1352 derivative records from 38965 primary records. [2025-09-05T19:14:27.059900] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-05T19:14:27.063665] [INFO ] [MAIN ] Derivative Progress: 1169/2117 symbols completed. MODG took 1.0s. Estimated remaining: 4m 40s. Rate: 203.2 symbols/min [2025-09-05T19:14:27.064591] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-05T19:14:27.067019] [INFO ] [MAIN ] Derivative Progress: 1170/2117 symbols completed. MOD took 1.0s. Estimated remaining: 4m 39s. Rate: 203.4 symbols/min [2025-09-05T19:14:27.067666] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:27.067455] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:27.067772] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:27.077750] [INFO ] [MAIN ] MPA: Loaded 4133 primary data records. [2025-09-05T19:14:27.280541] [INFO ] [MAIN ] MP: Loaded 26137 primary data records. [2025-09-05T19:14:27.286247] [INFO ] [MAIN ] MOH: Loaded 21820 primary data records. [2025-09-05T19:14:27.964958] [INFO ] [MAIN ] MPA: Generated 1352 derivative records from 4133 primary records. [2025-09-05T19:14:27.985687] [INFO ] [MAIN ] MP: Generated 871 derivative records from 26137 primary records. [2025-09-05T19:14:27.991327] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-05T19:14:28.008608] [INFO ] [MAIN ] MOH: Generated 871 derivative records from 21820 primary records. [2025-09-05T19:14:28.007444] [INFO ] [MAIN ] Derivative Progress: 1171/2117 symbols completed. MPA took 0.9s. Estimated remaining: 4m 40s. Rate: 203.0 symbols/min [2025-09-05T19:14:28.009794] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-05T19:14:28.011883] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:28.011604] [INFO ] [MAIN ] Derivative Progress: 1172/2117 symbols completed. MP took 0.9s. Estimated remaining: 4m 39s. Rate: 203.2 symbols/min [2025-09-05T19:14:28.020066] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:28.020299] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-05T19:14:28.022369] [INFO ] [MAIN ] Derivative Progress: 1173/2117 symbols completed. MOH took 1.0s. Estimated remaining: 4m 39s. Rate: 203.4 symbols/min [2025-09-05T19:14:28.023093] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:28.029532] [INFO ] [MAIN ] MPV: Loaded 3415 primary data records. [2025-09-05T19:14:28.231125] [INFO ] [MAIN ] MPLX: Loaded 24202 primary data records. [2025-09-05T19:14:28.386732] [INFO ] [MAIN ] MPC: Loaded 25051 primary data records. [2025-09-05T19:14:28.836778] [INFO ] [MAIN ] MPV: Generated 1352 derivative records from 3415 primary records. [2025-09-05T19:14:28.851594] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-05T19:14:28.854057] [INFO ] [MAIN ] Derivative Progress: 1174/2117 symbols completed. MPV took 0.8s. Estimated remaining: 4m 39s. Rate: 203.0 symbols/min [2025-09-05T19:14:28.861034] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:28.862145] [INFO ] [MAIN ] MPLX: Generated 871 derivative records from 24202 primary records. [2025-09-05T19:14:28.879386] [INFO ] [MAIN ] MPC: Generated 871 derivative records from 25051 primary records. [2025-09-05T19:14:28.880715] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-05T19:14:28.882403] [INFO ] [MAIN ] Derivative Progress: 1175/2117 symbols completed. MPLX took 0.9s. Estimated remaining: 4m 38s. Rate: 203.2 symbols/min [2025-09-05T19:14:28.888222] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:28.892788] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-05T19:14:28.894960] [INFO ] [MAIN ] Derivative Progress: 1176/2117 symbols completed. MPC took 0.9s. Estimated remaining: 4m 38s. Rate: 203.4 symbols/min [2025-09-05T19:14:28.895363] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:28.898325] [INFO ] [MAIN ] MQT: Loaded 3727 primary data records. [2025-09-05T19:14:29.018387] [INFO ] [MAIN ] MQY: Loaded 7919 primary data records. [2025-09-05T19:14:29.206547] [INFO ] [MAIN ] MPW: Loaded 40290 primary data records. [2025-09-05T19:14:29.696812] [INFO ] [MAIN ] MQT: Generated 871 derivative records from 3727 primary records. [2025-09-05T19:14:29.710365] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-05T19:14:29.718216] [INFO ] [MAIN ] Derivative Progress: 1177/2117 symbols completed. MQT took 0.8s. Estimated remaining: 4m 38s. Rate: 203.1 symbols/min [2025-09-05T19:14:29.718904] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:29.719574] [INFO ] [MAIN ] MQY: Generated 871 derivative records from 7919 primary records. [2025-09-05T19:14:29.732001] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-05T19:14:29.733666] [INFO ] [MAIN ] Derivative Progress: 1178/2117 symbols completed. MQY took 0.8s. Estimated remaining: 4m 37s. Rate: 203.2 symbols/min [2025-09-05T19:14:29.733963] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:29.744798] [INFO ] [MAIN ] MPW: Generated 1352 derivative records from 40290 primary records. [2025-09-05T19:14:29.767712] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-05T19:14:29.770235] [INFO ] [MAIN ] Derivative Progress: 1179/2117 symbols completed. MPW took 0.9s. Estimated remaining: 4m 37s. Rate: 203.4 symbols/min [2025-09-05T19:14:29.770612] [INFO ] [MAIN ] MRP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:29.782040] [INFO ] [MAIN ] MRC: Loaded 27899 primary data records. [2025-09-05T19:14:30.015109] [INFO ] [MAIN ] MRK: Loaded 40530 primary data records. [2025-09-05T19:14:30.108224] [INFO ] [MAIN ] MRP: Loaded 35038 primary data records. [2025-09-05T19:14:30.711032] [INFO ] [MAIN ] MRC: Generated 1352 derivative records from 27899 primary records. [2025-09-05T19:14:30.727535] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-05T19:14:30.730413] [INFO ] [MAIN ] Derivative Progress: 1180/2117 symbols completed. MRC took 1.0s. Estimated remaining: 4m 37s. Rate: 203.0 symbols/min [2025-09-05T19:14:30.730911] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:30.746111] [INFO ] [MAIN ] MRP: Generated 1352 derivative records from 35038 primary records. [2025-09-05T19:14:30.766446] [INFO ] [MAIN ] MRK: Generated 1352 derivative records from 40530 primary records. [2025-09-05T19:14:30.769279] [INFO ] [MAIN ] MRP: Successfully saved derivative data. [2025-09-05T19:14:30.771729] [INFO ] [MAIN ] Derivative Progress: 1181/2117 symbols completed. MRP took 1.0s. Estimated remaining: 4m 36s. Rate: 203.1 symbols/min [2025-09-05T19:14:30.780397] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:30.784048] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-05T19:14:30.786099] [INFO ] [MAIN ] Derivative Progress: 1182/2117 symbols completed. MRK took 1.1s. Estimated remaining: 4m 36s. Rate: 203.3 symbols/min [2025-09-05T19:14:30.798494] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:30.803766] [INFO ] [MAIN ] MSA: Loaded 8707 primary data records. [2025-09-05T19:14:30.916461] [INFO ] [MAIN ] MSB: Loaded 4232 primary data records. [2025-09-05T19:14:30.920958] [INFO ] [MAIN ] MS: Loaded 40437 primary data records. [2025-09-05T19:14:31.574564] [INFO ] [MAIN ] MSA: Generated 871 derivative records from 8707 primary records. [2025-09-05T19:14:31.586388] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-05T19:14:31.587790] [INFO ] [MAIN ] Derivative Progress: 1183/2117 symbols completed. MSA took 0.8s. Estimated remaining: 4m 36s. Rate: 203.0 symbols/min [2025-09-05T19:14:31.595054] [INFO ] [MAIN ] MSB: Generated 871 derivative records from 4232 primary records. [2025-09-05T19:14:31.604816] [INFO ] [MAIN ] MS: Generated 1352 derivative records from 40437 primary records. [2025-09-05T19:14:31.622479] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-05T19:14:31.624667] [INFO ] [MAIN ] Derivative Progress: 1184/2117 symbols completed. MSB took 0.8s. Estimated remaining: 4m 36s. Rate: 203.2 symbols/min [2025-09-05T19:14:31.626442] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-05T19:14:31.628783] [INFO ] [MAIN ] Derivative Progress: 1185/2117 symbols completed. MS took 0.9s. Estimated remaining: 4m 35s. Rate: 203.3 symbols/min [2025-09-05T19:14:31.629302] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:31.629271] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:31.629134] [INFO ] [MAIN ] MSC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:31.632956] [INFO ] [MAIN ] MSC: Loaded 678 primary data records. [2025-09-05T19:14:31.765326] [INFO ] [MAIN ] MSD: Loaded 8190 primary data records. [2025-09-05T19:14:32.010381] [INFO ] [MAIN ] MSCI: Loaded 25527 primary data records. [2025-09-05T19:14:32.425987] [INFO ] [MAIN ] MSC: Generated 871 derivative records from 678 primary records. [2025-09-05T19:14:32.436426] [INFO ] [MAIN ] MSC: Successfully saved derivative data. [2025-09-05T19:14:32.437710] [INFO ] [MAIN ] Derivative Progress: 1186/2117 symbols completed. MSC took 0.8s. Estimated remaining: 4m 35s. Rate: 203.0 symbols/min [2025-09-05T19:14:32.444384] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:32.445449] [INFO ] [MAIN ] MSD: Generated 871 derivative records from 8190 primary records. [2025-09-05T19:14:32.455452] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-05T19:14:32.457145] [INFO ] [MAIN ] Derivative Progress: 1187/2117 symbols completed. MSD took 0.8s. Estimated remaining: 4m 35s. Rate: 203.2 symbols/min [2025-09-05T19:14:32.457507] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:32.486240] [INFO ] [MAIN ] MSDL: Loaded 18598 primary data records. [2025-09-05T19:14:32.487158] [INFO ] [MAIN ] MSCI: Generated 1351 derivative records from 25527 primary records. [2025-09-05T19:14:32.522090] [INFO ] [MAIN ] MSGS: Loaded 8433 primary data records. [2025-09-05T19:14:32.731971] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-05T19:14:32.757894] [INFO ] [MAIN ] Derivative Progress: 1188/2117 symbols completed. MSCI took 1.1s. Estimated remaining: 4m 34s. Rate: 203.2 symbols/min [2025-09-05T19:14:32.905736] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:33.069686] [INFO ] [MAIN ] MSDL: Generated 871 derivative records from 18598 primary records. [2025-09-05T19:14:33.082502] [INFO ] [MAIN ] MSI: Loaded 19360 primary data records. [2025-09-05T19:14:33.085770] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-05T19:14:33.087113] [INFO ] [MAIN ] Derivative Progress: 1189/2117 symbols completed. MSDL took 0.6s. Estimated remaining: 4m 34s. Rate: 203.2 symbols/min [2025-09-05T19:14:33.137342] [INFO ] [MAIN ] MSIF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:33.216048] [INFO ] [MAIN ] MSGS: Generated 871 derivative records from 8433 primary records. [2025-09-05T19:14:33.357807] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-05T19:14:33.357726] [INFO ] [MAIN ] MSIF: Loaded 8502 primary data records. [2025-09-05T19:14:33.359443] [INFO ] [MAIN ] Derivative Progress: 1190/2117 symbols completed. MSGS took 0.9s. Estimated remaining: 4m 34s. Rate: 203.2 symbols/min [2025-09-05T19:14:33.394963] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:33.618342] [INFO ] [MAIN ] MSM: Loaded 16845 primary data records. [2025-09-05T19:14:33.764462] [INFO ] [MAIN ] MSI: Generated 871 derivative records from 19360 primary records. [2025-09-05T19:14:33.893983] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-05T19:14:33.896514] [INFO ] [MAIN ] Derivative Progress: 1191/2117 symbols completed. MSI took 1.1s. Estimated remaining: 4m 34s. Rate: 203.0 symbols/min [2025-09-05T19:14:33.899103] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:33.907890] [INFO ] [MAIN ] MSIF: Generated 871 derivative records from 8502 primary records. [2025-09-05T19:14:33.918658] [INFO ] [MAIN ] MSIF: Successfully saved derivative data. [2025-09-05T19:14:33.920289] [INFO ] [MAIN ] Derivative Progress: 1192/2117 symbols completed. MSIF took 0.8s. Estimated remaining: 4m 33s. Rate: 203.2 symbols/min [2025-09-05T19:14:33.920689] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:33.939269] [INFO ] [MAIN ] MSM: Generated 871 derivative records from 16845 primary records. [2025-09-05T19:14:33.954760] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-05T19:14:33.956751] [INFO ] [MAIN ] Derivative Progress: 1193/2117 symbols completed. MSM took 0.6s. Estimated remaining: 4m 33s. Rate: 203.3 symbols/min [2025-09-05T19:14:33.957095] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:33.968113] [INFO ] [MAIN ] MT: Loaded 24468 primary data records. [2025-09-05T19:14:34.031838] [INFO ] [MAIN ] MTB: Loaded 22674 primary data records. [2025-09-05T19:14:34.480661] [INFO ] [MAIN ] MTDR: Loaded 38976 primary data records. [2025-09-05T19:14:34.769710] [INFO ] [MAIN ] MTB: Generated 871 derivative records from 22674 primary records. [2025-09-05T19:14:34.785028] [INFO ] [MAIN ] MT: Generated 871 derivative records from 24468 primary records. [2025-09-05T19:14:34.796221] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-05T19:14:34.798302] [INFO ] [MAIN ] Derivative Progress: 1194/2117 symbols completed. MTB took 0.9s. Estimated remaining: 4m 33s. Rate: 203.0 symbols/min [2025-09-05T19:14:34.798759] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:34.803853] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-05T19:14:34.805394] [INFO ] [MAIN ] Derivative Progress: 1195/2117 symbols completed. MT took 0.9s. Estimated remaining: 4m 32s. Rate: 203.2 symbols/min [2025-09-05T19:14:34.806877] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:34.829199] [INFO ] [MAIN ] MTDR: Generated 1352 derivative records from 38976 primary records. [2025-09-05T19:14:34.854831] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-05T19:14:34.864216] [INFO ] [MAIN ] Derivative Progress: 1196/2117 symbols completed. MTDR took 0.9s. Estimated remaining: 4m 32s. Rate: 203.3 symbols/min [2025-09-05T19:14:34.864712] [INFO ] [MAIN ] MTH: Loaded 21356 primary data records. [2025-09-05T19:14:34.865736] [INFO ] [MAIN ] MTG: Loaded 24629 primary data records. [2025-09-05T19:14:34.865948] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:35.294024] [INFO ] [MAIN ] MTN: Loaded 18853 primary data records. [2025-09-05T19:14:35.607940] [INFO ] [MAIN ] MTH: Generated 871 derivative records from 21356 primary records. [2025-09-05T19:14:35.627343] [INFO ] [MAIN ] MTG: Generated 871 derivative records from 24629 primary records. [2025-09-05T19:14:35.640900] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-05T19:14:35.644804] [INFO ] [MAIN ] Derivative Progress: 1197/2117 symbols completed. MTH took 0.8s. Estimated remaining: 4m 32s. Rate: 203.0 symbols/min [2025-09-05T19:14:35.646036] [INFO ] [MAIN ] MTR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:35.647337] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-05T19:14:35.649062] [INFO ] [MAIN ] Derivative Progress: 1198/2117 symbols completed. MTG took 0.9s. Estimated remaining: 4m 31s. Rate: 203.2 symbols/min [2025-09-05T19:14:35.654047] [INFO ] [MAIN ] MTR: Loaded 1392 primary data records. [2025-09-05T19:14:35.694555] [INFO ] [MAIN ] MTN: Generated 871 derivative records from 18853 primary records. [2025-09-05T19:14:35.843082] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-05T19:14:35.944663] [INFO ] [MAIN ] Derivative Progress: 1199/2117 symbols completed. MTN took 1.1s. Estimated remaining: 4m 31s. Rate: 203.2 symbols/min [2025-09-05T19:14:35.966264] [INFO ] [MAIN ] MTR: Generated 871 derivative records from 1392 primary records. [2025-09-05T19:14:35.973156] [INFO ] [MAIN ] MTR: Successfully saved derivative data. [2025-09-05T19:14:35.974365] [INFO ] [MAIN ] Derivative Progress: 1200/2117 symbols completed. MTR took 0.3s. Estimated remaining: 4m 31s. Rate: 203.4 symbols/min [2025-09-05T19:14:35.974851] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:35.975050] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:35.974989] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:36.004293] [INFO ] [MAIN ] MTRN: Loaded 14029 primary data records. [2025-09-05T19:14:36.004163] [INFO ] [MAIN ] MTW: Loaded 12909 primary data records. [2025-09-05T19:14:36.196514] [INFO ] [MAIN ] MTUS: Loaded 21365 primary data records. [2025-09-05T19:14:36.808731] [INFO ] [MAIN ] MTW: Generated 871 derivative records from 12909 primary records. [2025-09-05T19:14:36.830220] [INFO ] [MAIN ] MTRN: Generated 1352 derivative records from 14029 primary records. [2025-09-05T19:14:36.830811] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-05T19:14:36.832553] [INFO ] [MAIN ] Derivative Progress: 1201/2117 symbols completed. MTW took 0.9s. Estimated remaining: 4m 31s. Rate: 203.0 symbols/min [2025-09-05T19:14:36.833193] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:36.847315] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-05T19:14:36.855413] [INFO ] [MAIN ] Derivative Progress: 1202/2117 symbols completed. MTRN took 0.9s. Estimated remaining: 4m 30s. Rate: 203.2 symbols/min [2025-09-05T19:14:36.859213] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:36.860339] [INFO ] [MAIN ] MTUS: Generated 1352 derivative records from 21365 primary records. [2025-09-05T19:14:36.880041] [INFO ] [MAIN ] MTX: Loaded 11338 primary data records. [2025-09-05T19:14:36.880502] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-05T19:14:36.930298] [INFO ] [MAIN ] Derivative Progress: 1203/2117 symbols completed. MTUS took 1.0s. Estimated remaining: 4m 30s. Rate: 203.3 symbols/min [2025-09-05T19:14:36.963161] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:37.007410] [INFO ] [MAIN ] MTZ: Loaded 20577 primary data records. [2025-09-05T19:14:37.228667] [INFO ] [MAIN ] MUA: Loaded 8798 primary data records. [2025-09-05T19:14:37.639143] [INFO ] [MAIN ] MTX: Generated 871 derivative records from 11338 primary records. [2025-09-05T19:14:37.648783] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-05T19:14:37.650075] [INFO ] [MAIN ] Derivative Progress: 1204/2117 symbols completed. MTX took 0.8s. Estimated remaining: 4m 30s. Rate: 203.1 symbols/min [2025-09-05T19:14:37.650260] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:37.660970] [INFO ] [MAIN ] MTZ: Generated 871 derivative records from 20577 primary records. [2025-09-05T19:14:37.674675] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-05T19:14:37.676390] [INFO ] [MAIN ] Derivative Progress: 1205/2117 symbols completed. MTZ took 0.8s. Estimated remaining: 4m 29s. Rate: 203.2 symbols/min [2025-09-05T19:14:37.677315] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:37.684681] [INFO ] [MAIN ] MUC: Loaded 14837 primary data records. [2025-09-05T19:14:37.695049] [INFO ] [MAIN ] MUA: Generated 1352 derivative records from 8798 primary records. [2025-09-05T19:14:37.775100] [INFO ] [MAIN ] MUE: Loaded 6520 primary data records. [2025-09-05T19:14:37.945029] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-05T19:14:37.982047] [INFO ] [MAIN ] Derivative Progress: 1206/2117 symbols completed. MUA took 1.0s. Estimated remaining: 4m 29s. Rate: 203.2 symbols/min [2025-09-05T19:14:37.988735] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:38.283041] [INFO ] [MAIN ] MUC: Generated 1352 derivative records from 14837 primary records. [2025-09-05T19:14:38.304364] [INFO ] [MAIN ] MUFG: Loaded 39658 primary data records. [2025-09-05T19:14:38.321322] [INFO ] [MAIN ] MUE: Generated 871 derivative records from 6520 primary records. [2025-09-05T19:14:38.364528] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-05T19:14:38.371664] [INFO ] [MAIN ] Derivative Progress: 1207/2117 symbols completed. MUC took 0.7s. Estimated remaining: 4m 29s. Rate: 203.2 symbols/min [2025-09-05T19:14:38.400601] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:38.421431] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-05T19:14:38.439821] [INFO ] [MAIN ] Derivative Progress: 1208/2117 symbols completed. MUE took 0.8s. Estimated remaining: 4m 28s. Rate: 203.3 symbols/min [2025-09-05T19:14:38.440145] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:38.518129] [INFO ] [MAIN ] MUJ: Loaded 10116 primary data records. [2025-09-05T19:14:38.798110] [INFO ] [MAIN ] MUR: Loaded 25588 primary data records. [2025-09-05T19:14:39.151240] [INFO ] [MAIN ] MUFG: Generated 1352 derivative records from 39658 primary records. [2025-09-05T19:14:39.167322] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-05T19:14:39.169757] [INFO ] [MAIN ] Derivative Progress: 1209/2117 symbols completed. MUFG took 1.2s. Estimated remaining: 4m 28s. Rate: 203.1 symbols/min [2025-09-05T19:14:39.171220] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:39.185418] [INFO ] [MAIN ] MUJ: Generated 1352 derivative records from 10116 primary records. [2025-09-05T19:14:39.207102] [INFO ] [MAIN ] MUSA: Loaded 12099 primary data records. [2025-09-05T19:14:39.214823] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-05T19:14:39.217386] [INFO ] [MAIN ] Derivative Progress: 1210/2117 symbols completed. MUJ took 0.8s. Estimated remaining: 4m 28s. Rate: 203.2 symbols/min [2025-09-05T19:14:39.218515] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:39.218350] [INFO ] [MAIN ] MUR: Generated 871 derivative records from 25588 primary records. [2025-09-05T19:14:39.373463] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-05T19:14:39.404527] [INFO ] [MAIN ] Derivative Progress: 1211/2117 symbols completed. MUR took 1.0s. Estimated remaining: 4m 27s. Rate: 203.3 symbols/min [2025-09-05T19:14:39.462631] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:39.463455] [INFO ] [MAIN ] MUX: Loaded 21003 primary data records. [2025-09-05T19:14:39.554610] [INFO ] [MAIN ] MVF: Loaded 9214 primary data records. [2025-09-05T19:14:40.033866] [INFO ] [MAIN ] MUSA: Generated 871 derivative records from 12099 primary records. [2025-09-05T19:14:40.053326] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-05T19:14:40.055166] [INFO ] [MAIN ] Derivative Progress: 1212/2117 symbols completed. MUSA took 0.9s. Estimated remaining: 4m 27s. Rate: 203.1 symbols/min [2025-09-05T19:14:40.056966] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:40.072846] [INFO ] [MAIN ] MVO: Loaded 4406 primary data records. [2025-09-05T19:14:40.073798] [INFO ] [MAIN ] MUX: Generated 871 derivative records from 21003 primary records. [2025-09-05T19:14:40.247715] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-05T19:14:40.254266] [INFO ] [MAIN ] MVF: Generated 1352 derivative records from 9214 primary records. [2025-09-05T19:14:40.274277] [INFO ] [MAIN ] Derivative Progress: 1213/2117 symbols completed. MUX took 1.1s. Estimated remaining: 4m 27s. Rate: 203.1 symbols/min [2025-09-05T19:14:40.442907] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-05T19:14:40.447710] [INFO ] [MAIN ] Derivative Progress: 1214/2117 symbols completed. MVF took 1.0s. Estimated remaining: 4m 27s. Rate: 203.2 symbols/min [2025-09-05T19:14:40.466220] [INFO ] [MAIN ] MVO: Generated 871 derivative records from 4406 primary records. [2025-09-05T19:14:40.479306] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-05T19:14:40.481358] [INFO ] [MAIN ] Derivative Progress: 1215/2117 symbols completed. MVO took 0.4s. Estimated remaining: 4m 26s. Rate: 203.3 symbols/min [2025-09-05T19:14:40.482565] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:40.482342] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:40.482780] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:40.493834] [INFO ] [MAIN ] MVT: Loaded 4986 primary data records. [2025-09-05T19:14:40.599581] [INFO ] [MAIN ] MX: Loaded 11001 primary data records. [2025-09-05T19:14:40.713375] [INFO ] [MAIN ] MWA: Loaded 21862 primary data records. [2025-09-05T19:14:41.529434] [INFO ] [MAIN ] MX: Generated 871 derivative records from 11001 primary records. [2025-09-05T19:14:41.522547] [INFO ] [MAIN ] MVT: Generated 871 derivative records from 4986 primary records. [2025-09-05T19:14:41.552526] [INFO ] [MAIN ] MWA: Generated 871 derivative records from 21862 primary records. [2025-09-05T19:14:41.554035] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-05T19:14:41.556455] [INFO ] [MAIN ] Derivative Progress: 1216/2117 symbols completed. MX took 1.1s. Estimated remaining: 4m 26s. Rate: 202.9 symbols/min [2025-09-05T19:14:41.556939] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:41.557021] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-05T19:14:41.558618] [INFO ] [MAIN ] Derivative Progress: 1217/2117 symbols completed. MVT took 1.1s. Estimated remaining: 4m 26s. Rate: 203.0 symbols/min [2025-09-05T19:14:41.565006] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:41.568680] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-05T19:14:41.570963] [INFO ] [MAIN ] MXF: Loaded 2104 primary data records. [2025-09-05T19:14:41.572617] [INFO ] [MAIN ] Derivative Progress: 1218/2117 symbols completed. MWA took 1.1s. Estimated remaining: 4m 25s. Rate: 203.2 symbols/min [2025-09-05T19:14:41.616254] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:41.692018] [INFO ] [MAIN ] MYE: Loaded 18359 primary data records. [2025-09-05T19:14:41.799596] [INFO ] [MAIN ] MYI: Loaded 8966 primary data records. [2025-09-05T19:14:42.337193] [INFO ] [MAIN ] MXF: Generated 871 derivative records from 2104 primary records. [2025-09-05T19:14:42.345927] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-05T19:14:42.348022] [INFO ] [MAIN ] Derivative Progress: 1219/2117 symbols completed. MXF took 0.8s. Estimated remaining: 4m 26s. Rate: 202.9 symbols/min [2025-09-05T19:14:42.349740] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:42.357911] [INFO ] [MAIN ] MYI: Generated 871 derivative records from 8966 primary records. [2025-09-05T19:14:42.383467] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-05T19:14:42.384540] [INFO ] [MAIN ] MYE: Generated 1352 derivative records from 18359 primary records. [2025-09-05T19:14:42.386170] [INFO ] [MAIN ] Derivative Progress: 1220/2117 symbols completed. MYI took 0.8s. Estimated remaining: 4m 25s. Rate: 203.1 symbols/min [2025-09-05T19:14:42.386550] [INFO ] [MAIN ] MYN: Loaded 7621 primary data records. [2025-09-05T19:14:42.398167] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:42.591435] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-05T19:14:42.594045] [INFO ] [MAIN ] Derivative Progress: 1221/2117 symbols completed. MYE took 1.0s. Estimated remaining: 4m 25s. Rate: 203.1 symbols/min [2025-09-05T19:14:42.678274] [INFO ] [MAIN ] NABL: Loaded 18300 primary data records. [2025-09-05T19:14:42.678667] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:42.868258] [INFO ] [MAIN ] NAC: Loaded 18251 primary data records. [2025-09-05T19:14:43.096841] [INFO ] [MAIN ] MYN: Generated 1352 derivative records from 7621 primary records. [2025-09-05T19:14:43.219374] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-05T19:14:43.227953] [INFO ] [MAIN ] Derivative Progress: 1222/2117 symbols completed. MYN took 0.9s. Estimated remaining: 4m 25s. Rate: 202.9 symbols/min [2025-09-05T19:14:43.228343] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:43.229150] [INFO ] [MAIN ] NABL: Generated 871 derivative records from 18300 primary records. [2025-09-05T19:14:43.239210] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-05T19:14:43.240977] [INFO ] [MAIN ] Derivative Progress: 1223/2117 symbols completed. NABL took 0.8s. Estimated remaining: 4m 24s. Rate: 203.1 symbols/min [2025-09-05T19:14:43.241272] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:43.252447] [INFO ] [MAIN ] NAN: Loaded 3925 primary data records. [2025-09-05T19:14:43.368439] [INFO ] [MAIN ] NAC: Generated 1352 derivative records from 18251 primary records. [2025-09-05T19:14:43.369002] [INFO ] [MAIN ] NAD: Loaded 16401 primary data records. [2025-09-05T19:14:43.636489] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-05T19:14:43.689396] [INFO ] [MAIN ] Derivative Progress: 1224/2117 symbols completed. NAC took 1.0s. Estimated remaining: 4m 24s. Rate: 203.0 symbols/min [2025-09-05T19:14:43.690142] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:43.801784] [INFO ] [MAIN ] NAN: Generated 871 derivative records from 3925 primary records. [2025-09-05T19:14:43.816599] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-05T19:14:43.818243] [INFO ] [MAIN ] Derivative Progress: 1225/2117 symbols completed. NAN took 0.6s. Estimated remaining: 4m 24s. Rate: 203.1 symbols/min [2025-09-05T19:14:43.818556] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:43.822321] [INFO ] [MAIN ] NAZ: Loaded 1911 primary data records. [2025-09-05T19:14:43.923180] [INFO ] [MAIN ] NAD: Generated 871 derivative records from 16401 primary records. [2025-09-05T19:14:43.936966] [INFO ] [MAIN ] NAT: Loaded 23452 primary data records. [2025-09-05T19:14:44.117145] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-05T19:14:44.121833] [INFO ] [MAIN ] Derivative Progress: 1226/2117 symbols completed. NAD took 0.9s. Estimated remaining: 4m 23s. Rate: 203.1 symbols/min [2025-09-05T19:14:44.126631] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:44.354344] [INFO ] [MAIN ] NBB: Loaded 6787 primary data records. [2025-09-05T19:14:44.646141] [INFO ] [MAIN ] NAZ: Generated 1352 derivative records from 1911 primary records. [2025-09-05T19:14:44.647167] [INFO ] [MAIN ] NAT: Generated 871 derivative records from 23452 primary records. [2025-09-05T19:14:44.669311] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-05T19:14:44.671617] [INFO ] [MAIN ] Derivative Progress: 1227/2117 symbols completed. NAT took 1.0s. Estimated remaining: 4m 23s. Rate: 203.0 symbols/min [2025-09-05T19:14:44.672058] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-05T19:14:44.672290] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:44.674701] [INFO ] [MAIN ] Derivative Progress: 1228/2117 symbols completed. NAZ took 0.9s. Estimated remaining: 4m 23s. Rate: 203.1 symbols/min [2025-09-05T19:14:44.696512] [INFO ] [MAIN ] NBB: Generated 1352 derivative records from 6787 primary records. [2025-09-05T19:14:44.715621] [INFO ] [MAIN ] NBXG: Loaded 16736 primary data records. [2025-09-05T19:14:44.716525] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-05T19:14:44.762285] [INFO ] [MAIN ] Derivative Progress: 1229/2117 symbols completed. NBB took 0.6s. Estimated remaining: 4m 22s. Rate: 203.2 symbols/min [2025-09-05T19:14:45.009840] [INFO ] [MAIN ] NBXG: Generated 1352 derivative records from 16736 primary records. [2025-09-05T19:14:45.022329] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-05T19:14:45.024609] [INFO ] [MAIN ] Derivative Progress: 1230/2117 symbols completed. NBXG took 0.4s. Estimated remaining: 4m 22s. Rate: 203.3 symbols/min [2025-09-05T19:14:45.025122] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:45.025178] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:45.025454] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:45.029424] [INFO ] [MAIN ] NC: Loaded 1486 primary data records. [2025-09-05T19:14:45.120086] [INFO ] [MAIN ] NCA: Loaded 7583 primary data records. [2025-09-05T19:14:45.181421] [INFO ] [MAIN ] NCDL: Loaded 15690 primary data records. [2025-09-05T19:14:45.944460] [INFO ] [MAIN ] NC: Generated 1351 derivative records from 1486 primary records. [2025-09-05T19:14:45.986823] [INFO ] [MAIN ] NCDL: Generated 1351 derivative records from 15690 primary records. [2025-09-05T19:14:45.988542] [INFO ] [MAIN ] NCA: Generated 1352 derivative records from 7583 primary records. [2025-09-05T19:14:45.989150] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-05T19:14:45.992632] [INFO ] [MAIN ] Derivative Progress: 1231/2117 symbols completed. NC took 1.0s. Estimated remaining: 4m 22s. Rate: 202.9 symbols/min [2025-09-05T19:14:46.008166] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:46.017744] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-05T19:14:46.020848] [INFO ] [MAIN ] Derivative Progress: 1232/2117 symbols completed. NCDL took 1.0s. Estimated remaining: 4m 22s. Rate: 203.0 symbols/min [2025-09-05T19:14:46.022796] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:46.024846] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-05T19:14:46.027745] [INFO ] [MAIN ] Derivative Progress: 1233/2117 symbols completed. NCA took 1.0s. Estimated remaining: 4m 21s. Rate: 203.2 symbols/min [2025-09-05T19:14:46.028177] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:46.039935] [INFO ] [MAIN ] NCZ: Loaded 5297 primary data records. [2025-09-05T19:14:46.043942] [INFO ] [MAIN ] NCV: Loaded 6305 primary data records. [2025-09-05T19:14:46.315594] [INFO ] [MAIN ] NCLH: Loaded 40493 primary data records. [2025-09-05T19:14:46.895259] [INFO ] [MAIN ] NCZ: Generated 871 derivative records from 5297 primary records. [2025-09-05T19:14:46.914665] [INFO ] [MAIN ] NCV: Generated 871 derivative records from 6305 primary records. [2025-09-05T19:14:46.915155] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-05T19:14:46.916629] [INFO ] [MAIN ] Derivative Progress: 1234/2117 symbols completed. NCZ took 0.9s. Estimated remaining: 4m 21s. Rate: 202.9 symbols/min [2025-09-05T19:14:46.917576] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:46.927612] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-05T19:14:46.933719] [INFO ] [MAIN ] Derivative Progress: 1235/2117 symbols completed. NCV took 0.9s. Estimated remaining: 4m 21s. Rate: 203.0 symbols/min [2025-09-05T19:14:46.934160] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:46.950921] [INFO ] [MAIN ] NDMO: Loaded 8190 primary data records. [2025-09-05T19:14:46.950609] [INFO ] [MAIN ] NCLH: Generated 1352 derivative records from 40493 primary records. [2025-09-05T19:14:47.076586] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-05T19:14:47.110482] [INFO ] [MAIN ] Derivative Progress: 1236/2117 symbols completed. NCLH took 1.1s. Estimated remaining: 4m 20s. Rate: 203.1 symbols/min [2025-09-05T19:14:47.146368] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:47.168695] [INFO ] [MAIN ] NE: Loaded 25296 primary data records. [2025-09-05T19:14:47.404989] [INFO ] [MAIN ] NEA: Loaded 17020 primary data records. [2025-09-05T19:14:47.661535] [INFO ] [MAIN ] NDMO: Generated 871 derivative records from 8190 primary records. [2025-09-05T19:14:47.757132] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-05T19:14:47.760033] [INFO ] [MAIN ] Derivative Progress: 1237/2117 symbols completed. NDMO took 0.8s. Estimated remaining: 4m 20s. Rate: 202.9 symbols/min [2025-09-05T19:14:47.762909] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:47.770756] [INFO ] [MAIN ] NE: Generated 871 derivative records from 25296 primary records. [2025-09-05T19:14:47.782395] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-05T19:14:47.784430] [INFO ] [MAIN ] Derivative Progress: 1238/2117 symbols completed. NE took 0.9s. Estimated remaining: 4m 20s. Rate: 203.0 symbols/min [2025-09-05T19:14:47.784904] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:47.796519] [INFO ] [MAIN ] NEA: Generated 871 derivative records from 17020 primary records. [2025-09-05T19:14:47.823212] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-05T19:14:47.824974] [INFO ] [MAIN ] Derivative Progress: 1239/2117 symbols completed. NEA took 0.7s. Estimated remaining: 4m 19s. Rate: 203.2 symbols/min [2025-09-05T19:14:47.825400] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:47.837361] [INFO ] [MAIN ] NEM: Loaded 26079 primary data records. [2025-09-05T19:14:47.851577] [INFO ] [MAIN ] NEE: Loaded 40447 primary data records. [2025-09-05T19:14:48.115333] [INFO ] [MAIN ] NET: Loaded 25692 primary data records. [2025-09-05T19:14:48.679710] [INFO ] [MAIN ] NEM: Generated 871 derivative records from 26079 primary records. [2025-09-05T19:14:48.701175] [INFO ] [MAIN ] NEE: Generated 1352 derivative records from 40447 primary records. [2025-09-05T19:14:48.703302] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-05T19:14:48.705593] [INFO ] [MAIN ] Derivative Progress: 1240/2117 symbols completed. NEM took 0.9s. Estimated remaining: 4m 19s. Rate: 202.9 symbols/min [2025-09-05T19:14:48.717899] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:48.719541] [INFO ] [MAIN ] NET: Generated 871 derivative records from 25692 primary records. [2025-09-05T19:14:48.735057] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-05T19:14:48.737544] [INFO ] [MAIN ] Derivative Progress: 1241/2117 symbols completed. NET took 0.9s. Estimated remaining: 4m 19s. Rate: 203.0 symbols/min [2025-09-05T19:14:48.737743] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:48.735936] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-05T19:14:48.742787] [INFO ] [MAIN ] Derivative Progress: 1242/2117 symbols completed. NEE took 1.0s. Estimated remaining: 4m 18s. Rate: 203.2 symbols/min [2025-09-05T19:14:48.743527] [INFO ] [MAIN ] NEU: Loaded 6769 primary data records. [2025-09-05T19:14:48.743605] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:48.821393] [INFO ] [MAIN ] NEUE: Loaded 1231 primary data records. [2025-09-05T19:14:48.833376] [INFO ] [MAIN ] NEXA: Loaded 2111 primary data records. [2025-09-05T19:14:49.540967] [INFO ] [MAIN ] NEXA: Generated 871 derivative records from 2111 primary records. [2025-09-05T19:14:49.552219] [INFO ] [MAIN ] NEU: Generated 1352 derivative records from 6769 primary records. [2025-09-05T19:14:49.584605] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-05T19:14:49.588202] [INFO ] [MAIN ] Derivative Progress: 1243/2117 symbols completed. NEXA took 0.8s. Estimated remaining: 4m 19s. Rate: 202.9 symbols/min [2025-09-05T19:14:49.586483] [INFO ] [MAIN ] NEUE: Generated 1346 derivative records from 1231 primary records. [2025-09-05T19:14:49.586591] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-05T19:14:49.590574] [INFO ] [MAIN ] Derivative Progress: 1244/2117 symbols completed. NEU took 0.9s. Estimated remaining: 4m 18s. Rate: 203.0 symbols/min [2025-09-05T19:14:49.601218] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-05T19:14:49.603880] [INFO ] [MAIN ] Derivative Progress: 1245/2117 symbols completed. NEUE took 0.9s. Estimated remaining: 4m 18s. Rate: 203.2 symbols/min [2025-09-05T19:14:49.604441] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:49.604632] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:49.604807] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:49.617424] [INFO ] [MAIN ] NFJ: Loaded 9691 primary data records. [2025-09-05T19:14:49.751938] [INFO ] [MAIN ] NGG: Loaded 22499 primary data records. [2025-09-05T19:14:49.768996] [INFO ] [MAIN ] NFG: Loaded 28942 primary data records. [2025-09-05T19:14:50.413757] [INFO ] [MAIN ] NFJ: Generated 871 derivative records from 9691 primary records. [2025-09-05T19:14:50.424919] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-05T19:14:50.426317] [INFO ] [MAIN ] Derivative Progress: 1246/2117 symbols completed. NFJ took 0.8s. Estimated remaining: 4m 18s. Rate: 202.9 symbols/min [2025-09-05T19:14:50.432924] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:50.433796] [INFO ] [MAIN ] NGG: Generated 871 derivative records from 22499 primary records. [2025-09-05T19:14:50.443918] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-05T19:14:50.446268] [INFO ] [MAIN ] Derivative Progress: 1247/2117 symbols completed. NGG took 0.8s. Estimated remaining: 4m 17s. Rate: 203.0 symbols/min [2025-09-05T19:14:50.447302] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:50.462772] [INFO ] [MAIN ] NFG: Generated 1352 derivative records from 28942 primary records. [2025-09-05T19:14:50.479331] [INFO ] [MAIN ] NGL: Loaded 16780 primary data records. [2025-09-05T19:14:50.526401] [INFO ] [MAIN ] NGVC: Loaded 11678 primary data records. [2025-09-05T19:14:50.561537] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-05T19:14:50.612808] [INFO ] [MAIN ] Derivative Progress: 1248/2117 symbols completed. NFG took 1.0s. Estimated remaining: 4m 17s. Rate: 203.1 symbols/min [2025-09-05T19:14:50.684734] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:50.969760] [INFO ] [MAIN ] NGVT: Loaded 11411 primary data records. [2025-09-05T19:14:51.270883] [INFO ] [MAIN ] NGL: Generated 871 derivative records from 16780 primary records. [2025-09-05T19:14:51.278883] [INFO ] [MAIN ] NGVC: Generated 871 derivative records from 11678 primary records. [2025-09-05T19:14:51.295606] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-05T19:14:51.297798] [INFO ] [MAIN ] Derivative Progress: 1249/2117 symbols completed. NGL took 0.9s. Estimated remaining: 4m 17s. Rate: 202.9 symbols/min [2025-09-05T19:14:51.299665] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-05T19:14:51.300936] [INFO ] [MAIN ] Derivative Progress: 1250/2117 symbols completed. NGVC took 0.9s. Estimated remaining: 4m 16s. Rate: 203.1 symbols/min [2025-09-05T19:14:51.299217] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:51.301484] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:51.313126] [INFO ] [MAIN ] NGVT: Generated 871 derivative records from 11411 primary records. [2025-09-05T19:14:51.326420] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-05T19:14:51.328062] [INFO ] [MAIN ] Derivative Progress: 1251/2117 symbols completed. NGVT took 0.6s. Estimated remaining: 4m 16s. Rate: 203.2 symbols/min [2025-09-05T19:14:51.328284] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:51.335973] [INFO ] [MAIN ] NHI: Loaded 16929 primary data records. [2025-09-05T19:14:51.414467] [INFO ] [MAIN ] NIC: Loaded 4684 primary data records. [2025-09-05T19:14:51.600574] [INFO ] [MAIN ] NI: Loaded 40196 primary data records. [2025-09-05T19:14:52.166192] [INFO ] [MAIN ] NHI: Generated 1352 derivative records from 16929 primary records. [2025-09-05T19:14:52.183805] [INFO ] [MAIN ] NIC: Generated 871 derivative records from 4684 primary records. [2025-09-05T19:14:52.187704] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-05T19:14:52.195104] [INFO ] [MAIN ] Derivative Progress: 1252/2117 symbols completed. NHI took 0.9s. Estimated remaining: 4m 16s. Rate: 202.9 symbols/min [2025-09-05T19:14:52.196007] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:52.199710] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-05T19:14:52.201711] [INFO ] [MAIN ] Derivative Progress: 1253/2117 symbols completed. NIC took 0.9s. Estimated remaining: 4m 15s. Rate: 203.0 symbols/min [2025-09-05T19:14:52.201941] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:52.214763] [INFO ] [MAIN ] NIM: Loaded 1730 primary data records. [2025-09-05T19:14:52.214580] [INFO ] [MAIN ] NI: Generated 1352 derivative records from 40196 primary records. [2025-09-05T19:14:52.338192] [INFO ] [MAIN ] NINE: Loaded 14647 primary data records. [2025-09-05T19:14:52.366003] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-05T19:14:52.456787] [INFO ] [MAIN ] Derivative Progress: 1254/2117 symbols completed. NI took 1.2s. Estimated remaining: 4m 15s. Rate: 203.1 symbols/min [2025-09-05T19:14:52.545965] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:52.742196] [INFO ] [MAIN ] NIO: Loaded 26172 primary data records. [2025-09-05T19:14:52.861248] [INFO ] [MAIN ] NIM: Generated 871 derivative records from 1730 primary records. [2025-09-05T19:14:53.010667] [INFO ] [MAIN ] NINE: Generated 871 derivative records from 14647 primary records. [2025-09-05T19:14:53.021081] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-05T19:14:53.023257] [INFO ] [MAIN ] Derivative Progress: 1255/2117 symbols completed. NIM took 0.8s. Estimated remaining: 4m 15s. Rate: 202.9 symbols/min [2025-09-05T19:14:53.023890] [INFO ] [MAIN ] NIQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:53.033355] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-05T19:14:53.035353] [INFO ] [MAIN ] Derivative Progress: 1256/2117 symbols completed. NINE took 0.8s. Estimated remaining: 4m 14s. Rate: 203.1 symbols/min [2025-09-05T19:14:53.035887] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:53.048728] [INFO ] [MAIN ] NIQ: Loaded 11149 primary data records. [2025-09-05T19:14:53.180693] [INFO ] [MAIN ] NJR: Loaded 18362 primary data records. [2025-09-05T19:14:53.180122] [INFO ] [MAIN ] NIO: Generated 871 derivative records from 26172 primary records. [2025-09-05T19:14:53.390955] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-05T19:14:53.397823] [INFO ] [MAIN ] Derivative Progress: 1257/2117 symbols completed. NIO took 0.9s. Estimated remaining: 4m 14s. Rate: 203.0 symbols/min [2025-09-05T19:14:53.413279] [INFO ] [MAIN ] NKE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:53.534929] [INFO ] [MAIN ] NIQ: Generated 409 derivative records from 11149 primary records. [2025-09-05T19:14:53.548408] [INFO ] [MAIN ] NIQ: Successfully saved derivative data. [2025-09-05T19:14:53.549177] [INFO ] [MAIN ] Derivative Progress: 1258/2117 symbols completed. NIQ took 0.5s. Estimated remaining: 4m 14s. Rate: 203.1 symbols/min [2025-09-05T19:14:53.559516] [INFO ] [MAIN ] NKE: Loaded 25797 primary data records. [2025-09-05T19:14:53.738750] [INFO ] [MAIN ] NJR: Generated 871 derivative records from 18362 primary records. [2025-09-05T19:14:53.832210] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-05T19:14:53.834575] [INFO ] [MAIN ] Derivative Progress: 1259/2117 symbols completed. NJR took 0.8s. Estimated remaining: 4m 13s. Rate: 203.1 symbols/min [2025-09-05T19:14:53.847046] [INFO ] [MAIN ] NKE: Generated 871 derivative records from 25797 primary records. [2025-09-05T19:14:53.855495] [INFO ] [MAIN ] NKE: Successfully saved derivative data. [2025-09-05T19:14:53.857095] [INFO ] [MAIN ] Derivative Progress: 1260/2117 symbols completed. NKE took 0.4s. Estimated remaining: 4m 13s. Rate: 203.3 symbols/min [2025-09-05T19:14:53.857546] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:53.857714] [INFO ] [MAIN ] NL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:53.858274] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:53.863911] [INFO ] [MAIN ] NL: Loaded 2626 primary data records. [2025-09-05T19:14:53.933019] [INFO ] [MAIN ] NLOP: Loaded 8649 primary data records. [2025-09-05T19:14:54.045949] [INFO ] [MAIN ] NKX: Loaded 10346 primary data records. [2025-09-05T19:14:54.741155] [INFO ] [MAIN ] NL: Generated 871 derivative records from 2626 primary records. [2025-09-05T19:14:54.763379] [INFO ] [MAIN ] NL: Successfully saved derivative data. [2025-09-05T19:14:54.762699] [INFO ] [MAIN ] NLOP: Generated 1352 derivative records from 8649 primary records. [2025-09-05T19:14:54.765943] [INFO ] [MAIN ] Derivative Progress: 1261/2117 symbols completed. NL took 0.9s. Estimated remaining: 4m 13s. Rate: 202.9 symbols/min [2025-09-05T19:14:54.767117] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:54.787322] [INFO ] [MAIN ] NKX: Generated 1352 derivative records from 10346 primary records. [2025-09-05T19:14:54.801088] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-05T19:14:54.803926] [INFO ] [MAIN ] Derivative Progress: 1262/2117 symbols completed. NLOP took 0.9s. Estimated remaining: 4m 13s. Rate: 203.1 symbols/min [2025-09-05T19:14:54.804922] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:54.806802] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-05T19:14:54.809806] [INFO ] [MAIN ] Derivative Progress: 1263/2117 symbols completed. NKX took 1.0s. Estimated remaining: 4m 12s. Rate: 203.2 symbols/min [2025-09-05T19:14:54.810023] [INFO ] [MAIN ] NMAX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:54.828575] [INFO ] [MAIN ] NMAI: Loaded 6692 primary data records. [2025-09-05T19:14:54.948579] [INFO ] [MAIN ] NLY: Loaded 40330 primary data records. [2025-09-05T19:14:55.111180] [INFO ] [MAIN ] NMAX: Loaded 21450 primary data records. [2025-09-05T19:14:55.620954] [INFO ] [MAIN ] NMAI: Generated 871 derivative records from 6692 primary records. [2025-09-05T19:14:55.633390] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-05T19:14:55.635577] [INFO ] [MAIN ] Derivative Progress: 1264/2117 symbols completed. NMAI took 0.8s. Estimated remaining: 4m 12s. Rate: 202.9 symbols/min [2025-09-05T19:14:55.637874] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:55.653580] [INFO ] [MAIN ] NMAX: Generated 871 derivative records from 21450 primary records. [2025-09-05T19:14:55.658392] [INFO ] [MAIN ] NLY: Generated 1352 derivative records from 40330 primary records. [2025-09-05T19:14:55.681314] [INFO ] [MAIN ] NMAX: Successfully saved derivative data. [2025-09-05T19:14:55.683675] [INFO ] [MAIN ] Derivative Progress: 1265/2117 symbols completed. NMAX took 0.9s. Estimated remaining: 4m 12s. Rate: 203.1 symbols/min [2025-09-05T19:14:55.693100] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-05T19:14:55.693542] [INFO ] [MAIN ] NMCO: Loaded 12946 primary data records. [2025-09-05T19:14:55.696917] [INFO ] [MAIN ] Derivative Progress: 1266/2117 symbols completed. NLY took 0.9s. Estimated remaining: 4m 11s. Rate: 203.2 symbols/min [2025-09-05T19:14:55.697336] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:55.693782] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:55.807033] [INFO ] [MAIN ] NMI: Loaded 3386 primary data records. [2025-09-05T19:14:55.894848] [INFO ] [MAIN ] NMM: Loaded 10676 primary data records. [2025-09-05T19:14:56.620143] [INFO ] [MAIN ] NMCO: Generated 1352 derivative records from 12946 primary records. [2025-09-05T19:14:56.651235] [INFO ] [MAIN ] NMI: Generated 1352 derivative records from 3386 primary records. [2025-09-05T19:14:56.667514] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-05T19:14:56.667637] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-05T19:14:56.676005] [INFO ] [MAIN ] Derivative Progress: 1267/2117 symbols completed. NMI took 1.0s. Estimated remaining: 4m 11s. Rate: 202.9 symbols/min [2025-09-05T19:14:56.680742] [INFO ] [MAIN ] NMM: Generated 1352 derivative records from 10676 primary records. [2025-09-05T19:14:56.684035] [INFO ] [MAIN ] Derivative Progress: 1268/2117 symbols completed. NMCO took 1.0s. Estimated remaining: 4m 11s. Rate: 203.0 symbols/min [2025-09-05T19:14:56.683955] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:56.691336] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:56.699695] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-05T19:14:56.704529] [INFO ] [MAIN ] NMS: Loaded 2219 primary data records. [2025-09-05T19:14:56.702231] [INFO ] [MAIN ] Derivative Progress: 1269/2117 symbols completed. NMM took 1.0s. Estimated remaining: 4m 10s. Rate: 203.2 symbols/min [2025-09-05T19:14:56.725848] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:56.822105] [INFO ] [MAIN ] NMT: Loaded 1436 primary data records. [2025-09-05T19:14:56.901731] [INFO ] [MAIN ] NMR: Loaded 16155 primary data records. [2025-09-05T19:14:57.493297] [INFO ] [MAIN ] NMT: Generated 871 derivative records from 1436 primary records. [2025-09-05T19:14:57.515226] [INFO ] [MAIN ] NMS: Generated 1351 derivative records from 2219 primary records. [2025-09-05T19:14:57.518196] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-05T19:14:57.532996] [INFO ] [MAIN ] NMR: Generated 871 derivative records from 16155 primary records. [2025-09-05T19:14:57.535951] [INFO ] [MAIN ] Derivative Progress: 1270/2117 symbols completed. NMT took 0.8s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-05T19:14:57.537106] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:57.544496] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-05T19:14:57.546258] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-05T19:14:57.548014] [INFO ] [MAIN ] Derivative Progress: 1271/2117 symbols completed. NMR took 0.9s. Estimated remaining: 4m 10s. Rate: 203.0 symbols/min [2025-09-05T19:14:57.550534] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:57.550450] [INFO ] [MAIN ] Derivative Progress: 1272/2117 symbols completed. NMS took 0.9s. Estimated remaining: 4m 10s. Rate: 203.2 symbols/min [2025-09-05T19:14:57.552623] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:57.556854] [INFO ] [MAIN ] NNI: Loaded 5381 primary data records. [2025-09-05T19:14:57.608318] [INFO ] [MAIN ] NNY: Loaded 2797 primary data records. [2025-09-05T19:14:57.934209] [INFO ] [MAIN ] NNN: Loaded 23348 primary data records. [2025-09-05T19:14:58.314133] [INFO ] [MAIN ] NNI: Generated 871 derivative records from 5381 primary records. [2025-09-05T19:14:58.322590] [INFO ] [MAIN ] NNY: Generated 871 derivative records from 2797 primary records. [2025-09-05T19:14:58.338277] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-05T19:14:58.340435] [INFO ] [MAIN ] Derivative Progress: 1273/2117 symbols completed. NNI took 0.8s. Estimated remaining: 4m 10s. Rate: 202.9 symbols/min [2025-09-05T19:14:58.342008] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-05T19:14:58.343957] [INFO ] [MAIN ] Derivative Progress: 1274/2117 symbols completed. NNY took 0.8s. Estimated remaining: 4m 9s. Rate: 203.1 symbols/min [2025-09-05T19:14:58.353051] [INFO ] [MAIN ] NNN: Generated 871 derivative records from 23348 primary records. [2025-09-05T19:14:58.361327] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-05T19:14:58.363004] [INFO ] [MAIN ] Derivative Progress: 1275/2117 symbols completed. NNN took 0.8s. Estimated remaining: 4m 9s. Rate: 203.2 symbols/min [2025-09-05T19:14:58.363556] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:58.363938] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:58.364417] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:58.379146] [INFO ] [MAIN ] NOA: Loaded 7579 primary data records. [2025-09-05T19:14:58.483781] [INFO ] [MAIN ] NOAH: Loaded 15022 primary data records. [2025-09-05T19:14:58.641056] [INFO ] [MAIN ] NOG: Loaded 24692 primary data records. [2025-09-05T19:14:59.212932] [INFO ] [MAIN ] NOA: Generated 871 derivative records from 7579 primary records. [2025-09-05T19:14:59.222461] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-05T19:14:59.223840] [INFO ] [MAIN ] Derivative Progress: 1276/2117 symbols completed. NOA took 0.9s. Estimated remaining: 4m 9s. Rate: 202.9 symbols/min [2025-09-05T19:14:59.225287] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:59.234624] [INFO ] [MAIN ] NOG: Generated 871 derivative records from 24692 primary records. [2025-09-05T19:14:59.246227] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-05T19:14:59.248014] [INFO ] [MAIN ] Derivative Progress: 1277/2117 symbols completed. NOG took 0.9s. Estimated remaining: 4m 8s. Rate: 203.1 symbols/min [2025-09-05T19:14:59.248287] [INFO ] [MAIN ] NOM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:59.268754] [INFO ] [MAIN ] NOM: Loaded 602 primary data records. [2025-09-05T19:14:59.259389] [INFO ] [MAIN ] NOAH: Generated 1352 derivative records from 15022 primary records. [2025-09-05T19:14:59.389231] [INFO ] [MAIN ] NOK: Loaded 26029 primary data records. [2025-09-05T19:14:59.626529] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-05T19:14:59.640429] [INFO ] [MAIN ] Derivative Progress: 1278/2117 symbols completed. NOAH took 1.3s. Estimated remaining: 4m 8s. Rate: 203.0 symbols/min [2025-09-05T19:14:59.681014] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:59.782859] [INFO ] [MAIN ] NOM: Generated 871 derivative records from 602 primary records. [2025-09-05T19:14:59.802946] [INFO ] [MAIN ] NOK: Generated 871 derivative records from 26029 primary records. [2025-09-05T19:14:59.803935] [INFO ] [MAIN ] NOM: Successfully saved derivative data. [2025-09-05T19:14:59.805448] [INFO ] [MAIN ] Derivative Progress: 1279/2117 symbols completed. NOM took 0.6s. Estimated remaining: 4m 8s. Rate: 203.1 symbols/min [2025-09-05T19:14:59.805927] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:59.821929] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-05T19:14:59.820267] [INFO ] [MAIN ] NOMD: Loaded 19395 primary data records. [2025-09-05T19:14:59.823691] [INFO ] [MAIN ] Derivative Progress: 1280/2117 symbols completed. NOK took 0.6s. Estimated remaining: 4m 7s. Rate: 203.2 symbols/min [2025-09-05T19:14:59.824062] [INFO ] [MAIN ] NPB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:14:59.943201] [INFO ] [MAIN ] NPB: Loaded 7666 primary data records. [2025-09-05T19:15:00.156385] [INFO ] [MAIN ] NOW: Loaded 36454 primary data records. [2025-09-05T19:15:00.625964] [INFO ] [MAIN ] NOMD: Generated 871 derivative records from 19395 primary records. [2025-09-05T19:15:00.627004] [INFO ] [MAIN ] NPB: Generated 871 derivative records from 7666 primary records. [2025-09-05T19:15:00.646992] [INFO ] [MAIN ] NPB: Successfully saved derivative data. [2025-09-05T19:15:00.648929] [INFO ] [MAIN ] Derivative Progress: 1281/2117 symbols completed. NPB took 0.8s. Estimated remaining: 4m 7s. Rate: 203.0 symbols/min [2025-09-05T19:15:00.649360] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-05T19:15:00.649598] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:00.651210] [INFO ] [MAIN ] Derivative Progress: 1282/2117 symbols completed. NOMD took 1.0s. Estimated remaining: 4m 7s. Rate: 203.1 symbols/min [2025-09-05T19:15:00.652354] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:00.678285] [INFO ] [MAIN ] NPFD: Loaded 4880 primary data records. [2025-09-05T19:15:00.679980] [INFO ] [MAIN ] NOW: Generated 1352 derivative records from 36454 primary records. [2025-09-05T19:15:00.678851] [INFO ] [MAIN ] NPCT: Loaded 8364 primary data records. [2025-09-05T19:15:00.964915] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-05T19:15:01.047985] [INFO ] [MAIN ] Derivative Progress: 1283/2117 symbols completed. NOW took 1.2s. Estimated remaining: 4m 6s. Rate: 203.1 symbols/min [2025-09-05T19:15:01.051439] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:01.198288] [INFO ] [MAIN ] NPK: Loaded 5166 primary data records. [2025-09-05T19:15:01.396209] [INFO ] [MAIN ] NPFD: Generated 871 derivative records from 4880 primary records. [2025-09-05T19:15:01.465859] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-05T19:15:01.468365] [INFO ] [MAIN ] Derivative Progress: 1284/2117 symbols completed. NPFD took 0.8s. Estimated remaining: 4m 6s. Rate: 203.0 symbols/min [2025-09-05T19:15:01.468843] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:01.477098] [INFO ] [MAIN ] NPCT: Generated 871 derivative records from 8364 primary records. [2025-09-05T19:15:01.487980] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-05T19:15:01.490026] [INFO ] [MAIN ] Derivative Progress: 1285/2117 symbols completed. NPCT took 0.8s. Estimated remaining: 4m 6s. Rate: 203.1 symbols/min [2025-09-05T19:15:01.490577] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:01.503689] [INFO ] [MAIN ] NPK: Generated 871 derivative records from 5166 primary records. [2025-09-05T19:15:01.508459] [INFO ] [MAIN ] NPO: Loaded 5950 primary data records. [2025-09-05T19:15:01.609874] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-05T19:15:01.654240] [INFO ] [MAIN ] Derivative Progress: 1286/2117 symbols completed. NPK took 0.6s. Estimated remaining: 4m 5s. Rate: 203.2 symbols/min [2025-09-05T19:15:01.654584] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:01.661942] [INFO ] [MAIN ] NPKI: Loaded 31334 primary data records. [2025-09-05T19:15:01.937316] [INFO ] [MAIN ] NPV: Loaded 2453 primary data records. [2025-09-05T19:15:02.408144] [INFO ] [MAIN ] NPO: Generated 871 derivative records from 5950 primary records. [2025-09-05T19:15:02.418461] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-05T19:15:02.420013] [INFO ] [MAIN ] Derivative Progress: 1287/2117 symbols completed. NPO took 0.9s. Estimated remaining: 4m 5s. Rate: 203.0 symbols/min [2025-09-05T19:15:02.420392] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:02.443971] [INFO ] [MAIN ] NPV: Generated 871 derivative records from 2453 primary records. [2025-09-05T19:15:02.445235] [INFO ] [MAIN ] NPKI: Generated 1352 derivative records from 31334 primary records. [2025-09-05T19:15:02.470127] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-05T19:15:02.472182] [INFO ] [MAIN ] Derivative Progress: 1288/2117 symbols completed. NPV took 0.8s. Estimated remaining: 4m 5s. Rate: 203.1 symbols/min [2025-09-05T19:15:02.482660] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-09-05T19:15:02.485577] [INFO ] [MAIN ] Derivative Progress: 1289/2117 symbols completed. NPKI took 1.0s. Estimated remaining: 4m 4s. Rate: 203.2 symbols/min [2025-09-05T19:15:02.486175] [INFO ] [MAIN ] NPWR: Loaded 21609 primary data records. [2025-09-05T19:15:02.728481] [INFO ] [MAIN ] NPWR: Generated 871 derivative records from 21609 primary records. [2025-09-05T19:15:02.736903] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-05T19:15:02.738311] [INFO ] [MAIN ] Derivative Progress: 1290/2117 symbols completed. NPWR took 0.3s. Estimated remaining: 4m 4s. Rate: 203.3 symbols/min [2025-09-05T19:15:02.739021] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:02.739256] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:02.739400] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:02.751469] [INFO ] [MAIN ] NQP: Loaded 4625 primary data records. [2025-09-05T19:15:02.751800] [INFO ] [MAIN ] NREF: Loaded 4030 primary data records. [2025-09-05T19:15:02.930367] [INFO ] [MAIN ] NRDY: Loaded 15842 primary data records. [2025-09-05T19:15:03.508523] [INFO ] [MAIN ] NREF: Generated 871 derivative records from 4030 primary records. [2025-09-05T19:15:03.521103] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-05T19:15:03.522696] [INFO ] [MAIN ] Derivative Progress: 1291/2117 symbols completed. NREF took 0.8s. Estimated remaining: 4m 4s. Rate: 203.0 symbols/min [2025-09-05T19:15:03.529430] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:03.536519] [INFO ] [MAIN ] NQP: Generated 871 derivative records from 4625 primary records. [2025-09-05T19:15:03.537688] [INFO ] [MAIN ] NRDY: Generated 871 derivative records from 15842 primary records. [2025-09-05T19:15:03.554368] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-05T19:15:03.556440] [INFO ] [MAIN ] Derivative Progress: 1292/2117 symbols completed. NQP took 0.8s. Estimated remaining: 4m 4s. Rate: 203.1 symbols/min [2025-09-05T19:15:03.557294] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:03.558581] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-05T19:15:03.560697] [INFO ] [MAIN ] Derivative Progress: 1293/2117 symbols completed. NRDY took 0.8s. Estimated remaining: 4m 3s. Rate: 203.3 symbols/min [2025-09-05T19:15:03.561174] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:03.589462] [INFO ] [MAIN ] NRK: Loaded 10248 primary data records. [2025-09-05T19:15:03.712506] [INFO ] [MAIN ] NRGV: Loaded 19988 primary data records. [2025-09-05T19:15:03.714350] [INFO ] [MAIN ] NRG: Loaded 39818 primary data records. [2025-09-05T19:15:04.427123] [INFO ] [MAIN ] NRK: Generated 871 derivative records from 10248 primary records. [2025-09-05T19:15:04.445083] [INFO ] [MAIN ] NRGV: Generated 870 derivative records from 19988 primary records. [2025-09-05T19:15:04.445810] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-05T19:15:04.447625] [INFO ] [MAIN ] Derivative Progress: 1294/2117 symbols completed. NRK took 0.9s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-05T19:15:04.447849] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:04.456655] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-05T19:15:04.458757] [INFO ] [MAIN ] Derivative Progress: 1295/2117 symbols completed. NRGV took 0.9s. Estimated remaining: 4m 3s. Rate: 203.1 symbols/min [2025-09-05T19:15:04.459002] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:04.462009] [INFO ] [MAIN ] NRP: Loaded 1995 primary data records. [2025-09-05T19:15:04.535277] [INFO ] [MAIN ] NRT: Loaded 2477 primary data records. [2025-09-05T19:15:04.642753] [INFO ] [MAIN ] NRG: Generated 1352 derivative records from 39818 primary records. [2025-09-05T19:15:04.902957] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-09-05T19:15:04.963660] [INFO ] [MAIN ] Derivative Progress: 1296/2117 symbols completed. NRG took 1.4s. Estimated remaining: 4m 3s. Rate: 203.0 symbols/min [2025-09-05T19:15:04.964853] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:04.971336] [INFO ] [MAIN ] NRUC: Loaded 1366 primary data records. [2025-09-05T19:15:05.160441] [INFO ] [MAIN ] NRP: Generated 871 derivative records from 1995 primary records. [2025-09-05T19:15:05.222411] [INFO ] [MAIN ] NRT: Generated 871 derivative records from 2477 primary records. [2025-09-05T19:15:05.236478] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-05T19:15:05.238390] [INFO ] [MAIN ] Derivative Progress: 1297/2117 symbols completed. NRP took 0.8s. Estimated remaining: 4m 2s. Rate: 203.0 symbols/min [2025-09-05T19:15:05.239025] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:05.240596] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-05T19:15:05.242858] [INFO ] [MAIN ] Derivative Progress: 1298/2117 symbols completed. NRT took 0.8s. Estimated remaining: 4m 2s. Rate: 203.2 symbols/min [2025-09-05T19:15:05.243804] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:05.256426] [INFO ] [MAIN ] NRUC: Generated 871 derivative records from 1366 primary records. [2025-09-05T19:15:05.265543] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-05T19:15:05.276448] [INFO ] [MAIN ] Derivative Progress: 1299/2117 symbols completed. NRUC took 0.3s. Estimated remaining: 4m 1s. Rate: 203.3 symbols/min [2025-09-05T19:15:05.276763] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:05.298564] [INFO ] [MAIN ] NSA: Loaded 33839 primary data records. [2025-09-05T19:15:05.415352] [INFO ] [MAIN ] NSP: Loaded 16973 primary data records. [2025-09-05T19:15:05.540098] [INFO ] [MAIN ] NSC: Loaded 36913 primary data records. [2025-09-05T19:15:06.133837] [INFO ] [MAIN ] NSA: Generated 1352 derivative records from 33839 primary records. [2025-09-05T19:15:06.158114] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-05T19:15:06.157759] [INFO ] [MAIN ] NSP: Generated 871 derivative records from 16973 primary records. [2025-09-05T19:15:06.160887] [INFO ] [MAIN ] Derivative Progress: 1300/2117 symbols completed. NSA took 0.9s. Estimated remaining: 4m 1s. Rate: 203.0 symbols/min [2025-09-05T19:15:06.161370] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:06.171531] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-05T19:15:06.173288] [INFO ] [MAIN ] Derivative Progress: 1301/2117 symbols completed. NSP took 0.9s. Estimated remaining: 4m 1s. Rate: 203.2 symbols/min [2025-09-05T19:15:06.176132] [INFO ] [MAIN ] NTEST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:06.183518] [INFO ] [MAIN ] NTB: Loaded 9429 primary data records. [2025-09-05T19:15:06.212999] [INFO ] [MAIN ] NSC: Generated 1352 derivative records from 36913 primary records. [2025-09-05T19:15:06.223930] [INFO ] [MAIN ] NTEST: Loaded 1494 primary data records. [2025-09-05T19:15:06.422221] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-09-05T19:15:06.446544] [INFO ] [MAIN ] Derivative Progress: 1302/2117 symbols completed. NSC took 1.2s. Estimated remaining: 4m 1s. Rate: 203.2 symbols/min [2025-09-05T19:15:06.520020] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:06.783258] [INFO ] [MAIN ] NTB: Generated 871 derivative records from 9429 primary records. [2025-09-05T19:15:06.785053] [INFO ] [MAIN ] NTR: Loaded 25378 primary data records. [2025-09-05T19:15:06.836299] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-05T19:15:06.845907] [INFO ] [MAIN ] Derivative Progress: 1303/2117 symbols completed. NTB took 0.7s. Estimated remaining: 4m 0s. Rate: 203.1 symbols/min [2025-09-05T19:15:06.925198] [INFO ] [MAIN ] NTEST: Generated 1347 derivative records from 1494 primary records. [2025-09-05T19:15:07.053453] [INFO ] [MAIN ] NTEST: Successfully saved derivative data. [2025-09-05T19:15:07.096341] [INFO ] [MAIN ] Derivative Progress: 1304/2117 symbols completed. NTEST took 0.9s. Estimated remaining: 4m 0s. Rate: 203.1 symbols/min [2025-09-05T19:15:07.131370] [INFO ] [MAIN ] NTR: Generated 871 derivative records from 25378 primary records. [2025-09-05T19:15:07.139709] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-05T19:15:07.140918] [INFO ] [MAIN ] Derivative Progress: 1305/2117 symbols completed. NTR took 0.6s. Estimated remaining: 3m 60s. Rate: 203.3 symbols/min [2025-09-05T19:15:07.141690] [INFO ] [MAIN ] NUE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:07.141398] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:07.141810] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:07.178083] [INFO ] [MAIN ] NTST: Loaded 21562 primary data records. [2025-09-05T19:15:07.290080] [INFO ] [MAIN ] NUE: Loaded 24690 primary data records. [2025-09-05T19:15:07.298204] [INFO ] [MAIN ] NU: Loaded 26117 primary data records. [2025-09-05T19:15:07.957060] [INFO ] [MAIN ] NTST: Generated 871 derivative records from 21562 primary records. [2025-09-05T19:15:07.967565] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-05T19:15:07.970690] [INFO ] [MAIN ] Derivative Progress: 1306/2117 symbols completed. NTST took 0.8s. Estimated remaining: 3m 60s. Rate: 203.0 symbols/min [2025-09-05T19:15:07.982209] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:07.983532] [INFO ] [MAIN ] NU: Generated 871 derivative records from 26117 primary records. [2025-09-05T19:15:08.002998] [INFO ] [MAIN ] NUE: Generated 871 derivative records from 24690 primary records. [2025-09-05T19:15:08.004471] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-05T19:15:08.006557] [INFO ] [MAIN ] Derivative Progress: 1307/2117 symbols completed. NU took 0.9s. Estimated remaining: 3m 59s. Rate: 203.1 symbols/min [2025-09-05T19:15:08.011528] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:08.024443] [INFO ] [MAIN ] NUE: Successfully saved derivative data. [2025-09-05T19:15:08.026220] [INFO ] [MAIN ] Derivative Progress: 1308/2117 symbols completed. NUE took 0.9s. Estimated remaining: 3m 59s. Rate: 203.3 symbols/min [2025-09-05T19:15:08.026565] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:08.037700] [INFO ] [MAIN ] NUS: Loaded 27698 primary data records. [2025-09-05T19:15:08.150971] [INFO ] [MAIN ] NUV: Loaded 17120 primary data records. [2025-09-05T19:15:08.346228] [INFO ] [MAIN ] NUVB: Loaded 38666 primary data records. [2025-09-05T19:15:08.899811] [INFO ] [MAIN ] NUS: Generated 1352 derivative records from 27698 primary records. [2025-09-05T19:15:08.918087] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-05T19:15:08.930440] [INFO ] [MAIN ] NUVB: Generated 1352 derivative records from 38666 primary records. [2025-09-05T19:15:08.920285] [INFO ] [MAIN ] Derivative Progress: 1309/2117 symbols completed. NUS took 0.9s. Estimated remaining: 3m 59s. Rate: 203.0 symbols/min [2025-09-05T19:15:08.941128] [INFO ] [MAIN ] NUV: Generated 1352 derivative records from 17120 primary records. [2025-09-05T19:15:08.940081] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:08.966188] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-05T19:15:08.966768] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-05T19:15:08.969399] [INFO ] [MAIN ] Derivative Progress: 1310/2117 symbols completed. NUVB took 0.9s. Estimated remaining: 3m 58s. Rate: 203.1 symbols/min [2025-09-05T19:15:08.969631] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:08.972150] [INFO ] [MAIN ] Derivative Progress: 1311/2117 symbols completed. NUV took 1.0s. Estimated remaining: 3m 58s. Rate: 203.2 symbols/min [2025-09-05T19:15:08.972774] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:09.003985] [INFO ] [MAIN ] NVR: Loaded 13639 primary data records. [2025-09-05T19:15:09.003591] [INFO ] [MAIN ] NVG: Loaded 20565 primary data records. [2025-09-05T19:15:09.157974] [INFO ] [MAIN ] NVGS: Loaded 16254 primary data records. [2025-09-05T19:15:09.832544] [INFO ] [MAIN ] NVR: Generated 1351 derivative records from 13639 primary records. [2025-09-05T19:15:09.861485] [INFO ] [MAIN ] NVG: Generated 1352 derivative records from 20565 primary records. [2025-09-05T19:15:09.862120] [INFO ] [MAIN ] NVGS: Generated 871 derivative records from 16254 primary records. [2025-09-05T19:15:09.877688] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-05T19:15:09.880522] [INFO ] [MAIN ] Derivative Progress: 1312/2117 symbols completed. NVR took 0.9s. Estimated remaining: 3m 58s. Rate: 202.9 symbols/min [2025-09-05T19:15:09.883809] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:09.881721] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-05T19:15:09.887941] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-05T19:15:09.889916] [INFO ] [MAIN ] Derivative Progress: 1313/2117 symbols completed. NVGS took 0.9s. Estimated remaining: 3m 58s. Rate: 203.1 symbols/min [2025-09-05T19:15:09.892275] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:09.892352] [INFO ] [MAIN ] Derivative Progress: 1314/2117 symbols completed. NVG took 1.0s. Estimated remaining: 3m 57s. Rate: 203.2 symbols/min [2025-09-05T19:15:09.892869] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:09.931361] [INFO ] [MAIN ] NVRI: Loaded 18425 primary data records. [2025-09-05T19:15:09.953963] [INFO ] [MAIN ] NVST: Loaded 24799 primary data records. [2025-09-05T19:15:10.063004] [INFO ] [MAIN ] NVS: Loaded 24810 primary data records. [2025-09-05T19:15:10.657336] [INFO ] [MAIN ] NVST: Generated 871 derivative records from 24799 primary records. [2025-09-05T19:15:10.665116] [INFO ] [MAIN ] NVRI: Generated 871 derivative records from 18425 primary records. [2025-09-05T19:15:10.679692] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-05T19:15:10.683701] [INFO ] [MAIN ] Derivative Progress: 1315/2117 symbols completed. NVST took 0.8s. Estimated remaining: 3m 57s. Rate: 203.0 symbols/min [2025-09-05T19:15:10.691033] [INFO ] [MAIN ] NVS: Generated 871 derivative records from 24810 primary records. [2025-09-05T19:15:10.691166] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:10.702141] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-05T19:15:10.700207] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-05T19:15:10.703837] [INFO ] [MAIN ] Derivative Progress: 1316/2117 symbols completed. NVS took 0.8s. Estimated remaining: 3m 57s. Rate: 203.1 symbols/min [2025-09-05T19:15:10.704216] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:10.705520] [INFO ] [MAIN ] Derivative Progress: 1317/2117 symbols completed. NVRI took 0.8s. Estimated remaining: 3m 56s. Rate: 203.3 symbols/min [2025-09-05T19:15:10.706120] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:10.739946] [INFO ] [MAIN ] NVT: Loaded 24768 primary data records. [2025-09-05T19:15:10.740570] [INFO ] [MAIN ] NWN: Loaded 13171 primary data records. [2025-09-05T19:15:10.918701] [INFO ] [MAIN ] NWG: Loaded 24930 primary data records. [2025-09-05T19:15:11.484228] [INFO ] [MAIN ] NVT: Generated 871 derivative records from 24768 primary records. [2025-09-05T19:15:11.499321] [INFO ] [MAIN ] NWN: Generated 871 derivative records from 13171 primary records. [2025-09-05T19:15:11.503867] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-05T19:15:11.505235] [INFO ] [MAIN ] Derivative Progress: 1318/2117 symbols completed. NVT took 0.8s. Estimated remaining: 3m 56s. Rate: 203.0 symbols/min [2025-09-05T19:15:11.512688] [INFO ] [MAIN ] NWG: Generated 871 derivative records from 24930 primary records. [2025-09-05T19:15:11.528832] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-05T19:15:11.530864] [INFO ] [MAIN ] Derivative Progress: 1319/2117 symbols completed. NWN took 0.8s. Estimated remaining: 3m 56s. Rate: 203.1 symbols/min [2025-09-05T19:15:11.529202] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-05T19:15:11.532667] [INFO ] [MAIN ] Derivative Progress: 1320/2117 symbols completed. NWG took 0.8s. Estimated remaining: 3m 55s. Rate: 203.3 symbols/min [2025-09-05T19:15:11.533264] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:11.533548] [INFO ] [MAIN ] NXDR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:11.533369] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:11.538805] [INFO ] [MAIN ] NXC: Loaded 1789 primary data records. [2025-09-05T19:15:11.642851] [INFO ] [MAIN ] NXDR: Loaded 12297 primary data records. [2025-09-05T19:15:11.707681] [INFO ] [MAIN ] NX: Loaded 15721 primary data records. [2025-09-05T19:15:12.338445] [INFO ] [MAIN ] NXDR: Generated 442 derivative records from 12297 primary records. [2025-09-05T19:15:12.339604] [INFO ] [MAIN ] NXC: Generated 871 derivative records from 1789 primary records. [2025-09-05T19:15:12.353996] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-05T19:15:12.356162] [INFO ] [MAIN ] Derivative Progress: 1321/2117 symbols completed. NXC took 0.8s. Estimated remaining: 3m 55s. Rate: 203.0 symbols/min [2025-09-05T19:15:12.356689] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:12.358742] [INFO ] [MAIN ] NXDR: Successfully saved derivative data. [2025-09-05T19:15:12.362056] [INFO ] [MAIN ] Derivative Progress: 1322/2117 symbols completed. NXDR took 0.8s. Estimated remaining: 3m 55s. Rate: 203.2 symbols/min [2025-09-05T19:15:12.362430] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:12.372499] [INFO ] [MAIN ] NX: Generated 871 derivative records from 15721 primary records. [2025-09-05T19:15:12.381789] [INFO ] [MAIN ] NXDT: Loaded 6682 primary data records. [2025-09-05T19:15:12.421967] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-05T19:15:12.429772] [INFO ] [MAIN ] Derivative Progress: 1323/2117 symbols completed. NX took 0.9s. Estimated remaining: 3m 54s. Rate: 203.3 symbols/min [2025-09-05T19:15:12.461598] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:12.583714] [INFO ] [MAIN ] NXG: Loaded 5396 primary data records. [2025-09-05T19:15:12.728049] [INFO ] [MAIN ] NXE: Loaded 25715 primary data records. [2025-09-05T19:15:13.146427] [INFO ] [MAIN ] NXDT: Generated 871 derivative records from 6682 primary records. [2025-09-05T19:15:13.156581] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-05T19:15:13.158321] [INFO ] [MAIN ] Derivative Progress: 1324/2117 symbols completed. NXDT took 0.8s. Estimated remaining: 3m 54s. Rate: 203.1 symbols/min [2025-09-05T19:15:13.161545] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:13.171971] [INFO ] [MAIN ] NXG: Generated 871 derivative records from 5396 primary records. [2025-09-05T19:15:13.179541] [INFO ] [MAIN ] NXN: Loaded 1781 primary data records. [2025-09-05T19:15:13.292891] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-05T19:15:13.295524] [INFO ] [MAIN ] Derivative Progress: 1325/2117 symbols completed. NXG took 0.8s. Estimated remaining: 3m 54s. Rate: 203.1 symbols/min [2025-09-05T19:15:13.293725] [INFO ] [MAIN ] NXE: Generated 871 derivative records from 25715 primary records. [2025-09-05T19:15:13.301265] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:13.472387] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-05T19:15:13.472637] [INFO ] [MAIN ] NXP: Loaded 9259 primary data records. [2025-09-05T19:15:13.474543] [INFO ] [MAIN ] Derivative Progress: 1326/2117 symbols completed. NXE took 1.1s. Estimated remaining: 3m 54s. Rate: 203.2 symbols/min [2025-09-05T19:15:13.485860] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:13.660329] [INFO ] [MAIN ] NXRT: Loaded 9111 primary data records. [2025-09-05T19:15:14.007863] [INFO ] [MAIN ] NXN: Generated 1352 derivative records from 1781 primary records. [2025-09-05T19:15:14.022570] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-05T19:15:14.025027] [INFO ] [MAIN ] Derivative Progress: 1327/2117 symbols completed. NXN took 0.9s. Estimated remaining: 3m 53s. Rate: 203.1 symbols/min [2025-09-05T19:15:14.025514] [INFO ] [MAIN ] NYC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:14.040114] [INFO ] [MAIN ] NYC: Loaded 727 primary data records. [2025-09-05T19:15:14.041494] [INFO ] [MAIN ] NXP: Generated 1352 derivative records from 9259 primary records. [2025-09-05T19:15:14.097536] [INFO ] [MAIN ] NXRT: Generated 871 derivative records from 9111 primary records. [2025-09-05T19:15:14.199233] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-05T19:15:14.224781] [INFO ] [MAIN ] Derivative Progress: 1328/2117 symbols completed. NXRT took 0.7s. Estimated remaining: 3m 53s. Rate: 203.1 symbols/min [2025-09-05T19:15:14.230541] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:14.230831] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-05T19:15:14.345834] [INFO ] [MAIN ] Derivative Progress: 1329/2117 symbols completed. NXP took 1.1s. Estimated remaining: 3m 53s. Rate: 203.2 symbols/min [2025-09-05T19:15:14.346936] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:14.376401] [INFO ] [MAIN ] NYT: Loaded 24136 primary data records. [2025-09-05T19:15:14.480225] [INFO ] [MAIN ] NYC: Generated 1350 derivative records from 727 primary records. [2025-09-05T19:15:14.498214] [INFO ] [MAIN ] NZF: Loaded 21720 primary data records. [2025-09-05T19:15:14.688181] [INFO ] [MAIN ] NYC: Successfully saved derivative data. [2025-09-05T19:15:14.744799] [INFO ] [MAIN ] Derivative Progress: 1330/2117 symbols completed. NYC took 0.7s. Estimated remaining: 3m 52s. Rate: 203.2 symbols/min [2025-09-05T19:15:14.795179] [INFO ] [MAIN ] O: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:14.960973] [INFO ] [MAIN ] NYT: Generated 871 derivative records from 24136 primary records. [2025-09-05T19:15:14.970327] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-05T19:15:14.971952] [INFO ] [MAIN ] Derivative Progress: 1331/2117 symbols completed. NYT took 0.7s. Estimated remaining: 3m 52s. Rate: 203.2 symbols/min [2025-09-05T19:15:14.972228] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:14.996564] [INFO ] [MAIN ] NZF: Generated 1352 derivative records from 21720 primary records. [2025-09-05T19:15:15.023911] [INFO ] [MAIN ] O: Loaded 40527 primary data records. [2025-09-05T19:15:15.056109] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-05T19:15:15.073799] [INFO ] [MAIN ] Derivative Progress: 1332/2117 symbols completed. NZF took 0.7s. Estimated remaining: 3m 52s. Rate: 203.3 symbols/min [2025-09-05T19:15:15.111946] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:15.239051] [INFO ] [MAIN ] OBDC: Loaded 38637 primary data records. [2025-09-05T19:15:15.371844] [INFO ] [MAIN ] OBK: Loaded 11897 primary data records. [2025-09-05T19:15:15.874230] [INFO ] [MAIN ] O: Generated 1352 derivative records from 40527 primary records. [2025-09-05T19:15:15.903184] [INFO ] [MAIN ] O: Successfully saved derivative data. [2025-09-05T19:15:15.904256] [INFO ] [MAIN ] OBDC: Generated 1352 derivative records from 38637 primary records. [2025-09-05T19:15:15.906561] [INFO ] [MAIN ] Derivative Progress: 1333/2117 symbols completed. O took 1.1s. Estimated remaining: 3m 52s. Rate: 203.0 symbols/min [2025-09-05T19:15:15.931016] [INFO ] [MAIN ] OBK: Generated 1352 derivative records from 11897 primary records. [2025-09-05T19:15:15.931511] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-05T19:15:15.934342] [INFO ] [MAIN ] Derivative Progress: 1334/2117 symbols completed. OBDC took 1.0s. Estimated remaining: 3m 51s. Rate: 203.1 symbols/min [2025-09-05T19:15:15.945532] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-05T19:15:15.947772] [INFO ] [MAIN ] Derivative Progress: 1335/2117 symbols completed. OBK took 0.8s. Estimated remaining: 3m 51s. Rate: 203.3 symbols/min [2025-09-05T19:15:15.948211] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:15.948627] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:15.948559] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:15.956735] [INFO ] [MAIN ] OCFT: Loaded 6110 primary data records. [2025-09-05T19:15:16.094786] [INFO ] [MAIN ] ODV: Loaded 19324 primary data records. [2025-09-05T19:15:16.367486] [INFO ] [MAIN ] OC: Loaded 33315 primary data records. [2025-09-05T19:15:16.834159] [INFO ] [MAIN ] OCFT: Generated 1352 derivative records from 6110 primary records. [2025-09-05T19:15:16.856533] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-05T19:15:16.869299] [INFO ] [MAIN ] Derivative Progress: 1336/2117 symbols completed. OCFT took 0.9s. Estimated remaining: 3m 51s. Rate: 203.0 symbols/min [2025-09-05T19:15:16.870352] [INFO ] [MAIN ] ODV: Generated 1352 derivative records from 19324 primary records. [2025-09-05T19:15:16.870703] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:16.895724] [INFO ] [MAIN ] OC: Generated 1352 derivative records from 33315 primary records. [2025-09-05T19:15:16.897429] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-05T19:15:16.904197] [INFO ] [MAIN ] Derivative Progress: 1337/2117 symbols completed. ODV took 1.0s. Estimated remaining: 3m 50s. Rate: 203.1 symbols/min [2025-09-05T19:15:16.910316] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:16.925900] [INFO ] [MAIN ] OEC: Loaded 17651 primary data records. [2025-09-05T19:15:16.926715] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-05T19:15:16.929167] [INFO ] [MAIN ] Derivative Progress: 1338/2117 symbols completed. OC took 1.0s. Estimated remaining: 3m 50s. Rate: 203.2 symbols/min [2025-09-05T19:15:16.974222] [INFO ] [MAIN ] OFG: Loaded 9634 primary data records. [2025-09-05T19:15:16.974300] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:17.444275] [INFO ] [MAIN ] OGE: Loaded 22459 primary data records. [2025-09-05T19:15:17.698906] [INFO ] [MAIN ] OEC: Generated 871 derivative records from 17651 primary records. [2025-09-05T19:15:17.720111] [INFO ] [MAIN ] OFG: Generated 871 derivative records from 9634 primary records. [2025-09-05T19:15:17.721713] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-05T19:15:17.723977] [INFO ] [MAIN ] Derivative Progress: 1339/2117 symbols completed. OEC took 0.9s. Estimated remaining: 3m 50s. Rate: 203.0 symbols/min [2025-09-05T19:15:17.724426] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:17.733119] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-05T19:15:17.734922] [INFO ] [MAIN ] Derivative Progress: 1340/2117 symbols completed. OFG took 0.8s. Estimated remaining: 3m 50s. Rate: 203.1 symbols/min [2025-09-05T19:15:17.735299] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:17.746887] [INFO ] [MAIN ] OGE: Generated 871 derivative records from 22459 primary records. [2025-09-05T19:15:17.761325] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-05T19:15:17.776426] [INFO ] [MAIN ] Derivative Progress: 1341/2117 symbols completed. OGE took 0.8s. Estimated remaining: 3m 49s. Rate: 203.3 symbols/min [2025-09-05T19:15:17.776833] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:17.777565] [INFO ] [MAIN ] OGS: Loaded 16638 primary data records. [2025-09-05T19:15:17.894546] [INFO ] [MAIN ] OGN: Loaded 25681 primary data records. [2025-09-05T19:15:18.138598] [INFO ] [MAIN ] OHI: Loaded 25265 primary data records. [2025-09-05T19:15:18.525472] [INFO ] [MAIN ] OGS: Generated 871 derivative records from 16638 primary records. [2025-09-05T19:15:18.536061] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-05T19:15:18.538045] [INFO ] [MAIN ] Derivative Progress: 1342/2117 symbols completed. OGS took 0.8s. Estimated remaining: 3m 49s. Rate: 203.0 symbols/min [2025-09-05T19:15:18.538231] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:18.548628] [INFO ] [MAIN ] OGN: Generated 871 derivative records from 25681 primary records. [2025-09-05T19:15:18.568142] [INFO ] [MAIN ] OHI: Generated 871 derivative records from 25265 primary records. [2025-09-05T19:15:18.568537] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-05T19:15:18.570723] [INFO ] [MAIN ] Derivative Progress: 1343/2117 symbols completed. OGN took 0.8s. Estimated remaining: 3m 49s. Rate: 203.2 symbols/min [2025-09-05T19:15:18.570922] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:18.579038] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-05T19:15:18.580882] [INFO ] [MAIN ] Derivative Progress: 1344/2117 symbols completed. OHI took 0.8s. Estimated remaining: 3m 48s. Rate: 203.3 symbols/min [2025-09-05T19:15:18.581533] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:18.598952] [INFO ] [MAIN ] OIA: Loaded 7012 primary data records. [2025-09-05T19:15:18.745409] [INFO ] [MAIN ] OII: Loaded 20750 primary data records. [2025-09-05T19:15:18.734762] [INFO ] [MAIN ] OI: Loaded 35612 primary data records. [2025-09-05T19:15:19.366329] [INFO ] [MAIN ] OIA: Generated 871 derivative records from 7012 primary records. [2025-09-05T19:15:19.378193] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-05T19:15:19.379574] [INFO ] [MAIN ] Derivative Progress: 1345/2117 symbols completed. OIA took 0.8s. Estimated remaining: 3m 48s. Rate: 203.0 symbols/min [2025-09-05T19:15:19.386308] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:19.387478] [INFO ] [MAIN ] OII: Generated 871 derivative records from 20750 primary records. [2025-09-05T19:15:19.397574] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-05T19:15:19.399359] [INFO ] [MAIN ] Derivative Progress: 1346/2117 symbols completed. OII took 0.8s. Estimated remaining: 3m 48s. Rate: 203.2 symbols/min [2025-09-05T19:15:19.399748] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:19.410377] [INFO ] [MAIN ] OI: Generated 1352 derivative records from 35612 primary records. [2025-09-05T19:15:19.436008] [INFO ] [MAIN ] OIS: Loaded 19629 primary data records. [2025-09-05T19:15:19.436898] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-05T19:15:19.488846] [INFO ] [MAIN ] Derivative Progress: 1347/2117 symbols completed. OI took 1.0s. Estimated remaining: 3m 47s. Rate: 203.3 symbols/min [2025-09-05T19:15:19.521591] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:19.600133] [INFO ] [MAIN ] OKE: Loaded 25996 primary data records. [2025-09-05T19:15:19.984054] [INFO ] [MAIN ] OKLO: Loaded 26190 primary data records. [2025-09-05T19:15:20.238010] [INFO ] [MAIN ] OIS: Generated 871 derivative records from 19629 primary records. [2025-09-05T19:15:20.256816] [INFO ] [MAIN ] OKE: Generated 871 derivative records from 25996 primary records. [2025-09-05T19:15:20.249595] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-05T19:15:20.258606] [INFO ] [MAIN ] Derivative Progress: 1348/2117 symbols completed. OIS took 0.9s. Estimated remaining: 3m 47s. Rate: 203.1 symbols/min [2025-09-05T19:15:20.267676] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-05T19:15:20.269608] [INFO ] [MAIN ] Derivative Progress: 1349/2117 symbols completed. OKE took 0.9s. Estimated remaining: 3m 47s. Rate: 203.2 symbols/min [2025-09-05T19:15:20.276617] [INFO ] [MAIN ] OKLO: Generated 871 derivative records from 26190 primary records. [2025-09-05T19:15:20.284586] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-05T19:15:20.287020] [INFO ] [MAIN ] Derivative Progress: 1350/2117 symbols completed. OKLO took 0.8s. Estimated remaining: 3m 46s. Rate: 203.3 symbols/min [2025-09-05T19:15:20.287563] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:20.287535] [INFO ] [MAIN ] OLO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:20.287402] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:20.296394] [INFO ] [MAIN ] OLP: Loaded 4812 primary data records. [2025-09-05T19:15:20.579388] [INFO ] [MAIN ] OLO: Loaded 36271 primary data records. [2025-09-05T19:15:20.580243] [INFO ] [MAIN ] OLN: Loaded 38994 primary data records. [2025-09-05T19:15:21.143928] [INFO ] [MAIN ] OLP: Generated 871 derivative records from 4812 primary records. [2025-09-05T19:15:21.155174] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-05T19:15:21.156988] [INFO ] [MAIN ] Derivative Progress: 1351/2117 symbols completed. OLP took 0.9s. Estimated remaining: 3m 46s. Rate: 203.0 symbols/min [2025-09-05T19:15:21.157482] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:21.172479] [INFO ] [MAIN ] OLO: Generated 1352 derivative records from 36271 primary records. [2025-09-05T19:15:21.185198] [INFO ] [MAIN ] OLO: Successfully saved derivative data. [2025-09-05T19:15:21.187147] [INFO ] [MAIN ] Derivative Progress: 1352/2117 symbols completed. OLO took 0.9s. Estimated remaining: 3m 46s. Rate: 203.2 symbols/min [2025-09-05T19:15:21.187534] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:21.211615] [INFO ] [MAIN ] OLN: Generated 1352 derivative records from 38994 primary records. [2025-09-05T19:15:21.246097] [INFO ] [MAIN ] OMF: Loaded 21775 primary data records. [2025-09-05T19:15:21.259048] [INFO ] [MAIN ] OMC: Loaded 25915 primary data records. [2025-09-05T19:15:21.284522] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-05T19:15:21.304576] [INFO ] [MAIN ] Derivative Progress: 1353/2117 symbols completed. OLN took 1.0s. Estimated remaining: 3m 46s. Rate: 203.3 symbols/min [2025-09-05T19:15:21.365048] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:21.760581] [INFO ] [MAIN ] OMI: Loaded 34194 primary data records. [2025-09-05T19:15:21.898236] [INFO ] [MAIN ] OMF: Generated 871 derivative records from 21775 primary records. [2025-09-05T19:15:21.967991] [INFO ] [MAIN ] OMC: Generated 871 derivative records from 25915 primary records. [2025-09-05T19:15:22.075795] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-05T19:15:22.076996] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-05T19:15:22.078659] [INFO ] [MAIN ] Derivative Progress: 1354/2117 symbols completed. OMF took 0.9s. Estimated remaining: 3m 45s. Rate: 203.0 symbols/min [2025-09-05T19:15:22.080600] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:22.080932] [INFO ] [MAIN ] Derivative Progress: 1355/2117 symbols completed. OMC took 0.9s. Estimated remaining: 3m 45s. Rate: 203.2 symbols/min [2025-09-05T19:15:22.081754] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:22.088136] [INFO ] [MAIN ] ONIT: Loaded 3871 primary data records. [2025-09-05T19:15:22.206279] [INFO ] [MAIN ] ONL: Loaded 14122 primary data records. [2025-09-05T19:15:22.468867] [INFO ] [MAIN ] OMI: Generated 1352 derivative records from 34194 primary records. [2025-09-05T19:15:22.638048] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-05T19:15:22.640424] [INFO ] [MAIN ] Derivative Progress: 1356/2117 symbols completed. OMI took 1.3s. Estimated remaining: 3m 45s. Rate: 203.0 symbols/min [2025-09-05T19:15:22.640959] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:22.654612] [INFO ] [MAIN ] ONIT: Generated 871 derivative records from 3871 primary records. [2025-09-05T19:15:22.667577] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-05T19:15:22.670065] [INFO ] [MAIN ] Derivative Progress: 1357/2117 symbols completed. ONIT took 0.6s. Estimated remaining: 3m 44s. Rate: 203.2 symbols/min [2025-09-05T19:15:22.680492] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:22.688057] [INFO ] [MAIN ] ONL: Generated 871 derivative records from 14122 primary records. [2025-09-05T19:15:22.697360] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-05T19:15:22.699095] [INFO ] [MAIN ] Derivative Progress: 1358/2117 symbols completed. ONL took 0.6s. Estimated remaining: 3m 44s. Rate: 203.3 symbols/min [2025-09-05T19:15:22.714667] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:22.716037] [INFO ] [MAIN ] ONON: Loaded 40361 primary data records. [2025-09-05T19:15:22.823408] [INFO ] [MAIN ] ONTF: Loaded 17107 primary data records. [2025-09-05T19:15:23.060878] [INFO ] [MAIN ] ONTO: Loaded 22667 primary data records. [2025-09-05T19:15:23.514546] [INFO ] [MAIN ] ONON: Generated 1352 derivative records from 40361 primary records. [2025-09-05T19:15:23.537343] [INFO ] [MAIN ] ONTF: Generated 1352 derivative records from 17107 primary records. [2025-09-05T19:15:23.539526] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-05T19:15:23.542277] [INFO ] [MAIN ] Derivative Progress: 1359/2117 symbols completed. ONON took 0.9s. Estimated remaining: 3m 44s. Rate: 203.0 symbols/min [2025-09-05T19:15:23.549862] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:23.564532] [INFO ] [MAIN ] ONTO: Generated 871 derivative records from 22667 primary records. [2025-09-05T19:15:23.565584] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-05T19:15:23.568737] [INFO ] [MAIN ] Derivative Progress: 1360/2117 symbols completed. ONTF took 0.9s. Estimated remaining: 3m 44s. Rate: 203.2 symbols/min [2025-09-05T19:15:23.572145] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:23.580109] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-05T19:15:23.581754] [INFO ] [MAIN ] Derivative Progress: 1361/2117 symbols completed. ONTO took 0.9s. Estimated remaining: 3m 43s. Rate: 203.3 symbols/min [2025-09-05T19:15:23.582044] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:23.587006] [INFO ] [MAIN ] OOMA: Loaded 9619 primary data records. [2025-09-05T19:15:23.701475] [INFO ] [MAIN ] OPAD: Loaded 12774 primary data records. [2025-09-05T19:15:23.973337] [INFO ] [MAIN ] OPFI: Loaded 34910 primary data records. [2025-09-05T19:15:24.375825] [INFO ] [MAIN ] OOMA: Generated 871 derivative records from 9619 primary records. [2025-09-05T19:15:24.394698] [INFO ] [MAIN ] OPAD: Generated 871 derivative records from 12774 primary records. [2025-09-05T19:15:24.395280] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-05T19:15:24.397766] [INFO ] [MAIN ] Derivative Progress: 1362/2117 symbols completed. OOMA took 0.8s. Estimated remaining: 3m 43s. Rate: 203.1 symbols/min [2025-09-05T19:15:24.403338] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:24.405544] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-05T19:15:24.407636] [INFO ] [MAIN ] Derivative Progress: 1363/2117 symbols completed. OPAD took 0.8s. Estimated remaining: 3m 43s. Rate: 203.2 symbols/min [2025-09-05T19:15:24.424008] [INFO ] [MAIN ] OPFI: Generated 1351 derivative records from 34910 primary records. [2025-09-05T19:15:24.448107] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-05T19:15:24.453631] [INFO ] [MAIN ] OR: Loaded 22027 primary data records. [2025-09-05T19:15:24.452573] [INFO ] [MAIN ] Derivative Progress: 1364/2117 symbols completed. OPFI took 0.9s. Estimated remaining: 3m 42s. Rate: 203.3 symbols/min [2025-09-05T19:15:24.708328] [INFO ] [MAIN ] OR: Generated 871 derivative records from 22027 primary records. [2025-09-05T19:15:24.716532] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-05T19:15:24.717816] [INFO ] [MAIN ] Derivative Progress: 1365/2117 symbols completed. OR took 0.3s. Estimated remaining: 3m 42s. Rate: 203.3 symbols/min [2025-09-05T19:15:24.718625] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:24.718503] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:24.718790] [INFO ] [MAIN ] ORCL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:24.753834] [INFO ] [MAIN ] ORA: Loaded 16237 primary data records. [2025-09-05T19:15:24.878001] [INFO ] [MAIN ] ORCL: Loaded 26186 primary data records. [2025-09-05T19:15:24.878638] [INFO ] [MAIN ] ORC: Loaded 25445 primary data records. [2025-09-05T19:15:25.583250] [INFO ] [MAIN ] ORA: Generated 871 derivative records from 16237 primary records. [2025-09-05T19:15:25.597708] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-05T19:15:25.599625] [INFO ] [MAIN ] Derivative Progress: 1366/2117 symbols completed. ORA took 0.9s. Estimated remaining: 3m 42s. Rate: 203.0 symbols/min [2025-09-05T19:15:25.606661] [INFO ] [MAIN ] ORI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:25.607974] [INFO ] [MAIN ] ORC: Generated 871 derivative records from 25445 primary records. [2025-09-05T19:15:25.626569] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-05T19:15:25.627632] [INFO ] [MAIN ] ORCL: Generated 871 derivative records from 26186 primary records. [2025-09-05T19:15:25.629326] [INFO ] [MAIN ] Derivative Progress: 1367/2117 symbols completed. ORC took 0.9s. Estimated remaining: 3m 41s. Rate: 203.2 symbols/min [2025-09-05T19:15:25.629976] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:25.645938] [INFO ] [MAIN ] ORCL: Successfully saved derivative data. [2025-09-05T19:15:25.647609] [INFO ] [MAIN ] Derivative Progress: 1368/2117 symbols completed. ORCL took 0.9s. Estimated remaining: 3m 41s. Rate: 203.3 symbols/min [2025-09-05T19:15:25.652073] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:25.660379] [INFO ] [MAIN ] ORI: Loaded 23656 primary data records. [2025-09-05T19:15:25.730614] [INFO ] [MAIN ] ORN: Loaded 14834 primary data records. [2025-09-05T19:15:26.181845] [INFO ] [MAIN ] OSCR: Loaded 40509 primary data records. [2025-09-05T19:15:26.466022] [INFO ] [MAIN ] ORI: Generated 871 derivative records from 23656 primary records. [2025-09-05T19:15:26.475909] [INFO ] [MAIN ] ORI: Successfully saved derivative data. [2025-09-05T19:15:26.477225] [INFO ] [MAIN ] Derivative Progress: 1369/2117 symbols completed. ORI took 0.9s. Estimated remaining: 3m 41s. Rate: 203.0 symbols/min [2025-09-05T19:15:26.477488] [INFO ] [MAIN ] OSK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:26.488428] [INFO ] [MAIN ] ORN: Generated 871 derivative records from 14834 primary records. [2025-09-05T19:15:26.498003] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-05T19:15:26.499601] [INFO ] [MAIN ] Derivative Progress: 1370/2117 symbols completed. ORN took 0.9s. Estimated remaining: 3m 41s. Rate: 203.2 symbols/min [2025-09-05T19:15:26.499922] [INFO ] [MAIN ] OTF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:26.514345] [INFO ] [MAIN ] OSCR: Generated 1352 derivative records from 40509 primary records. [2025-09-05T19:15:26.538007] [INFO ] [MAIN ] OTF: Loaded 5131 primary data records. [2025-09-05T19:15:26.546117] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-05T19:15:26.583787] [INFO ] [MAIN ] Derivative Progress: 1371/2117 symbols completed. OSCR took 0.9s. Estimated remaining: 3m 40s. Rate: 203.3 symbols/min [2025-09-05T19:15:26.610824] [INFO ] [MAIN ] OSK: Loaded 31759 primary data records. [2025-09-05T19:15:26.637007] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:27.095050] [INFO ] [MAIN ] OTIS: Loaded 25571 primary data records. [2025-09-05T19:15:27.353858] [INFO ] [MAIN ] OTF: Generated 766 derivative records from 5131 primary records. [2025-09-05T19:15:27.363435] [INFO ] [MAIN ] OTF: Successfully saved derivative data. [2025-09-05T19:15:27.367472] [INFO ] [MAIN ] Derivative Progress: 1372/2117 symbols completed. OTF took 0.9s. Estimated remaining: 3m 40s. Rate: 203.0 symbols/min [2025-09-05T19:15:27.368144] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:27.380994] [INFO ] [MAIN ] OSK: Generated 1352 derivative records from 31759 primary records. [2025-09-05T19:15:27.396856] [INFO ] [MAIN ] OSK: Successfully saved derivative data. [2025-09-05T19:15:27.401716] [INFO ] [MAIN ] Derivative Progress: 1373/2117 symbols completed. OSK took 0.9s. Estimated remaining: 3m 40s. Rate: 203.2 symbols/min [2025-09-05T19:15:27.402538] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:27.416533] [INFO ] [MAIN ] OTIS: Generated 871 derivative records from 25571 primary records. [2025-09-05T19:15:27.425727] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-05T19:15:27.427269] [INFO ] [MAIN ] Derivative Progress: 1374/2117 symbols completed. OTIS took 0.8s. Estimated remaining: 3m 39s. Rate: 203.3 symbols/min [2025-09-05T19:15:27.427473] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:27.439209] [INFO ] [MAIN ] OUT: Loaded 23362 primary data records. [2025-09-05T19:15:27.679068] [INFO ] [MAIN ] OVV: Loaded 40281 primary data records. [2025-09-05T19:15:27.685509] [INFO ] [MAIN ] OWL: Loaded 40305 primary data records. [2025-09-05T19:15:28.337391] [INFO ] [MAIN ] OUT: Generated 871 derivative records from 23362 primary records. [2025-09-05T19:15:28.347902] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-05T19:15:28.349096] [INFO ] [MAIN ] Derivative Progress: 1375/2117 symbols completed. OUT took 1.0s. Estimated remaining: 3m 39s. Rate: 203.0 symbols/min [2025-09-05T19:15:28.350511] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:28.360360] [INFO ] [MAIN ] OWLT: Loaded 6806 primary data records. [2025-09-05T19:15:28.452131] [INFO ] [MAIN ] OWL: Generated 1352 derivative records from 40305 primary records. [2025-09-05T19:15:28.460143] [INFO ] [MAIN ] OVV: Generated 1352 derivative records from 40281 primary records. [2025-09-05T19:15:28.579584] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-05T19:15:28.584462] [INFO ] [MAIN ] Derivative Progress: 1376/2117 symbols completed. OVV took 1.2s. Estimated remaining: 3m 39s. Rate: 203.0 symbols/min [2025-09-05T19:15:28.588385] [INFO ] [MAIN ] OXY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:28.676904] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-05T19:15:28.679590] [INFO ] [MAIN ] Derivative Progress: 1377/2117 symbols completed. OWL took 1.3s. Estimated remaining: 3m 39s. Rate: 203.1 symbols/min [2025-09-05T19:15:28.680610] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:28.722078] [INFO ] [MAIN ] OWLT: Generated 1352 derivative records from 6806 primary records. [2025-09-05T19:15:28.724411] [INFO ] [MAIN ] OXY: Loaded 26167 primary data records. [2025-09-05T19:15:28.843948] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-05T19:15:28.844736] [INFO ] [MAIN ] PAAS: Loaded 26022 primary data records. [2025-09-05T19:15:28.852065] [INFO ] [MAIN ] Derivative Progress: 1378/2117 symbols completed. OWLT took 0.5s. Estimated remaining: 3m 38s. Rate: 203.2 symbols/min [2025-09-05T19:15:29.218794] [INFO ] [MAIN ] OXY: Generated 871 derivative records from 26167 primary records. [2025-09-05T19:15:29.234588] [INFO ] [MAIN ] OXY: Successfully saved derivative data. [2025-09-05T19:15:29.235283] [INFO ] [MAIN ] PAAS: Generated 871 derivative records from 26022 primary records. [2025-09-05T19:15:29.236430] [INFO ] [MAIN ] Derivative Progress: 1379/2117 symbols completed. OXY took 0.6s. Estimated remaining: 3m 38s. Rate: 203.1 symbols/min [2025-09-05T19:15:29.244441] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-05T19:15:29.245835] [INFO ] [MAIN ] Derivative Progress: 1380/2117 symbols completed. PAAS took 0.6s. Estimated remaining: 3m 38s. Rate: 203.3 symbols/min [2025-09-05T19:15:29.246306] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:29.246409] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:29.246260] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:29.254475] [INFO ] [MAIN ] PAC: Loaded 5654 primary data records. [2025-09-05T19:15:29.387509] [INFO ] [MAIN ] PACS: Loaded 16177 primary data records. [2025-09-05T19:15:29.454423] [INFO ] [MAIN ] PACK: Loaded 23494 primary data records. [2025-09-05T19:15:30.112718] [INFO ] [MAIN ] PAC: Generated 871 derivative records from 5654 primary records. [2025-09-05T19:15:30.131164] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-05T19:15:30.132459] [INFO ] [MAIN ] Derivative Progress: 1381/2117 symbols completed. PAC took 0.9s. Estimated remaining: 3m 38s. Rate: 203.0 symbols/min [2025-09-05T19:15:30.134608] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:30.134439] [INFO ] [MAIN ] PACS: Generated 871 derivative records from 16177 primary records. [2025-09-05T19:15:30.156373] [INFO ] [MAIN ] PACK: Generated 1352 derivative records from 23494 primary records. [2025-09-05T19:15:30.159589] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-05T19:15:30.161598] [INFO ] [MAIN ] Derivative Progress: 1382/2117 symbols completed. PACS took 0.9s. Estimated remaining: 3m 37s. Rate: 203.1 symbols/min [2025-09-05T19:15:30.162062] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:30.175881] [INFO ] [MAIN ] PAG: Loaded 10407 primary data records. [2025-09-05T19:15:30.215695] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-05T19:15:30.245708] [INFO ] [MAIN ] Derivative Progress: 1383/2117 symbols completed. PACK took 1.0s. Estimated remaining: 3m 37s. Rate: 203.2 symbols/min [2025-09-05T19:15:30.262919] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:30.355435] [INFO ] [MAIN ] PAI: Loaded 1287 primary data records. [2025-09-05T19:15:30.571031] [INFO ] [MAIN ] PAGS: Loaded 39722 primary data records. [2025-09-05T19:15:30.913479] [INFO ] [MAIN ] PAG: Generated 871 derivative records from 10407 primary records. [2025-09-05T19:15:31.022048] [INFO ] [MAIN ] PAI: Generated 871 derivative records from 1287 primary records. [2025-09-05T19:15:31.032825] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-05T19:15:31.035608] [INFO ] [MAIN ] Derivative Progress: 1384/2117 symbols completed. PAI took 0.8s. Estimated remaining: 3m 37s. Rate: 203.0 symbols/min [2025-09-05T19:15:31.036380] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:31.036212] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-05T19:15:31.038379] [INFO ] [MAIN ] Derivative Progress: 1385/2117 symbols completed. PAG took 0.9s. Estimated remaining: 3m 36s. Rate: 203.1 symbols/min [2025-09-05T19:15:31.039632] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:31.071324] [INFO ] [MAIN ] PAGS: Generated 1352 derivative records from 39722 primary records. [2025-09-05T19:15:31.071759] [INFO ] [MAIN ] PAM: Loaded 13094 primary data records. [2025-09-05T19:15:31.153316] [INFO ] [MAIN ] PAR: Loaded 15611 primary data records. [2025-09-05T19:15:31.293522] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-05T19:15:31.333038] [INFO ] [MAIN ] Derivative Progress: 1386/2117 symbols completed. PAGS took 1.2s. Estimated remaining: 3m 36s. Rate: 203.1 symbols/min [2025-09-05T19:15:31.409139] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:31.624713] [INFO ] [MAIN ] PAM: Generated 871 derivative records from 13094 primary records. [2025-09-05T19:15:31.647494] [INFO ] [MAIN ] PARR: Loaded 36333 primary data records. [2025-09-05T19:15:31.651257] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-05T19:15:31.696083] [INFO ] [MAIN ] Derivative Progress: 1387/2117 symbols completed. PAM took 0.7s. Estimated remaining: 3m 36s. Rate: 203.1 symbols/min [2025-09-05T19:15:31.704435] [INFO ] [MAIN ] PAR: Generated 871 derivative records from 15611 primary records. [2025-09-05T19:15:31.731842] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:31.835295] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-05T19:15:31.871509] [INFO ] [MAIN ] Derivative Progress: 1388/2117 symbols completed. PAR took 0.8s. Estimated remaining: 3m 35s. Rate: 203.2 symbols/min [2025-09-05T19:15:31.876561] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:31.987440] [INFO ] [MAIN ] PATH: Loaded 26072 primary data records. [2025-09-05T19:15:32.029312] [INFO ] [MAIN ] PAXS: Loaded 10528 primary data records. [2025-09-05T19:15:32.494532] [INFO ] [MAIN ] PARR: Generated 1352 derivative records from 36333 primary records. [2025-09-05T19:15:32.512063] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-05T19:15:32.514293] [INFO ] [MAIN ] Derivative Progress: 1389/2117 symbols completed. PARR took 1.1s. Estimated remaining: 3m 35s. Rate: 203.0 symbols/min [2025-09-05T19:15:32.514896] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:32.532634] [INFO ] [MAIN ] PAXS: Generated 871 derivative records from 10528 primary records. [2025-09-05T19:15:32.533403] [INFO ] [MAIN ] PATH: Generated 871 derivative records from 26072 primary records. [2025-09-05T19:15:32.555204] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-05T19:15:32.557564] [INFO ] [MAIN ] Derivative Progress: 1390/2117 symbols completed. PATH took 0.8s. Estimated remaining: 3m 35s. Rate: 203.1 symbols/min [2025-09-05T19:15:32.558390] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:32.558186] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-05T19:15:32.560269] [INFO ] [MAIN ] Derivative Progress: 1391/2117 symbols completed. PAXS took 0.7s. Estimated remaining: 3m 34s. Rate: 203.3 symbols/min [2025-09-05T19:15:32.560892] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:32.569081] [INFO ] [MAIN ] PAY: Loaded 19002 primary data records. [2025-09-05T19:15:32.754976] [INFO ] [MAIN ] PB: Loaded 20628 primary data records. [2025-09-05T19:15:32.779933] [INFO ] [MAIN ] PAYC: Loaded 26794 primary data records. [2025-09-05T19:15:33.664141] [INFO ] [MAIN ] PAY: Generated 871 derivative records from 19002 primary records. [2025-09-05T19:15:33.679329] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-05T19:15:33.682196] [INFO ] [MAIN ] Derivative Progress: 1392/2117 symbols completed. PAY took 1.2s. Estimated remaining: 3m 34s. Rate: 202.8 symbols/min [2025-09-05T19:15:33.685409] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:33.705250] [INFO ] [MAIN ] PB: Generated 871 derivative records from 20628 primary records. [2025-09-05T19:15:33.730045] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-05T19:15:33.732815] [INFO ] [MAIN ] Derivative Progress: 1393/2117 symbols completed. PB took 1.2s. Estimated remaining: 3m 34s. Rate: 203.0 symbols/min [2025-09-05T19:15:33.754226] [INFO ] [MAIN ] PBA: Loaded 24014 primary data records. [2025-09-05T19:15:33.790191] [INFO ] [MAIN ] PAYC: Generated 1351 derivative records from 26794 primary records. [2025-09-05T19:15:33.962316] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-05T19:15:33.972403] [INFO ] [MAIN ] Derivative Progress: 1394/2117 symbols completed. PAYC took 1.4s. Estimated remaining: 3m 34s. Rate: 203.0 symbols/min [2025-09-05T19:15:34.144946] [INFO ] [MAIN ] PBA: Generated 871 derivative records from 24014 primary records. [2025-09-05T19:15:34.154387] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-05T19:15:34.155759] [INFO ] [MAIN ] Derivative Progress: 1395/2117 symbols completed. PBA took 0.5s. Estimated remaining: 3m 33s. Rate: 203.0 symbols/min [2025-09-05T19:15:34.156590] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:34.156749] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:34.156962] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:34.213877] [INFO ] [MAIN ] PBI: Loaded 24285 primary data records. [2025-09-05T19:15:34.331849] [INFO ] [MAIN ] PBR: Loaded 26094 primary data records. [2025-09-05T19:15:34.379218] [INFO ] [MAIN ] PBF: Loaded 40011 primary data records. [2025-09-05T19:15:35.083300] [INFO ] [MAIN ] PBI: Generated 871 derivative records from 24285 primary records. [2025-09-05T19:15:35.101584] [INFO ] [MAIN ] PBR: Generated 871 derivative records from 26094 primary records. [2025-09-05T19:15:35.103374] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-05T19:15:35.104420] [INFO ] [MAIN ] Derivative Progress: 1396/2117 symbols completed. PBI took 0.9s. Estimated remaining: 3m 33s. Rate: 202.7 symbols/min [2025-09-05T19:15:35.106519] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:35.125037] [INFO ] [MAIN ] PBF: Generated 1352 derivative records from 40011 primary records. [2025-09-05T19:15:35.126231] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-05T19:15:35.127830] [INFO ] [MAIN ] Derivative Progress: 1397/2117 symbols completed. PBR took 1.0s. Estimated remaining: 3m 33s. Rate: 202.9 symbols/min [2025-09-05T19:15:35.134318] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:35.144021] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-05T19:15:35.147421] [INFO ] [MAIN ] Derivative Progress: 1398/2117 symbols completed. PBF took 1.0s. Estimated remaining: 3m 33s. Rate: 203.0 symbols/min [2025-09-05T19:15:35.148708] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:35.156529] [INFO ] [MAIN ] PCF: Loaded 4272 primary data records. [2025-09-05T19:15:35.177972] [INFO ] [MAIN ] PBT: Loaded 9557 primary data records. [2025-09-05T19:15:35.552459] [INFO ] [MAIN ] PCG: Loaded 40459 primary data records. [2025-09-05T19:15:35.995560] [INFO ] [MAIN ] PCF: Generated 871 derivative records from 4272 primary records. [2025-09-05T19:15:36.012692] [INFO ] [MAIN ] PBT: Generated 871 derivative records from 9557 primary records. [2025-09-05T19:15:36.013559] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-05T19:15:36.015381] [INFO ] [MAIN ] Derivative Progress: 1399/2117 symbols completed. PCF took 0.9s. Estimated remaining: 3m 33s. Rate: 202.7 symbols/min [2025-09-05T19:15:36.015917] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:36.027720] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-05T19:15:36.029371] [INFO ] [MAIN ] Derivative Progress: 1400/2117 symbols completed. PBT took 0.9s. Estimated remaining: 3m 32s. Rate: 202.9 symbols/min [2025-09-05T19:15:36.027632] [INFO ] [MAIN ] PCM: Loaded 3164 primary data records. [2025-09-05T19:15:36.029730] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:36.221706] [INFO ] [MAIN ] PCG: Generated 1352 derivative records from 40459 primary records. [2025-09-05T19:15:36.198714] [INFO ] [MAIN ] PCN: Loaded 11890 primary data records. [2025-09-05T19:15:36.400889] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-09-05T19:15:36.403733] [INFO ] [MAIN ] Derivative Progress: 1401/2117 symbols completed. PCG took 1.3s. Estimated remaining: 3m 32s. Rate: 202.8 symbols/min [2025-09-05T19:15:36.403966] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:36.553414] [INFO ] [MAIN ] PCM: Generated 871 derivative records from 3164 primary records. [2025-09-05T19:15:36.569202] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-05T19:15:36.571155] [INFO ] [MAIN ] PCOR: Loaded 23260 primary data records. [2025-09-05T19:15:36.570449] [INFO ] [MAIN ] Derivative Progress: 1402/2117 symbols completed. PCM took 0.6s. Estimated remaining: 3m 31s. Rate: 202.9 symbols/min [2025-09-05T19:15:36.582544] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:36.686281] [INFO ] [MAIN ] PCN: Generated 871 derivative records from 11890 primary records. [2025-09-05T19:15:36.700442] [INFO ] [MAIN ] PCQ: Loaded 5562 primary data records. [2025-09-05T19:15:36.844204] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-05T19:15:36.925955] [INFO ] [MAIN ] Derivative Progress: 1403/2117 symbols completed. PCN took 0.9s. Estimated remaining: 3m 31s. Rate: 202.8 symbols/min [2025-09-05T19:15:36.938834] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:37.104421] [INFO ] [MAIN ] PCOR: Generated 871 derivative records from 23260 primary records. [2025-09-05T19:15:37.105971] [INFO ] [MAIN ] PD: Loaded 23561 primary data records. [2025-09-05T19:15:37.202938] [INFO ] [MAIN ] PCQ: Generated 871 derivative records from 5562 primary records. [2025-09-05T19:15:37.220014] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-05T19:15:37.235280] [INFO ] [MAIN ] Derivative Progress: 1404/2117 symbols completed. PCOR took 0.8s. Estimated remaining: 3m 31s. Rate: 202.8 symbols/min [2025-09-05T19:15:37.243919] [INFO ] [MAIN ] PDCC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:37.249173] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-05T19:15:37.261131] [INFO ] [MAIN ] Derivative Progress: 1405/2117 symbols completed. PCQ took 0.7s. Estimated remaining: 3m 30s. Rate: 203.0 symbols/min [2025-09-05T19:15:37.314146] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:37.370581] [INFO ] [MAIN ] PDCC: Loaded 416 primary data records. [2025-09-05T19:15:37.630784] [INFO ] [MAIN ] PDI: Loaded 24142 primary data records. [2025-09-05T19:15:37.762347] [INFO ] [MAIN ] PD: Generated 871 derivative records from 23561 primary records. [2025-09-05T19:15:37.836596] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-05T19:15:37.893090] [INFO ] [MAIN ] Derivative Progress: 1406/2117 symbols completed. PD took 1.0s. Estimated remaining: 3m 30s. Rate: 202.8 symbols/min [2025-09-05T19:15:37.893908] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:37.908843] [INFO ] [MAIN ] PDCC: Generated 859 derivative records from 416 primary records. [2025-09-05T19:15:37.929423] [INFO ] [MAIN ] PDM: Loaded 18441 primary data records. [2025-09-05T19:15:37.930244] [INFO ] [MAIN ] PDCC: Successfully saved derivative data. [2025-09-05T19:15:37.932290] [INFO ] [MAIN ] Derivative Progress: 1407/2117 symbols completed. PDCC took 0.7s. Estimated remaining: 3m 30s. Rate: 202.9 symbols/min [2025-09-05T19:15:37.938828] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:38.020092] [INFO ] [MAIN ] PDI: Generated 871 derivative records from 24142 primary records. [2025-09-05T19:15:38.112050] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-05T19:15:38.141139] [INFO ] [MAIN ] PDO: Loaded 14742 primary data records. [2025-09-05T19:15:38.133000] [INFO ] [MAIN ] Derivative Progress: 1408/2117 symbols completed. PDI took 0.8s. Estimated remaining: 3m 30s. Rate: 203.0 symbols/min [2025-09-05T19:15:38.483676] [INFO ] [MAIN ] PDM: Generated 871 derivative records from 18441 primary records. [2025-09-05T19:15:38.493027] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-05T19:15:38.494153] [INFO ] [MAIN ] Derivative Progress: 1409/2117 symbols completed. PDM took 0.6s. Estimated remaining: 3m 29s. Rate: 202.9 symbols/min [2025-09-05T19:15:38.504611] [INFO ] [MAIN ] PDO: Generated 871 derivative records from 14742 primary records. [2025-09-05T19:15:38.512997] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-05T19:15:38.514558] [INFO ] [MAIN ] Derivative Progress: 1410/2117 symbols completed. PDO took 0.6s. Estimated remaining: 3m 29s. Rate: 203.1 symbols/min [2025-09-05T19:15:38.515189] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:38.515150] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:38.515258] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:38.527849] [INFO ] [MAIN ] PDS: Loaded 7895 primary data records. [2025-09-05T19:15:38.603077] [INFO ] [MAIN ] PDT: Loaded 8836 primary data records. [2025-09-05T19:15:38.677044] [INFO ] [MAIN ] PDX: Loaded 11017 primary data records. [2025-09-05T19:15:39.336611] [INFO ] [MAIN ] PDT: Generated 871 derivative records from 8836 primary records. [2025-09-05T19:15:39.348902] [INFO ] [MAIN ] PDS: Generated 871 derivative records from 7895 primary records. [2025-09-05T19:15:39.354284] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-05T19:15:39.355855] [INFO ] [MAIN ] Derivative Progress: 1411/2117 symbols completed. PDT took 0.8s. Estimated remaining: 3m 29s. Rate: 202.8 symbols/min [2025-09-05T19:15:39.356202] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:39.367154] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-05T19:15:39.368964] [INFO ] [MAIN ] Derivative Progress: 1412/2117 symbols completed. PDS took 0.9s. Estimated remaining: 3m 28s. Rate: 203.0 symbols/min [2025-09-05T19:15:39.369327] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:39.380889] [INFO ] [MAIN ] PDX: Generated 1352 derivative records from 11017 primary records. [2025-09-05T19:15:39.401333] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-05T19:15:39.404022] [INFO ] [MAIN ] Derivative Progress: 1413/2117 symbols completed. PDX took 0.9s. Estimated remaining: 3m 28s. Rate: 203.1 symbols/min [2025-09-05T19:15:39.404359] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:39.420469] [INFO ] [MAIN ] PEB: Loaded 24454 primary data records. [2025-09-05T19:15:39.530710] [INFO ] [MAIN ] PEG: Loaded 25779 primary data records. [2025-09-05T19:15:39.695140] [INFO ] [MAIN ] PEN: Loaded 23161 primary data records. [2025-09-05T19:15:40.273389] [INFO ] [MAIN ] PEB: Generated 871 derivative records from 24454 primary records. [2025-09-05T19:15:40.284222] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-05T19:15:40.286379] [INFO ] [MAIN ] Derivative Progress: 1414/2117 symbols completed. PEB took 0.9s. Estimated remaining: 3m 28s. Rate: 202.8 symbols/min [2025-09-05T19:15:40.287116] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:40.300860] [INFO ] [MAIN ] PEG: Generated 871 derivative records from 25779 primary records. [2025-09-05T19:15:40.314597] [INFO ] [MAIN ] PEO: Loaded 5725 primary data records. [2025-09-05T19:15:40.353286] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-09-05T19:15:40.388537] [INFO ] [MAIN ] Derivative Progress: 1415/2117 symbols completed. PEG took 1.0s. Estimated remaining: 3m 28s. Rate: 202.9 symbols/min [2025-09-05T19:15:40.386421] [INFO ] [MAIN ] PEN: Generated 1352 derivative records from 23161 primary records. [2025-09-05T19:15:40.438478] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:40.531984] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-05T19:15:40.534684] [INFO ] [MAIN ] Derivative Progress: 1416/2117 symbols completed. PEN took 1.1s. Estimated remaining: 3m 27s. Rate: 203.0 symbols/min [2025-09-05T19:15:40.594288] [INFO ] [MAIN ] PEW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:40.601923] [INFO ] [MAIN ] PERF: Loaded 11163 primary data records. [2025-09-05T19:15:40.727779] [INFO ] [MAIN ] PEW: Loaded 12057 primary data records. [2025-09-05T19:15:41.043776] [INFO ] [MAIN ] PEO: Generated 871 derivative records from 5725 primary records. [2025-09-05T19:15:41.148032] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-05T19:15:41.150871] [INFO ] [MAIN ] Derivative Progress: 1417/2117 symbols completed. PEO took 0.9s. Estimated remaining: 3m 27s. Rate: 202.8 symbols/min [2025-09-05T19:15:41.151760] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:41.158398] [INFO ] [MAIN ] PFD: Loaded 2930 primary data records. [2025-09-05T19:15:41.249313] [INFO ] [MAIN ] PEW: Generated 481 derivative records from 12057 primary records. [2025-09-05T19:15:41.289634] [INFO ] [MAIN ] PERF: Generated 1352 derivative records from 11163 primary records. [2025-09-05T19:15:41.330319] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-05T19:15:41.353915] [INFO ] [MAIN ] PEW: Successfully saved derivative data. [2025-09-05T19:15:41.386054] [INFO ] [MAIN ] Derivative Progress: 1418/2117 symbols completed. PERF took 1.0s. Estimated remaining: 3m 27s. Rate: 202.8 symbols/min [2025-09-05T19:15:41.393224] [INFO ] [MAIN ] Derivative Progress: 1419/2117 symbols completed. PEW took 0.8s. Estimated remaining: 3m 26s. Rate: 203.0 symbols/min [2025-09-05T19:15:41.393129] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:41.457759] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:41.487389] [INFO ] [MAIN ] PFD: Generated 871 derivative records from 2930 primary records. [2025-09-05T19:15:41.505701] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-05T19:15:41.507127] [INFO ] [MAIN ] PFGC: Loaded 22836 primary data records. [2025-09-05T19:15:41.508544] [INFO ] [MAIN ] Derivative Progress: 1420/2117 symbols completed. PFD took 0.4s. Estimated remaining: 3m 26s. Rate: 203.1 symbols/min [2025-09-05T19:15:41.519315] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:41.519256] [INFO ] [MAIN ] PFE: Loaded 26185 primary data records. [2025-09-05T19:15:41.627912] [INFO ] [MAIN ] PFH: Loaded 3329 primary data records. [2025-09-05T19:15:42.303265] [INFO ] [MAIN ] PFE: Generated 871 derivative records from 26185 primary records. [2025-09-05T19:15:42.310087] [INFO ] [MAIN ] PFGC: Generated 871 derivative records from 22836 primary records. [2025-09-05T19:15:42.326683] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-09-05T19:15:42.328434] [INFO ] [MAIN ] Derivative Progress: 1421/2117 symbols completed. PFE took 0.9s. Estimated remaining: 3m 26s. Rate: 202.8 symbols/min [2025-09-05T19:15:42.329440] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:42.329830] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-05T19:15:42.331226] [INFO ] [MAIN ] Derivative Progress: 1422/2117 symbols completed. PFGC took 0.9s. Estimated remaining: 3m 25s. Rate: 203.0 symbols/min [2025-09-05T19:15:42.338496] [INFO ] [MAIN ] PFH: Generated 871 derivative records from 3329 primary records. [2025-09-05T19:15:42.338681] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:42.350069] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-05T19:15:42.355791] [INFO ] [MAIN ] Derivative Progress: 1423/2117 symbols completed. PFH took 0.8s. Estimated remaining: 3m 25s. Rate: 203.1 symbols/min [2025-09-05T19:15:42.354113] [INFO ] [MAIN ] PFL: Loaded 10201 primary data records. [2025-09-05T19:15:42.633538] [INFO ] [MAIN ] PFLT: Loaded 32369 primary data records. [2025-09-05T19:15:42.939069] [INFO ] [MAIN ] PFL: Generated 1352 derivative records from 10201 primary records. [2025-09-05T19:15:42.953997] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-05T19:15:42.955986] [INFO ] [MAIN ] Derivative Progress: 1424/2117 symbols completed. PFL took 0.6s. Estimated remaining: 3m 25s. Rate: 202.9 symbols/min [2025-09-05T19:15:42.970358] [INFO ] [MAIN ] PFLT: Generated 1352 derivative records from 32369 primary records. [2025-09-05T19:15:42.982551] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-05T19:15:42.985010] [INFO ] [MAIN ] Derivative Progress: 1425/2117 symbols completed. PFLT took 0.6s. Estimated remaining: 3m 24s. Rate: 203.1 symbols/min [2025-09-05T19:15:42.985479] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:42.985699] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:42.986019] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:42.993493] [INFO ] [MAIN ] PFO: Loaded 4267 primary data records. [2025-09-05T19:15:43.114578] [INFO ] [MAIN ] PFN: Loaded 16083 primary data records. [2025-09-05T19:15:43.270665] [INFO ] [MAIN ] PFS: Loaded 26540 primary data records. [2025-09-05T19:15:43.857989] [INFO ] [MAIN ] PFO: Generated 1352 derivative records from 4267 primary records. [2025-09-05T19:15:43.871520] [INFO ] [MAIN ] PFN: Generated 1352 derivative records from 16083 primary records. [2025-09-05T19:15:43.895225] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-05T19:15:43.907392] [INFO ] [MAIN ] Derivative Progress: 1426/2117 symbols completed. PFO took 0.9s. Estimated remaining: 3m 24s. Rate: 202.8 symbols/min [2025-09-05T19:15:43.908078] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:43.909202] [INFO ] [MAIN ] PFS: Generated 1352 derivative records from 26540 primary records. [2025-09-05T19:15:43.918077] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-05T19:15:43.923254] [INFO ] [MAIN ] Derivative Progress: 1427/2117 symbols completed. PFN took 0.9s. Estimated remaining: 3m 24s. Rate: 202.9 symbols/min [2025-09-05T19:15:43.924467] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:43.927288] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-05T19:15:43.930075] [INFO ] [MAIN ] Derivative Progress: 1428/2117 symbols completed. PFS took 0.9s. Estimated remaining: 3m 24s. Rate: 203.0 symbols/min [2025-09-05T19:15:43.930512] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:43.934938] [INFO ] [MAIN ] PGP: Loaded 2700 primary data records. [2025-09-05T19:15:44.114194] [INFO ] [MAIN ] PFSI: Loaded 21300 primary data records. [2025-09-05T19:15:44.332094] [INFO ] [MAIN ] PG: Loaded 26128 primary data records. [2025-09-05T19:15:44.770152] [INFO ] [MAIN ] PGP: Generated 871 derivative records from 2700 primary records. [2025-09-05T19:15:44.780807] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-05T19:15:44.782592] [INFO ] [MAIN ] Derivative Progress: 1429/2117 symbols completed. PGP took 0.9s. Estimated remaining: 3m 24s. Rate: 202.8 symbols/min [2025-09-05T19:15:44.783335] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:44.810816] [INFO ] [MAIN ] PFSI: Generated 1352 derivative records from 21300 primary records. [2025-09-05T19:15:44.812829] [INFO ] [MAIN ] PG: Generated 871 derivative records from 26128 primary records. [2025-09-05T19:15:44.844997] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-05T19:15:44.849254] [INFO ] [MAIN ] Derivative Progress: 1430/2117 symbols completed. PFSI took 0.9s. Estimated remaining: 3m 23s. Rate: 202.9 symbols/min [2025-09-05T19:15:44.846732] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-09-05T19:15:44.861201] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:44.863340] [INFO ] [MAIN ] Derivative Progress: 1431/2117 symbols completed. PG took 0.9s. Estimated remaining: 3m 23s. Rate: 203.0 symbols/min [2025-09-05T19:15:44.864966] [INFO ] [MAIN ] PGR: Loaded 39870 primary data records. [2025-09-05T19:15:44.865535] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:45.001728] [INFO ] [MAIN ] PGZ: Loaded 2782 primary data records. [2025-09-05T19:15:45.147703] [INFO ] [MAIN ] PGRE: Loaded 22973 primary data records. [2025-09-05T19:15:45.651401] [INFO ] [MAIN ] PGZ: Generated 871 derivative records from 2782 primary records. [2025-09-05T19:15:45.652099] [INFO ] [MAIN ] PGR: Generated 1352 derivative records from 39870 primary records. [2025-09-05T19:15:45.671519] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-05T19:15:45.673553] [INFO ] [MAIN ] Derivative Progress: 1432/2117 symbols completed. PGZ took 0.8s. Estimated remaining: 3m 23s. Rate: 202.8 symbols/min [2025-09-05T19:15:45.681119] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:45.680862] [INFO ] [MAIN ] PGRE: Generated 871 derivative records from 22973 primary records. [2025-09-05T19:15:45.683910] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-09-05T19:15:45.686521] [INFO ] [MAIN ] Derivative Progress: 1433/2117 symbols completed. PGR took 0.9s. Estimated remaining: 3m 22s. Rate: 202.9 symbols/min [2025-09-05T19:15:45.686720] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:45.696921] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-05T19:15:45.698621] [INFO ] [MAIN ] Derivative Progress: 1434/2117 symbols completed. PGRE took 0.8s. Estimated remaining: 3m 22s. Rate: 203.0 symbols/min [2025-09-05T19:15:45.698888] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:45.702476] [INFO ] [MAIN ] PHD: Loaded 4860 primary data records. [2025-09-05T19:15:45.825634] [INFO ] [MAIN ] PH: Loaded 17527 primary data records. [2025-09-05T19:15:46.063930] [INFO ] [MAIN ] PHG: Loaded 22388 primary data records. [2025-09-05T19:15:46.448722] [INFO ] [MAIN ] PHD: Generated 871 derivative records from 4860 primary records. [2025-09-05T19:15:46.459157] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-05T19:15:46.466685] [INFO ] [MAIN ] Derivative Progress: 1435/2117 symbols completed. PHD took 0.8s. Estimated remaining: 3m 22s. Rate: 202.8 symbols/min [2025-09-05T19:15:46.466942] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:46.467723] [INFO ] [MAIN ] PH: Generated 871 derivative records from 17527 primary records. [2025-09-05T19:15:46.478736] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-05T19:15:46.482006] [INFO ] [MAIN ] Derivative Progress: 1436/2117 symbols completed. PH took 0.8s. Estimated remaining: 3m 21s. Rate: 202.9 symbols/min [2025-09-05T19:15:46.482214] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:46.489256] [INFO ] [MAIN ] PHG: Generated 871 derivative records from 22388 primary records. [2025-09-05T19:15:46.501424] [INFO ] [MAIN ] PHI: Loaded 7025 primary data records. [2025-09-05T19:15:46.515481] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-05T19:15:46.528492] [INFO ] [MAIN ] Derivative Progress: 1437/2117 symbols completed. PHG took 0.8s. Estimated remaining: 3m 21s. Rate: 203.1 symbols/min [2025-09-05T19:15:46.540138] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:46.728769] [INFO ] [MAIN ] PHIN: Loaded 24002 primary data records. [2025-09-05T19:15:46.847231] [INFO ] [MAIN ] PHK: Loaded 19629 primary data records. [2025-09-05T19:15:47.391487] [INFO ] [MAIN ] PHI: Generated 871 derivative records from 7025 primary records. [2025-09-05T19:15:47.402101] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-05T19:15:47.404549] [INFO ] [MAIN ] Derivative Progress: 1438/2117 symbols completed. PHI took 0.9s. Estimated remaining: 3m 21s. Rate: 202.8 symbols/min [2025-09-05T19:15:47.430187] [INFO ] [MAIN ] PHIN: Generated 1352 derivative records from 24002 primary records. [2025-09-05T19:15:47.430989] [INFO ] [MAIN ] PHK: Generated 1352 derivative records from 19629 primary records. [2025-09-05T19:15:47.456311] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-05T19:15:47.456973] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-05T19:15:47.459979] [INFO ] [MAIN ] Derivative Progress: 1439/2117 symbols completed. PHK took 0.9s. Estimated remaining: 3m 20s. Rate: 202.9 symbols/min [2025-09-05T19:15:47.462383] [INFO ] [MAIN ] Derivative Progress: 1440/2117 symbols completed. PHIN took 1.0s. Estimated remaining: 3m 20s. Rate: 203.0 symbols/min [2025-09-05T19:15:47.463009] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:47.463114] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:47.463197] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:47.479009] [INFO ] [MAIN ] PHT: Loaded 12240 primary data records. [2025-09-05T19:15:47.693708] [INFO ] [MAIN ] PHR: Loaded 27182 primary data records. [2025-09-05T19:15:47.694807] [INFO ] [MAIN ] PHM: Loaded 25074 primary data records. [2025-09-05T19:15:48.306839] [INFO ] [MAIN ] PHT: Generated 1352 derivative records from 12240 primary records. [2025-09-05T19:15:48.322523] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-05T19:15:48.324754] [INFO ] [MAIN ] Derivative Progress: 1441/2117 symbols completed. PHT took 0.9s. Estimated remaining: 3m 20s. Rate: 202.8 symbols/min [2025-09-05T19:15:48.325243] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:48.340675] [INFO ] [MAIN ] PHR: Generated 1352 derivative records from 27182 primary records. [2025-09-05T19:15:48.349112] [INFO ] [MAIN ] PHM: Generated 871 derivative records from 25074 primary records. [2025-09-05T19:15:48.375225] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-09-05T19:15:48.377978] [INFO ] [MAIN ] Derivative Progress: 1442/2117 symbols completed. PHM took 0.9s. Estimated remaining: 3m 20s. Rate: 202.9 symbols/min [2025-09-05T19:15:48.379511] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-05T19:15:48.378270] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:48.382137] [INFO ] [MAIN ] Derivative Progress: 1443/2117 symbols completed. PHR took 0.9s. Estimated remaining: 3m 19s. Rate: 203.0 symbols/min [2025-09-05T19:15:48.383142] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:48.393609] [INFO ] [MAIN ] PII: Loaded 23417 primary data records. [2025-09-05T19:15:48.468915] [INFO ] [MAIN ] PIM: Loaded 2160 primary data records. [2025-09-05T19:15:48.517193] [INFO ] [MAIN ] PINE: Loaded 11006 primary data records. [2025-09-05T19:15:49.239944] [INFO ] [MAIN ] PII: Generated 871 derivative records from 23417 primary records. [2025-09-05T19:15:49.255586] [INFO ] [MAIN ] PIM: Generated 871 derivative records from 2160 primary records. [2025-09-05T19:15:49.265677] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-05T19:15:49.267707] [INFO ] [MAIN ] Derivative Progress: 1444/2117 symbols completed. PII took 0.9s. Estimated remaining: 3m 19s. Rate: 202.7 symbols/min [2025-09-05T19:15:49.268428] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:49.268804] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-05T19:15:49.276162] [INFO ] [MAIN ] Derivative Progress: 1445/2117 symbols completed. PIM took 0.9s. Estimated remaining: 3m 19s. Rate: 202.9 symbols/min [2025-09-05T19:15:49.281343] [INFO ] [MAIN ] PINE: Generated 1352 derivative records from 11006 primary records. [2025-09-05T19:15:49.281384] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:49.297416] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-05T19:15:49.299993] [INFO ] [MAIN ] Derivative Progress: 1446/2117 symbols completed. PINE took 0.9s. Estimated remaining: 3m 18s. Rate: 203.0 symbols/min [2025-09-05T19:15:49.300226] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:49.304030] [INFO ] [MAIN ] PIPR: Loaded 7179 primary data records. [2025-09-05T19:15:49.432012] [INFO ] [MAIN ] PJT: Loaded 9838 primary data records. [2025-09-05T19:15:49.453811] [INFO ] [MAIN ] PINS: Loaded 26064 primary data records. [2025-09-05T19:15:50.040451] [INFO ] [MAIN ] PIPR: Generated 871 derivative records from 7179 primary records. [2025-09-05T19:15:50.052078] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-05T19:15:50.053625] [INFO ] [MAIN ] Derivative Progress: 1447/2117 symbols completed. PIPR took 0.8s. Estimated remaining: 3m 18s. Rate: 202.8 symbols/min [2025-09-05T19:15:50.054530] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:50.062859] [INFO ] [MAIN ] PINS: Generated 871 derivative records from 26064 primary records. [2025-09-05T19:15:50.075167] [INFO ] [MAIN ] PJT: Generated 871 derivative records from 9838 primary records. [2025-09-05T19:15:50.087288] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-05T19:15:50.088978] [INFO ] [MAIN ] Derivative Progress: 1448/2117 symbols completed. PINS took 0.8s. Estimated remaining: 3m 18s. Rate: 202.9 symbols/min [2025-09-05T19:15:50.086961] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-05T19:15:50.096263] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:50.097954] [INFO ] [MAIN ] Derivative Progress: 1449/2117 symbols completed. PJT took 0.8s. Estimated remaining: 3m 17s. Rate: 203.1 symbols/min [2025-09-05T19:15:50.098211] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:50.118420] [INFO ] [MAIN ] PK: Loaded 25581 primary data records. [2025-09-05T19:15:50.193318] [INFO ] [MAIN ] PKE: Loaded 10084 primary data records. [2025-09-05T19:15:50.267310] [INFO ] [MAIN ] PKG: Loaded 18525 primary data records. [2025-09-05T19:15:50.935807] [INFO ] [MAIN ] PK: Generated 871 derivative records from 25581 primary records. [2025-09-05T19:15:50.954150] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-05T19:15:50.965516] [INFO ] [MAIN ] Derivative Progress: 1450/2117 symbols completed. PK took 0.9s. Estimated remaining: 3m 17s. Rate: 202.8 symbols/min [2025-09-05T19:15:50.960620] [INFO ] [MAIN ] PKG: Generated 871 derivative records from 18525 primary records. [2025-09-05T19:15:50.965746] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:50.967075] [INFO ] [MAIN ] PKE: Generated 1352 derivative records from 10084 primary records. [2025-09-05T19:15:50.975552] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-05T19:15:50.977321] [INFO ] [MAIN ] Derivative Progress: 1451/2117 symbols completed. PKG took 0.9s. Estimated remaining: 3m 17s. Rate: 202.9 symbols/min [2025-09-05T19:15:50.989282] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:50.996156] [INFO ] [MAIN ] PKST: Loaded 8679 primary data records. [2025-09-05T19:15:50.996785] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-05T19:15:51.019741] [INFO ] [MAIN ] Derivative Progress: 1452/2117 symbols completed. PKE took 0.9s. Estimated remaining: 3m 17s. Rate: 203.0 symbols/min [2025-09-05T19:15:51.080025] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:51.110440] [INFO ] [MAIN ] PKX: Loaded 10238 primary data records. [2025-09-05T19:15:51.524273] [INFO ] [MAIN ] PL: Loaded 39955 primary data records. [2025-09-05T19:15:51.890576] [INFO ] [MAIN ] PKST: Generated 871 derivative records from 8679 primary records. [2025-09-05T19:15:51.910516] [INFO ] [MAIN ] PKX: Generated 871 derivative records from 10238 primary records. [2025-09-05T19:15:51.912070] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-05T19:15:51.913417] [INFO ] [MAIN ] Derivative Progress: 1453/2117 symbols completed. PKST took 0.9s. Estimated remaining: 3m 16s. Rate: 202.8 symbols/min [2025-09-05T19:15:51.922782] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-05T19:15:51.924520] [INFO ] [MAIN ] Derivative Progress: 1454/2117 symbols completed. PKX took 0.9s. Estimated remaining: 3m 16s. Rate: 202.9 symbols/min [2025-09-05T19:15:51.938758] [INFO ] [MAIN ] PL: Generated 1352 derivative records from 39955 primary records. [2025-09-05T19:15:51.950865] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-05T19:15:51.953368] [INFO ] [MAIN ] Derivative Progress: 1455/2117 symbols completed. PL took 0.9s. Estimated remaining: 3m 16s. Rate: 203.0 symbols/min [2025-09-05T19:15:51.954057] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:51.954008] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:51.954190] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:51.968149] [INFO ] [MAIN ] PLOW: Loaded 9685 primary data records. [2025-09-05T19:15:52.131501] [INFO ] [MAIN ] PLD: Loaded 25914 primary data records. [2025-09-05T19:15:52.325120] [INFO ] [MAIN ] PLNT: Loaded 36475 primary data records. [2025-09-05T19:15:52.768279] [INFO ] [MAIN ] PLOW: Generated 871 derivative records from 9685 primary records. [2025-09-05T19:15:52.780515] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-05T19:15:52.784039] [INFO ] [MAIN ] Derivative Progress: 1456/2117 symbols completed. PLOW took 0.8s. Estimated remaining: 3m 16s. Rate: 202.8 symbols/min [2025-09-05T19:15:52.784878] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:52.792397] [INFO ] [MAIN ] PLD: Generated 871 derivative records from 25914 primary records. [2025-09-05T19:15:52.804665] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-05T19:15:52.806681] [INFO ] [MAIN ] Derivative Progress: 1457/2117 symbols completed. PLD took 0.9s. Estimated remaining: 3m 15s. Rate: 202.9 symbols/min [2025-09-05T19:15:52.807058] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:52.817908] [INFO ] [MAIN ] PLNT: Generated 1352 derivative records from 36475 primary records. [2025-09-05T19:15:52.837471] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-05T19:15:52.840009] [INFO ] [MAIN ] Derivative Progress: 1458/2117 symbols completed. PLNT took 0.9s. Estimated remaining: 3m 15s. Rate: 203.0 symbols/min [2025-09-05T19:15:52.840782] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:52.849348] [INFO ] [MAIN ] PLYM: Loaded 24449 primary data records. [2025-09-05T19:15:53.041334] [INFO ] [MAIN ] PM: Loaded 26060 primary data records. [2025-09-05T19:15:53.060888] [INFO ] [MAIN ] PML: Loaded 15598 primary data records. [2025-09-05T19:15:53.697124] [INFO ] [MAIN ] PLYM: Generated 1352 derivative records from 24449 primary records. [2025-09-05T19:15:53.713337] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-05T19:15:53.715697] [INFO ] [MAIN ] Derivative Progress: 1459/2117 symbols completed. PLYM took 0.9s. Estimated remaining: 3m 15s. Rate: 202.7 symbols/min [2025-09-05T19:15:53.716017] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:53.744193] [INFO ] [MAIN ] PML: Generated 1352 derivative records from 15598 primary records. [2025-09-05T19:15:53.745010] [INFO ] [MAIN ] PM: Generated 871 derivative records from 26060 primary records. [2025-09-05T19:15:53.737433] [INFO ] [MAIN ] PMM: Loaded 7357 primary data records. [2025-09-05T19:15:53.872927] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-05T19:15:53.871607] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-09-05T19:15:53.879758] [INFO ] [MAIN ] Derivative Progress: 1460/2117 symbols completed. PM took 1.1s. Estimated remaining: 3m 14s. Rate: 202.8 symbols/min [2025-09-05T19:15:53.900453] [INFO ] [MAIN ] Derivative Progress: 1461/2117 symbols completed. PML took 1.0s. Estimated remaining: 3m 14s. Rate: 202.9 symbols/min [2025-09-05T19:15:53.895297] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:53.919820] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:54.045928] [INFO ] [MAIN ] PMO: Loaded 4274 primary data records. [2025-09-05T19:15:54.252138] [INFO ] [MAIN ] PMT: Loaded 30526 primary data records. [2025-09-05T19:15:54.582377] [INFO ] [MAIN ] PMM: Generated 1352 derivative records from 7357 primary records. [2025-09-05T19:15:54.689468] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-05T19:15:54.692557] [INFO ] [MAIN ] Derivative Progress: 1462/2117 symbols completed. PMM took 1.0s. Estimated remaining: 3m 14s. Rate: 202.7 symbols/min [2025-09-05T19:15:54.701389] [INFO ] [MAIN ] PMO: Generated 871 derivative records from 4274 primary records. [2025-09-05T19:15:54.702021] [INFO ] [MAIN ] PMTU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:54.714947] [INFO ] [MAIN ] PMTU: Loaded 506 primary data records. [2025-09-05T19:15:54.713165] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-05T19:15:54.716921] [INFO ] [MAIN ] Derivative Progress: 1463/2117 symbols completed. PMO took 0.8s. Estimated remaining: 3m 13s. Rate: 202.8 symbols/min [2025-09-05T19:15:54.752637] [INFO ] [MAIN ] PMTV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:54.833015] [INFO ] [MAIN ] PMTV: Loaded 3649 primary data records. [2025-09-05T19:15:55.112314] [INFO ] [MAIN ] PMT: Generated 1352 derivative records from 30526 primary records. [2025-09-05T19:15:55.296744] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-05T19:15:55.299509] [INFO ] [MAIN ] Derivative Progress: 1464/2117 symbols completed. PMT took 1.4s. Estimated remaining: 3m 13s. Rate: 202.7 symbols/min [2025-09-05T19:15:55.300154] [INFO ] [MAIN ] PMTW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:55.309478] [INFO ] [MAIN ] PMTW: Loaded 3369 primary data records. [2025-09-05T19:15:55.376399] [INFO ] [MAIN ] PMTU: Generated 1352 derivative records from 506 primary records. [2025-09-05T19:15:55.446326] [INFO ] [MAIN ] PMTU: Successfully saved derivative data. [2025-09-05T19:15:55.463999] [INFO ] [MAIN ] Derivative Progress: 1465/2117 symbols completed. PMTU took 0.8s. Estimated remaining: 3m 13s. Rate: 202.8 symbols/min [2025-09-05T19:15:55.478982] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:55.522406] [INFO ] [MAIN ] PMTV: Generated 1352 derivative records from 3649 primary records. [2025-09-05T19:15:55.583590] [INFO ] [MAIN ] PMTV: Successfully saved derivative data. [2025-09-05T19:15:55.586237] [INFO ] [MAIN ] Derivative Progress: 1466/2117 symbols completed. PMTV took 0.8s. Estimated remaining: 3m 13s. Rate: 202.8 symbols/min [2025-09-05T19:15:55.586624] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:55.600616] [INFO ] [MAIN ] PNI: Loaded 5217 primary data records. [2025-09-05T19:15:55.723880] [INFO ] [MAIN ] PNC: Loaded 25186 primary data records. [2025-09-05T19:15:55.759868] [INFO ] [MAIN ] PMTW: Generated 767 derivative records from 3369 primary records. [2025-09-05T19:15:55.998137] [INFO ] [MAIN ] PMTW: Successfully saved derivative data. [2025-09-05T19:15:55.999972] [INFO ] [MAIN ] Derivative Progress: 1467/2117 symbols completed. PMTW took 0.7s. Estimated remaining: 3m 12s. Rate: 202.8 symbols/min [2025-09-05T19:15:56.015930] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:56.147201] [INFO ] [MAIN ] PNNT: Loaded 15169 primary data records. [2025-09-05T19:15:56.412526] [INFO ] [MAIN ] PNI: Generated 1352 derivative records from 5217 primary records. [2025-09-05T19:15:56.435980] [INFO ] [MAIN ] PNC: Generated 871 derivative records from 25186 primary records. [2025-09-05T19:15:56.444594] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-05T19:15:56.455635] [INFO ] [MAIN ] Derivative Progress: 1468/2117 symbols completed. PNI took 0.9s. Estimated remaining: 3m 12s. Rate: 202.7 symbols/min [2025-09-05T19:15:56.461357] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-09-05T19:15:56.464364] [INFO ] [MAIN ] Derivative Progress: 1469/2117 symbols completed. PNC took 1.0s. Estimated remaining: 3m 12s. Rate: 202.8 symbols/min [2025-09-05T19:15:56.475193] [INFO ] [MAIN ] PNNT: Generated 871 derivative records from 15169 primary records. [2025-09-05T19:15:56.483512] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-05T19:15:56.485296] [INFO ] [MAIN ] Derivative Progress: 1470/2117 symbols completed. PNNT took 0.5s. Estimated remaining: 3m 11s. Rate: 203.0 symbols/min [2025-09-05T19:15:56.485962] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:56.485894] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:56.487045] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:56.541876] [INFO ] [MAIN ] POR: Loaded 23200 primary data records. [2025-09-05T19:15:56.684906] [INFO ] [MAIN ] PNW: Loaded 34722 primary data records. [2025-09-05T19:15:56.686910] [INFO ] [MAIN ] PNR: Loaded 36047 primary data records. [2025-09-05T19:15:57.420364] [INFO ] [MAIN ] POR: Generated 871 derivative records from 23200 primary records. [2025-09-05T19:15:57.432077] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-05T19:15:57.433479] [INFO ] [MAIN ] Derivative Progress: 1471/2117 symbols completed. POR took 0.9s. Estimated remaining: 3m 11s. Rate: 202.7 symbols/min [2025-09-05T19:15:57.433960] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:57.452622] [INFO ] [MAIN ] PNR: Generated 1352 derivative records from 36047 primary records. [2025-09-05T19:15:57.463802] [INFO ] [MAIN ] PNW: Generated 1352 derivative records from 34722 primary records. [2025-09-05T19:15:57.488364] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-09-05T19:15:57.501810] [INFO ] [MAIN ] Derivative Progress: 1472/2117 symbols completed. PNR took 1.0s. Estimated remaining: 3m 11s. Rate: 202.8 symbols/min [2025-09-05T19:15:57.506060] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:57.507577] [INFO ] [MAIN ] POST: Loaded 19113 primary data records. [2025-09-05T19:15:57.508936] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-05T19:15:57.552466] [INFO ] [MAIN ] Derivative Progress: 1473/2117 symbols completed. PNW took 1.1s. Estimated remaining: 3m 10s. Rate: 202.9 symbols/min [2025-09-05T19:15:57.592135] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:57.713536] [INFO ] [MAIN ] PPG: Loaded 24259 primary data records. [2025-09-05T19:15:57.868571] [INFO ] [MAIN ] PPL: Loaded 25958 primary data records. [2025-09-05T19:15:58.309923] [INFO ] [MAIN ] POST: Generated 871 derivative records from 19113 primary records. [2025-09-05T19:15:58.320529] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-05T19:15:58.322678] [INFO ] [MAIN ] Derivative Progress: 1474/2117 symbols completed. POST took 0.9s. Estimated remaining: 3m 10s. Rate: 202.7 symbols/min [2025-09-05T19:15:58.323090] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:58.342182] [INFO ] [MAIN ] PPL: Generated 871 derivative records from 25958 primary records. [2025-09-05T19:15:58.350670] [INFO ] [MAIN ] PPG: Generated 871 derivative records from 24259 primary records. [2025-09-05T19:15:58.372636] [INFO ] [MAIN ] PPT: Loaded 9888 primary data records. [2025-09-05T19:15:58.377099] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-05T19:15:58.379155] [INFO ] [MAIN ] Derivative Progress: 1475/2117 symbols completed. PPG took 0.9s. Estimated remaining: 3m 10s. Rate: 202.8 symbols/min [2025-09-05T19:15:58.377013] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-09-05T19:15:58.379440] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:58.381607] [INFO ] [MAIN ] Derivative Progress: 1476/2117 symbols completed. PPL took 0.8s. Estimated remaining: 3m 10s. Rate: 202.9 symbols/min [2025-09-05T19:15:58.382160] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:58.617411] [INFO ] [MAIN ] PR: Loaded 26003 primary data records. [2025-09-05T19:15:58.686890] [INFO ] [MAIN ] PRA: Loaded 26927 primary data records. [2025-09-05T19:15:59.232342] [INFO ] [MAIN ] PPT: Generated 871 derivative records from 9888 primary records. [2025-09-05T19:15:59.247053] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-05T19:15:59.249425] [INFO ] [MAIN ] Derivative Progress: 1477/2117 symbols completed. PPT took 0.9s. Estimated remaining: 3m 9s. Rate: 202.6 symbols/min [2025-09-05T19:15:59.250610] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:59.257015] [INFO ] [MAIN ] PRCS: Loaded 1339 primary data records. [2025-09-05T19:15:59.373679] [INFO ] [MAIN ] PR: Generated 871 derivative records from 26003 primary records. [2025-09-05T19:15:59.593858] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-05T19:15:59.608540] [INFO ] [MAIN ] PRA: Generated 1352 derivative records from 26927 primary records. [2025-09-05T19:15:59.606654] [INFO ] [MAIN ] Derivative Progress: 1478/2117 symbols completed. PR took 1.2s. Estimated remaining: 3m 9s. Rate: 202.6 symbols/min [2025-09-05T19:15:59.609933] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:59.627104] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-05T19:15:59.630138] [INFO ] [MAIN ] Derivative Progress: 1479/2117 symbols completed. PRA took 1.2s. Estimated remaining: 3m 9s. Rate: 202.7 symbols/min [2025-09-05T19:15:59.630512] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:59.648550] [INFO ] [MAIN ] PRCS: Generated 870 derivative records from 1339 primary records. [2025-09-05T19:15:59.669234] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-09-05T19:15:59.675747] [INFO ] [MAIN ] Derivative Progress: 1480/2117 symbols completed. PRCS took 0.4s. Estimated remaining: 3m 8s. Rate: 202.9 symbols/min [2025-09-05T19:15:59.677951] [INFO ] [MAIN ] PRG: Loaded 22440 primary data records. [2025-09-05T19:15:59.678440] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:15:59.771811] [INFO ] [MAIN ] PRH: Loaded 3859 primary data records. [2025-09-05T19:15:59.833546] [INFO ] [MAIN ] PRGO: Loaded 22045 primary data records. [2025-09-05T19:16:00.516503] [INFO ] [MAIN ] PRG: Generated 1352 derivative records from 22440 primary records. [2025-09-05T19:16:00.533232] [INFO ] [MAIN ] PRGO: Generated 871 derivative records from 22045 primary records. [2025-09-05T19:16:00.540554] [INFO ] [MAIN ] PRH: Generated 1352 derivative records from 3859 primary records. [2025-09-05T19:16:00.564910] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-05T19:16:00.567004] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-05T19:16:00.569413] [INFO ] [MAIN ] Derivative Progress: 1481/2117 symbols completed. PRH took 0.9s. Estimated remaining: 3m 8s. Rate: 202.6 symbols/min [2025-09-05T19:16:00.571774] [INFO ] [MAIN ] Derivative Progress: 1482/2117 symbols completed. PRGO took 0.9s. Estimated remaining: 3m 8s. Rate: 202.7 symbols/min [2025-09-05T19:16:00.571720] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:00.571456] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-05T19:16:00.574532] [INFO ] [MAIN ] Derivative Progress: 1483/2117 symbols completed. PRG took 1.0s. Estimated remaining: 3m 8s. Rate: 202.9 symbols/min [2025-09-05T19:16:00.572170] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:00.589918] [INFO ] [MAIN ] PRI: Loaded 13601 primary data records. [2025-09-05T19:16:00.869285] [INFO ] [MAIN ] PRIM: Loaded 33426 primary data records. [2025-09-05T19:16:01.161154] [INFO ] [MAIN ] PRI: Generated 1352 derivative records from 13601 primary records. [2025-09-05T19:16:01.175396] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-05T19:16:01.177468] [INFO ] [MAIN ] Derivative Progress: 1484/2117 symbols completed. PRI took 0.6s. Estimated remaining: 3m 7s. Rate: 202.7 symbols/min [2025-09-05T19:16:01.192061] [INFO ] [MAIN ] PRIM: Generated 1352 derivative records from 33426 primary records. [2025-09-05T19:16:01.204982] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-05T19:16:01.207584] [INFO ] [MAIN ] Derivative Progress: 1485/2117 symbols completed. PRIM took 0.6s. Estimated remaining: 3m 7s. Rate: 202.8 symbols/min [2025-09-05T19:16:01.208132] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:01.208250] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:01.208366] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:01.220974] [INFO ] [MAIN ] PRLB: Loaded 9801 primary data records. [2025-09-05T19:16:01.384079] [INFO ] [MAIN ] PRM: Loaded 21643 primary data records. [2025-09-05T19:16:01.390248] [INFO ] [MAIN ] PRKS: Loaded 31567 primary data records. [2025-09-05T19:16:02.116597] [INFO ] [MAIN ] PRLB: Generated 871 derivative records from 9801 primary records. [2025-09-05T19:16:02.129667] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-05T19:16:02.133057] [INFO ] [MAIN ] Derivative Progress: 1486/2117 symbols completed. PRLB took 0.9s. Estimated remaining: 3m 7s. Rate: 202.5 symbols/min [2025-09-05T19:16:02.133509] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:02.141497] [INFO ] [MAIN ] PRM: Generated 871 derivative records from 21643 primary records. [2025-09-05T19:16:02.152586] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-05T19:16:02.155807] [INFO ] [MAIN ] Derivative Progress: 1487/2117 symbols completed. PRM took 0.9s. Estimated remaining: 3m 7s. Rate: 202.7 symbols/min [2025-09-05T19:16:02.156321] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:02.168482] [INFO ] [MAIN ] PRKS: Generated 1352 derivative records from 31567 primary records. [2025-09-05T19:16:02.200025] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-05T19:16:02.212981] [INFO ] [MAIN ] PRMB: Loaded 25824 primary data records. [2025-09-05T19:16:02.211660] [INFO ] [MAIN ] Derivative Progress: 1488/2117 symbols completed. PRKS took 1.0s. Estimated remaining: 3m 6s. Rate: 202.8 symbols/min [2025-09-05T19:16:02.213327] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:02.318868] [INFO ] [MAIN ] PRO: Loaded 29015 primary data records. [2025-09-05T19:16:02.485238] [INFO ] [MAIN ] PRSU: Loaded 18222 primary data records. [2025-09-05T19:16:03.060803] [INFO ] [MAIN ] PRMB: Generated 871 derivative records from 25824 primary records. [2025-09-05T19:16:03.072129] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-05T19:16:03.075828] [INFO ] [MAIN ] Derivative Progress: 1489/2117 symbols completed. PRMB took 0.9s. Estimated remaining: 3m 6s. Rate: 202.5 symbols/min [2025-09-05T19:16:03.076414] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:03.088811] [INFO ] [MAIN ] PRO: Generated 1352 derivative records from 29015 primary records. [2025-09-05T19:16:03.095322] [INFO ] [MAIN ] PRT: Loaded 3715 primary data records. [2025-09-05T19:16:03.106286] [INFO ] [MAIN ] PRSU: Generated 1352 derivative records from 18222 primary records. [2025-09-05T19:16:03.240566] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-09-05T19:16:03.240136] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-05T19:16:03.243027] [INFO ] [MAIN ] Derivative Progress: 1490/2117 symbols completed. PRSU took 1.0s. Estimated remaining: 3m 6s. Rate: 202.6 symbols/min [2025-09-05T19:16:03.251396] [INFO ] [MAIN ] Derivative Progress: 1491/2117 symbols completed. PRO took 1.1s. Estimated remaining: 3m 5s. Rate: 202.7 symbols/min [2025-09-05T19:16:03.245741] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:03.267377] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:03.477910] [INFO ] [MAIN ] PRU: Loaded 38686 primary data records. [2025-09-05T19:16:03.479169] [INFO ] [MAIN ] PRT: Generated 1352 derivative records from 3715 primary records. [2025-09-05T19:16:03.501495] [INFO ] [MAIN ] PSA: Loaded 31881 primary data records. [2025-09-05T19:16:03.718543] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-05T19:16:03.750363] [INFO ] [MAIN ] Derivative Progress: 1492/2117 symbols completed. PRT took 0.7s. Estimated remaining: 3m 5s. Rate: 202.6 symbols/min [2025-09-05T19:16:03.820888] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:04.045901] [INFO ] [MAIN ] PSBD: Loaded 3660 primary data records. [2025-09-05T19:16:04.368334] [INFO ] [MAIN ] PRU: Generated 1352 derivative records from 38686 primary records. [2025-09-05T19:16:04.394277] [INFO ] [MAIN ] PSA: Generated 1352 derivative records from 31881 primary records. [2025-09-05T19:16:04.398100] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-05T19:16:04.408919] [INFO ] [MAIN ] Derivative Progress: 1493/2117 symbols completed. PRU took 1.2s. Estimated remaining: 3m 5s. Rate: 202.5 symbols/min [2025-09-05T19:16:04.412609] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:04.419447] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-05T19:16:04.421721] [INFO ] [MAIN ] Derivative Progress: 1494/2117 symbols completed. PSA took 1.2s. Estimated remaining: 3m 5s. Rate: 202.6 symbols/min [2025-09-05T19:16:04.429195] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:04.430567] [INFO ] [MAIN ] PSBD: Generated 871 derivative records from 3660 primary records. [2025-09-05T19:16:04.433844] [INFO ] [MAIN ] PSF: Loaded 3094 primary data records. [2025-09-05T19:16:04.510459] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-05T19:16:04.517502] [INFO ] [MAIN ] Derivative Progress: 1495/2117 symbols completed. PSBD took 0.7s. Estimated remaining: 3m 4s. Rate: 202.7 symbols/min [2025-09-05T19:16:04.535693] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:04.614731] [INFO ] [MAIN ] PSFE: Loaded 23441 primary data records. [2025-09-05T19:16:04.993784] [INFO ] [MAIN ] PSN: Loaded 34573 primary data records. [2025-09-05T19:16:05.150408] [INFO ] [MAIN ] PSF: Generated 871 derivative records from 3094 primary records. [2025-09-05T19:16:05.282550] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-05T19:16:05.283846] [INFO ] [MAIN ] Derivative Progress: 1496/2117 symbols completed. PSF took 0.9s. Estimated remaining: 3m 4s. Rate: 202.5 symbols/min [2025-09-05T19:16:05.284290] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:05.301156] [INFO ] [MAIN ] PSFE: Generated 1352 derivative records from 23441 primary records. [2025-09-05T19:16:05.320863] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-05T19:16:05.322889] [INFO ] [MAIN ] Derivative Progress: 1497/2117 symbols completed. PSFE took 0.9s. Estimated remaining: 3m 4s. Rate: 202.6 symbols/min [2025-09-05T19:16:05.329612] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:05.330385] [INFO ] [MAIN ] PSO: Loaded 17829 primary data records. [2025-09-05T19:16:05.457922] [INFO ] [MAIN ] PSQH: Loaded 15680 primary data records. [2025-09-05T19:16:05.494069] [INFO ] [MAIN ] PSN: Generated 1352 derivative records from 34573 primary records. [2025-09-05T19:16:05.752481] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-05T19:16:05.780566] [INFO ] [MAIN ] Derivative Progress: 1498/2117 symbols completed. PSN took 1.2s. Estimated remaining: 3m 3s. Rate: 202.5 symbols/min [2025-09-05T19:16:05.887982] [INFO ] [MAIN ] PSO: Generated 871 derivative records from 17829 primary records. [2025-09-05T19:16:05.898384] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-05T19:16:05.901268] [INFO ] [MAIN ] Derivative Progress: 1499/2117 symbols completed. PSO took 0.6s. Estimated remaining: 3m 3s. Rate: 202.6 symbols/min [2025-09-05T19:16:05.908272] [INFO ] [MAIN ] PSQH: Generated 871 derivative records from 15680 primary records. [2025-09-05T19:16:05.916122] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-05T19:16:05.917424] [INFO ] [MAIN ] Derivative Progress: 1500/2117 symbols completed. PSQH took 0.6s. Estimated remaining: 3m 3s. Rate: 202.7 symbols/min [2025-09-05T19:16:05.918101] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:05.918214] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:05.918252] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:05.933015] [INFO ] [MAIN ] PSTL: Loaded 9214 primary data records. [2025-09-05T19:16:06.125744] [INFO ] [MAIN ] PSTG: Loaded 25465 primary data records. [2025-09-05T19:16:06.144064] [INFO ] [MAIN ] PSX: Loaded 25764 primary data records. [2025-09-05T19:16:06.704718] [INFO ] [MAIN ] PSTL: Generated 871 derivative records from 9214 primary records. [2025-09-05T19:16:06.723028] [INFO ] [MAIN ] PSTG: Generated 871 derivative records from 25465 primary records. [2025-09-05T19:16:06.722328] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-05T19:16:06.725666] [INFO ] [MAIN ] Derivative Progress: 1501/2117 symbols completed. PSTL took 0.8s. Estimated remaining: 3m 3s. Rate: 202.5 symbols/min [2025-09-05T19:16:06.726071] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:06.739962] [INFO ] [MAIN ] PSX: Generated 871 derivative records from 25764 primary records. [2025-09-05T19:16:06.748759] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-05T19:16:06.752443] [INFO ] [MAIN ] Derivative Progress: 1502/2117 symbols completed. PSTG took 0.8s. Estimated remaining: 3m 2s. Rate: 202.6 symbols/min [2025-09-05T19:16:06.753511] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:06.753822] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-05T19:16:06.755549] [INFO ] [MAIN ] Derivative Progress: 1503/2117 symbols completed. PSX took 0.8s. Estimated remaining: 3m 2s. Rate: 202.7 symbols/min [2025-09-05T19:16:06.756001] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:06.760292] [INFO ] [MAIN ] PTA: Loaded 7335 primary data records. [2025-09-05T19:16:07.042214] [INFO ] [MAIN ] PUK: Loaded 33262 primary data records. [2025-09-05T19:16:07.043595] [INFO ] [MAIN ] PTY: Loaded 27841 primary data records. [2025-09-05T19:16:07.656834] [INFO ] [MAIN ] PTA: Generated 871 derivative records from 7335 primary records. [2025-09-05T19:16:07.668688] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-05T19:16:07.670666] [INFO ] [MAIN ] Derivative Progress: 1504/2117 symbols completed. PTA took 0.9s. Estimated remaining: 3m 2s. Rate: 202.5 symbols/min [2025-09-05T19:16:07.671493] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:07.698745] [INFO ] [MAIN ] PUK: Generated 1352 derivative records from 33262 primary records. [2025-09-05T19:16:07.699435] [INFO ] [MAIN ] PTY: Generated 1352 derivative records from 27841 primary records. [2025-09-05T19:16:07.739772] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-05T19:16:07.739840] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-05T19:16:07.741820] [INFO ] [MAIN ] Derivative Progress: 1505/2117 symbols completed. PUK took 1.0s. Estimated remaining: 3m 1s. Rate: 202.6 symbols/min [2025-09-05T19:16:07.745321] [INFO ] [MAIN ] PUMP: Loaded 23767 primary data records. [2025-09-05T19:16:07.745800] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:07.745722] [INFO ] [MAIN ] Derivative Progress: 1506/2117 symbols completed. PTY took 1.0s. Estimated remaining: 3m 1s. Rate: 202.7 symbols/min [2025-09-05T19:16:07.782212] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:07.856574] [INFO ] [MAIN ] PVL: Loaded 3522 primary data records. [2025-09-05T19:16:08.219241] [INFO ] [MAIN ] PVH: Loaded 38270 primary data records. [2025-09-05T19:16:08.608016] [INFO ] [MAIN ] PUMP: Generated 871 derivative records from 23767 primary records. [2025-09-05T19:16:08.621220] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-05T19:16:08.623930] [INFO ] [MAIN ] Derivative Progress: 1507/2117 symbols completed. PUMP took 1.0s. Estimated remaining: 3m 1s. Rate: 202.4 symbols/min [2025-09-05T19:16:08.624911] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:08.639433] [INFO ] [MAIN ] PVL: Generated 1352 derivative records from 3522 primary records. [2025-09-05T19:16:08.659064] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-05T19:16:08.663284] [INFO ] [MAIN ] Derivative Progress: 1508/2117 symbols completed. PVL took 0.9s. Estimated remaining: 3m 0s. Rate: 202.5 symbols/min [2025-09-05T19:16:08.664389] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:08.690712] [INFO ] [MAIN ] PWR: Loaded 22415 primary data records. [2025-09-05T19:16:08.689608] [INFO ] [MAIN ] PVH: Generated 1352 derivative records from 38270 primary records. [2025-09-05T19:16:08.815390] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-05T19:16:08.844392] [INFO ] [MAIN ] Derivative Progress: 1509/2117 symbols completed. PVH took 1.1s. Estimated remaining: 3m 0s. Rate: 202.6 symbols/min [2025-09-05T19:16:08.845013] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:08.861709] [INFO ] [MAIN ] PX: Loaded 17197 primary data records. [2025-09-05T19:16:09.254952] [INFO ] [MAIN ] QBTS: Loaded 40560 primary data records. [2025-09-05T19:16:09.417386] [INFO ] [MAIN ] PWR: Generated 871 derivative records from 22415 primary records. [2025-09-05T19:16:09.622873] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-05T19:16:09.625289] [INFO ] [MAIN ] Derivative Progress: 1510/2117 symbols completed. PWR took 1.0s. Estimated remaining: 2m 60s. Rate: 202.4 symbols/min [2025-09-05T19:16:09.623981] [INFO ] [MAIN ] PX: Generated 871 derivative records from 17197 primary records. [2025-09-05T19:16:09.625844] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:09.635881] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-05T19:16:09.637587] [INFO ] [MAIN ] Derivative Progress: 1511/2117 symbols completed. PX took 1.0s. Estimated remaining: 2m 60s. Rate: 202.5 symbols/min [2025-09-05T19:16:09.642961] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:09.654972] [INFO ] [MAIN ] QD: Loaded 20807 primary data records. [2025-09-05T19:16:09.670356] [INFO ] [MAIN ] QBTS: Generated 1352 derivative records from 40560 primary records. [2025-09-05T19:16:09.806355] [INFO ] [MAIN ] QGEN: Loaded 23850 primary data records. [2025-09-05T19:16:10.076208] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-05T19:16:10.084141] [INFO ] [MAIN ] Derivative Progress: 1512/2117 symbols completed. QBTS took 1.2s. Estimated remaining: 2m 59s. Rate: 202.4 symbols/min [2025-09-05T19:16:10.101401] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:10.273821] [INFO ] [MAIN ] QD: Generated 1352 derivative records from 20807 primary records. [2025-09-05T19:16:10.276795] [INFO ] [MAIN ] QS: Loaded 26167 primary data records. [2025-09-05T19:16:10.309872] [INFO ] [MAIN ] QGEN: Generated 871 derivative records from 23850 primary records. [2025-09-05T19:16:10.451835] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-05T19:16:10.437368] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-05T19:16:10.482961] [INFO ] [MAIN ] Derivative Progress: 1513/2117 symbols completed. QD took 0.9s. Estimated remaining: 2m 59s. Rate: 202.4 symbols/min [2025-09-05T19:16:10.488466] [INFO ] [MAIN ] Derivative Progress: 1514/2117 symbols completed. QGEN took 0.8s. Estimated remaining: 2m 59s. Rate: 202.5 symbols/min [2025-09-05T19:16:10.559301] [INFO ] [MAIN ] QS: Generated 871 derivative records from 26167 primary records. [2025-09-05T19:16:10.567581] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-05T19:16:10.568793] [INFO ] [MAIN ] Derivative Progress: 1515/2117 symbols completed. QS took 0.5s. Estimated remaining: 2m 58s. Rate: 202.6 symbols/min [2025-09-05T19:16:10.569186] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:10.569425] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:10.569287] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:10.584248] [INFO ] [MAIN ] QUAD: Loaded 11021 primary data records. [2025-09-05T19:16:10.731586] [INFO ] [MAIN ] QTWO: Loaded 17837 primary data records. [2025-09-05T19:16:10.755879] [INFO ] [MAIN ] QSR: Loaded 25361 primary data records. [2025-09-05T19:16:11.419999] [INFO ] [MAIN ] QUAD: Generated 871 derivative records from 11021 primary records. [2025-09-05T19:16:11.431486] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-05T19:16:11.433773] [INFO ] [MAIN ] Derivative Progress: 1516/2117 symbols completed. QUAD took 0.9s. Estimated remaining: 2m 58s. Rate: 202.4 symbols/min [2025-09-05T19:16:11.434245] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:11.450140] [INFO ] [MAIN ] QSR: Generated 871 derivative records from 25361 primary records. [2025-09-05T19:16:11.452242] [INFO ] [MAIN ] QTWO: Generated 871 derivative records from 17837 primary records. [2025-09-05T19:16:11.466790] [INFO ] [MAIN ] QVCC: Loaded 4244 primary data records. [2025-09-05T19:16:11.475610] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-05T19:16:11.483555] [INFO ] [MAIN ] Derivative Progress: 1517/2117 symbols completed. QTWO took 0.9s. Estimated remaining: 2m 58s. Rate: 202.5 symbols/min [2025-09-05T19:16:11.501921] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:11.543331] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-05T19:16:11.562411] [INFO ] [MAIN ] Derivative Progress: 1518/2117 symbols completed. QSR took 1.0s. Estimated remaining: 2m 57s. Rate: 202.6 symbols/min [2025-09-05T19:16:11.582175] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:11.581887] [INFO ] [MAIN ] QVCD: Loaded 2098 primary data records. [2025-09-05T19:16:11.977368] [INFO ] [MAIN ] QXO: Loaded 40229 primary data records. [2025-09-05T19:16:12.087907] [INFO ] [MAIN ] QVCC: Generated 871 derivative records from 4244 primary records. [2025-09-05T19:16:12.253057] [INFO ] [MAIN ] QVCD: Generated 871 derivative records from 2098 primary records. [2025-09-05T19:16:12.263525] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-05T19:16:12.265821] [INFO ] [MAIN ] Derivative Progress: 1519/2117 symbols completed. QVCC took 0.8s. Estimated remaining: 2m 57s. Rate: 202.4 symbols/min [2025-09-05T19:16:12.266291] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:12.274878] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-05T19:16:12.276625] [INFO ] [MAIN ] Derivative Progress: 1520/2117 symbols completed. QVCD took 0.8s. Estimated remaining: 2m 57s. Rate: 202.5 symbols/min [2025-09-05T19:16:12.277123] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:12.290192] [INFO ] [MAIN ] R: Loaded 12741 primary data records. [2025-09-05T19:16:12.416006] [INFO ] [MAIN ] QXO: Generated 1352 derivative records from 40229 primary records. [2025-09-05T19:16:12.421873] [INFO ] [MAIN ] RA: Loaded 16400 primary data records. [2025-09-05T19:16:12.750511] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-05T19:16:12.756247] [INFO ] [MAIN ] Derivative Progress: 1521/2117 symbols completed. QXO took 1.2s. Estimated remaining: 2m 57s. Rate: 202.4 symbols/min [2025-09-05T19:16:12.762215] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:12.963610] [INFO ] [MAIN ] R: Generated 871 derivative records from 12741 primary records. [2025-09-05T19:16:12.974077] [INFO ] [MAIN ] RACE: Loaded 23624 primary data records. [2025-09-05T19:16:13.085924] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-05T19:16:13.087473] [INFO ] [MAIN ] Derivative Progress: 1522/2117 symbols completed. R took 0.8s. Estimated remaining: 2m 56s. Rate: 202.4 symbols/min [2025-09-05T19:16:13.088026] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:13.277425] [INFO ] [MAIN ] RA: Generated 1352 derivative records from 16400 primary records. [2025-09-05T19:16:13.286165] [INFO ] [MAIN ] RAMP: Loaded 17051 primary data records. [2025-09-05T19:16:13.336769] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-05T19:16:13.359356] [INFO ] [MAIN ] Derivative Progress: 1523/2117 symbols completed. RA took 1.1s. Estimated remaining: 2m 56s. Rate: 202.4 symbols/min [2025-09-05T19:16:13.380630] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:13.558120] [INFO ] [MAIN ] RACE: Generated 1352 derivative records from 23624 primary records. [2025-09-05T19:16:13.588117] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-05T19:16:13.590414] [INFO ] [MAIN ] Derivative Progress: 1524/2117 symbols completed. RACE took 0.8s. Estimated remaining: 2m 56s. Rate: 202.5 symbols/min [2025-09-05T19:16:13.592260] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:13.600432] [INFO ] [MAIN ] RAMP: Generated 871 derivative records from 17051 primary records. [2025-09-05T19:16:13.621949] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-05T19:16:13.624965] [INFO ] [MAIN ] Derivative Progress: 1525/2117 symbols completed. RAMP took 0.5s. Estimated remaining: 2m 55s. Rate: 202.6 symbols/min [2025-09-05T19:16:13.625152] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:13.627061] [INFO ] [MAIN ] RBA: Loaded 34606 primary data records. [2025-09-05T19:16:13.630823] [INFO ] [MAIN ] RBC: Loaded 7019 primary data records. [2025-09-05T19:16:14.157767] [INFO ] [MAIN ] RBLX: Loaded 40471 primary data records. [2025-09-05T19:16:14.465042] [INFO ] [MAIN ] RBC: Generated 871 derivative records from 7019 primary records. [2025-09-05T19:16:14.467251] [INFO ] [MAIN ] RBA: Generated 1352 derivative records from 34606 primary records. [2025-09-05T19:16:14.488849] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-05T19:16:14.491994] [INFO ] [MAIN ] Derivative Progress: 1526/2117 symbols completed. RBC took 0.9s. Estimated remaining: 2m 55s. Rate: 202.3 symbols/min [2025-09-05T19:16:14.493137] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:14.496179] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-05T19:16:14.499522] [INFO ] [MAIN ] Derivative Progress: 1527/2117 symbols completed. RBA took 1.1s. Estimated remaining: 2m 55s. Rate: 202.4 symbols/min [2025-09-05T19:16:14.500358] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:14.502901] [INFO ] [MAIN ] RBOT: Loaded 2796 primary data records. [2025-09-05T19:16:14.681082] [INFO ] [MAIN ] RBLX: Generated 1352 derivative records from 40471 primary records. [2025-09-05T19:16:14.796440] [INFO ] [MAIN ] RBRK: Loaded 25809 primary data records. [2025-09-05T19:16:14.915219] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-05T19:16:14.918728] [INFO ] [MAIN ] Derivative Progress: 1528/2117 symbols completed. RBLX took 1.3s. Estimated remaining: 2m 55s. Rate: 202.4 symbols/min [2025-09-05T19:16:15.121288] [INFO ] [MAIN ] RBOT: Generated 871 derivative records from 2796 primary records. [2025-09-05T19:16:15.130659] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-05T19:16:15.131995] [INFO ] [MAIN ] Derivative Progress: 1529/2117 symbols completed. RBOT took 0.6s. Estimated remaining: 2m 54s. Rate: 202.4 symbols/min [2025-09-05T19:16:15.141369] [INFO ] [MAIN ] RBRK: Generated 871 derivative records from 25809 primary records. [2025-09-05T19:16:15.149421] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-05T19:16:15.150908] [INFO ] [MAIN ] Derivative Progress: 1530/2117 symbols completed. RBRK took 0.7s. Estimated remaining: 2m 54s. Rate: 202.6 symbols/min [2025-09-05T19:16:15.151473] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:15.151528] [INFO ] [MAIN ] RCB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:15.151379] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:15.157094] [INFO ] [MAIN ] RCB: Loaded 636 primary data records. [2025-09-05T19:16:15.214964] [INFO ] [MAIN ] RCD: Loaded 1751 primary data records. [2025-09-05T19:16:15.528845] [INFO ] [MAIN ] RC: Loaded 23119 primary data records. [2025-09-05T19:16:15.899100] [INFO ] [MAIN ] RCB: Generated 871 derivative records from 636 primary records. [2025-09-05T19:16:15.913300] [INFO ] [MAIN ] RCD: Generated 871 derivative records from 1751 primary records. [2025-09-05T19:16:15.921257] [INFO ] [MAIN ] RCB: Successfully saved derivative data. [2025-09-05T19:16:15.922840] [INFO ] [MAIN ] Derivative Progress: 1531/2117 symbols completed. RCB took 0.8s. Estimated remaining: 2m 54s. Rate: 202.3 symbols/min [2025-09-05T19:16:15.923359] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:15.925154] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-09-05T19:16:15.926972] [INFO ] [MAIN ] Derivative Progress: 1532/2117 symbols completed. RCD took 0.8s. Estimated remaining: 2m 53s. Rate: 202.5 symbols/min [2025-09-05T19:16:15.927481] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:15.937503] [INFO ] [MAIN ] RC: Generated 871 derivative records from 23119 primary records. [2025-09-05T19:16:15.946410] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-05T19:16:15.947947] [INFO ] [MAIN ] Derivative Progress: 1533/2117 symbols completed. RC took 0.8s. Estimated remaining: 2m 53s. Rate: 202.6 symbols/min [2025-09-05T19:16:15.954075] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:15.972524] [INFO ] [MAIN ] RCI: Loaded 23665 primary data records. [2025-09-05T19:16:16.059227] [INFO ] [MAIN ] RCS: Loaded 5582 primary data records. [2025-09-05T19:16:16.094188] [INFO ] [MAIN ] RCL: Loaded 25169 primary data records. [2025-09-05T19:16:16.707735] [INFO ] [MAIN ] RCI: Generated 871 derivative records from 23665 primary records. [2025-09-05T19:16:16.727669] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-05T19:16:16.729010] [INFO ] [MAIN ] Derivative Progress: 1534/2117 symbols completed. RCI took 0.8s. Estimated remaining: 2m 53s. Rate: 202.4 symbols/min [2025-09-05T19:16:16.727514] [INFO ] [MAIN ] RCS: Generated 871 derivative records from 5582 primary records. [2025-09-05T19:16:16.735265] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:16.736568] [INFO ] [MAIN ] RCL: Generated 871 derivative records from 25169 primary records. [2025-09-05T19:16:16.752829] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-05T19:16:16.753148] [INFO ] [MAIN ] RCL: Successfully saved derivative data. [2025-09-05T19:16:16.754792] [INFO ] [MAIN ] Derivative Progress: 1535/2117 symbols completed. RCS took 0.8s. Estimated remaining: 2m 52s. Rate: 202.5 symbols/min [2025-09-05T19:16:16.756457] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:16.756626] [INFO ] [MAIN ] Derivative Progress: 1536/2117 symbols completed. RCL took 0.8s. Estimated remaining: 2m 52s. Rate: 202.6 symbols/min [2025-09-05T19:16:16.757105] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:16.798761] [INFO ] [MAIN ] RCUS: Loaded 32404 primary data records. [2025-09-05T19:16:16.799400] [INFO ] [MAIN ] RDN: Loaded 21238 primary data records. [2025-09-05T19:16:17.058869] [INFO ] [MAIN ] RDDT: Loaded 40528 primary data records. [2025-09-05T19:16:17.688991] [INFO ] [MAIN ] RDN: Generated 871 derivative records from 21238 primary records. [2025-09-05T19:16:17.708794] [INFO ] [MAIN ] RCUS: Generated 1352 derivative records from 32404 primary records. [2025-09-05T19:16:17.711579] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-05T19:16:17.713482] [INFO ] [MAIN ] Derivative Progress: 1537/2117 symbols completed. RDN took 1.0s. Estimated remaining: 2m 52s. Rate: 202.3 symbols/min [2025-09-05T19:16:17.713781] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:17.728626] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-05T19:16:17.732367] [INFO ] [MAIN ] Derivative Progress: 1538/2117 symbols completed. RCUS took 1.0s. Estimated remaining: 2m 52s. Rate: 202.5 symbols/min [2025-09-05T19:16:17.732837] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:17.746328] [INFO ] [MAIN ] RDDT: Generated 1352 derivative records from 40528 primary records. [2025-09-05T19:16:17.781483] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-05T19:16:17.784045] [INFO ] [MAIN ] Derivative Progress: 1539/2117 symbols completed. RDDT took 1.0s. Estimated remaining: 2m 51s. Rate: 202.6 symbols/min [2025-09-05T19:16:17.785463] [INFO ] [MAIN ] RDW: Loaded 25896 primary data records. [2025-09-05T19:16:17.785686] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:17.893890] [INFO ] [MAIN ] RDY: Loaded 22552 primary data records. [2025-09-05T19:16:18.163610] [INFO ] [MAIN ] RELX: Loaded 23816 primary data records. [2025-09-05T19:16:18.553702] [INFO ] [MAIN ] RDW: Generated 871 derivative records from 25896 primary records. [2025-09-05T19:16:18.573530] [INFO ] [MAIN ] RDY: Generated 871 derivative records from 22552 primary records. [2025-09-05T19:16:18.576843] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-05T19:16:18.579181] [INFO ] [MAIN ] Derivative Progress: 1540/2117 symbols completed. RDW took 0.9s. Estimated remaining: 2m 51s. Rate: 202.3 symbols/min [2025-09-05T19:16:18.579627] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:18.590447] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-05T19:16:18.591976] [INFO ] [MAIN ] Derivative Progress: 1541/2117 symbols completed. RDY took 0.9s. Estimated remaining: 2m 51s. Rate: 202.5 symbols/min [2025-09-05T19:16:18.592340] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:18.599916] [INFO ] [MAIN ] RELX: Generated 871 derivative records from 23816 primary records. [2025-09-05T19:16:18.615816] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-05T19:16:18.617413] [INFO ] [MAIN ] Derivative Progress: 1542/2117 symbols completed. RELX took 0.8s. Estimated remaining: 2m 50s. Rate: 202.6 symbols/min [2025-09-05T19:16:18.617765] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:18.636344] [INFO ] [MAIN ] RERE: Loaded 21415 primary data records. [2025-09-05T19:16:18.760149] [INFO ] [MAIN ] RES: Loaded 22929 primary data records. [2025-09-05T19:16:18.795491] [INFO ] [MAIN ] REVG: Loaded 19664 primary data records. [2025-09-05T19:16:19.423113] [INFO ] [MAIN ] RERE: Generated 871 derivative records from 21415 primary records. [2025-09-05T19:16:19.434086] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-05T19:16:19.436776] [INFO ] [MAIN ] Derivative Progress: 1543/2117 symbols completed. RERE took 0.9s. Estimated remaining: 2m 50s. Rate: 202.4 symbols/min [2025-09-05T19:16:19.448060] [INFO ] [MAIN ] RES: Generated 871 derivative records from 22929 primary records. [2025-09-05T19:16:19.456415] [INFO ] [MAIN ] REVG: Generated 871 derivative records from 19664 primary records. [2025-09-05T19:16:19.471983] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-05T19:16:19.475127] [INFO ] [MAIN ] Derivative Progress: 1544/2117 symbols completed. RES took 0.9s. Estimated remaining: 2m 50s. Rate: 202.5 symbols/min [2025-09-05T19:16:19.475758] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-05T19:16:19.477487] [INFO ] [MAIN ] Derivative Progress: 1545/2117 symbols completed. REVG took 0.9s. Estimated remaining: 2m 49s. Rate: 202.6 symbols/min [2025-09-05T19:16:19.478278] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:19.477998] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:19.478166] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:19.487689] [INFO ] [MAIN ] REX: Loaded 5873 primary data records. [2025-09-05T19:16:19.706402] [INFO ] [MAIN ] REXR: Loaded 25214 primary data records. [2025-09-05T19:16:19.705788] [INFO ] [MAIN ] REZI: Loaded 35080 primary data records. [2025-09-05T19:16:20.366765] [INFO ] [MAIN ] REX: Generated 871 derivative records from 5873 primary records. [2025-09-05T19:16:20.378773] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-05T19:16:20.380309] [INFO ] [MAIN ] Derivative Progress: 1546/2117 symbols completed. REX took 0.9s. Estimated remaining: 2m 49s. Rate: 202.3 symbols/min [2025-09-05T19:16:20.381305] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:20.395546] [INFO ] [MAIN ] REXR: Generated 871 derivative records from 25214 primary records. [2025-09-05T19:16:20.415030] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-05T19:16:20.416660] [INFO ] [MAIN ] Derivative Progress: 1547/2117 symbols completed. REXR took 0.9s. Estimated remaining: 2m 49s. Rate: 202.5 symbols/min [2025-09-05T19:16:20.414499] [INFO ] [MAIN ] REZI: Generated 1352 derivative records from 35080 primary records. [2025-09-05T19:16:20.417774] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:20.439988] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-05T19:16:20.442635] [INFO ] [MAIN ] Derivative Progress: 1548/2117 symbols completed. REZI took 1.0s. Estimated remaining: 2m 49s. Rate: 202.6 symbols/min [2025-09-05T19:16:20.453392] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:20.453316] [INFO ] [MAIN ] RFI: Loaded 5331 primary data records. [2025-09-05T19:16:20.510687] [INFO ] [MAIN ] RF: Loaded 26013 primary data records. [2025-09-05T19:16:20.675118] [INFO ] [MAIN ] RFL: Loaded 5979 primary data records. [2025-09-05T19:16:21.181120] [INFO ] [MAIN ] RFI: Generated 871 derivative records from 5331 primary records. [2025-09-05T19:16:21.198664] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-05T19:16:21.200985] [INFO ] [MAIN ] Derivative Progress: 1549/2117 symbols completed. RFI took 0.8s. Estimated remaining: 2m 48s. Rate: 202.4 symbols/min [2025-09-05T19:16:21.199713] [INFO ] [MAIN ] RF: Generated 871 derivative records from 26013 primary records. [2025-09-05T19:16:21.201261] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:21.215254] [INFO ] [MAIN ] RFM: Loaded 3040 primary data records. [2025-09-05T19:16:21.213123] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-05T19:16:21.235137] [INFO ] [MAIN ] RFL: Generated 871 derivative records from 5979 primary records. [2025-09-05T19:16:21.234388] [INFO ] [MAIN ] Derivative Progress: 1550/2117 symbols completed. RF took 0.9s. Estimated remaining: 2m 48s. Rate: 202.5 symbols/min [2025-09-05T19:16:21.279378] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:21.335540] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-05T19:16:21.349339] [INFO ] [MAIN ] Derivative Progress: 1551/2117 symbols completed. RFL took 0.9s. Estimated remaining: 2m 48s. Rate: 202.6 symbols/min [2025-09-05T19:16:21.403874] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:21.421478] [INFO ] [MAIN ] RFMZ: Loaded 6534 primary data records. [2025-09-05T19:16:21.705235] [INFO ] [MAIN ] RGA: Loaded 13352 primary data records. [2025-09-05T19:16:22.081780] [INFO ] [MAIN ] RFM: Generated 1351 derivative records from 3040 primary records. [2025-09-05T19:16:22.098598] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-05T19:16:22.101315] [INFO ] [MAIN ] Derivative Progress: 1552/2117 symbols completed. RFM took 0.9s. Estimated remaining: 2m 48s. Rate: 202.4 symbols/min [2025-09-05T19:16:22.114628] [INFO ] [MAIN ] RFMZ: Generated 1352 derivative records from 6534 primary records. [2025-09-05T19:16:22.113631] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:22.128357] [INFO ] [MAIN ] RGA: Generated 871 derivative records from 13352 primary records. [2025-09-05T19:16:22.135570] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-05T19:16:22.138057] [INFO ] [MAIN ] Derivative Progress: 1553/2117 symbols completed. RFMZ took 0.9s. Estimated remaining: 2m 47s. Rate: 202.5 symbols/min [2025-09-05T19:16:22.143780] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:22.147969] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-05T19:16:22.149779] [INFO ] [MAIN ] Derivative Progress: 1554/2117 symbols completed. RGA took 0.8s. Estimated remaining: 2m 47s. Rate: 202.6 symbols/min [2025-09-05T19:16:22.152041] [INFO ] [MAIN ] RGT: Loaded 2082 primary data records. [2025-09-05T19:16:22.156388] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:22.260584] [INFO ] [MAIN ] RGR: Loaded 15407 primary data records. [2025-09-05T19:16:22.566956] [INFO ] [MAIN ] RH: Loaded 22810 primary data records. [2025-09-05T19:16:23.067945] [INFO ] [MAIN ] RGT: Generated 1352 derivative records from 2082 primary records. [2025-09-05T19:16:23.084388] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-05T19:16:23.096611] [INFO ] [MAIN ] Derivative Progress: 1555/2117 symbols completed. RGT took 1.0s. Estimated remaining: 2m 47s. Rate: 202.3 symbols/min [2025-09-05T19:16:23.098473] [INFO ] [MAIN ] RGR: Generated 1352 derivative records from 15407 primary records. [2025-09-05T19:16:23.097463] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:23.121572] [INFO ] [MAIN ] RH: Generated 871 derivative records from 22810 primary records. [2025-09-05T19:16:23.125001] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-05T19:16:23.133692] [INFO ] [MAIN ] Derivative Progress: 1556/2117 symbols completed. RGR took 1.0s. Estimated remaining: 2m 46s. Rate: 202.4 symbols/min [2025-09-05T19:16:23.135818] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:23.136250] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-05T19:16:23.138249] [INFO ] [MAIN ] Derivative Progress: 1557/2117 symbols completed. RH took 1.0s. Estimated remaining: 2m 46s. Rate: 202.6 symbols/min [2025-09-05T19:16:23.138565] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:23.183839] [INFO ] [MAIN ] RHI: Loaded 37361 primary data records. [2025-09-05T19:16:23.284510] [INFO ] [MAIN ] RIG: Loaded 26066 primary data records. [2025-09-05T19:16:23.372855] [INFO ] [MAIN ] RHP: Loaded 30706 primary data records. [2025-09-05T19:16:24.029063] [INFO ] [MAIN ] RHI: Generated 1352 derivative records from 37361 primary records. [2025-09-05T19:16:24.051272] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-05T19:16:24.052196] [INFO ] [MAIN ] RIG: Generated 871 derivative records from 26066 primary records. [2025-09-05T19:16:24.054065] [INFO ] [MAIN ] Derivative Progress: 1558/2117 symbols completed. RHI took 1.0s. Estimated remaining: 2m 46s. Rate: 202.3 symbols/min [2025-09-05T19:16:24.064066] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-05T19:16:24.066181] [INFO ] [MAIN ] Derivative Progress: 1559/2117 symbols completed. RIG took 0.9s. Estimated remaining: 2m 45s. Rate: 202.4 symbols/min [2025-09-05T19:16:24.076544] [INFO ] [MAIN ] RHP: Generated 1352 derivative records from 30706 primary records. [2025-09-05T19:16:24.088467] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-05T19:16:24.090769] [INFO ] [MAIN ] Derivative Progress: 1560/2117 symbols completed. RHP took 1.0s. Estimated remaining: 2m 45s. Rate: 202.5 symbols/min [2025-09-05T19:16:24.091397] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:24.091226] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:24.091365] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:24.099678] [INFO ] [MAIN ] RIV: Loaded 5915 primary data records. [2025-09-05T19:16:24.322772] [INFO ] [MAIN ] RIO: Loaded 25918 primary data records. [2025-09-05T19:16:24.321590] [INFO ] [MAIN ] RITM: Loaded 25603 primary data records. [2025-09-05T19:16:24.858736] [INFO ] [MAIN ] RIV: Generated 871 derivative records from 5915 primary records. [2025-09-05T19:16:24.870854] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-05T19:16:24.872442] [INFO ] [MAIN ] Derivative Progress: 1561/2117 symbols completed. RIV took 0.8s. Estimated remaining: 2m 45s. Rate: 202.3 symbols/min [2025-09-05T19:16:24.873923] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:24.887198] [INFO ] [MAIN ] RIO: Generated 871 derivative records from 25918 primary records. [2025-09-05T19:16:24.887942] [INFO ] [MAIN ] RITM: Generated 871 derivative records from 25603 primary records. [2025-09-05T19:16:24.902747] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-05T19:16:24.904607] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-05T19:16:24.906071] [INFO ] [MAIN ] Derivative Progress: 1562/2117 symbols completed. RITM took 0.8s. Estimated remaining: 2m 44s. Rate: 202.4 symbols/min [2025-09-05T19:16:24.907849] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:24.907886] [INFO ] [MAIN ] Derivative Progress: 1563/2117 symbols completed. RIO took 0.8s. Estimated remaining: 2m 44s. Rate: 202.6 symbols/min [2025-09-05T19:16:24.908334] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:24.962595] [INFO ] [MAIN ] RJF: Loaded 35072 primary data records. [2025-09-05T19:16:24.974604] [INFO ] [MAIN ] RKT: Loaded 26104 primary data records. [2025-09-05T19:16:25.154309] [INFO ] [MAIN ] RL: Loaded 30752 primary data records. [2025-09-05T19:16:25.843621] [INFO ] [MAIN ] RKT: Generated 871 derivative records from 26104 primary records. [2025-09-05T19:16:25.854301] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-05T19:16:25.861235] [INFO ] [MAIN ] Derivative Progress: 1564/2117 symbols completed. RKT took 1.0s. Estimated remaining: 2m 44s. Rate: 202.3 symbols/min [2025-09-05T19:16:25.861407] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:25.867365] [INFO ] [MAIN ] RJF: Generated 1352 derivative records from 35072 primary records. [2025-09-05T19:16:25.883598] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-05T19:16:25.886203] [INFO ] [MAIN ] Derivative Progress: 1565/2117 symbols completed. RJF took 1.0s. Estimated remaining: 2m 44s. Rate: 202.4 symbols/min [2025-09-05T19:16:25.886599] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:25.897074] [INFO ] [MAIN ] RL: Generated 1351 derivative records from 30752 primary records. [2025-09-05T19:16:25.920625] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-05T19:16:25.923178] [INFO ] [MAIN ] Derivative Progress: 1566/2117 symbols completed. RL took 1.0s. Estimated remaining: 2m 43s. Rate: 202.5 symbols/min [2025-09-05T19:16:25.929246] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:25.941001] [INFO ] [MAIN ] RLI: Loaded 25380 primary data records. [2025-09-05T19:16:26.000783] [INFO ] [MAIN ] RLJ: Loaded 22744 primary data records. [2025-09-05T19:16:26.027400] [INFO ] [MAIN ] RLTY: Loaded 5337 primary data records. [2025-09-05T19:16:26.736894] [INFO ] [MAIN ] RLTY: Generated 871 derivative records from 5337 primary records. [2025-09-05T19:16:26.755277] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-05T19:16:26.766770] [INFO ] [MAIN ] Derivative Progress: 1567/2117 symbols completed. RLTY took 0.8s. Estimated remaining: 2m 43s. Rate: 202.3 symbols/min [2025-09-05T19:16:26.768265] [INFO ] [MAIN ] RLJ: Generated 871 derivative records from 22744 primary records. [2025-09-05T19:16:26.770500] [INFO ] [MAIN ] RLI: Generated 1352 derivative records from 25380 primary records. [2025-09-05T19:16:26.768737] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:26.779755] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-05T19:16:26.787366] [INFO ] [MAIN ] Derivative Progress: 1568/2117 symbols completed. RLJ took 0.9s. Estimated remaining: 2m 43s. Rate: 202.4 symbols/min [2025-09-05T19:16:26.791936] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:26.794554] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-05T19:16:26.796400] [INFO ] [MAIN ] Derivative Progress: 1569/2117 symbols completed. RLI took 0.9s. Estimated remaining: 2m 42s. Rate: 202.5 symbols/min [2025-09-05T19:16:26.796825] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:26.803185] [INFO ] [MAIN ] RM: Loaded 5778 primary data records. [2025-09-05T19:16:26.949752] [INFO ] [MAIN ] RMAX: Loaded 16755 primary data records. [2025-09-05T19:16:27.048060] [INFO ] [MAIN ] RLX: Loaded 35858 primary data records. [2025-09-05T19:16:27.672427] [INFO ] [MAIN ] RM: Generated 1352 derivative records from 5778 primary records. [2025-09-05T19:16:27.700049] [INFO ] [MAIN ] RMAX: Generated 1352 derivative records from 16755 primary records. [2025-09-05T19:16:27.713335] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-05T19:16:27.715593] [INFO ] [MAIN ] Derivative Progress: 1570/2117 symbols completed. RM took 0.9s. Estimated remaining: 2m 42s. Rate: 202.2 symbols/min [2025-09-05T19:16:27.716660] [INFO ] [MAIN ] RLX: Generated 1352 derivative records from 35858 primary records. [2025-09-05T19:16:27.722216] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:27.739668] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-05T19:16:27.743221] [INFO ] [MAIN ] Derivative Progress: 1571/2117 symbols completed. RMAX took 0.9s. Estimated remaining: 2m 42s. Rate: 202.4 symbols/min [2025-09-05T19:16:27.743759] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:27.745866] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-05T19:16:27.749663] [INFO ] [MAIN ] Derivative Progress: 1572/2117 symbols completed. RLX took 1.0s. Estimated remaining: 2m 41s. Rate: 202.5 symbols/min [2025-09-05T19:16:27.750053] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:27.755315] [INFO ] [MAIN ] RMI: Loaded 3495 primary data records. [2025-09-05T19:16:27.873849] [INFO ] [MAIN ] RMM: Loaded 7890 primary data records. [2025-09-05T19:16:28.155991] [INFO ] [MAIN ] RMD: Loaded 31877 primary data records. [2025-09-05T19:16:28.695353] [INFO ] [MAIN ] RMI: Generated 1352 derivative records from 3495 primary records. [2025-09-05T19:16:28.711493] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-05T19:16:28.719676] [INFO ] [MAIN ] Derivative Progress: 1573/2117 symbols completed. RMI took 1.0s. Estimated remaining: 2m 41s. Rate: 202.2 symbols/min [2025-09-05T19:16:28.724783] [INFO ] [MAIN ] RMM: Generated 1352 derivative records from 7890 primary records. [2025-09-05T19:16:28.740194] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-05T19:16:28.743076] [INFO ] [MAIN ] Derivative Progress: 1574/2117 symbols completed. RMM took 1.0s. Estimated remaining: 2m 41s. Rate: 202.3 symbols/min [2025-09-05T19:16:28.754364] [INFO ] [MAIN ] RMD: Generated 1352 derivative records from 31877 primary records. [2025-09-05T19:16:28.766803] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-05T19:16:28.769236] [INFO ] [MAIN ] Derivative Progress: 1575/2117 symbols completed. RMD took 1.0s. Estimated remaining: 2m 41s. Rate: 202.4 symbols/min [2025-09-05T19:16:28.769693] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:28.769796] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:28.770843] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:28.775235] [INFO ] [MAIN ] RMMZ: Loaded 2565 primary data records. [2025-09-05T19:16:28.885802] [INFO ] [MAIN ] RMT: Loaded 13194 primary data records. [2025-09-05T19:16:29.140713] [INFO ] [MAIN ] RNG: Loaded 35865 primary data records. [2025-09-05T19:16:29.603822] [INFO ] [MAIN ] RMMZ: Generated 871 derivative records from 2565 primary records. [2025-09-05T19:16:29.615074] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-05T19:16:29.616920] [INFO ] [MAIN ] Derivative Progress: 1576/2117 symbols completed. RMMZ took 0.8s. Estimated remaining: 2m 41s. Rate: 202.2 symbols/min [2025-09-05T19:16:29.617539] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:29.629158] [INFO ] [MAIN ] RMT: Generated 1352 derivative records from 13194 primary records. [2025-09-05T19:16:29.657234] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-05T19:16:29.662192] [INFO ] [MAIN ] RNG: Generated 1352 derivative records from 35865 primary records. [2025-09-05T19:16:29.665864] [INFO ] [MAIN ] RNGR: Loaded 11010 primary data records. [2025-09-05T19:16:29.665290] [INFO ] [MAIN ] Derivative Progress: 1577/2117 symbols completed. RMT took 0.9s. Estimated remaining: 2m 40s. Rate: 202.3 symbols/min [2025-09-05T19:16:29.677720] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:29.795796] [INFO ] [MAIN ] RNP: Loaded 11887 primary data records. [2025-09-05T19:16:29.817458] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-05T19:16:29.885607] [INFO ] [MAIN ] Derivative Progress: 1578/2117 symbols completed. RNG took 1.1s. Estimated remaining: 2m 40s. Rate: 202.3 symbols/min [2025-09-05T19:16:29.937349] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:30.233129] [INFO ] [MAIN ] RNR: Loaded 25768 primary data records. [2025-09-05T19:16:30.415929] [INFO ] [MAIN ] RNGR: Generated 871 derivative records from 11010 primary records. [2025-09-05T19:16:30.617300] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-05T19:16:30.619727] [INFO ] [MAIN ] Derivative Progress: 1579/2117 symbols completed. RNGR took 1.0s. Estimated remaining: 2m 40s. Rate: 202.1 symbols/min [2025-09-05T19:16:30.620569] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:30.632302] [INFO ] [MAIN ] RNP: Generated 1352 derivative records from 11887 primary records. [2025-09-05T19:16:30.647052] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-05T19:16:30.649593] [INFO ] [MAIN ] Derivative Progress: 1580/2117 symbols completed. RNP took 1.0s. Estimated remaining: 2m 39s. Rate: 202.3 symbols/min [2025-09-05T19:16:30.655134] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:30.668298] [INFO ] [MAIN ] RNST: Loaded 16847 primary data records. [2025-09-05T19:16:30.727244] [INFO ] [MAIN ] RNR: Generated 1352 derivative records from 25768 primary records. [2025-09-05T19:16:30.828072] [INFO ] [MAIN ] ROG: Loaded 17729 primary data records. [2025-09-05T19:16:30.955756] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-05T19:16:31.058010] [INFO ] [MAIN ] Derivative Progress: 1581/2117 symbols completed. RNR took 1.1s. Estimated remaining: 2m 39s. Rate: 202.2 symbols/min [2025-09-05T19:16:31.070581] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:31.262080] [INFO ] [MAIN ] RNST: Generated 871 derivative records from 16847 primary records. [2025-09-05T19:16:31.283457] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-05T19:16:31.285028] [INFO ] [MAIN ] Derivative Progress: 1582/2117 symbols completed. RNST took 0.7s. Estimated remaining: 2m 39s. Rate: 202.2 symbols/min [2025-09-05T19:16:31.285772] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:31.319407] [INFO ] [MAIN ] ROK: Loaded 33226 primary data records. [2025-09-05T19:16:31.320549] [INFO ] [MAIN ] ROG: Generated 1352 derivative records from 17729 primary records. [2025-09-05T19:16:31.418658] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-05T19:16:31.444034] [INFO ] [MAIN ] Derivative Progress: 1583/2117 symbols completed. ROG took 0.8s. Estimated remaining: 2m 38s. Rate: 202.3 symbols/min [2025-09-05T19:16:31.469097] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:31.663620] [INFO ] [MAIN ] ROL: Loaded 37575 primary data records. [2025-09-05T19:16:31.768800] [INFO ] [MAIN ] RPM: Loaded 19942 primary data records. [2025-09-05T19:16:32.208071] [INFO ] [MAIN ] ROK: Generated 1351 derivative records from 33226 primary records. [2025-09-05T19:16:32.227630] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-05T19:16:32.230032] [INFO ] [MAIN ] Derivative Progress: 1584/2117 symbols completed. ROK took 1.2s. Estimated remaining: 2m 38s. Rate: 202.1 symbols/min [2025-09-05T19:16:32.230704] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:32.250331] [INFO ] [MAIN ] ROL: Generated 1352 derivative records from 37575 primary records. [2025-09-05T19:16:32.258884] [INFO ] [MAIN ] RPM: Generated 871 derivative records from 19942 primary records. [2025-09-05T19:16:32.289622] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-05T19:16:32.294399] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-05T19:16:32.292379] [INFO ] [MAIN ] Derivative Progress: 1585/2117 symbols completed. ROL took 1.0s. Estimated remaining: 2m 38s. Rate: 202.2 symbols/min [2025-09-05T19:16:32.295481] [INFO ] [MAIN ] RPT: Loaded 15033 primary data records. [2025-09-05T19:16:32.295885] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:32.297618] [INFO ] [MAIN ] Derivative Progress: 1586/2117 symbols completed. RPM took 0.8s. Estimated remaining: 2m 37s. Rate: 202.3 symbols/min [2025-09-05T19:16:32.334336] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:32.466683] [INFO ] [MAIN ] RQI: Loaded 13947 primary data records. [2025-09-05T19:16:32.775314] [INFO ] [MAIN ] RRC: Loaded 39718 primary data records. [2025-09-05T19:16:33.195465] [INFO ] [MAIN ] RPT: Generated 1352 derivative records from 15033 primary records. [2025-09-05T19:16:33.214237] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-05T19:16:33.216689] [INFO ] [MAIN ] Derivative Progress: 1587/2117 symbols completed. RPT took 1.0s. Estimated remaining: 2m 37s. Rate: 202.0 symbols/min [2025-09-05T19:16:33.223720] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:33.224609] [INFO ] [MAIN ] RQI: Generated 871 derivative records from 13947 primary records. [2025-09-05T19:16:33.233762] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-05T19:16:33.235388] [INFO ] [MAIN ] Derivative Progress: 1588/2117 symbols completed. RQI took 0.9s. Estimated remaining: 2m 37s. Rate: 202.2 symbols/min [2025-09-05T19:16:33.248282] [INFO ] [MAIN ] RRC: Generated 1352 derivative records from 39718 primary records. [2025-09-05T19:16:33.272090] [INFO ] [MAIN ] RRX: Loaded 19329 primary data records. [2025-09-05T19:16:33.272832] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-05T19:16:33.325746] [INFO ] [MAIN ] Derivative Progress: 1589/2117 symbols completed. RRC took 1.0s. Estimated remaining: 2m 37s. Rate: 202.3 symbols/min [2025-09-05T19:16:33.533183] [INFO ] [MAIN ] RRX: Generated 871 derivative records from 19329 primary records. [2025-09-05T19:16:33.541817] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-05T19:16:33.542972] [INFO ] [MAIN ] Derivative Progress: 1590/2117 symbols completed. RRX took 0.3s. Estimated remaining: 2m 36s. Rate: 202.3 symbols/min [2025-09-05T19:16:33.543385] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:33.543765] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:33.544259] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:33.550690] [INFO ] [MAIN ] RSF: Loaded 3388 primary data records. [2025-09-05T19:16:33.673270] [INFO ] [MAIN ] RS: Loaded 12523 primary data records. [2025-09-05T19:16:33.829106] [INFO ] [MAIN ] RSG: Loaded 22863 primary data records. [2025-09-05T19:16:34.369430] [INFO ] [MAIN ] RSF: Generated 1352 derivative records from 3388 primary records. [2025-09-05T19:16:34.378009] [INFO ] [MAIN ] RS: Generated 871 derivative records from 12523 primary records. [2025-09-05T19:16:34.400004] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-05T19:16:34.401782] [INFO ] [MAIN ] Derivative Progress: 1591/2117 symbols completed. RS took 0.9s. Estimated remaining: 2m 36s. Rate: 202.0 symbols/min [2025-09-05T19:16:34.402121] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:34.400156] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-05T19:16:34.404362] [INFO ] [MAIN ] Derivative Progress: 1592/2117 symbols completed. RSF took 0.9s. Estimated remaining: 2m 36s. Rate: 202.2 symbols/min [2025-09-05T19:16:34.410842] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:34.412822] [INFO ] [MAIN ] RSG: Generated 871 derivative records from 22863 primary records. [2025-09-05T19:16:34.427298] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-05T19:16:34.429177] [INFO ] [MAIN ] Derivative Progress: 1593/2117 symbols completed. RSG took 0.9s. Estimated remaining: 2m 35s. Rate: 202.3 symbols/min [2025-09-05T19:16:34.429475] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:34.437203] [INFO ] [MAIN ] RSKD: Loaded 16708 primary data records. [2025-09-05T19:16:34.572229] [INFO ] [MAIN ] RSI: Loaded 22639 primary data records. [2025-09-05T19:16:34.576804] [INFO ] [MAIN ] RTO: Loaded 19234 primary data records. [2025-09-05T19:16:35.204154] [INFO ] [MAIN ] RSKD: Generated 871 derivative records from 16708 primary records. [2025-09-05T19:16:35.226409] [INFO ] [MAIN ] RTO: Generated 871 derivative records from 19234 primary records. [2025-09-05T19:16:35.227465] [INFO ] [MAIN ] RSI: Generated 871 derivative records from 22639 primary records. [2025-09-05T19:16:35.228550] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-05T19:16:35.230145] [INFO ] [MAIN ] Derivative Progress: 1594/2117 symbols completed. RSKD took 0.8s. Estimated remaining: 2m 35s. Rate: 202.1 symbols/min [2025-09-05T19:16:35.237603] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:35.245243] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-05T19:16:35.247510] [INFO ] [MAIN ] Derivative Progress: 1595/2117 symbols completed. RSI took 0.8s. Estimated remaining: 2m 35s. Rate: 202.2 symbols/min [2025-09-05T19:16:35.248232] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:35.249560] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-05T19:16:35.251617] [INFO ] [MAIN ] Derivative Progress: 1596/2117 symbols completed. RTO took 0.8s. Estimated remaining: 2m 35s. Rate: 202.3 symbols/min [2025-09-05T19:16:35.251904] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:35.279825] [INFO ] [MAIN ] RVT: Loaded 19945 primary data records. [2025-09-05T19:16:35.320104] [INFO ] [MAIN ] RTX: Loaded 26098 primary data records. [2025-09-05T19:16:35.487776] [INFO ] [MAIN ] RVLV: Loaded 35911 primary data records. [2025-09-05T19:16:36.145885] [INFO ] [MAIN ] RTX: Generated 871 derivative records from 26098 primary records. [2025-09-05T19:16:36.167320] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-05T19:16:36.169359] [INFO ] [MAIN ] Derivative Progress: 1597/2117 symbols completed. RTX took 0.9s. Estimated remaining: 2m 34s. Rate: 202.1 symbols/min [2025-09-05T19:16:36.168192] [INFO ] [MAIN ] RVT: Generated 1352 derivative records from 19945 primary records. [2025-09-05T19:16:36.170338] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:36.190681] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-05T19:16:36.196911] [INFO ] [MAIN ] Derivative Progress: 1598/2117 symbols completed. RVT took 0.9s. Estimated remaining: 2m 34s. Rate: 202.2 symbols/min [2025-09-05T19:16:36.197706] [INFO ] [MAIN ] RVLV: Generated 1352 derivative records from 35911 primary records. [2025-09-05T19:16:36.197994] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:36.211293] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-05T19:16:36.213940] [INFO ] [MAIN ] Derivative Progress: 1599/2117 symbols completed. RVLV took 1.0s. Estimated remaining: 2m 34s. Rate: 202.3 symbols/min [2025-09-05T19:16:36.214277] [INFO ] [MAIN ] RWTN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:36.217524] [INFO ] [MAIN ] RWTN: Loaded 997 primary data records. [2025-09-05T19:16:36.362043] [INFO ] [MAIN ] RWT: Loaded 19138 primary data records. [2025-09-05T19:16:36.368083] [INFO ] [MAIN ] RVTY: Loaded 36062 primary data records. [2025-09-05T19:16:36.994006] [INFO ] [MAIN ] RWTN: Generated 870 derivative records from 997 primary records. [2025-09-05T19:16:37.001789] [INFO ] [MAIN ] RWTN: Successfully saved derivative data. [2025-09-05T19:16:37.002958] [INFO ] [MAIN ] Derivative Progress: 1600/2117 symbols completed. RWTN took 0.8s. Estimated remaining: 2m 34s. Rate: 202.1 symbols/min [2025-09-05T19:16:37.003177] [INFO ] [MAIN ] RWTO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:37.013332] [INFO ] [MAIN ] RWT: Generated 871 derivative records from 19138 primary records. [2025-09-05T19:16:37.022094] [INFO ] [MAIN ] RWTO: Loaded 2026 primary data records. [2025-09-05T19:16:37.110688] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-05T19:16:37.122778] [INFO ] [MAIN ] Derivative Progress: 1601/2117 symbols completed. RWT took 0.9s. Estimated remaining: 2m 33s. Rate: 202.2 symbols/min [2025-09-05T19:16:37.131626] [INFO ] [MAIN ] RVTY: Generated 1352 derivative records from 36062 primary records. [2025-09-05T19:16:37.144273] [INFO ] [MAIN ] RWTP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:37.202104] [INFO ] [MAIN ] RWTP: Loaded 2008 primary data records. [2025-09-05T19:16:37.390532] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-05T19:16:37.396863] [INFO ] [MAIN ] Derivative Progress: 1602/2117 symbols completed. RVTY took 1.2s. Estimated remaining: 2m 33s. Rate: 202.2 symbols/min [2025-09-05T19:16:37.402875] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:37.586119] [INFO ] [MAIN ] RWTO: Generated 869 derivative records from 2026 primary records. [2025-09-05T19:16:37.594794] [INFO ] [MAIN ] RWTO: Successfully saved derivative data. [2025-09-05T19:16:37.602213] [INFO ] [MAIN ] Derivative Progress: 1603/2117 symbols completed. RWTO took 0.6s. Estimated remaining: 2m 33s. Rate: 202.2 symbols/min [2025-09-05T19:16:37.604329] [INFO ] [MAIN ] RXO: Loaded 23120 primary data records. [2025-09-05T19:16:37.755288] [INFO ] [MAIN ] RWTP: Generated 1352 derivative records from 2008 primary records. [2025-09-05T19:16:37.855288] [INFO ] [MAIN ] RWTP: Successfully saved derivative data. [2025-09-05T19:16:37.858975] [INFO ] [MAIN ] Derivative Progress: 1604/2117 symbols completed. RWTP took 0.7s. Estimated remaining: 2m 32s. Rate: 202.2 symbols/min [2025-09-05T19:16:37.870809] [INFO ] [MAIN ] RXO: Generated 871 derivative records from 23120 primary records. [2025-09-05T19:16:37.879348] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-05T19:16:37.880685] [INFO ] [MAIN ] Derivative Progress: 1605/2117 symbols completed. RXO took 0.5s. Estimated remaining: 2m 32s. Rate: 202.3 symbols/min [2025-09-05T19:16:37.881353] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:37.881437] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:37.881224] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:37.906036] [INFO ] [MAIN ] RYAM: Loaded 16474 primary data records. [2025-09-05T19:16:37.946869] [INFO ] [MAIN ] RYAN: Loaded 21097 primary data records. [2025-09-05T19:16:38.232574] [INFO ] [MAIN ] RY: Loaded 36071 primary data records. [2025-09-05T19:16:38.741053] [INFO ] [MAIN ] RYAM: Generated 871 derivative records from 16474 primary records. [2025-09-05T19:16:38.740390] [INFO ] [MAIN ] RYAN: Generated 871 derivative records from 21097 primary records. [2025-09-05T19:16:38.757995] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-05T19:16:38.759828] [INFO ] [MAIN ] Derivative Progress: 1606/2117 symbols completed. RYAM took 0.9s. Estimated remaining: 2m 32s. Rate: 202.1 symbols/min [2025-09-05T19:16:38.760716] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-05T19:16:38.760591] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:38.762341] [INFO ] [MAIN ] Derivative Progress: 1607/2117 symbols completed. RYAN took 0.9s. Estimated remaining: 2m 31s. Rate: 202.2 symbols/min [2025-09-05T19:16:38.762913] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:38.777429] [INFO ] [MAIN ] RY: Generated 1352 derivative records from 36071 primary records. [2025-09-05T19:16:38.805291] [INFO ] [MAIN ] RYI: Loaded 16340 primary data records. [2025-09-05T19:16:38.918594] [INFO ] [MAIN ] RYN: Loaded 22166 primary data records. [2025-09-05T19:16:38.894539] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-05T19:16:38.929550] [INFO ] [MAIN ] Derivative Progress: 1608/2117 symbols completed. RY took 1.0s. Estimated remaining: 2m 31s. Rate: 202.3 symbols/min [2025-09-05T19:16:38.962615] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:39.090767] [INFO ] [MAIN ] RZB: Loaded 3906 primary data records. [2025-09-05T19:16:39.637473] [INFO ] [MAIN ] RYI: Generated 1352 derivative records from 16340 primary records. [2025-09-05T19:16:39.658065] [INFO ] [MAIN ] RYN: Generated 871 derivative records from 22166 primary records. [2025-09-05T19:16:39.666278] [INFO ] [MAIN ] RZB: Generated 870 derivative records from 3906 primary records. [2025-09-05T19:16:39.681520] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-05T19:16:39.683531] [INFO ] [MAIN ] Derivative Progress: 1609/2117 symbols completed. RYN took 0.9s. Estimated remaining: 2m 31s. Rate: 202.1 symbols/min [2025-09-05T19:16:39.684148] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-05T19:16:39.686385] [INFO ] [MAIN ] Derivative Progress: 1610/2117 symbols completed. RYI took 0.9s. Estimated remaining: 2m 30s. Rate: 202.2 symbols/min [2025-09-05T19:16:39.686862] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:39.684318] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:39.688397] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-05T19:16:39.690024] [INFO ] [MAIN ] Derivative Progress: 1611/2117 symbols completed. RZB took 0.7s. Estimated remaining: 2m 30s. Rate: 202.3 symbols/min [2025-09-05T19:16:39.690688] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:39.695473] [INFO ] [MAIN ] RZC: Loaded 3383 primary data records. [2025-09-05T19:16:39.962504] [INFO ] [MAIN ] S: Loaded 25965 primary data records. [2025-09-05T19:16:39.963618] [INFO ] [MAIN ] SA: Loaded 32208 primary data records. [2025-09-05T19:16:40.473193] [INFO ] [MAIN ] RZC: Generated 871 derivative records from 3383 primary records. [2025-09-05T19:16:40.483976] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-05T19:16:40.485694] [INFO ] [MAIN ] Derivative Progress: 1612/2117 symbols completed. RZC took 0.8s. Estimated remaining: 2m 30s. Rate: 202.1 symbols/min [2025-09-05T19:16:40.486359] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:40.499610] [INFO ] [MAIN ] S: Generated 871 derivative records from 25965 primary records. [2025-09-05T19:16:40.502893] [INFO ] [MAIN ] SABA: Loaded 4511 primary data records. [2025-09-05T19:16:40.599510] [INFO ] [MAIN ] SA: Generated 1352 derivative records from 32208 primary records. [2025-09-05T19:16:40.634872] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-05T19:16:40.636567] [INFO ] [MAIN ] Derivative Progress: 1613/2117 symbols completed. S took 0.9s. Estimated remaining: 2m 30s. Rate: 202.2 symbols/min [2025-09-05T19:16:40.660093] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:40.716277] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-05T19:16:40.791070] [INFO ] [MAIN ] Derivative Progress: 1614/2117 symbols completed. SA took 1.1s. Estimated remaining: 2m 29s. Rate: 202.2 symbols/min [2025-09-05T19:16:40.860667] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:40.870469] [INFO ] [MAIN ] SAFE: Loaded 14774 primary data records. [2025-09-05T19:16:40.973935] [INFO ] [MAIN ] SAH: Loaded 10318 primary data records. [2025-09-05T19:16:41.268364] [INFO ] [MAIN ] SABA: Generated 870 derivative records from 4511 primary records. [2025-09-05T19:16:41.371698] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-05T19:16:41.373546] [INFO ] [MAIN ] Derivative Progress: 1615/2117 symbols completed. SABA took 0.9s. Estimated remaining: 2m 29s. Rate: 202.1 symbols/min [2025-09-05T19:16:41.374266] [INFO ] [MAIN ] SAJ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:41.378193] [INFO ] [MAIN ] SAJ: Loaded 367 primary data records. [2025-09-05T19:16:41.501166] [INFO ] [MAIN ] SAFE: Generated 871 derivative records from 14774 primary records. [2025-09-05T19:16:41.525042] [INFO ] [MAIN ] SAH: Generated 871 derivative records from 10318 primary records. [2025-09-05T19:16:41.593895] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-05T19:16:41.653296] [INFO ] [MAIN ] Derivative Progress: 1616/2117 symbols completed. SAFE took 1.0s. Estimated remaining: 2m 29s. Rate: 202.1 symbols/min [2025-09-05T19:16:41.654582] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:41.654522] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-05T19:16:41.656304] [INFO ] [MAIN ] Derivative Progress: 1617/2117 symbols completed. SAH took 0.8s. Estimated remaining: 2m 28s. Rate: 202.2 symbols/min [2025-09-05T19:16:41.656813] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:41.681873] [INFO ] [MAIN ] SAM: Loaded 16094 primary data records. [2025-09-05T19:16:41.682735] [INFO ] [MAIN ] SAJ: Generated 869 derivative records from 367 primary records. [2025-09-05T19:16:41.782576] [INFO ] [MAIN ] SAJ: Successfully saved derivative data. [2025-09-05T19:16:41.815127] [INFO ] [MAIN ] SAN: Loaded 25703 primary data records. [2025-09-05T19:16:41.814332] [INFO ] [MAIN ] Derivative Progress: 1618/2117 symbols completed. SAJ took 0.4s. Estimated remaining: 2m 28s. Rate: 202.3 symbols/min [2025-09-05T19:16:42.224419] [INFO ] [MAIN ] SAM: Generated 1352 derivative records from 16094 primary records. [2025-09-05T19:16:42.231294] [INFO ] [MAIN ] SAN: Generated 871 derivative records from 25703 primary records. [2025-09-05T19:16:42.249847] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-05T19:16:42.252540] [INFO ] [MAIN ] Derivative Progress: 1619/2117 symbols completed. SAN took 0.6s. Estimated remaining: 2m 28s. Rate: 202.2 symbols/min [2025-09-05T19:16:42.250971] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-05T19:16:42.254699] [INFO ] [MAIN ] Derivative Progress: 1620/2117 symbols completed. SAM took 0.6s. Estimated remaining: 2m 27s. Rate: 202.4 symbols/min [2025-09-05T19:16:42.255202] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:42.255120] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:42.255316] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:42.266189] [INFO ] [MAIN ] SAR: Loaded 8457 primary data records. [2025-09-05T19:16:42.417673] [INFO ] [MAIN ] SAP: Loaded 23801 primary data records. [2025-09-05T19:16:42.506744] [INFO ] [MAIN ] SAND: Loaded 25224 primary data records. [2025-09-05T19:16:43.008995] [INFO ] [MAIN ] SAR: Generated 871 derivative records from 8457 primary records. [2025-09-05T19:16:43.018837] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-05T19:16:43.020273] [INFO ] [MAIN ] Derivative Progress: 1621/2117 symbols completed. SAR took 0.8s. Estimated remaining: 2m 27s. Rate: 202.2 symbols/min [2025-09-05T19:16:43.020597] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:43.031968] [INFO ] [MAIN ] SAP: Generated 871 derivative records from 23801 primary records. [2025-09-05T19:16:43.047541] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-05T19:16:43.049960] [INFO ] [MAIN ] Derivative Progress: 1622/2117 symbols completed. SAP took 0.8s. Estimated remaining: 2m 27s. Rate: 202.3 symbols/min [2025-09-05T19:16:43.050129] [INFO ] [MAIN ] SAT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:43.048396] [INFO ] [MAIN ] SAND: Generated 871 derivative records from 25224 primary records. [2025-09-05T19:16:43.061091] [INFO ] [MAIN ] SAT: Loaded 506 primary data records. [2025-09-05T19:16:43.082235] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-05T19:16:43.109513] [INFO ] [MAIN ] Derivative Progress: 1623/2117 symbols completed. SAND took 0.9s. Estimated remaining: 2m 26s. Rate: 202.4 symbols/min [2025-09-05T19:16:43.148785] [INFO ] [MAIN ] SAY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:43.206859] [INFO ] [MAIN ] SARO: Loaded 36524 primary data records. [2025-09-05T19:16:43.218904] [INFO ] [MAIN ] SAY: Loaded 478 primary data records. [2025-09-05T19:16:43.903391] [INFO ] [MAIN ] SAT: Generated 869 derivative records from 506 primary records. [2025-09-05T19:16:43.922208] [INFO ] [MAIN ] SAT: Successfully saved derivative data. [2025-09-05T19:16:43.923789] [INFO ] [MAIN ] Derivative Progress: 1624/2117 symbols completed. SAT took 0.9s. Estimated remaining: 2m 26s. Rate: 202.2 symbols/min [2025-09-05T19:16:43.922300] [INFO ] [MAIN ] SAY: Generated 870 derivative records from 478 primary records. [2025-09-05T19:16:43.924132] [INFO ] [MAIN ] SAZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:43.932494] [INFO ] [MAIN ] SAY: Successfully saved derivative data. [2025-09-05T19:16:43.934292] [INFO ] [MAIN ] Derivative Progress: 1625/2117 symbols completed. SAY took 0.8s. Estimated remaining: 2m 26s. Rate: 202.3 symbols/min [2025-09-05T19:16:43.937115] [INFO ] [MAIN ] SAZ: Loaded 1011 primary data records. [2025-09-05T19:16:43.949921] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:44.050010] [INFO ] [MAIN ] SARO: Generated 1352 derivative records from 36524 primary records. [2025-09-05T19:16:44.148472] [INFO ] [MAIN ] SB: Loaded 15918 primary data records. [2025-09-05T19:16:44.168250] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-05T19:16:44.201748] [INFO ] [MAIN ] Derivative Progress: 1626/2117 symbols completed. SARO took 1.2s. Estimated remaining: 2m 26s. Rate: 202.3 symbols/min [2025-09-05T19:16:44.286910] [INFO ] [MAIN ] SBDS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:44.368114] [INFO ] [MAIN ] SBDS: Loaded 663 primary data records. [2025-09-05T19:16:44.747053] [INFO ] [MAIN ] SAZ: Generated 1349 derivative records from 1011 primary records. [2025-09-05T19:16:44.762329] [INFO ] [MAIN ] SBDS: Generated 403 derivative records from 663 primary records. [2025-09-05T19:16:44.765409] [INFO ] [MAIN ] SAZ: Successfully saved derivative data. [2025-09-05T19:16:44.767805] [INFO ] [MAIN ] Derivative Progress: 1627/2117 symbols completed. SAZ took 0.8s. Estimated remaining: 2m 25s. Rate: 202.2 symbols/min [2025-09-05T19:16:44.768059] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:44.778297] [INFO ] [MAIN ] SBDS: Successfully saved derivative data. [2025-09-05T19:16:44.779301] [INFO ] [MAIN ] SB: Generated 871 derivative records from 15918 primary records. [2025-09-05T19:16:44.780312] [INFO ] [MAIN ] Derivative Progress: 1628/2117 symbols completed. SBDS took 0.5s. Estimated remaining: 2m 25s. Rate: 202.3 symbols/min [2025-09-05T19:16:44.780930] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:44.791689] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-05T19:16:44.793422] [INFO ] [MAIN ] Derivative Progress: 1629/2117 symbols completed. SB took 0.9s. Estimated remaining: 2m 25s. Rate: 202.4 symbols/min [2025-09-05T19:16:44.799786] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:44.803017] [INFO ] [MAIN ] SBI: Loaded 3898 primary data records. [2025-09-05T19:16:44.884586] [INFO ] [MAIN ] SBR: Loaded 3644 primary data records. [2025-09-05T19:16:44.987970] [INFO ] [MAIN ] SBH: Loaded 23921 primary data records. [2025-09-05T19:16:45.554743] [INFO ] [MAIN ] SBI: Generated 871 derivative records from 3898 primary records. [2025-09-05T19:16:45.562603] [INFO ] [MAIN ] SBR: Generated 871 derivative records from 3644 primary records. [2025-09-05T19:16:45.571811] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-05T19:16:45.573306] [INFO ] [MAIN ] Derivative Progress: 1630/2117 symbols completed. SBI took 0.8s. Estimated remaining: 2m 24s. Rate: 202.2 symbols/min [2025-09-05T19:16:45.579738] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:45.586345] [INFO ] [MAIN ] SBH: Generated 871 derivative records from 23921 primary records. [2025-09-05T19:16:45.588798] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-05T19:16:45.590661] [INFO ] [MAIN ] Derivative Progress: 1631/2117 symbols completed. SBR took 0.8s. Estimated remaining: 2m 24s. Rate: 202.3 symbols/min [2025-09-05T19:16:45.590887] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:45.599329] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-05T19:16:45.601036] [INFO ] [MAIN ] Derivative Progress: 1632/2117 symbols completed. SBH took 0.8s. Estimated remaining: 2m 24s. Rate: 202.5 symbols/min [2025-09-05T19:16:45.601399] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:45.616558] [INFO ] [MAIN ] SBSI: Loaded 7104 primary data records. [2025-09-05T19:16:45.689114] [INFO ] [MAIN ] SBS: Loaded 23685 primary data records. [2025-09-05T19:16:45.860604] [INFO ] [MAIN ] SBSW: Loaded 25842 primary data records. [2025-09-05T19:16:46.412144] [INFO ] [MAIN ] SBSI: Generated 871 derivative records from 7104 primary records. [2025-09-05T19:16:46.430251] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-05T19:16:46.431849] [INFO ] [MAIN ] Derivative Progress: 1633/2117 symbols completed. SBSI took 0.8s. Estimated remaining: 2m 24s. Rate: 202.2 symbols/min [2025-09-05T19:16:46.433598] [INFO ] [MAIN ] SBS: Generated 871 derivative records from 23685 primary records. [2025-09-05T19:16:46.443113] [INFO ] [MAIN ] SBSW: Generated 871 derivative records from 25842 primary records. [2025-09-05T19:16:46.457723] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-05T19:16:46.460660] [INFO ] [MAIN ] Derivative Progress: 1634/2117 symbols completed. SBS took 0.9s. Estimated remaining: 2m 23s. Rate: 202.3 symbols/min [2025-09-05T19:16:46.461523] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-05T19:16:46.463213] [INFO ] [MAIN ] Derivative Progress: 1635/2117 symbols completed. SBSW took 0.9s. Estimated remaining: 2m 23s. Rate: 202.5 symbols/min [2025-09-05T19:16:46.463726] [INFO ] [MAIN ] SBXD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:46.463834] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:46.463899] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:46.471800] [INFO ] [MAIN ] SBXD: Loaded 2804 primary data records. [2025-09-05T19:16:46.549981] [INFO ] [MAIN ] SCD: Loaded 8204 primary data records. [2025-09-05T19:16:46.915554] [INFO ] [MAIN ] SCCO: Loaded 36913 primary data records. [2025-09-05T19:16:47.315255] [INFO ] [MAIN ] SBXD: Generated 1342 derivative records from 2804 primary records. [2025-09-05T19:16:47.329604] [INFO ] [MAIN ] SBXD: Successfully saved derivative data. [2025-09-05T19:16:47.333090] [INFO ] [MAIN ] Derivative Progress: 1636/2117 symbols completed. SBXD took 0.9s. Estimated remaining: 2m 23s. Rate: 202.2 symbols/min [2025-09-05T19:16:47.333477] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:47.341226] [INFO ] [MAIN ] SCD: Generated 871 derivative records from 8204 primary records. [2025-09-05T19:16:47.351622] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-05T19:16:47.353623] [INFO ] [MAIN ] Derivative Progress: 1637/2117 symbols completed. SCD took 0.9s. Estimated remaining: 2m 22s. Rate: 202.3 symbols/min [2025-09-05T19:16:47.353935] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:47.377387] [INFO ] [MAIN ] SCCO: Generated 1352 derivative records from 36913 primary records. [2025-09-05T19:16:47.400879] [INFO ] [MAIN ] SCHW: Loaded 26057 primary data records. [2025-09-05T19:16:47.466247] [INFO ] [MAIN ] SCI: Loaded 22233 primary data records. [2025-09-05T19:16:47.549592] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-05T19:16:47.584238] [INFO ] [MAIN ] Derivative Progress: 1638/2117 symbols completed. SCCO took 1.1s. Estimated remaining: 2m 22s. Rate: 202.4 symbols/min [2025-09-05T19:16:47.605865] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:47.829383] [INFO ] [MAIN ] SCL: Loaded 6541 primary data records. [2025-09-05T19:16:48.178352] [INFO ] [MAIN ] SCHW: Generated 871 derivative records from 26057 primary records. [2025-09-05T19:16:48.190699] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-05T19:16:48.195922] [INFO ] [MAIN ] Derivative Progress: 1639/2117 symbols completed. SCHW took 0.9s. Estimated remaining: 2m 22s. Rate: 202.2 symbols/min [2025-09-05T19:16:48.202706] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:48.206593] [INFO ] [MAIN ] SCI: Generated 871 derivative records from 22233 primary records. [2025-09-05T19:16:48.217819] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-05T19:16:48.222252] [INFO ] [MAIN ] Derivative Progress: 1640/2117 symbols completed. SCI took 0.9s. Estimated remaining: 2m 21s. Rate: 202.4 symbols/min [2025-09-05T19:16:48.222600] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:48.228185] [INFO ] [MAIN ] SCM: Loaded 8910 primary data records. [2025-09-05T19:16:48.323563] [INFO ] [MAIN ] SCL: Generated 871 derivative records from 6541 primary records. [2025-09-05T19:16:48.393110] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-05T19:16:48.415986] [INFO ] [MAIN ] Derivative Progress: 1641/2117 symbols completed. SCL took 0.8s. Estimated remaining: 2m 21s. Rate: 202.4 symbols/min [2025-09-05T19:16:48.444140] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:48.516119] [INFO ] [MAIN ] SCS: Loaded 31842 primary data records. [2025-09-05T19:16:48.614457] [INFO ] [MAIN ] SD: Loaded 13892 primary data records. [2025-09-05T19:16:49.016582] [INFO ] [MAIN ] SCM: Generated 871 derivative records from 8910 primary records. [2025-09-05T19:16:49.103592] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-05T19:16:49.105369] [INFO ] [MAIN ] Derivative Progress: 1642/2117 symbols completed. SCM took 0.9s. Estimated remaining: 2m 21s. Rate: 202.2 symbols/min [2025-09-05T19:16:49.105887] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:49.114792] [INFO ] [MAIN ] SDHC: Loaded 5272 primary data records. [2025-09-05T19:16:49.237753] [INFO ] [MAIN ] SD: Generated 871 derivative records from 13892 primary records. [2025-09-05T19:16:49.287085] [INFO ] [MAIN ] SCS: Generated 1351 derivative records from 31842 primary records. [2025-09-05T19:16:49.383531] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-05T19:16:49.389890] [INFO ] [MAIN ] Derivative Progress: 1643/2117 symbols completed. SD took 1.0s. Estimated remaining: 2m 21s. Rate: 202.2 symbols/min [2025-09-05T19:16:49.390175] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:49.394428] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-05T19:16:49.397339] [INFO ] [MAIN ] Derivative Progress: 1644/2117 symbols completed. SCS took 1.2s. Estimated remaining: 2m 20s. Rate: 202.4 symbols/min [2025-09-05T19:16:49.399500] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:49.405195] [INFO ] [MAIN ] SDHY: Loaded 4979 primary data records. [2025-09-05T19:16:49.599960] [INFO ] [MAIN ] SDRL: Loaded 20389 primary data records. [2025-09-05T19:16:49.607109] [INFO ] [MAIN ] SDHC: Generated 871 derivative records from 5272 primary records. [2025-09-05T19:16:49.776450] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-05T19:16:49.789152] [INFO ] [MAIN ] Derivative Progress: 1645/2117 symbols completed. SDHC took 0.7s. Estimated remaining: 2m 20s. Rate: 202.3 symbols/min [2025-09-05T19:16:49.855529] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:49.935311] [INFO ] [MAIN ] SDHY: Generated 871 derivative records from 4979 primary records. [2025-09-05T19:16:49.954667] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-05T19:16:49.956779] [INFO ] [MAIN ] Derivative Progress: 1646/2117 symbols completed. SDHY took 0.6s. Estimated remaining: 2m 20s. Rate: 202.4 symbols/min [2025-09-05T19:16:49.965506] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:49.969163] [INFO ] [MAIN ] SE: Loaded 25898 primary data records. [2025-09-05T19:16:50.001372] [INFO ] [MAIN ] SDRL: Generated 871 derivative records from 20389 primary records. [2025-09-05T19:16:50.127256] [INFO ] [MAIN ] SEE: Loaded 22499 primary data records. [2025-09-05T19:16:50.149357] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-05T19:16:50.182001] [INFO ] [MAIN ] Derivative Progress: 1647/2117 symbols completed. SDRL took 0.8s. Estimated remaining: 2m 19s. Rate: 202.4 symbols/min [2025-09-05T19:16:50.289986] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:50.516286] [INFO ] [MAIN ] SEI: Loaded 23766 primary data records. [2025-09-05T19:16:50.567972] [INFO ] [MAIN ] SE: Generated 871 derivative records from 25898 primary records. [2025-09-05T19:16:50.649934] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-05T19:16:50.662392] [INFO ] [MAIN ] Derivative Progress: 1648/2117 symbols completed. SE took 0.8s. Estimated remaining: 2m 19s. Rate: 202.3 symbols/min [2025-09-05T19:16:50.803054] [INFO ] [MAIN ] SEE: Generated 871 derivative records from 22499 primary records. [2025-09-05T19:16:50.871548] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-05T19:16:50.876493] [INFO ] [MAIN ] Derivative Progress: 1649/2117 symbols completed. SEE took 0.9s. Estimated remaining: 2m 19s. Rate: 202.4 symbols/min [2025-09-05T19:16:50.894632] [INFO ] [MAIN ] SEI: Generated 871 derivative records from 23766 primary records. [2025-09-05T19:16:50.908828] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-05T19:16:50.910954] [INFO ] [MAIN ] Derivative Progress: 1650/2117 symbols completed. SEI took 0.7s. Estimated remaining: 2m 18s. Rate: 202.5 symbols/min [2025-09-05T19:16:50.912116] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:50.911778] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:50.911946] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:50.970443] [INFO ] [MAIN ] SEMR: Loaded 20695 primary data records. [2025-09-05T19:16:50.973237] [INFO ] [MAIN ] SEM: Loaded 21192 primary data records. [2025-09-05T19:16:51.132874] [INFO ] [MAIN ] SES: Loaded 24651 primary data records. [2025-09-05T19:16:52.077120] [INFO ] [MAIN ] SEMR: Generated 871 derivative records from 20695 primary records. [2025-09-05T19:16:52.085661] [INFO ] [MAIN ] SEM: Generated 871 derivative records from 21192 primary records. [2025-09-05T19:16:52.110336] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-05T19:16:52.110026] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-05T19:16:52.111827] [INFO ] [MAIN ] Derivative Progress: 1651/2117 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 18s. Rate: 202.1 symbols/min [2025-09-05T19:16:52.114222] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:52.116624] [INFO ] [MAIN ] Derivative Progress: 1652/2117 symbols completed. SEM took 1.2s. Estimated remaining: 2m 18s. Rate: 202.2 symbols/min [2025-09-05T19:16:52.118312] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:52.130197] [INFO ] [MAIN ] SES: Generated 871 derivative records from 24651 primary records. [2025-09-05T19:16:52.134941] [INFO ] [MAIN ] SFB: Loaded 1758 primary data records. [2025-09-05T19:16:52.249298] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-05T19:16:52.252209] [INFO ] [MAIN ] Derivative Progress: 1653/2117 symbols completed. SES took 1.3s. Estimated remaining: 2m 18s. Rate: 202.3 symbols/min [2025-09-05T19:16:52.249918] [INFO ] [MAIN ] SF: Loaded 19396 primary data records. [2025-09-05T19:16:52.257814] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:52.550010] [INFO ] [MAIN ] SFBS: Loaded 10297 primary data records. [2025-09-05T19:16:52.953311] [INFO ] [MAIN ] SFB: Generated 871 derivative records from 1758 primary records. [2025-09-05T19:16:52.966607] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-05T19:16:52.968460] [INFO ] [MAIN ] Derivative Progress: 1654/2117 symbols completed. SFB took 0.9s. Estimated remaining: 2m 17s. Rate: 202.1 symbols/min [2025-09-05T19:16:52.975866] [INFO ] [MAIN ] SF: Generated 871 derivative records from 19396 primary records. [2025-09-05T19:16:52.976947] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:52.985873] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-05T19:16:52.987920] [INFO ] [MAIN ] Derivative Progress: 1655/2117 symbols completed. SF took 0.9s. Estimated remaining: 2m 17s. Rate: 202.2 symbols/min [2025-09-05T19:16:52.988130] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:53.003616] [INFO ] [MAIN ] SFBS: Generated 871 derivative records from 10297 primary records. [2025-09-05T19:16:53.027304] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-05T19:16:53.029107] [INFO ] [MAIN ] Derivative Progress: 1656/2117 symbols completed. SFBS took 0.8s. Estimated remaining: 2m 17s. Rate: 202.3 symbols/min [2025-09-05T19:16:53.029457] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:53.039778] [INFO ] [MAIN ] SFL: Loaded 21536 primary data records. [2025-09-05T19:16:53.091502] [INFO ] [MAIN ] SG: Loaded 25967 primary data records. [2025-09-05T19:16:53.342270] [INFO ] [MAIN ] SGHC: Loaded 22757 primary data records. [2025-09-05T19:16:53.807056] [INFO ] [MAIN ] SFL: Generated 871 derivative records from 21536 primary records. [2025-09-05T19:16:53.815085] [INFO ] [MAIN ] SG: Generated 871 derivative records from 25967 primary records. [2025-09-05T19:16:53.823662] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-05T19:16:53.832746] [INFO ] [MAIN ] Derivative Progress: 1657/2117 symbols completed. SFL took 0.9s. Estimated remaining: 2m 17s. Rate: 202.1 symbols/min [2025-09-05T19:16:53.831423] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-05T19:16:53.835019] [INFO ] [MAIN ] Derivative Progress: 1658/2117 symbols completed. SG took 0.8s. Estimated remaining: 2m 16s. Rate: 202.2 symbols/min [2025-09-05T19:16:53.833391] [INFO ] [MAIN ] SGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:53.835986] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:53.847061] [INFO ] [MAIN ] SGHC: Generated 871 derivative records from 22757 primary records. [2025-09-05T19:16:53.857805] [INFO ] [MAIN ] SGU: Loaded 3702 primary data records. [2025-09-05T19:16:53.918249] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-05T19:16:53.958200] [INFO ] [MAIN ] Derivative Progress: 1659/2117 symbols completed. SGHC took 0.9s. Estimated remaining: 2m 16s. Rate: 202.3 symbols/min [2025-09-05T19:16:54.002508] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:54.061877] [INFO ] [MAIN ] SGI: Loaded 25125 primary data records. [2025-09-05T19:16:54.411195] [INFO ] [MAIN ] SHAK: Loaded 36835 primary data records. [2025-09-05T19:16:54.603279] [INFO ] [MAIN ] SGU: Generated 871 derivative records from 3702 primary records. [2025-09-05T19:16:54.706319] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-05T19:16:54.707830] [INFO ] [MAIN ] Derivative Progress: 1660/2117 symbols completed. SGU took 0.9s. Estimated remaining: 2m 16s. Rate: 202.1 symbols/min [2025-09-05T19:16:54.714840] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:54.716889] [INFO ] [MAIN ] SGI: Generated 871 derivative records from 25125 primary records. [2025-09-05T19:16:54.728176] [INFO ] [MAIN ] SGI: Successfully saved derivative data. [2025-09-05T19:16:54.730044] [INFO ] [MAIN ] Derivative Progress: 1661/2117 symbols completed. SGI took 0.9s. Estimated remaining: 2m 15s. Rate: 202.2 symbols/min [2025-09-05T19:16:54.730554] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:54.748265] [INFO ] [MAIN ] SHCO: Loaded 18578 primary data records. [2025-09-05T19:16:54.837687] [INFO ] [MAIN ] SHAK: Generated 1352 derivative records from 36835 primary records. [2025-09-05T19:16:54.944281] [INFO ] [MAIN ] SHEL: Loaded 26001 primary data records. [2025-09-05T19:16:54.999915] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-05T19:16:55.174576] [INFO ] [MAIN ] Derivative Progress: 1662/2117 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 15s. Rate: 202.2 symbols/min [2025-09-05T19:16:55.230067] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:55.396591] [INFO ] [MAIN ] SHG: Loaded 12212 primary data records. [2025-09-05T19:16:55.664598] [INFO ] [MAIN ] SHCO: Generated 1352 derivative records from 18578 primary records. [2025-09-05T19:16:55.686482] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-05T19:16:55.690293] [INFO ] [MAIN ] Derivative Progress: 1663/2117 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 15s. Rate: 202.1 symbols/min [2025-09-05T19:16:55.688081] [INFO ] [MAIN ] SHEL: Generated 871 derivative records from 26001 primary records. [2025-09-05T19:16:55.699419] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-05T19:16:55.701139] [INFO ] [MAIN ] Derivative Progress: 1664/2117 symbols completed. SHEL took 1.0s. Estimated remaining: 2m 14s. Rate: 202.2 symbols/min [2025-09-05T19:16:55.709901] [INFO ] [MAIN ] SHG: Generated 871 derivative records from 12212 primary records. [2025-09-05T19:16:55.717731] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-05T19:16:55.719307] [INFO ] [MAIN ] Derivative Progress: 1665/2117 symbols completed. SHG took 0.5s. Estimated remaining: 2m 14s. Rate: 202.3 symbols/min [2025-09-05T19:16:55.719905] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:55.720053] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:55.720408] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:55.724258] [INFO ] [MAIN ] SHOC: Loaded 1441 primary data records. [2025-09-05T19:16:55.924656] [INFO ] [MAIN ] SHO: Loaded 23860 primary data records. [2025-09-05T19:16:56.114366] [INFO ] [MAIN ] SHW: Loaded 37730 primary data records. [2025-09-05T19:16:56.531033] [INFO ] [MAIN ] SHOC: Generated 870 derivative records from 1441 primary records. [2025-09-05T19:16:56.545201] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-05T19:16:56.547049] [INFO ] [MAIN ] Derivative Progress: 1666/2117 symbols completed. SHOC took 0.8s. Estimated remaining: 2m 14s. Rate: 202.1 symbols/min [2025-09-05T19:16:56.554403] [INFO ] [MAIN ] SI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:56.556339] [INFO ] [MAIN ] SHO: Generated 871 derivative records from 23860 primary records. [2025-09-05T19:16:56.572189] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-05T19:16:56.573628] [INFO ] [MAIN ] Derivative Progress: 1667/2117 symbols completed. SHO took 0.9s. Estimated remaining: 2m 14s. Rate: 202.2 symbols/min [2025-09-05T19:16:56.570177] [INFO ] [MAIN ] SI: Loaded 3942 primary data records. [2025-09-05T19:16:56.574082] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:56.800156] [INFO ] [MAIN ] SHW: Generated 1352 derivative records from 37730 primary records. [2025-09-05T19:16:56.801888] [INFO ] [MAIN ] SID: Loaded 20746 primary data records. [2025-09-05T19:16:56.860508] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-05T19:16:56.880861] [INFO ] [MAIN ] Derivative Progress: 1668/2117 symbols completed. SHW took 1.2s. Estimated remaining: 2m 13s. Rate: 202.2 symbols/min [2025-09-05T19:16:56.912773] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:57.041891] [INFO ] [MAIN ] SI: Generated 333 derivative records from 3942 primary records. [2025-09-05T19:16:57.120432] [INFO ] [MAIN ] SI: Successfully saved derivative data. [2025-09-05T19:16:57.121498] [INFO ] [MAIN ] Derivative Progress: 1669/2117 symbols completed. SI took 0.6s. Estimated remaining: 2m 13s. Rate: 202.2 symbols/min [2025-09-05T19:16:57.122999] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:57.133173] [INFO ] [MAIN ] SIG: Loaded 22240 primary data records. [2025-09-05T19:16:57.339117] [INFO ] [MAIN ] SII: Loaded 18133 primary data records. [2025-09-05T19:16:57.511662] [INFO ] [MAIN ] SID: Generated 871 derivative records from 20746 primary records. [2025-09-05T19:16:57.755911] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-05T19:16:57.758712] [INFO ] [MAIN ] Derivative Progress: 1670/2117 symbols completed. SID took 1.2s. Estimated remaining: 2m 13s. Rate: 202.1 symbols/min [2025-09-05T19:16:57.759191] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:57.772863] [INFO ] [MAIN ] SIG: Generated 871 derivative records from 22240 primary records. [2025-09-05T19:16:57.783896] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-05T19:16:57.785840] [INFO ] [MAIN ] Derivative Progress: 1671/2117 symbols completed. SIG took 0.9s. Estimated remaining: 2m 12s. Rate: 202.2 symbols/min [2025-09-05T19:16:57.786593] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:57.817033] [INFO ] [MAIN ] SII: Generated 1352 derivative records from 18133 primary records. [2025-09-05T19:16:57.837898] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-05T19:16:57.857175] [INFO ] [MAIN ] Derivative Progress: 1672/2117 symbols completed. SII took 0.7s. Estimated remaining: 2m 12s. Rate: 202.3 symbols/min [2025-09-05T19:16:57.857685] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:57.860012] [INFO ] [MAIN ] SITC: Loaded 30861 primary data records. [2025-09-05T19:16:57.911894] [INFO ] [MAIN ] SITE: Loaded 26316 primary data records. [2025-09-05T19:16:58.289382] [INFO ] [MAIN ] SJM: Loaded 37749 primary data records. [2025-09-05T19:16:58.840301] [INFO ] [MAIN ] SITE: Generated 1352 derivative records from 26316 primary records. [2025-09-05T19:16:58.841538] [INFO ] [MAIN ] SITC: Generated 1352 derivative records from 30861 primary records. [2025-09-05T19:16:58.865102] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-05T19:16:58.869840] [INFO ] [MAIN ] Derivative Progress: 1673/2117 symbols completed. SITE took 1.1s. Estimated remaining: 2m 12s. Rate: 202.0 symbols/min [2025-09-05T19:16:58.870320] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:58.875535] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-05T19:16:58.878554] [INFO ] [MAIN ] Derivative Progress: 1674/2117 symbols completed. SITC took 1.1s. Estimated remaining: 2m 12s. Rate: 202.1 symbols/min [2025-09-05T19:16:58.879226] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:58.892761] [INFO ] [MAIN ] SJT: Loaded 10342 primary data records. [2025-09-05T19:16:58.903949] [INFO ] [MAIN ] SJM: Generated 1352 derivative records from 37749 primary records. [2025-09-05T19:16:59.026792] [INFO ] [MAIN ] SKE: Loaded 26255 primary data records. [2025-09-05T19:16:59.048549] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-05T19:16:59.056845] [INFO ] [MAIN ] Derivative Progress: 1675/2117 symbols completed. SJM took 1.2s. Estimated remaining: 2m 11s. Rate: 202.2 symbols/min [2025-09-05T19:16:59.057126] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:59.254375] [INFO ] [MAIN ] SKIL: Loaded 3209 primary data records. [2025-09-05T19:16:59.742159] [INFO ] [MAIN ] SJT: Generated 871 derivative records from 10342 primary records. [2025-09-05T19:16:59.751884] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-05T19:16:59.753969] [INFO ] [MAIN ] Derivative Progress: 1676/2117 symbols completed. SJT took 0.9s. Estimated remaining: 2m 11s. Rate: 202.0 symbols/min [2025-09-05T19:16:59.754248] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:59.768845] [INFO ] [MAIN ] SKIL: Generated 871 derivative records from 3209 primary records. [2025-09-05T19:16:59.774828] [INFO ] [MAIN ] SKLZ: Loaded 8790 primary data records. [2025-09-05T19:16:59.821172] [INFO ] [MAIN ] SKE: Generated 1352 derivative records from 26255 primary records. [2025-09-05T19:16:59.855599] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-05T19:16:59.869099] [INFO ] [MAIN ] Derivative Progress: 1677/2117 symbols completed. SKIL took 0.8s. Estimated remaining: 2m 11s. Rate: 202.1 symbols/min [2025-09-05T19:16:59.874405] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:16:59.907672] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-05T19:16:59.915905] [INFO ] [MAIN ] Derivative Progress: 1678/2117 symbols completed. SKE took 1.0s. Estimated remaining: 2m 10s. Rate: 202.2 symbols/min [2025-09-05T19:17:00.051448] [INFO ] [MAIN ] SKM: Loaded 16629 primary data records. [2025-09-05T19:17:00.402545] [INFO ] [MAIN ] SKLZ: Generated 1352 derivative records from 8790 primary records. [2025-09-05T19:17:00.416388] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-05T19:17:00.418661] [INFO ] [MAIN ] Derivative Progress: 1679/2117 symbols completed. SKLZ took 0.7s. Estimated remaining: 2m 10s. Rate: 202.1 symbols/min [2025-09-05T19:17:00.425776] [INFO ] [MAIN ] SKM: Generated 871 derivative records from 16629 primary records. [2025-09-05T19:17:00.433629] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-05T19:17:00.435118] [INFO ] [MAIN ] Derivative Progress: 1680/2117 symbols completed. SKM took 0.6s. Estimated remaining: 2m 10s. Rate: 202.2 symbols/min [2025-09-05T19:17:00.435597] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:00.435550] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:00.435734] [INFO ] [MAIN ] SKX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:00.486393] [INFO ] [MAIN ] SKT: Loaded 20286 primary data records. [2025-09-05T19:17:00.537966] [INFO ] [MAIN ] SKY: Loaded 28672 primary data records. [2025-09-05T19:17:00.784591] [INFO ] [MAIN ] SKX: Loaded 38368 primary data records. [2025-09-05T19:17:01.373485] [INFO ] [MAIN ] SKT: Generated 871 derivative records from 20286 primary records. [2025-09-05T19:17:01.387098] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-05T19:17:01.388844] [INFO ] [MAIN ] Derivative Progress: 1681/2117 symbols completed. SKT took 1.0s. Estimated remaining: 2m 10s. Rate: 201.9 symbols/min [2025-09-05T19:17:01.389359] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:01.400952] [INFO ] [MAIN ] SKY: Generated 1352 derivative records from 28672 primary records. [2025-09-05T19:17:01.419676] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-05T19:17:01.429389] [INFO ] [MAIN ] SKYH: Loaded 12018 primary data records. [2025-09-05T19:17:01.428876] [INFO ] [MAIN ] Derivative Progress: 1682/2117 symbols completed. SKY took 1.0s. Estimated remaining: 2m 9s. Rate: 202.0 symbols/min [2025-09-05T19:17:01.429738] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:01.480689] [INFO ] [MAIN ] SKX: Generated 1352 derivative records from 38368 primary records. [2025-09-05T19:17:01.735728] [INFO ] [MAIN ] SKX: Successfully saved derivative data. [2025-09-05T19:17:01.755799] [INFO ] [MAIN ] Derivative Progress: 1683/2117 symbols completed. SKX took 1.3s. Estimated remaining: 2m 9s. Rate: 202.0 symbols/min [2025-09-05T19:17:01.756159] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:01.757535] [INFO ] [MAIN ] SLB: Loaded 26069 primary data records. [2025-09-05T19:17:01.972535] [INFO ] [MAIN ] SLF: Loaded 19434 primary data records. [2025-09-05T19:17:02.201702] [INFO ] [MAIN ] SKYH: Generated 1352 derivative records from 12018 primary records. [2025-09-05T19:17:02.308399] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-05T19:17:02.310906] [INFO ] [MAIN ] Derivative Progress: 1684/2117 symbols completed. SKYH took 0.9s. Estimated remaining: 2m 9s. Rate: 201.9 symbols/min [2025-09-05T19:17:02.312137] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:02.328695] [INFO ] [MAIN ] SLB: Generated 871 derivative records from 26069 primary records. [2025-09-05T19:17:02.364490] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-05T19:17:02.366292] [INFO ] [MAIN ] SLF: Generated 871 derivative records from 19434 primary records. [2025-09-05T19:17:02.368385] [INFO ] [MAIN ] Derivative Progress: 1685/2117 symbols completed. SLB took 0.9s. Estimated remaining: 2m 8s. Rate: 202.0 symbols/min [2025-09-05T19:17:02.369362] [INFO ] [MAIN ] SLG: Loaded 22423 primary data records. [2025-09-05T19:17:02.369460] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:02.476958] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-05T19:17:02.499148] [INFO ] [MAIN ] Derivative Progress: 1686/2117 symbols completed. SLF took 0.7s. Estimated remaining: 2m 8s. Rate: 202.1 symbols/min [2025-09-05T19:17:02.499522] [INFO ] [MAIN ] SLNZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:02.558804] [INFO ] [MAIN ] SLNZ: Loaded 383 primary data records. [2025-09-05T19:17:02.573251] [INFO ] [MAIN ] SLGN: Loaded 19314 primary data records. [2025-09-05T19:17:03.198091] [INFO ] [MAIN ] SLG: Generated 871 derivative records from 22423 primary records. [2025-09-05T19:17:03.209678] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-05T19:17:03.213907] [INFO ] [MAIN ] Derivative Progress: 1687/2117 symbols completed. SLG took 0.9s. Estimated remaining: 2m 8s. Rate: 201.9 symbols/min [2025-09-05T19:17:03.221056] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:03.222115] [INFO ] [MAIN ] SLNZ: Generated 869 derivative records from 383 primary records. [2025-09-05T19:17:03.238117] [INFO ] [MAIN ] SLGN: Generated 871 derivative records from 19314 primary records. [2025-09-05T19:17:03.244283] [INFO ] [MAIN ] SLNZ: Successfully saved derivative data. [2025-09-05T19:17:03.245967] [INFO ] [MAIN ] Derivative Progress: 1688/2117 symbols completed. SLNZ took 0.7s. Estimated remaining: 2m 7s. Rate: 202.0 symbols/min [2025-09-05T19:17:03.248272] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:03.250209] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-05T19:17:03.253065] [INFO ] [MAIN ] Derivative Progress: 1689/2117 symbols completed. SLGN took 0.9s. Estimated remaining: 2m 7s. Rate: 202.1 symbols/min [2025-09-05T19:17:03.253482] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:03.275856] [INFO ] [MAIN ] SLQT: Loaded 21490 primary data records. [2025-09-05T19:17:03.312272] [INFO ] [MAIN ] SLVM: Loaded 13367 primary data records. [2025-09-05T19:17:03.592233] [INFO ] [MAIN ] SM: Loaded 25301 primary data records. [2025-09-05T19:17:04.085169] [INFO ] [MAIN ] SLQT: Generated 871 derivative records from 21490 primary records. [2025-09-05T19:17:04.085899] [INFO ] [MAIN ] SLVM: Generated 871 derivative records from 13367 primary records. [2025-09-05T19:17:04.102776] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-05T19:17:04.106469] [INFO ] [MAIN ] Derivative Progress: 1690/2117 symbols completed. SLVM took 0.9s. Estimated remaining: 2m 7s. Rate: 201.9 symbols/min [2025-09-05T19:17:04.104572] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-05T19:17:04.107104] [INFO ] [MAIN ] SMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:04.108506] [INFO ] [MAIN ] Derivative Progress: 1691/2117 symbols completed. SLQT took 0.9s. Estimated remaining: 2m 7s. Rate: 202.0 symbols/min [2025-09-05T19:17:04.108865] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:04.122743] [INFO ] [MAIN ] SM: Generated 871 derivative records from 25301 primary records. [2025-09-05T19:17:04.133432] [INFO ] [MAIN ] SMBK: Loaded 6212 primary data records. [2025-09-05T19:17:04.209495] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-05T19:17:04.245695] [INFO ] [MAIN ] Derivative Progress: 1692/2117 symbols completed. SM took 1.0s. Estimated remaining: 2m 6s. Rate: 202.1 symbols/min [2025-09-05T19:17:04.260235] [INFO ] [MAIN ] SMA: Loaded 16489 primary data records. [2025-09-05T19:17:04.260525] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:04.415685] [INFO ] [MAIN ] SMC: Loaded 5551 primary data records. [2025-09-05T19:17:05.053341] [INFO ] [MAIN ] SMBK: Generated 1352 derivative records from 6212 primary records. [2025-09-05T19:17:05.080513] [INFO ] [MAIN ] SMA: Generated 871 derivative records from 16489 primary records. [2025-09-05T19:17:05.090177] [INFO ] [MAIN ] SMC: Generated 871 derivative records from 5551 primary records. [2025-09-05T19:17:05.091469] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-05T19:17:05.095782] [INFO ] [MAIN ] Derivative Progress: 1693/2117 symbols completed. SMBK took 1.0s. Estimated remaining: 2m 6s. Rate: 201.9 symbols/min [2025-09-05T19:17:05.112074] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-05T19:17:05.113396] [INFO ] [MAIN ] SMA: Successfully saved derivative data. [2025-09-05T19:17:05.115675] [INFO ] [MAIN ] Derivative Progress: 1694/2117 symbols completed. SMA took 1.0s. Estimated remaining: 2m 6s. Rate: 202.0 symbols/min [2025-09-05T19:17:05.117824] [INFO ] [MAIN ] Derivative Progress: 1695/2117 symbols completed. SMC took 0.9s. Estimated remaining: 2m 5s. Rate: 202.1 symbols/min [2025-09-05T19:17:05.118312] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:05.119196] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:05.118737] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:05.131248] [INFO ] [MAIN ] SMHI: Loaded 6179 primary data records. [2025-09-05T19:17:05.280601] [INFO ] [MAIN ] SMFG: Loaded 23049 primary data records. [2025-09-05T19:17:05.280707] [INFO ] [MAIN ] SMG: Loaded 20620 primary data records. [2025-09-05T19:17:05.999177] [INFO ] [MAIN ] SMHI: Generated 871 derivative records from 6179 primary records. [2025-09-05T19:17:06.010430] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-05T19:17:06.012122] [INFO ] [MAIN ] Derivative Progress: 1696/2117 symbols completed. SMHI took 0.9s. Estimated remaining: 2m 5s. Rate: 201.9 symbols/min [2025-09-05T19:17:06.012442] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:06.026811] [INFO ] [MAIN ] SMFG: Generated 871 derivative records from 23049 primary records. [2025-09-05T19:17:06.037840] [INFO ] [MAIN ] SMG: Generated 871 derivative records from 20620 primary records. [2025-09-05T19:17:06.058607] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-05T19:17:06.059277] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-05T19:17:06.060876] [INFO ] [MAIN ] Derivative Progress: 1697/2117 symbols completed. SMFG took 0.9s. Estimated remaining: 2m 5s. Rate: 202.0 symbols/min [2025-09-05T19:17:06.061056] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:06.049885] [INFO ] [MAIN ] SMP: Loaded 8823 primary data records. [2025-09-05T19:17:06.062861] [INFO ] [MAIN ] Derivative Progress: 1698/2117 symbols completed. SMG took 0.9s. Estimated remaining: 2m 4s. Rate: 202.1 symbols/min [2025-09-05T19:17:06.094130] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:06.337745] [INFO ] [MAIN ] SMR: Loaded 26181 primary data records. [2025-09-05T19:17:06.336477] [INFO ] [MAIN ] SMRT: Loaded 21450 primary data records. [2025-09-05T19:17:06.862440] [INFO ] [MAIN ] SMP: Generated 871 derivative records from 8823 primary records. [2025-09-05T19:17:06.876260] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-05T19:17:06.878336] [INFO ] [MAIN ] Derivative Progress: 1699/2117 symbols completed. SMP took 0.9s. Estimated remaining: 2m 4s. Rate: 201.9 symbols/min [2025-09-05T19:17:06.878655] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:06.898081] [INFO ] [MAIN ] SMR: Generated 871 derivative records from 26181 primary records. [2025-09-05T19:17:06.906370] [INFO ] [MAIN ] SMRT: Generated 871 derivative records from 21450 primary records. [2025-09-05T19:17:06.921027] [INFO ] [MAIN ] SMWB: Loaded 16202 primary data records. [2025-09-05T19:17:06.920107] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-05T19:17:06.922979] [INFO ] [MAIN ] Derivative Progress: 1700/2117 symbols completed. SMR took 0.9s. Estimated remaining: 2m 4s. Rate: 202.0 symbols/min [2025-09-05T19:17:06.934282] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:07.040037] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-05T19:17:07.042181] [INFO ] [MAIN ] Derivative Progress: 1701/2117 symbols completed. SMRT took 0.9s. Estimated remaining: 2m 4s. Rate: 202.1 symbols/min [2025-09-05T19:17:07.042954] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:07.219368] [INFO ] [MAIN ] SN: Loaded 24355 primary data records. [2025-09-05T19:17:07.281609] [INFO ] [MAIN ] SNA: Loaded 11653 primary data records. [2025-09-05T19:17:07.671315] [INFO ] [MAIN ] SMWB: Generated 871 derivative records from 16202 primary records. [2025-09-05T19:17:07.745618] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-05T19:17:07.748103] [INFO ] [MAIN ] Derivative Progress: 1702/2117 symbols completed. SMWB took 0.9s. Estimated remaining: 2m 3s. Rate: 201.9 symbols/min [2025-09-05T19:17:07.748975] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:07.762063] [INFO ] [MAIN ] SN: Generated 871 derivative records from 24355 primary records. [2025-09-05T19:17:07.782665] [INFO ] [MAIN ] SNA: Generated 871 derivative records from 11653 primary records. [2025-09-05T19:17:07.781380] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-05T19:17:07.784872] [INFO ] [MAIN ] Derivative Progress: 1703/2117 symbols completed. SN took 0.9s. Estimated remaining: 2m 3s. Rate: 202.0 symbols/min [2025-09-05T19:17:07.800440] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:07.804600] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-05T19:17:07.806664] [INFO ] [MAIN ] Derivative Progress: 1704/2117 symbols completed. SNA took 0.8s. Estimated remaining: 2m 3s. Rate: 202.1 symbols/min [2025-09-05T19:17:07.807559] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:07.810345] [INFO ] [MAIN ] SNDA: Loaded 1921 primary data records. [2025-09-05T19:17:07.909386] [INFO ] [MAIN ] SNAP: Loaded 26168 primary data records. [2025-09-05T19:17:07.996072] [INFO ] [MAIN ] SNDR: Loaded 19484 primary data records. [2025-09-05T19:17:08.587343] [INFO ] [MAIN ] SNDA: Generated 871 derivative records from 1921 primary records. [2025-09-05T19:17:08.601105] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-05T19:17:08.611534] [INFO ] [MAIN ] Derivative Progress: 1705/2117 symbols completed. SNDA took 0.8s. Estimated remaining: 2m 2s. Rate: 201.9 symbols/min [2025-09-05T19:17:08.609381] [INFO ] [MAIN ] SNAP: Generated 871 derivative records from 26168 primary records. [2025-09-05T19:17:08.612006] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:08.623864] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-05T19:17:08.625931] [INFO ] [MAIN ] Derivative Progress: 1706/2117 symbols completed. SNAP took 0.9s. Estimated remaining: 2m 2s. Rate: 202.0 symbols/min [2025-09-05T19:17:08.633171] [INFO ] [MAIN ] SNDR: Generated 871 derivative records from 19484 primary records. [2025-09-05T19:17:08.633437] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:08.642912] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-05T19:17:08.645053] [INFO ] [MAIN ] Derivative Progress: 1707/2117 symbols completed. SNDR took 0.8s. Estimated remaining: 2m 2s. Rate: 202.1 symbols/min [2025-09-05T19:17:08.645320] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:08.670340] [INFO ] [MAIN ] SNN: Loaded 22012 primary data records. [2025-09-05T19:17:08.789046] [INFO ] [MAIN ] SNOW: Loaded 25967 primary data records. [2025-09-05T19:17:08.816544] [INFO ] [MAIN ] SNV: Loaded 23838 primary data records. [2025-09-05T19:17:09.458670] [INFO ] [MAIN ] SNN: Generated 871 derivative records from 22012 primary records. [2025-09-05T19:17:09.470095] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-05T19:17:09.472775] [INFO ] [MAIN ] Derivative Progress: 1708/2117 symbols completed. SNN took 0.9s. Estimated remaining: 2m 2s. Rate: 201.9 symbols/min [2025-09-05T19:17:09.479826] [INFO ] [MAIN ] SNV: Generated 871 derivative records from 23838 primary records. [2025-09-05T19:17:09.491676] [INFO ] [MAIN ] SNOW: Generated 871 derivative records from 25967 primary records. [2025-09-05T19:17:09.495483] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-05T19:17:09.502408] [INFO ] [MAIN ] Derivative Progress: 1709/2117 symbols completed. SNV took 0.9s. Estimated remaining: 2m 1s. Rate: 202.0 symbols/min [2025-09-05T19:17:09.504399] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-05T19:17:09.505974] [INFO ] [MAIN ] Derivative Progress: 1710/2117 symbols completed. SNOW took 0.9s. Estimated remaining: 2m 1s. Rate: 202.1 symbols/min [2025-09-05T19:17:09.506347] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:09.506529] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:09.506971] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:09.531951] [INFO ] [MAIN ] SNX: Loaded 18064 primary data records. [2025-09-05T19:17:09.665961] [INFO ] [MAIN ] SOC: Loaded 24651 primary data records. [2025-09-05T19:17:09.672104] [INFO ] [MAIN ] SO: Loaded 26019 primary data records. [2025-09-05T19:17:10.301811] [INFO ] [MAIN ] SNX: Generated 871 derivative records from 18064 primary records. [2025-09-05T19:17:10.310537] [INFO ] [MAIN ] SOC: Generated 871 derivative records from 24651 primary records. [2025-09-05T19:17:10.327665] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-05T19:17:10.329502] [INFO ] [MAIN ] Derivative Progress: 1711/2117 symbols completed. SNX took 0.8s. Estimated remaining: 2m 1s. Rate: 201.9 symbols/min [2025-09-05T19:17:10.330502] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:10.334564] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-05T19:17:10.343813] [INFO ] [MAIN ] Derivative Progress: 1712/2117 symbols completed. SOC took 0.8s. Estimated remaining: 2m 0s. Rate: 202.0 symbols/min [2025-09-05T19:17:10.344846] [INFO ] [MAIN ] SO: Generated 871 derivative records from 26019 primary records. [2025-09-05T19:17:10.345159] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:10.354307] [INFO ] [MAIN ] SOJC: Loaded 2169 primary data records. [2025-09-05T19:17:10.356799] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-05T19:17:10.388748] [INFO ] [MAIN ] Derivative Progress: 1713/2117 symbols completed. SO took 0.9s. Estimated remaining: 1m 60s. Rate: 202.1 symbols/min [2025-09-05T19:17:10.396151] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:10.466988] [INFO ] [MAIN ] SOJD: Loaded 6039 primary data records. [2025-09-05T19:17:10.510864] [INFO ] [MAIN ] SOJE: Loaded 4375 primary data records. [2025-09-05T19:17:11.088117] [INFO ] [MAIN ] SOJC: Generated 871 derivative records from 2169 primary records. [2025-09-05T19:17:11.104678] [INFO ] [MAIN ] SOJD: Generated 871 derivative records from 6039 primary records. [2025-09-05T19:17:11.104733] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-05T19:17:11.107722] [INFO ] [MAIN ] Derivative Progress: 1714/2117 symbols completed. SOJC took 0.8s. Estimated remaining: 1m 60s. Rate: 202.0 symbols/min [2025-09-05T19:17:11.107963] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:11.121208] [INFO ] [MAIN ] SOJE: Generated 871 derivative records from 4375 primary records. [2025-09-05T19:17:11.123120] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-05T19:17:11.124805] [INFO ] [MAIN ] Derivative Progress: 1715/2117 symbols completed. SOJD took 0.8s. Estimated remaining: 1m 59s. Rate: 202.1 symbols/min [2025-09-05T19:17:11.125031] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:11.132572] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-05T19:17:11.134378] [INFO ] [MAIN ] Derivative Progress: 1716/2117 symbols completed. SOJE took 0.7s. Estimated remaining: 1m 59s. Rate: 202.2 symbols/min [2025-09-05T19:17:11.134699] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:11.158788] [INFO ] [MAIN ] SOLV: Loaded 20523 primary data records. [2025-09-05T19:17:11.287837] [INFO ] [MAIN ] SONY: Loaded 25860 primary data records. [2025-09-05T19:17:11.281963] [INFO ] [MAIN ] SON: Loaded 20663 primary data records. [2025-09-05T19:17:11.927182] [INFO ] [MAIN ] SOLV: Generated 871 derivative records from 20523 primary records. [2025-09-05T19:17:11.939296] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-05T19:17:11.940775] [INFO ] [MAIN ] Derivative Progress: 1717/2117 symbols completed. SOLV took 0.8s. Estimated remaining: 1m 59s. Rate: 202.0 symbols/min [2025-09-05T19:17:11.940983] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:11.954762] [INFO ] [MAIN ] SONY: Generated 871 derivative records from 25860 primary records. [2025-09-05T19:17:11.955622] [INFO ] [MAIN ] SON: Generated 871 derivative records from 20663 primary records. [2025-09-05T19:17:11.965053] [INFO ] [MAIN ] SOR: Loaded 1415 primary data records. [2025-09-05T19:17:11.971218] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-05T19:17:11.987802] [INFO ] [MAIN ] Derivative Progress: 1718/2117 symbols completed. SONY took 0.9s. Estimated remaining: 1m 58s. Rate: 202.1 symbols/min [2025-09-05T19:17:12.006702] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:12.048366] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-05T19:17:12.062457] [INFO ] [MAIN ] Derivative Progress: 1719/2117 symbols completed. SON took 0.9s. Estimated remaining: 1m 58s. Rate: 202.2 symbols/min [2025-09-05T19:17:12.084053] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:12.134848] [INFO ] [MAIN ] SOS: Loaded 5154 primary data records. [2025-09-05T19:17:12.425117] [INFO ] [MAIN ] SPB: Loaded 26805 primary data records. [2025-09-05T19:17:12.760007] [INFO ] [MAIN ] SOR: Generated 871 derivative records from 1415 primary records. [2025-09-05T19:17:12.777556] [INFO ] [MAIN ] SOS: Generated 871 derivative records from 5154 primary records. [2025-09-05T19:17:12.777866] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-05T19:17:12.779915] [INFO ] [MAIN ] Derivative Progress: 1720/2117 symbols completed. SOR took 0.8s. Estimated remaining: 1m 58s. Rate: 202.0 symbols/min [2025-09-05T19:17:12.780592] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:12.787928] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-05T19:17:12.790389] [INFO ] [MAIN ] Derivative Progress: 1721/2117 symbols completed. SOS took 0.8s. Estimated remaining: 1m 58s. Rate: 202.1 symbols/min [2025-09-05T19:17:12.790799] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:12.796204] [INFO ] [MAIN ] SPE: Loaded 3049 primary data records. [2025-09-05T19:17:12.962326] [INFO ] [MAIN ] SPCE: Loaded 24263 primary data records. [2025-09-05T19:17:13.156881] [INFO ] [MAIN ] SPB: Generated 1352 derivative records from 26805 primary records. [2025-09-05T19:17:13.304534] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-05T19:17:13.307713] [INFO ] [MAIN ] Derivative Progress: 1722/2117 symbols completed. SPB took 1.2s. Estimated remaining: 1m 57s. Rate: 202.0 symbols/min [2025-09-05T19:17:13.308223] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:13.320702] [INFO ] [MAIN ] SPE: Generated 871 derivative records from 3049 primary records. [2025-09-05T19:17:13.329518] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-05T19:17:13.331005] [INFO ] [MAIN ] Derivative Progress: 1723/2117 symbols completed. SPE took 0.5s. Estimated remaining: 1m 57s. Rate: 202.2 symbols/min [2025-09-05T19:17:13.347370] [INFO ] [MAIN ] SPCE: Generated 871 derivative records from 24263 primary records. [2025-09-05T19:17:13.363939] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-05T19:17:13.363428] [INFO ] [MAIN ] SPG: Loaded 24179 primary data records. [2025-09-05T19:17:13.365695] [INFO ] [MAIN ] Derivative Progress: 1724/2117 symbols completed. SPCE took 0.6s. Estimated remaining: 1m 57s. Rate: 202.3 symbols/min [2025-09-05T19:17:13.602753] [INFO ] [MAIN ] SPG: Generated 871 derivative records from 24179 primary records. [2025-09-05T19:17:13.611050] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-05T19:17:13.612421] [INFO ] [MAIN ] Derivative Progress: 1725/2117 symbols completed. SPG took 0.3s. Estimated remaining: 1m 56s. Rate: 202.3 symbols/min [2025-09-05T19:17:13.613259] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:13.613197] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:13.613798] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:13.629328] [INFO ] [MAIN ] SPH: Loaded 13058 primary data records. [2025-09-05T19:17:13.757761] [INFO ] [MAIN ] SPHR: Loaded 18095 primary data records. [2025-09-05T19:17:13.818619] [INFO ] [MAIN ] SPGI: Loaded 21521 primary data records. [2025-09-05T19:17:14.491739] [INFO ] [MAIN ] SPHR: Generated 871 derivative records from 18095 primary records. [2025-09-05T19:17:14.492758] [INFO ] [MAIN ] SPH: Generated 1352 derivative records from 13058 primary records. [2025-09-05T19:17:14.514072] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-05T19:17:14.517383] [INFO ] [MAIN ] Derivative Progress: 1726/2117 symbols completed. SPH took 0.9s. Estimated remaining: 1m 56s. Rate: 202.0 symbols/min [2025-09-05T19:17:14.517929] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-05T19:17:14.518096] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:14.526825] [INFO ] [MAIN ] Derivative Progress: 1727/2117 symbols completed. SPHR took 0.9s. Estimated remaining: 1m 56s. Rate: 202.2 symbols/min [2025-09-05T19:17:14.527203] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:14.528182] [INFO ] [MAIN ] SPGI: Generated 871 derivative records from 21521 primary records. [2025-09-05T19:17:14.538667] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-05T19:17:14.542919] [INFO ] [MAIN ] Derivative Progress: 1728/2117 symbols completed. SPGI took 0.9s. Estimated remaining: 1m 55s. Rate: 202.3 symbols/min [2025-09-05T19:17:14.543202] [INFO ] [MAIN ] SPME: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:14.541139] [INFO ] [MAIN ] SPMC: Loaded 2520 primary data records. [2025-09-05T19:17:14.629835] [INFO ] [MAIN ] SPME: Loaded 624 primary data records. [2025-09-05T19:17:14.701730] [INFO ] [MAIN ] SPIR: Loaded 18304 primary data records. [2025-09-05T19:17:15.262337] [INFO ] [MAIN ] SPME: Generated 454 derivative records from 624 primary records. [2025-09-05T19:17:15.270832] [INFO ] [MAIN ] SPMC: Generated 871 derivative records from 2520 primary records. [2025-09-05T19:17:15.279053] [INFO ] [MAIN ] SPME: Successfully saved derivative data. [2025-09-05T19:17:15.281406] [INFO ] [MAIN ] Derivative Progress: 1729/2117 symbols completed. SPME took 0.7s. Estimated remaining: 1m 55s. Rate: 202.1 symbols/min [2025-09-05T19:17:15.282333] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:15.284497] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-05T19:17:15.286201] [INFO ] [MAIN ] Derivative Progress: 1730/2117 symbols completed. SPMC took 0.8s. Estimated remaining: 1m 55s. Rate: 202.2 symbols/min [2025-09-05T19:17:15.286728] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:15.296986] [INFO ] [MAIN ] SPIR: Generated 871 derivative records from 18304 primary records. [2025-09-05T19:17:15.313413] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-05T19:17:15.315237] [INFO ] [MAIN ] Derivative Progress: 1731/2117 symbols completed. SPIR took 0.8s. Estimated remaining: 1m 54s. Rate: 202.3 symbols/min [2025-09-05T19:17:15.315509] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:15.331827] [INFO ] [MAIN ] SPNT: Loaded 25848 primary data records. [2025-09-05T19:17:15.451069] [INFO ] [MAIN ] SPR: Loaded 18960 primary data records. [2025-09-05T19:17:15.451755] [INFO ] [MAIN ] SPOT: Loaded 24332 primary data records. [2025-09-05T19:17:16.106282] [INFO ] [MAIN ] SPOT: Generated 871 derivative records from 24332 primary records. [2025-09-05T19:17:16.118602] [INFO ] [MAIN ] SPR: Generated 871 derivative records from 18960 primary records. [2025-09-05T19:17:16.123043] [INFO ] [MAIN ] SPNT: Generated 1352 derivative records from 25848 primary records. [2025-09-05T19:17:16.146736] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-05T19:17:16.148914] [INFO ] [MAIN ] Derivative Progress: 1732/2117 symbols completed. SPR took 0.8s. Estimated remaining: 1m 54s. Rate: 202.1 symbols/min [2025-09-05T19:17:16.149721] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:16.152332] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-05T19:17:16.154795] [INFO ] [MAIN ] Derivative Progress: 1733/2117 symbols completed. SPOT took 0.9s. Estimated remaining: 1m 54s. Rate: 202.2 symbols/min [2025-09-05T19:17:16.155904] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:16.159189] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-05T19:17:16.162288] [INFO ] [MAIN ] Derivative Progress: 1734/2117 symbols completed. SPNT took 0.9s. Estimated remaining: 1m 54s. Rate: 202.3 symbols/min [2025-09-05T19:17:16.162493] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:16.166598] [INFO ] [MAIN ] SPRU: Loaded 6592 primary data records. [2025-09-05T19:17:16.260370] [INFO ] [MAIN ] SPXX: Loaded 5924 primary data records. [2025-09-05T19:17:16.285527] [INFO ] [MAIN ] SPXC: Loaded 11756 primary data records. [2025-09-05T19:17:17.027331] [INFO ] [MAIN ] SPRU: Generated 1352 derivative records from 6592 primary records. [2025-09-05T19:17:17.035010] [INFO ] [MAIN ] SPXC: Generated 871 derivative records from 11756 primary records. [2025-09-05T19:17:17.047292] [INFO ] [MAIN ] SPXX: Generated 1352 derivative records from 5924 primary records. [2025-09-05T19:17:17.071389] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-05T19:17:17.077135] [INFO ] [MAIN ] Derivative Progress: 1735/2117 symbols completed. SPRU took 0.9s. Estimated remaining: 1m 53s. Rate: 202.1 symbols/min [2025-09-05T19:17:17.080186] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:17.080125] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-05T19:17:17.083150] [INFO ] [MAIN ] Derivative Progress: 1736/2117 symbols completed. SPXX took 0.9s. Estimated remaining: 1m 53s. Rate: 202.2 symbols/min [2025-09-05T19:17:17.084095] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-05T19:17:17.085838] [INFO ] [MAIN ] Derivative Progress: 1737/2117 symbols completed. SPXC took 0.9s. Estimated remaining: 1m 53s. Rate: 202.3 symbols/min [2025-09-05T19:17:17.084146] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:17.086352] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:17.117451] [INFO ] [MAIN ] SQNS: Loaded 18841 primary data records. [2025-09-05T19:17:17.148847] [INFO ] [MAIN ] SR: Loaded 15996 primary data records. [2025-09-05T19:17:17.348684] [INFO ] [MAIN ] SQM: Loaded 36560 primary data records. [2025-09-05T19:17:17.904869] [INFO ] [MAIN ] SQNS: Generated 871 derivative records from 18841 primary records. [2025-09-05T19:17:17.919256] [INFO ] [MAIN ] SR: Generated 871 derivative records from 15996 primary records. [2025-09-05T19:17:17.928538] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-05T19:17:17.930784] [INFO ] [MAIN ] Derivative Progress: 1738/2117 symbols completed. SQNS took 0.8s. Estimated remaining: 1m 53s. Rate: 202.1 symbols/min [2025-09-05T19:17:17.932309] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-05T19:17:17.933965] [INFO ] [MAIN ] Derivative Progress: 1739/2117 symbols completed. SR took 0.8s. Estimated remaining: 1m 52s. Rate: 202.2 symbols/min [2025-09-05T19:17:17.947153] [INFO ] [MAIN ] SQM: Generated 1352 derivative records from 36560 primary records. [2025-09-05T19:17:17.958881] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-05T19:17:17.961252] [INFO ] [MAIN ] Derivative Progress: 1740/2117 symbols completed. SQM took 0.9s. Estimated remaining: 1m 52s. Rate: 202.3 symbols/min [2025-09-05T19:17:17.961883] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:17.961841] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:17.961715] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:17.972064] [INFO ] [MAIN ] SREA: Loaded 7745 primary data records. [2025-09-05T19:17:18.164324] [INFO ] [MAIN ] SRE: Loaded 25801 primary data records. [2025-09-05T19:17:18.167213] [INFO ] [MAIN ] SRFM: Loaded 23153 primary data records. [2025-09-05T19:17:18.776300] [INFO ] [MAIN ] SREA: Generated 1352 derivative records from 7745 primary records. [2025-09-05T19:17:18.800028] [INFO ] [MAIN ] SRFM: Generated 871 derivative records from 23153 primary records. [2025-09-05T19:17:18.801135] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-05T19:17:18.810677] [INFO ] [MAIN ] Derivative Progress: 1741/2117 symbols completed. SREA took 0.8s. Estimated remaining: 1m 52s. Rate: 202.1 symbols/min [2025-09-05T19:17:18.811746] [INFO ] [MAIN ] SRE: Generated 871 derivative records from 25801 primary records. [2025-09-05T19:17:18.818309] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:18.826854] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-05T19:17:18.830310] [INFO ] [MAIN ] Derivative Progress: 1742/2117 symbols completed. SRFM took 0.9s. Estimated remaining: 1m 51s. Rate: 202.2 symbols/min [2025-09-05T19:17:18.828626] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-05T19:17:18.832253] [INFO ] [MAIN ] Derivative Progress: 1743/2117 symbols completed. SRE took 0.9s. Estimated remaining: 1m 51s. Rate: 202.3 symbols/min [2025-09-05T19:17:18.832306] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:18.834937] [INFO ] [MAIN ] SRL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:18.841704] [INFO ] [MAIN ] SRL: Loaded 749 primary data records. [2025-09-05T19:17:18.842078] [INFO ] [MAIN ] SRG: Loaded 6336 primary data records. [2025-09-05T19:17:19.012499] [INFO ] [MAIN ] SRI: Loaded 14052 primary data records. [2025-09-05T19:17:19.669831] [INFO ] [MAIN ] SRG: Generated 871 derivative records from 6336 primary records. [2025-09-05T19:17:19.671515] [INFO ] [MAIN ] SRL: Generated 1352 derivative records from 749 primary records. [2025-09-05T19:17:19.691758] [INFO ] [MAIN ] SRI: Generated 871 derivative records from 14052 primary records. [2025-09-05T19:17:19.694819] [INFO ] [MAIN ] SRL: Successfully saved derivative data. [2025-09-05T19:17:19.697327] [INFO ] [MAIN ] Derivative Progress: 1744/2117 symbols completed. SRL took 0.9s. Estimated remaining: 1m 51s. Rate: 202.1 symbols/min [2025-09-05T19:17:19.699160] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-05T19:17:19.701108] [INFO ] [MAIN ] Derivative Progress: 1745/2117 symbols completed. SRG took 0.9s. Estimated remaining: 1m 50s. Rate: 202.2 symbols/min [2025-09-05T19:17:19.698872] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:19.707106] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:19.713383] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-05T19:17:19.718612] [INFO ] [MAIN ] SRV: Loaded 5606 primary data records. [2025-09-05T19:17:19.718252] [INFO ] [MAIN ] Derivative Progress: 1746/2117 symbols completed. SRI took 0.9s. Estimated remaining: 1m 50s. Rate: 202.3 symbols/min [2025-09-05T19:17:19.730138] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:19.858923] [INFO ] [MAIN ] SSB: Loaded 20887 primary data records. [2025-09-05T19:17:19.923295] [INFO ] [MAIN ] SSD: Loaded 11117 primary data records. [2025-09-05T19:17:20.515194] [INFO ] [MAIN ] SRV: Generated 1352 derivative records from 5606 primary records. [2025-09-05T19:17:20.531120] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-05T19:17:20.533659] [INFO ] [MAIN ] Derivative Progress: 1747/2117 symbols completed. SRV took 0.8s. Estimated remaining: 1m 50s. Rate: 202.1 symbols/min [2025-09-05T19:17:20.534457] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:20.547302] [INFO ] [MAIN ] SSD: Generated 871 derivative records from 11117 primary records. [2025-09-05T19:17:20.566741] [INFO ] [MAIN ] SSB: Generated 871 derivative records from 20887 primary records. [2025-09-05T19:17:20.576815] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-05T19:17:20.579278] [INFO ] [MAIN ] Derivative Progress: 1748/2117 symbols completed. SSD took 0.8s. Estimated remaining: 1m 49s. Rate: 202.2 symbols/min [2025-09-05T19:17:20.579486] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:20.604117] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-05T19:17:20.605936] [INFO ] [MAIN ] Derivative Progress: 1749/2117 symbols completed. SSB took 0.9s. Estimated remaining: 1m 49s. Rate: 202.3 symbols/min [2025-09-05T19:17:20.606179] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:20.607686] [INFO ] [MAIN ] SSL: Loaded 31036 primary data records. [2025-09-05T19:17:20.666520] [INFO ] [MAIN ] SST: Loaded 9993 primary data records. [2025-09-05T19:17:20.836056] [INFO ] [MAIN ] SSTK: Loaded 11826 primary data records. [2025-09-05T19:17:21.423123] [INFO ] [MAIN ] SST: Generated 1352 derivative records from 9993 primary records. [2025-09-05T19:17:21.421700] [INFO ] [MAIN ] SSL: Generated 1352 derivative records from 31036 primary records. [2025-09-05T19:17:21.451982] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-05T19:17:21.450454] [INFO ] [MAIN ] SSTK: Generated 871 derivative records from 11826 primary records. [2025-09-05T19:17:21.454478] [INFO ] [MAIN ] Derivative Progress: 1750/2117 symbols completed. SSL took 0.9s. Estimated remaining: 1m 49s. Rate: 202.1 symbols/min [2025-09-05T19:17:21.455800] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:21.464156] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-05T19:17:21.466008] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-05T19:17:21.468478] [INFO ] [MAIN ] Derivative Progress: 1751/2117 symbols completed. SST took 0.9s. Estimated remaining: 1m 49s. Rate: 202.2 symbols/min [2025-09-05T19:17:21.470206] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:21.470400] [INFO ] [MAIN ] Derivative Progress: 1752/2117 symbols completed. SSTK took 0.9s. Estimated remaining: 1m 48s. Rate: 202.3 symbols/min [2025-09-05T19:17:21.470945] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:21.482987] [INFO ] [MAIN ] STC: Loaded 8791 primary data records. [2025-09-05T19:17:21.707037] [INFO ] [MAIN ] STAG: Loaded 23956 primary data records. [2025-09-05T19:17:21.719261] [INFO ] [MAIN ] ST: Loaded 37460 primary data records. [2025-09-05T19:17:22.327655] [INFO ] [MAIN ] STC: Generated 871 derivative records from 8791 primary records. [2025-09-05T19:17:22.338908] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-05T19:17:22.340524] [INFO ] [MAIN ] Derivative Progress: 1753/2117 symbols completed. STC took 0.9s. Estimated remaining: 1m 48s. Rate: 202.1 symbols/min [2025-09-05T19:17:22.351563] [INFO ] [MAIN ] STAG: Generated 871 derivative records from 23956 primary records. [2025-09-05T19:17:22.361313] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-05T19:17:22.372192] [INFO ] [MAIN ] Derivative Progress: 1754/2117 symbols completed. STAG took 0.9s. Estimated remaining: 1m 48s. Rate: 202.2 symbols/min [2025-09-05T19:17:22.373156] [INFO ] [MAIN ] ST: Generated 1352 derivative records from 37460 primary records. [2025-09-05T19:17:22.385396] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-05T19:17:22.387942] [INFO ] [MAIN ] Derivative Progress: 1755/2117 symbols completed. ST took 0.9s. Estimated remaining: 1m 47s. Rate: 202.3 symbols/min [2025-09-05T19:17:22.388439] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:22.388754] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:22.388353] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:22.400676] [INFO ] [MAIN ] STEL: Loaded 10997 primary data records. [2025-09-05T19:17:22.525981] [INFO ] [MAIN ] STE: Loaded 16798 primary data records. [2025-09-05T19:17:22.526804] [INFO ] [MAIN ] STEM: Loaded 17344 primary data records. [2025-09-05T19:17:23.156287] [INFO ] [MAIN ] STEL: Generated 871 derivative records from 10997 primary records. [2025-09-05T19:17:23.168771] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-05T19:17:23.171112] [INFO ] [MAIN ] Derivative Progress: 1756/2117 symbols completed. STEL took 0.8s. Estimated remaining: 1m 47s. Rate: 202.1 symbols/min [2025-09-05T19:17:23.171517] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:23.178927] [INFO ] [MAIN ] STEM: Generated 871 derivative records from 17344 primary records. [2025-09-05T19:17:23.187332] [INFO ] [MAIN ] STE: Generated 871 derivative records from 16798 primary records. [2025-09-05T19:17:23.198222] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-05T19:17:23.200117] [INFO ] [MAIN ] Derivative Progress: 1757/2117 symbols completed. STEM took 0.8s. Estimated remaining: 1m 47s. Rate: 202.2 symbols/min [2025-09-05T19:17:23.200581] [INFO ] [MAIN ] STG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:23.208901] [INFO ] [MAIN ] STEW: Loaded 6832 primary data records. [2025-09-05T19:17:23.212397] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-05T19:17:23.214615] [INFO ] [MAIN ] Derivative Progress: 1758/2117 symbols completed. STE took 0.8s. Estimated remaining: 1m 46s. Rate: 202.3 symbols/min [2025-09-05T19:17:23.269226] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:23.298725] [INFO ] [MAIN ] STG: Loaded 1807 primary data records. [2025-09-05T19:17:23.415233] [INFO ] [MAIN ] STK: Loaded 4072 primary data records. [2025-09-05T19:17:24.043073] [INFO ] [MAIN ] STEW: Generated 871 derivative records from 6832 primary records. [2025-09-05T19:17:24.056426] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-05T19:17:24.057898] [INFO ] [MAIN ] Derivative Progress: 1759/2117 symbols completed. STEW took 0.9s. Estimated remaining: 1m 46s. Rate: 202.1 symbols/min [2025-09-05T19:17:24.073177] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:24.075196] [INFO ] [MAIN ] STK: Generated 871 derivative records from 4072 primary records. [2025-09-05T19:17:24.074463] [INFO ] [MAIN ] STG: Generated 1352 derivative records from 1807 primary records. [2025-09-05T19:17:24.084034] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-05T19:17:24.092418] [INFO ] [MAIN ] Derivative Progress: 1760/2117 symbols completed. STK took 0.8s. Estimated remaining: 1m 46s. Rate: 202.2 symbols/min [2025-09-05T19:17:24.094780] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:24.094864] [INFO ] [MAIN ] STG: Successfully saved derivative data. [2025-09-05T19:17:24.097769] [INFO ] [MAIN ] Derivative Progress: 1761/2117 symbols completed. STG took 0.9s. Estimated remaining: 1m 46s. Rate: 202.4 symbols/min [2025-09-05T19:17:24.098246] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:24.140916] [INFO ] [MAIN ] STN: Loaded 17373 primary data records. [2025-09-05T19:17:24.142282] [INFO ] [MAIN ] STLA: Loaded 25952 primary data records. [2025-09-05T19:17:24.319759] [INFO ] [MAIN ] STM: Loaded 25939 primary data records. [2025-09-05T19:17:24.945851] [INFO ] [MAIN ] STLA: Generated 871 derivative records from 25952 primary records. [2025-09-05T19:17:24.958494] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-05T19:17:24.970293] [INFO ] [MAIN ] Derivative Progress: 1762/2117 symbols completed. STLA took 0.9s. Estimated remaining: 1m 45s. Rate: 202.1 symbols/min [2025-09-05T19:17:24.971463] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:24.971276] [INFO ] [MAIN ] STN: Generated 1352 derivative records from 17373 primary records. [2025-09-05T19:17:24.986665] [INFO ] [MAIN ] STM: Generated 871 derivative records from 25939 primary records. [2025-09-05T19:17:24.991603] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-05T19:17:24.994127] [INFO ] [MAIN ] Derivative Progress: 1763/2117 symbols completed. STN took 0.9s. Estimated remaining: 1m 45s. Rate: 202.2 symbols/min [2025-09-05T19:17:24.995001] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:25.008605] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-05T19:17:25.010542] [INFO ] [MAIN ] Derivative Progress: 1764/2117 symbols completed. STM took 0.9s. Estimated remaining: 1m 45s. Rate: 202.3 symbols/min [2025-09-05T19:17:25.010738] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:25.021900] [INFO ] [MAIN ] STNG: Loaded 21538 primary data records. [2025-09-05T19:17:25.045927] [INFO ] [MAIN ] STRV: Loaded 4788 primary data records. [2025-09-05T19:17:25.256410] [INFO ] [MAIN ] STT: Loaded 24494 primary data records. [2025-09-05T19:17:25.768666] [INFO ] [MAIN ] STNG: Generated 871 derivative records from 21538 primary records. [2025-09-05T19:17:25.776083] [INFO ] [MAIN ] STRV: Generated 870 derivative records from 4788 primary records. [2025-09-05T19:17:25.794045] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-05T19:17:25.796183] [INFO ] [MAIN ] Derivative Progress: 1765/2117 symbols completed. STRV took 0.8s. Estimated remaining: 1m 44s. Rate: 202.2 symbols/min [2025-09-05T19:17:25.797100] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:25.804918] [INFO ] [MAIN ] STT: Generated 871 derivative records from 24494 primary records. [2025-09-05T19:17:25.806838] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-05T19:17:25.814628] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-05T19:17:25.816341] [INFO ] [MAIN ] Derivative Progress: 1766/2117 symbols completed. STNG took 0.8s. Estimated remaining: 1m 44s. Rate: 202.3 symbols/min [2025-09-05T19:17:25.818556] [INFO ] [MAIN ] Derivative Progress: 1767/2117 symbols completed. STT took 0.8s. Estimated remaining: 1m 44s. Rate: 202.4 symbols/min [2025-09-05T19:17:25.818500] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:25.822945] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:25.825616] [INFO ] [MAIN ] STXD: Loaded 476 primary data records. [2025-09-05T19:17:25.841712] [INFO ] [MAIN ] STVN: Loaded 13146 primary data records. [2025-09-05T19:17:26.209458] [INFO ] [MAIN ] STWD: Loaded 24977 primary data records. [2025-09-05T19:17:26.577833] [INFO ] [MAIN ] STXD: Generated 870 derivative records from 476 primary records. [2025-09-05T19:17:26.586144] [INFO ] [MAIN ] STVN: Generated 871 derivative records from 13146 primary records. [2025-09-05T19:17:26.601778] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-05T19:17:26.603215] [INFO ] [MAIN ] Derivative Progress: 1768/2117 symbols completed. STVN took 0.8s. Estimated remaining: 1m 44s. Rate: 202.2 symbols/min [2025-09-05T19:17:26.602014] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-05T19:17:26.605456] [INFO ] [MAIN ] Derivative Progress: 1769/2117 symbols completed. STXD took 0.8s. Estimated remaining: 1m 43s. Rate: 202.3 symbols/min [2025-09-05T19:17:26.615865] [INFO ] [MAIN ] STWD: Generated 871 derivative records from 24977 primary records. [2025-09-05T19:17:26.623909] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-05T19:17:26.625556] [INFO ] [MAIN ] Derivative Progress: 1770/2117 symbols completed. STWD took 0.8s. Estimated remaining: 1m 43s. Rate: 202.4 symbols/min [2025-09-05T19:17:26.626255] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:26.626214] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:26.626451] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:26.630418] [INFO ] [MAIN ] STXG: Loaded 894 primary data records. [2025-09-05T19:17:26.631848] [INFO ] [MAIN ] STXE: Loaded 905 primary data records. [2025-09-05T19:17:26.633209] [INFO ] [MAIN ] STXK: Loaded 615 primary data records. [2025-09-05T19:17:27.432262] [INFO ] [MAIN ] STXG: Generated 870 derivative records from 894 primary records. [2025-09-05T19:17:27.440304] [INFO ] [MAIN ] STXE: Generated 869 derivative records from 905 primary records. [2025-09-05T19:17:27.456316] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-05T19:17:27.461542] [INFO ] [MAIN ] Derivative Progress: 1771/2117 symbols completed. STXG took 0.8s. Estimated remaining: 1m 43s. Rate: 202.2 symbols/min [2025-09-05T19:17:27.463265] [INFO ] [MAIN ] STXM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:27.471625] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-05T19:17:27.472998] [INFO ] [MAIN ] Derivative Progress: 1772/2117 symbols completed. STXE took 0.8s. Estimated remaining: 1m 42s. Rate: 202.3 symbols/min [2025-09-05T19:17:27.473505] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:27.474863] [INFO ] [MAIN ] STXK: Generated 870 derivative records from 615 primary records. [2025-09-05T19:17:27.477839] [INFO ] [MAIN ] STXM: Loaded 385 primary data records. [2025-09-05T19:17:27.546961] [INFO ] [MAIN ] STXT: Loaded 1303 primary data records. [2025-09-05T19:17:27.618999] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-05T19:17:27.636826] [INFO ] [MAIN ] Derivative Progress: 1773/2117 symbols completed. STXK took 1.0s. Estimated remaining: 1m 42s. Rate: 202.4 symbols/min [2025-09-05T19:17:27.762370] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:27.913597] [INFO ] [MAIN ] STXV: Loaded 696 primary data records. [2025-09-05T19:17:28.227327] [INFO ] [MAIN ] STXM: Generated 869 derivative records from 385 primary records. [2025-09-05T19:17:28.245441] [INFO ] [MAIN ] STXT: Generated 870 derivative records from 1303 primary records. [2025-09-05T19:17:28.245525] [INFO ] [MAIN ] STXM: Successfully saved derivative data. [2025-09-05T19:17:28.247988] [INFO ] [MAIN ] Derivative Progress: 1774/2117 symbols completed. STXM took 0.8s. Estimated remaining: 1m 42s. Rate: 202.2 symbols/min [2025-09-05T19:17:28.248247] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:28.256350] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-05T19:17:28.258244] [INFO ] [MAIN ] Derivative Progress: 1775/2117 symbols completed. STXT took 0.8s. Estimated remaining: 1m 41s. Rate: 202.3 symbols/min [2025-09-05T19:17:28.258450] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:28.269044] [INFO ] [MAIN ] STXV: Generated 870 derivative records from 696 primary records. [2025-09-05T19:17:28.276533] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-05T19:17:28.278331] [INFO ] [MAIN ] Derivative Progress: 1776/2117 symbols completed. STXV took 0.6s. Estimated remaining: 1m 41s. Rate: 202.5 symbols/min [2025-09-05T19:17:28.286415] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:28.314612] [INFO ] [MAIN ] SU: Loaded 25856 primary data records. [2025-09-05T19:17:28.319370] [INFO ] [MAIN ] STZ: Loaded 25417 primary data records. [2025-09-05T19:17:28.444842] [INFO ] [MAIN ] SUI: Loaded 21121 primary data records. [2025-09-05T19:17:29.070908] [INFO ] [MAIN ] SU: Generated 871 derivative records from 25856 primary records. [2025-09-05T19:17:29.088919] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-05T19:17:29.091331] [INFO ] [MAIN ] Derivative Progress: 1777/2117 symbols completed. SU took 0.8s. Estimated remaining: 1m 41s. Rate: 202.3 symbols/min [2025-09-05T19:17:29.089790] [INFO ] [MAIN ] STZ: Generated 871 derivative records from 25417 primary records. [2025-09-05T19:17:29.093473] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:29.101410] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-05T19:17:29.103946] [INFO ] [MAIN ] Derivative Progress: 1778/2117 symbols completed. STZ took 0.9s. Estimated remaining: 1m 41s. Rate: 202.4 symbols/min [2025-09-05T19:17:29.104907] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:29.112721] [INFO ] [MAIN ] SUI: Generated 871 derivative records from 21121 primary records. [2025-09-05T19:17:29.123302] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-05T19:17:29.125092] [INFO ] [MAIN ] Derivative Progress: 1779/2117 symbols completed. SUI took 0.8s. Estimated remaining: 1m 40s. Rate: 202.5 symbols/min [2025-09-05T19:17:29.125374] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:29.155083] [INFO ] [MAIN ] SUN: Loaded 18971 primary data records. [2025-09-05T19:17:29.188729] [INFO ] [MAIN ] SUPV: Loaded 23193 primary data records. [2025-09-05T19:17:29.270628] [INFO ] [MAIN ] SUZ: Loaded 21938 primary data records. [2025-09-05T19:17:29.937476] [INFO ] [MAIN ] SUPV: Generated 871 derivative records from 23193 primary records. [2025-09-05T19:17:29.945876] [INFO ] [MAIN ] SUN: Generated 871 derivative records from 18971 primary records. [2025-09-05T19:17:29.957163] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-05T19:17:29.965048] [INFO ] [MAIN ] Derivative Progress: 1780/2117 symbols completed. SUPV took 0.9s. Estimated remaining: 1m 40s. Rate: 202.3 symbols/min [2025-09-05T19:17:29.973761] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-05T19:17:29.973879] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:29.975388] [INFO ] [MAIN ] Derivative Progress: 1781/2117 symbols completed. SUN took 0.9s. Estimated remaining: 1m 40s. Rate: 202.4 symbols/min [2025-09-05T19:17:29.976190] [INFO ] [MAIN ] SUZ: Generated 871 derivative records from 21938 primary records. [2025-09-05T19:17:29.977496] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:29.986005] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-05T19:17:29.987811] [INFO ] [MAIN ] Derivative Progress: 1782/2117 symbols completed. SUZ took 0.9s. Estimated remaining: 1m 39s. Rate: 202.5 symbols/min [2025-09-05T19:17:29.988041] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:30.013197] [INFO ] [MAIN ] SVV: Loaded 17629 primary data records. [2025-09-05T19:17:30.140423] [INFO ] [MAIN ] SWK: Loaded 25368 primary data records. [2025-09-05T19:17:30.141603] [INFO ] [MAIN ] SW: Loaded 25683 primary data records. [2025-09-05T19:17:30.852842] [INFO ] [MAIN ] SVV: Generated 871 derivative records from 17629 primary records. [2025-09-05T19:17:30.863068] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-05T19:17:30.864515] [INFO ] [MAIN ] Derivative Progress: 1783/2117 symbols completed. SVV took 0.9s. Estimated remaining: 1m 39s. Rate: 202.3 symbols/min [2025-09-05T19:17:30.883600] [INFO ] [MAIN ] SWK: Generated 871 derivative records from 25368 primary records. [2025-09-05T19:17:30.884601] [INFO ] [MAIN ] SW: Generated 871 derivative records from 25683 primary records. [2025-09-05T19:17:30.900042] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-05T19:17:30.902052] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-05T19:17:30.903902] [INFO ] [MAIN ] Derivative Progress: 1784/2117 symbols completed. SW took 0.9s. Estimated remaining: 1m 39s. Rate: 202.4 symbols/min [2025-09-05T19:17:30.905818] [INFO ] [MAIN ] Derivative Progress: 1785/2117 symbols completed. SWK took 0.9s. Estimated remaining: 1m 38s. Rate: 202.5 symbols/min [2025-09-05T19:17:30.906403] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:30.906484] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:30.907069] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:30.912541] [INFO ] [MAIN ] SWZ: Loaded 2801 primary data records. [2025-09-05T19:17:31.042291] [INFO ] [MAIN ] SWX: Loaded 15206 primary data records. [2025-09-05T19:17:31.041439] [INFO ] [MAIN ] SXC: Loaded 20524 primary data records. [2025-09-05T19:17:31.654784] [INFO ] [MAIN ] SWZ: Generated 871 derivative records from 2801 primary records. [2025-09-05T19:17:31.666894] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-05T19:17:31.668316] [INFO ] [MAIN ] Derivative Progress: 1786/2117 symbols completed. SWZ took 0.8s. Estimated remaining: 1m 38s. Rate: 202.3 symbols/min [2025-09-05T19:17:31.668963] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:31.676681] [INFO ] [MAIN ] SWX: Generated 871 derivative records from 15206 primary records. [2025-09-05T19:17:31.685955] [INFO ] [MAIN ] SXC: Generated 871 derivative records from 20524 primary records. [2025-09-05T19:17:31.700427] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-05T19:17:31.706756] [INFO ] [MAIN ] Derivative Progress: 1787/2117 symbols completed. SWX took 0.8s. Estimated remaining: 1m 38s. Rate: 202.4 symbols/min [2025-09-05T19:17:31.708462] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-05T19:17:31.710434] [INFO ] [MAIN ] Derivative Progress: 1788/2117 symbols completed. SXC took 0.8s. Estimated remaining: 1m 37s. Rate: 202.5 symbols/min [2025-09-05T19:17:31.710684] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:31.710616] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:31.716944] [INFO ] [MAIN ] SXI: Loaded 8779 primary data records. [2025-09-05T19:17:31.834716] [INFO ] [MAIN ] SXT: Loaded 14088 primary data records. [2025-09-05T19:17:32.132724] [INFO ] [MAIN ] SYF: Loaded 40226 primary data records. [2025-09-05T19:17:32.556336] [INFO ] [MAIN ] SXI: Generated 1352 derivative records from 8779 primary records. [2025-09-05T19:17:32.577752] [INFO ] [MAIN ] SXT: Generated 871 derivative records from 14088 primary records. [2025-09-05T19:17:32.586691] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-05T19:17:32.589167] [INFO ] [MAIN ] Derivative Progress: 1789/2117 symbols completed. SXI took 0.9s. Estimated remaining: 1m 37s. Rate: 202.3 symbols/min [2025-09-05T19:17:32.589788] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:32.592155] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-05T19:17:32.593818] [INFO ] [MAIN ] Derivative Progress: 1790/2117 symbols completed. SXT took 0.9s. Estimated remaining: 1m 37s. Rate: 202.4 symbols/min [2025-09-05T19:17:32.594108] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:32.609333] [INFO ] [MAIN ] SYF: Generated 1352 derivative records from 40226 primary records. [2025-09-05T19:17:32.629068] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-05T19:17:32.637765] [INFO ] [MAIN ] Derivative Progress: 1791/2117 symbols completed. SYF took 0.9s. Estimated remaining: 1m 37s. Rate: 202.5 symbols/min [2025-09-05T19:17:32.639484] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:32.640259] [INFO ] [MAIN ] SYK: Loaded 22086 primary data records. [2025-09-05T19:17:32.823550] [INFO ] [MAIN ] SYY: Loaded 40110 primary data records. [2025-09-05T19:17:33.044520] [INFO ] [MAIN ] T: Loaded 26108 primary data records. [2025-09-05T19:17:33.497112] [INFO ] [MAIN ] SYK: Generated 871 derivative records from 22086 primary records. [2025-09-05T19:17:33.510113] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-05T19:17:33.511967] [INFO ] [MAIN ] Derivative Progress: 1792/2117 symbols completed. SYK took 0.9s. Estimated remaining: 1m 36s. Rate: 202.3 symbols/min [2025-09-05T19:17:33.512390] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:33.534448] [INFO ] [MAIN ] SYY: Generated 1352 derivative records from 40110 primary records. [2025-09-05T19:17:33.535097] [INFO ] [MAIN ] T: Generated 871 derivative records from 26108 primary records. [2025-09-05T19:17:33.569543] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-05T19:17:33.571434] [INFO ] [MAIN ] Derivative Progress: 1793/2117 symbols completed. T took 0.9s. Estimated remaining: 1m 36s. Rate: 202.4 symbols/min [2025-09-05T19:17:33.572391] [INFO ] [MAIN ] TAC: Loaded 20836 primary data records. [2025-09-05T19:17:33.573358] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:33.585377] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-05T19:17:33.597251] [INFO ] [MAIN ] Derivative Progress: 1794/2117 symbols completed. SYY took 1.0s. Estimated remaining: 1m 36s. Rate: 202.5 symbols/min [2025-09-05T19:17:33.613604] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:33.826200] [INFO ] [MAIN ] TAK: Loaded 24500 primary data records. [2025-09-05T19:17:33.949324] [INFO ] [MAIN ] TAL: Loaded 39051 primary data records. [2025-09-05T19:17:34.396007] [INFO ] [MAIN ] TAC: Generated 871 derivative records from 20836 primary records. [2025-09-05T19:17:34.411436] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-05T19:17:34.414961] [INFO ] [MAIN ] Derivative Progress: 1795/2117 symbols completed. TAC took 0.9s. Estimated remaining: 1m 36s. Rate: 202.3 symbols/min [2025-09-05T19:17:34.416358] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:34.428898] [INFO ] [MAIN ] TAK: Generated 871 derivative records from 24500 primary records. [2025-09-05T19:17:34.439603] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-05T19:17:34.441036] [INFO ] [MAIN ] Derivative Progress: 1796/2117 symbols completed. TAK took 0.9s. Estimated remaining: 1m 35s. Rate: 202.4 symbols/min [2025-09-05T19:17:34.441472] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:34.463977] [INFO ] [MAIN ] TAL: Generated 1352 derivative records from 39051 primary records. [2025-09-05T19:17:34.486108] [INFO ] [MAIN ] TALO: Loaded 24990 primary data records. [2025-09-05T19:17:34.566395] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-05T19:17:34.591916] [INFO ] [MAIN ] Derivative Progress: 1797/2117 symbols completed. TAL took 1.0s. Estimated remaining: 1m 35s. Rate: 202.4 symbols/min [2025-09-05T19:17:34.611314] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:34.633424] [INFO ] [MAIN ] TAP: Loaded 25574 primary data records. [2025-09-05T19:17:34.840618] [INFO ] [MAIN ] TBB: Loaded 5449 primary data records. [2025-09-05T19:17:35.189486] [INFO ] [MAIN ] TALO: Generated 871 derivative records from 24990 primary records. [2025-09-05T19:17:35.259301] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-05T19:17:35.261975] [INFO ] [MAIN ] Derivative Progress: 1798/2117 symbols completed. TALO took 0.8s. Estimated remaining: 1m 35s. Rate: 202.3 symbols/min [2025-09-05T19:17:35.273627] [INFO ] [MAIN ] TAP: Generated 871 derivative records from 25574 primary records. [2025-09-05T19:17:35.282941] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-05T19:17:35.284650] [INFO ] [MAIN ] Derivative Progress: 1799/2117 symbols completed. TAP took 0.8s. Estimated remaining: 1m 34s. Rate: 202.4 symbols/min [2025-09-05T19:17:35.293007] [INFO ] [MAIN ] TBB: Generated 871 derivative records from 5449 primary records. [2025-09-05T19:17:35.300717] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-05T19:17:35.302612] [INFO ] [MAIN ] Derivative Progress: 1800/2117 symbols completed. TBB took 0.7s. Estimated remaining: 1m 34s. Rate: 202.5 symbols/min [2025-09-05T19:17:35.303291] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:35.303460] [INFO ] [MAIN ] TBLU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:35.303524] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:35.307185] [INFO ] [MAIN ] TBLU: Loaded 404 primary data records. [2025-09-05T19:17:35.426110] [INFO ] [MAIN ] TBI: Loaded 10127 primary data records. [2025-09-05T19:17:35.426609] [INFO ] [MAIN ] TBBB: Loaded 16968 primary data records. [2025-09-05T19:17:36.140152] [INFO ] [MAIN ] TBLU: Generated 871 derivative records from 404 primary records. [2025-09-05T19:17:36.148717] [INFO ] [MAIN ] TBLU: Successfully saved derivative data. [2025-09-05T19:17:36.150472] [INFO ] [MAIN ] Derivative Progress: 1801/2117 symbols completed. TBLU took 0.8s. Estimated remaining: 1m 34s. Rate: 202.3 symbols/min [2025-09-05T19:17:36.151372] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:36.159923] [INFO ] [MAIN ] TBI: Generated 871 derivative records from 10127 primary records. [2025-09-05T19:17:36.169294] [INFO ] [MAIN ] TBN: Loaded 1576 primary data records. [2025-09-05T19:17:36.167151] [INFO ] [MAIN ] TBBB: Generated 871 derivative records from 16968 primary records. [2025-09-05T19:17:36.280472] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-05T19:17:36.284492] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-05T19:17:36.286223] [INFO ] [MAIN ] Derivative Progress: 1802/2117 symbols completed. TBBB took 1.0s. Estimated remaining: 1m 33s. Rate: 202.3 symbols/min [2025-09-05T19:17:36.288062] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:36.288315] [INFO ] [MAIN ] Derivative Progress: 1803/2117 symbols completed. TBI took 1.0s. Estimated remaining: 1m 33s. Rate: 202.5 symbols/min [2025-09-05T19:17:36.289268] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:36.448954] [INFO ] [MAIN ] TD: Loaded 25216 primary data records. [2025-09-05T19:17:36.497018] [INFO ] [MAIN ] TDC: Loaded 34764 primary data records. [2025-09-05T19:17:36.990159] [INFO ] [MAIN ] TBN: Generated 871 derivative records from 1576 primary records. [2025-09-05T19:17:37.000659] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-05T19:17:37.002217] [INFO ] [MAIN ] Derivative Progress: 1804/2117 symbols completed. TBN took 0.9s. Estimated remaining: 1m 33s. Rate: 202.3 symbols/min [2025-09-05T19:17:37.002883] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:37.018537] [INFO ] [MAIN ] TD: Generated 871 derivative records from 25216 primary records. [2025-09-05T19:17:37.018927] [INFO ] [MAIN ] TDF: Loaded 2485 primary data records. [2025-09-05T19:17:37.133863] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-05T19:17:37.146201] [INFO ] [MAIN ] Derivative Progress: 1805/2117 symbols completed. TD took 0.9s. Estimated remaining: 1m 33s. Rate: 202.4 symbols/min [2025-09-05T19:17:37.185448] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:37.225990] [INFO ] [MAIN ] TDC: Generated 1352 derivative records from 34764 primary records. [2025-09-05T19:17:37.307744] [INFO ] [MAIN ] TDG: Loaded 10068 primary data records. [2025-09-05T19:17:37.308316] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-05T19:17:37.358074] [INFO ] [MAIN ] Derivative Progress: 1806/2117 symbols completed. TDC took 1.1s. Estimated remaining: 1m 32s. Rate: 202.4 symbols/min [2025-09-05T19:17:37.381228] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:37.515066] [INFO ] [MAIN ] TDF: Generated 871 derivative records from 2485 primary records. [2025-09-05T19:17:37.589091] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-05T19:17:37.597693] [INFO ] [MAIN ] Derivative Progress: 1807/2117 symbols completed. TDF took 0.6s. Estimated remaining: 1m 32s. Rate: 202.4 symbols/min [2025-09-05T19:17:37.600098] [INFO ] [MAIN ] TDOC: Loaded 25887 primary data records. [2025-09-05T19:17:37.601203] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:37.858319] [INFO ] [MAIN ] TDS: Loaded 20950 primary data records. [2025-09-05T19:17:37.935114] [INFO ] [MAIN ] TDG: Generated 871 derivative records from 10068 primary records. [2025-09-05T19:17:38.039156] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-05T19:17:38.062688] [INFO ] [MAIN ] Derivative Progress: 1808/2117 symbols completed. TDG took 0.9s. Estimated remaining: 1m 32s. Rate: 202.3 symbols/min [2025-09-05T19:17:38.121630] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:38.138158] [INFO ] [MAIN ] TDOC: Generated 871 derivative records from 25887 primary records. [2025-09-05T19:17:38.149053] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-05T19:17:38.150690] [INFO ] [MAIN ] Derivative Progress: 1809/2117 symbols completed. TDOC took 0.8s. Estimated remaining: 1m 31s. Rate: 202.4 symbols/min [2025-09-05T19:17:38.151165] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:38.162151] [INFO ] [MAIN ] TDS: Generated 871 derivative records from 20950 primary records. [2025-09-05T19:17:38.182866] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-05T19:17:38.184738] [INFO ] [MAIN ] Derivative Progress: 1810/2117 symbols completed. TDS took 0.6s. Estimated remaining: 1m 31s. Rate: 202.5 symbols/min [2025-09-05T19:17:38.189632] [INFO ] [MAIN ] TE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:38.189987] [INFO ] [MAIN ] TDY: Loaded 10883 primary data records. [2025-09-05T19:17:38.298305] [INFO ] [MAIN ] TDW: Loaded 34192 primary data records. [2025-09-05T19:17:38.620442] [INFO ] [MAIN ] TE: Loaded 33338 primary data records. [2025-09-05T19:17:39.082245] [INFO ] [MAIN ] TDY: Generated 871 derivative records from 10883 primary records. [2025-09-05T19:17:39.092205] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-05T19:17:39.093686] [INFO ] [MAIN ] Derivative Progress: 1811/2117 symbols completed. TDY took 0.9s. Estimated remaining: 1m 31s. Rate: 202.3 symbols/min [2025-09-05T19:17:39.094826] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:39.110334] [INFO ] [MAIN ] TDW: Generated 1352 derivative records from 34192 primary records. [2025-09-05T19:17:39.122918] [INFO ] [MAIN ] TEAF: Loaded 5322 primary data records. [2025-09-05T19:17:39.125827] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-05T19:17:39.139670] [INFO ] [MAIN ] Derivative Progress: 1812/2117 symbols completed. TDW took 1.0s. Estimated remaining: 1m 30s. Rate: 202.4 symbols/min [2025-09-05T19:17:39.164756] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:39.294120] [INFO ] [MAIN ] TE: Generated 1352 derivative records from 33338 primary records. [2025-09-05T19:17:39.424412] [INFO ] [MAIN ] TE: Successfully saved derivative data. [2025-09-05T19:17:39.438557] [INFO ] [MAIN ] Derivative Progress: 1813/2117 symbols completed. TE took 1.2s. Estimated remaining: 1m 30s. Rate: 202.4 symbols/min [2025-09-05T19:17:39.452881] [INFO ] [MAIN ] TECK: Loaded 40206 primary data records. [2025-09-05T19:17:39.738367] [INFO ] [MAIN ] TEAF: Generated 1352 derivative records from 5322 primary records. [2025-09-05T19:17:39.753165] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-05T19:17:39.755185] [INFO ] [MAIN ] Derivative Progress: 1814/2117 symbols completed. TEAF took 0.7s. Estimated remaining: 1m 30s. Rate: 202.4 symbols/min [2025-09-05T19:17:39.769392] [INFO ] [MAIN ] TECK: Generated 1352 derivative records from 40206 primary records. [2025-09-05T19:17:39.782987] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-05T19:17:39.786374] [INFO ] [MAIN ] Derivative Progress: 1815/2117 symbols completed. TECK took 0.6s. Estimated remaining: 1m 29s. Rate: 202.5 symbols/min [2025-09-05T19:17:39.787005] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:39.787162] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:39.787568] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:39.798741] [INFO ] [MAIN ] TEI: Loaded 9977 primary data records. [2025-09-05T19:17:39.925352] [INFO ] [MAIN ] TEF: Loaded 16988 primary data records. [2025-09-05T19:17:39.926296] [INFO ] [MAIN ] TEL: Loaded 24777 primary data records. [2025-09-05T19:17:40.555699] [INFO ] [MAIN ] TEI: Generated 871 derivative records from 9977 primary records. [2025-09-05T19:17:40.571458] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-05T19:17:40.573905] [INFO ] [MAIN ] TEL: Generated 871 derivative records from 24777 primary records. [2025-09-05T19:17:40.572965] [INFO ] [MAIN ] Derivative Progress: 1816/2117 symbols completed. TEI took 0.8s. Estimated remaining: 1m 29s. Rate: 202.3 symbols/min [2025-09-05T19:17:40.581409] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:40.591755] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-05T19:17:40.593380] [INFO ] [MAIN ] Derivative Progress: 1817/2117 symbols completed. TEL took 0.8s. Estimated remaining: 1m 29s. Rate: 202.4 symbols/min [2025-09-05T19:17:40.594288] [INFO ] [MAIN ] TEF: Generated 871 derivative records from 16988 primary records. [2025-09-05T19:17:40.594533] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:40.608116] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-05T19:17:40.610024] [INFO ] [MAIN ] Derivative Progress: 1818/2117 symbols completed. TEF took 0.8s. Estimated remaining: 1m 29s. Rate: 202.5 symbols/min [2025-09-05T19:17:40.610292] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:40.621823] [INFO ] [MAIN ] TEN: Loaded 15047 primary data records. [2025-09-05T19:17:40.697526] [INFO ] [MAIN ] TEO: Loaded 16211 primary data records. [2025-09-05T19:17:40.959730] [INFO ] [MAIN ] TEVA: Loaded 25959 primary data records. [2025-09-05T19:17:41.490099] [INFO ] [MAIN ] TEN: Generated 871 derivative records from 15047 primary records. [2025-09-05T19:17:41.499550] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-05T19:17:41.502059] [INFO ] [MAIN ] Derivative Progress: 1819/2117 symbols completed. TEN took 0.9s. Estimated remaining: 1m 28s. Rate: 202.3 symbols/min [2025-09-05T19:17:41.502351] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:41.517696] [INFO ] [MAIN ] TEO: Generated 1352 derivative records from 16211 primary records. [2025-09-05T19:17:41.538603] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-05T19:17:41.547452] [INFO ] [MAIN ] Derivative Progress: 1820/2117 symbols completed. TEO took 1.0s. Estimated remaining: 1m 28s. Rate: 202.4 symbols/min [2025-09-05T19:17:41.554750] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:41.548562] [INFO ] [MAIN ] TEVA: Generated 871 derivative records from 25959 primary records. [2025-09-05T19:17:41.556420] [INFO ] [MAIN ] TEX: Loaded 21195 primary data records. [2025-09-05T19:17:41.664626] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-05T19:17:41.674772] [INFO ] [MAIN ] Derivative Progress: 1821/2117 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 28s. Rate: 202.4 symbols/min [2025-09-05T19:17:41.675106] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:41.755711] [INFO ] [MAIN ] TFC: Loaded 25977 primary data records. [2025-09-05T19:17:41.922714] [INFO ] [MAIN ] TFII: Loaded 15403 primary data records. [2025-09-05T19:17:42.336227] [INFO ] [MAIN ] TEX: Generated 871 derivative records from 21195 primary records. [2025-09-05T19:17:42.348118] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-05T19:17:42.349605] [INFO ] [MAIN ] Derivative Progress: 1822/2117 symbols completed. TEX took 0.8s. Estimated remaining: 1m 27s. Rate: 202.3 symbols/min [2025-09-05T19:17:42.350263] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:42.364122] [INFO ] [MAIN ] TFC: Generated 871 derivative records from 25977 primary records. [2025-09-05T19:17:42.380141] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-05T19:17:42.388373] [INFO ] [MAIN ] Derivative Progress: 1823/2117 symbols completed. TFC took 0.8s. Estimated remaining: 1m 27s. Rate: 202.4 symbols/min [2025-09-05T19:17:42.388609] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:42.395328] [INFO ] [MAIN ] TFIN: Loaded 17700 primary data records. [2025-09-05T19:17:42.396667] [INFO ] [MAIN ] TFII: Generated 871 derivative records from 15403 primary records. [2025-09-05T19:17:42.527081] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-05T19:17:42.530164] [INFO ] [MAIN ] Derivative Progress: 1824/2117 symbols completed. TFII took 0.9s. Estimated remaining: 1m 27s. Rate: 202.4 symbols/min [2025-09-05T19:17:42.531031] [INFO ] [MAIN ] TFPM: Loaded 18655 primary data records. [2025-09-05T19:17:42.551850] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:42.880963] [INFO ] [MAIN ] TFX: Loaded 16873 primary data records. [2025-09-05T19:17:43.213814] [INFO ] [MAIN ] TFIN: Generated 1352 derivative records from 17700 primary records. [2025-09-05T19:17:43.234869] [INFO ] [MAIN ] TFPM: Generated 871 derivative records from 18655 primary records. [2025-09-05T19:17:43.239181] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-05T19:17:43.242421] [INFO ] [MAIN ] Derivative Progress: 1825/2117 symbols completed. TFIN took 0.9s. Estimated remaining: 1m 27s. Rate: 202.3 symbols/min [2025-09-05T19:17:43.247452] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:43.251804] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-05T19:17:43.253566] [INFO ] [MAIN ] Derivative Progress: 1826/2117 symbols completed. TFPM took 0.9s. Estimated remaining: 1m 26s. Rate: 202.4 symbols/min [2025-09-05T19:17:43.254186] [INFO ] [MAIN ] TGE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:43.260081] [INFO ] [MAIN ] TG: Loaded 4736 primary data records. [2025-09-05T19:17:43.347300] [INFO ] [MAIN ] TFX: Generated 871 derivative records from 16873 primary records. [2025-09-05T19:17:43.379556] [INFO ] [MAIN ] TGE: Loaded 6835 primary data records. [2025-09-05T19:17:43.529209] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-05T19:17:43.671013] [INFO ] [MAIN ] Derivative Progress: 1827/2117 symbols completed. TFX took 1.1s. Estimated remaining: 1m 26s. Rate: 202.4 symbols/min [2025-09-05T19:17:43.677554] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:43.850385] [INFO ] [MAIN ] TGLS: Loaded 12749 primary data records. [2025-09-05T19:17:44.068320] [INFO ] [MAIN ] TG: Generated 871 derivative records from 4736 primary records. [2025-09-05T19:17:44.184891] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-05T19:17:44.190500] [INFO ] [MAIN ] TGE: Generated 832 derivative records from 6835 primary records. [2025-09-05T19:17:44.192702] [INFO ] [MAIN ] Derivative Progress: 1828/2117 symbols completed. TG took 0.9s. Estimated remaining: 1m 26s. Rate: 202.3 symbols/min [2025-09-05T19:17:44.287733] [INFO ] [MAIN ] TGE: Successfully saved derivative data. [2025-09-05T19:17:44.289746] [INFO ] [MAIN ] Derivative Progress: 1829/2117 symbols completed. TGE took 1.0s. Estimated remaining: 1m 25s. Rate: 202.3 symbols/min [2025-09-05T19:17:44.307103] [INFO ] [MAIN ] TGLS: Generated 871 derivative records from 12749 primary records. [2025-09-05T19:17:44.318804] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-05T19:17:44.320968] [INFO ] [MAIN ] Derivative Progress: 1830/2117 symbols completed. TGLS took 0.6s. Estimated remaining: 1m 25s. Rate: 202.4 symbols/min [2025-09-05T19:17:44.321899] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:44.321998] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:44.321586] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:44.371470] [INFO ] [MAIN ] TGS: Loaded 15506 primary data records. [2025-09-05T19:17:44.468266] [INFO ] [MAIN ] TGT: Loaded 26088 primary data records. [2025-09-05T19:17:44.486119] [INFO ] [MAIN ] TGNA: Loaded 23470 primary data records. [2025-09-05T19:17:45.374662] [INFO ] [MAIN ] TGS: Generated 871 derivative records from 15506 primary records. [2025-09-05T19:17:45.382674] [INFO ] [MAIN ] TGT: Generated 871 derivative records from 26088 primary records. [2025-09-05T19:17:45.400778] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-05T19:17:45.401152] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-05T19:17:45.402765] [INFO ] [MAIN ] Derivative Progress: 1831/2117 symbols completed. TGT took 1.1s. Estimated remaining: 1m 25s. Rate: 202.1 symbols/min [2025-09-05T19:17:45.410052] [INFO ] [MAIN ] TGNA: Generated 871 derivative records from 23470 primary records. [2025-09-05T19:17:45.411485] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:45.412276] [INFO ] [MAIN ] Derivative Progress: 1832/2117 symbols completed. TGS took 1.1s. Estimated remaining: 1m 25s. Rate: 202.3 symbols/min [2025-09-05T19:17:45.416541] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:45.422370] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-05T19:17:45.424602] [INFO ] [MAIN ] Derivative Progress: 1833/2117 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 24s. Rate: 202.4 symbols/min [2025-09-05T19:17:45.424912] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:45.429487] [INFO ] [MAIN ] THIR: Loaded 1788 primary data records. [2025-09-05T19:17:45.561592] [INFO ] [MAIN ] THC: Loaded 22904 primary data records. [2025-09-05T19:17:45.562137] [INFO ] [MAIN ] THG: Loaded 16548 primary data records. [2025-09-05T19:17:46.297961] [INFO ] [MAIN ] THC: Generated 871 derivative records from 22904 primary records. [2025-09-05T19:17:46.299044] [INFO ] [MAIN ] THIR: Generated 1351 derivative records from 1788 primary records. [2025-09-05T19:17:46.329855] [INFO ] [MAIN ] THG: Generated 1351 derivative records from 16548 primary records. [2025-09-05T19:17:46.344105] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-05T19:17:46.344905] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-05T19:17:46.347464] [INFO ] [MAIN ] Derivative Progress: 1834/2117 symbols completed. THC took 0.9s. Estimated remaining: 1m 24s. Rate: 202.1 symbols/min [2025-09-05T19:17:46.350582] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:46.350468] [INFO ] [MAIN ] Derivative Progress: 1835/2117 symbols completed. THIR took 0.9s. Estimated remaining: 1m 24s. Rate: 202.2 symbols/min [2025-09-05T19:17:46.351094] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:46.353763] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-05T19:17:46.356827] [INFO ] [MAIN ] Derivative Progress: 1836/2117 symbols completed. THG took 0.9s. Estimated remaining: 1m 23s. Rate: 202.3 symbols/min [2025-09-05T19:17:46.357094] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:46.359471] [INFO ] [MAIN ] THLV: Loaded 1147 primary data records. [2025-09-05T19:17:46.534569] [INFO ] [MAIN ] THQ: Loaded 13594 primary data records. [2025-09-05T19:17:46.735798] [INFO ] [MAIN ] THO: Loaded 20010 primary data records. [2025-09-05T19:17:47.177671] [INFO ] [MAIN ] THLV: Generated 1344 derivative records from 1147 primary records. [2025-09-05T19:17:47.197082] [INFO ] [MAIN ] THQ: Generated 871 derivative records from 13594 primary records. [2025-09-05T19:17:47.198929] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-05T19:17:47.201163] [INFO ] [MAIN ] Derivative Progress: 1837/2117 symbols completed. THLV took 0.9s. Estimated remaining: 1m 23s. Rate: 202.1 symbols/min [2025-09-05T19:17:47.207496] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:47.210292] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-05T19:17:47.213696] [INFO ] [MAIN ] Derivative Progress: 1838/2117 symbols completed. THQ took 0.9s. Estimated remaining: 1m 23s. Rate: 202.2 symbols/min [2025-09-05T19:17:47.214221] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:47.221780] [INFO ] [MAIN ] THO: Generated 871 derivative records from 20010 primary records. [2025-09-05T19:17:47.237223] [INFO ] [MAIN ] THR: Loaded 9280 primary data records. [2025-09-05T19:17:47.237003] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-05T19:17:47.275233] [INFO ] [MAIN ] Derivative Progress: 1839/2117 symbols completed. THO took 0.9s. Estimated remaining: 1m 22s. Rate: 202.3 symbols/min [2025-09-05T19:17:47.328746] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:47.493953] [INFO ] [MAIN ] THS: Loaded 28715 primary data records. [2025-09-05T19:17:47.523970] [INFO ] [MAIN ] THW: Loaded 15083 primary data records. [2025-09-05T19:17:48.042525] [INFO ] [MAIN ] THR: Generated 871 derivative records from 9280 primary records. [2025-09-05T19:17:48.054498] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-05T19:17:48.056278] [INFO ] [MAIN ] Derivative Progress: 1840/2117 symbols completed. THR took 0.9s. Estimated remaining: 1m 22s. Rate: 202.2 symbols/min [2025-09-05T19:17:48.057347] [INFO ] [MAIN ] TIC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:48.074223] [INFO ] [MAIN ] THW: Generated 1352 derivative records from 15083 primary records. [2025-09-05T19:17:48.085091] [INFO ] [MAIN ] THS: Generated 1352 derivative records from 28715 primary records. [2025-09-05T19:17:48.114200] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-05T19:17:48.117371] [INFO ] [MAIN ] Derivative Progress: 1841/2117 symbols completed. THS took 0.9s. Estimated remaining: 1m 22s. Rate: 202.2 symbols/min [2025-09-05T19:17:48.125179] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-05T19:17:48.126247] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:48.128756] [INFO ] [MAIN ] Derivative Progress: 1842/2117 symbols completed. THW took 0.8s. Estimated remaining: 1m 22s. Rate: 202.3 symbols/min [2025-09-05T19:17:48.129215] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:48.130194] [INFO ] [MAIN ] TIC: Loaded 23119 primary data records. [2025-09-05T19:17:48.243625] [INFO ] [MAIN ] TISI: Loaded 1238 primary data records. [2025-09-05T19:17:48.416270] [INFO ] [MAIN ] TIMB: Loaded 27684 primary data records. [2025-09-05T19:17:48.913362] [INFO ] [MAIN ] TIC: Generated 871 derivative records from 23119 primary records. [2025-09-05T19:17:48.926472] [INFO ] [MAIN ] TIC: Successfully saved derivative data. [2025-09-05T19:17:48.928054] [INFO ] [MAIN ] Derivative Progress: 1843/2117 symbols completed. TIC took 0.9s. Estimated remaining: 1m 21s. Rate: 202.2 symbols/min [2025-09-05T19:17:48.935539] [INFO ] [MAIN ] TISI: Generated 871 derivative records from 1238 primary records. [2025-09-05T19:17:48.943130] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-05T19:17:48.944834] [INFO ] [MAIN ] Derivative Progress: 1844/2117 symbols completed. TISI took 0.8s. Estimated remaining: 1m 21s. Rate: 202.3 symbols/min [2025-09-05T19:17:48.957214] [INFO ] [MAIN ] TIMB: Generated 1352 derivative records from 27684 primary records. [2025-09-05T19:17:48.969866] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-05T19:17:48.972694] [INFO ] [MAIN ] Derivative Progress: 1845/2117 symbols completed. TIMB took 0.8s. Estimated remaining: 1m 21s. Rate: 202.4 symbols/min [2025-09-05T19:17:48.973149] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:48.973258] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:48.973352] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:49.010214] [INFO ] [MAIN ] TIXT: Loaded 17105 primary data records. [2025-09-05T19:17:49.010798] [INFO ] [MAIN ] TK: Loaded 18966 primary data records. [2025-09-05T19:17:49.148436] [INFO ] [MAIN ] TJX: Loaded 25993 primary data records. [2025-09-05T19:17:49.775379] [INFO ] [MAIN ] TK: Generated 871 derivative records from 18966 primary records. [2025-09-05T19:17:49.790088] [INFO ] [MAIN ] TIXT: Generated 871 derivative records from 17105 primary records. [2025-09-05T19:17:49.797767] [INFO ] [MAIN ] TJX: Generated 871 derivative records from 25993 primary records. [2025-09-05T19:17:49.810424] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-05T19:17:49.813507] [INFO ] [MAIN ] Derivative Progress: 1846/2117 symbols completed. TK took 0.8s. Estimated remaining: 1m 20s. Rate: 202.2 symbols/min [2025-09-05T19:17:49.816209] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-05T19:17:49.814465] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:49.818349] [INFO ] [MAIN ] Derivative Progress: 1847/2117 symbols completed. TJX took 0.8s. Estimated remaining: 1m 20s. Rate: 202.3 symbols/min [2025-09-05T19:17:49.818596] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:49.817127] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-05T19:17:49.820390] [INFO ] [MAIN ] Derivative Progress: 1848/2117 symbols completed. TIXT took 0.8s. Estimated remaining: 1m 20s. Rate: 202.4 symbols/min [2025-09-05T19:17:49.820877] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:49.842468] [INFO ] [MAIN ] TKC: Loaded 18281 primary data records. [2025-09-05T19:17:49.964157] [INFO ] [MAIN ] TKR: Loaded 18069 primary data records. [2025-09-05T19:17:49.959269] [INFO ] [MAIN ] TKO: Loaded 20108 primary data records. [2025-09-05T19:17:50.591009] [INFO ] [MAIN ] TKC: Generated 871 derivative records from 18281 primary records. [2025-09-05T19:17:50.616727] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-05T19:17:50.616172] [INFO ] [MAIN ] TKR: Generated 871 derivative records from 18069 primary records. [2025-09-05T19:17:50.618731] [INFO ] [MAIN ] Derivative Progress: 1849/2117 symbols completed. TKC took 0.8s. Estimated remaining: 1m 20s. Rate: 202.2 symbols/min [2025-09-05T19:17:50.618981] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:50.620156] [INFO ] [MAIN ] TKO: Generated 871 derivative records from 20108 primary records. [2025-09-05T19:17:50.636669] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-05T19:17:50.636586] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-05T19:17:50.638448] [INFO ] [MAIN ] Derivative Progress: 1850/2117 symbols completed. TKO took 0.8s. Estimated remaining: 1m 19s. Rate: 202.3 symbols/min [2025-09-05T19:17:50.638725] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:50.640265] [INFO ] [MAIN ] Derivative Progress: 1851/2117 symbols completed. TKR took 0.8s. Estimated remaining: 1m 19s. Rate: 202.4 symbols/min [2025-09-05T19:17:50.640801] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:50.656433] [INFO ] [MAIN ] TLYS: Loaded 9694 primary data records. [2025-09-05T19:17:50.754091] [INFO ] [MAIN ] TLK: Loaded 18883 primary data records. [2025-09-05T19:17:50.977277] [INFO ] [MAIN ] TM: Loaded 28494 primary data records. [2025-09-05T19:17:51.452815] [INFO ] [MAIN ] TLYS: Generated 871 derivative records from 9694 primary records. [2025-09-05T19:17:51.462542] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-05T19:17:51.464557] [INFO ] [MAIN ] Derivative Progress: 1852/2117 symbols completed. TLYS took 0.8s. Estimated remaining: 1m 19s. Rate: 202.2 symbols/min [2025-09-05T19:17:51.464786] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:51.477135] [INFO ] [MAIN ] TLK: Generated 871 derivative records from 18883 primary records. [2025-09-05T19:17:51.495398] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-05T19:17:51.497101] [INFO ] [MAIN ] Derivative Progress: 1853/2117 symbols completed. TLK took 0.9s. Estimated remaining: 1m 18s. Rate: 202.3 symbols/min [2025-09-05T19:17:51.497577] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:51.521564] [INFO ] [MAIN ] TM: Generated 1352 derivative records from 28494 primary records. [2025-09-05T19:17:51.522493] [INFO ] [MAIN ] TME: Loaded 25804 primary data records. [2025-09-05T19:17:51.679503] [INFO ] [MAIN ] TMHC: Loaded 22133 primary data records. [2025-09-05T19:17:51.685357] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-05T19:17:51.714837] [INFO ] [MAIN ] Derivative Progress: 1854/2117 symbols completed. TM took 1.1s. Estimated remaining: 1m 18s. Rate: 202.3 symbols/min [2025-09-05T19:17:51.840097] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:52.137202] [INFO ] [MAIN ] TMO: Loaded 25341 primary data records. [2025-09-05T19:17:52.231019] [INFO ] [MAIN ] TME: Generated 871 derivative records from 25804 primary records. [2025-09-05T19:17:52.346377] [INFO ] [MAIN ] TMHC: Generated 871 derivative records from 22133 primary records. [2025-09-05T19:17:52.403570] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-05T19:17:52.406385] [INFO ] [MAIN ] Derivative Progress: 1855/2117 symbols completed. TME took 0.9s. Estimated remaining: 1m 18s. Rate: 202.2 symbols/min [2025-09-05T19:17:52.413218] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:52.416887] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-05T19:17:52.419160] [INFO ] [MAIN ] Derivative Progress: 1856/2117 symbols completed. TMHC took 0.9s. Estimated remaining: 1m 17s. Rate: 202.3 symbols/min [2025-09-05T19:17:52.419777] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:52.430132] [INFO ] [MAIN ] TNC: Loaded 6804 primary data records. [2025-09-05T19:17:52.542665] [INFO ] [MAIN ] TNET: Loaded 13809 primary data records. [2025-09-05T19:17:52.782795] [INFO ] [MAIN ] TMO: Generated 871 derivative records from 25341 primary records. [2025-09-05T19:17:52.857837] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-05T19:17:52.876841] [INFO ] [MAIN ] Derivative Progress: 1857/2117 symbols completed. TMO took 1.1s. Estimated remaining: 1m 17s. Rate: 202.2 symbols/min [2025-09-05T19:17:52.881832] [INFO ] [MAIN ] TNGY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:52.946678] [INFO ] [MAIN ] TNGY: Loaded 2662 primary data records. [2025-09-05T19:17:53.062702] [INFO ] [MAIN ] TNC: Generated 871 derivative records from 6804 primary records. [2025-09-05T19:17:53.206586] [INFO ] [MAIN ] TNET: Generated 871 derivative records from 13809 primary records. [2025-09-05T19:17:53.205741] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-05T19:17:53.209083] [INFO ] [MAIN ] Derivative Progress: 1858/2117 symbols completed. TNC took 0.8s. Estimated remaining: 1m 17s. Rate: 202.2 symbols/min [2025-09-05T19:17:53.218577] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-05T19:17:53.220588] [INFO ] [MAIN ] Derivative Progress: 1859/2117 symbols completed. TNET took 0.8s. Estimated remaining: 1m 17s. Rate: 202.3 symbols/min [2025-09-05T19:17:53.230873] [INFO ] [MAIN ] TNGY: Generated 739 derivative records from 2662 primary records. [2025-09-05T19:17:53.237508] [INFO ] [MAIN ] TNGY: Successfully saved derivative data. [2025-09-05T19:17:53.238901] [INFO ] [MAIN ] Derivative Progress: 1860/2117 symbols completed. TNGY took 0.4s. Estimated remaining: 1m 16s. Rate: 202.4 symbols/min [2025-09-05T19:17:53.239491] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:53.239657] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:53.240239] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:53.273524] [INFO ] [MAIN ] TNL: Loaded 19918 primary data records. [2025-09-05T19:17:53.274906] [INFO ] [MAIN ] TNK: Loaded 16431 primary data records. [2025-09-05T19:17:53.582966] [INFO ] [MAIN ] TOL: Loaded 38288 primary data records. [2025-09-05T19:17:54.053623] [INFO ] [MAIN ] TNL: Generated 871 derivative records from 19918 primary records. [2025-09-05T19:17:54.068342] [INFO ] [MAIN ] TNK: Generated 871 derivative records from 16431 primary records. [2025-09-05T19:17:54.077295] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-05T19:17:54.078920] [INFO ] [MAIN ] Derivative Progress: 1861/2117 symbols completed. TNL took 0.8s. Estimated remaining: 1m 16s. Rate: 202.2 symbols/min [2025-09-05T19:17:54.080329] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:54.081260] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-05T19:17:54.082657] [INFO ] [MAIN ] Derivative Progress: 1862/2117 symbols completed. TNK took 0.8s. Estimated remaining: 1m 16s. Rate: 202.3 symbols/min [2025-09-05T19:17:54.082946] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:54.096716] [INFO ] [MAIN ] TOL: Generated 1352 derivative records from 38288 primary records. [2025-09-05T19:17:54.121771] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-05T19:17:54.125016] [INFO ] [MAIN ] Derivative Progress: 1863/2117 symbols completed. TOL took 0.9s. Estimated remaining: 1m 15s. Rate: 202.4 symbols/min [2025-09-05T19:17:54.130935] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:54.133147] [INFO ] [MAIN ] TPB: Loaded 18984 primary data records. [2025-09-05T19:17:54.179701] [INFO ] [MAIN ] TOST: Loaded 26003 primary data records. [2025-09-05T19:17:54.436064] [INFO ] [MAIN ] TPC: Loaded 19526 primary data records. [2025-09-05T19:17:54.971756] [INFO ] [MAIN ] TOST: Generated 871 derivative records from 26003 primary records. [2025-09-05T19:17:54.972430] [INFO ] [MAIN ] TPB: Generated 1352 derivative records from 18984 primary records. [2025-09-05T19:17:54.990588] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-05T19:17:54.994370] [INFO ] [MAIN ] Derivative Progress: 1864/2117 symbols completed. TOST took 0.9s. Estimated remaining: 1m 15s. Rate: 202.2 symbols/min [2025-09-05T19:17:55.003875] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:55.003986] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-05T19:17:55.005203] [INFO ] [MAIN ] TPC: Generated 871 derivative records from 19526 primary records. [2025-09-05T19:17:55.008158] [INFO ] [MAIN ] Derivative Progress: 1865/2117 symbols completed. TPB took 0.9s. Estimated remaining: 1m 15s. Rate: 202.3 symbols/min [2025-09-05T19:17:55.008935] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:55.017127] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-05T19:17:55.020582] [INFO ] [MAIN ] Derivative Progress: 1866/2117 symbols completed. TPC took 0.9s. Estimated remaining: 1m 14s. Rate: 202.4 symbols/min [2025-09-05T19:17:55.020867] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:55.025331] [INFO ] [MAIN ] TPL: Loaded 6522 primary data records. [2025-09-05T19:17:55.245838] [INFO ] [MAIN ] TPH: Loaded 34022 primary data records. [2025-09-05T19:17:55.322762] [INFO ] [MAIN ] TPR: Loaded 25885 primary data records. [2025-09-05T19:17:55.831067] [INFO ] [MAIN ] TPL: Generated 871 derivative records from 6522 primary records. [2025-09-05T19:17:55.842548] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-05T19:17:55.844859] [INFO ] [MAIN ] Derivative Progress: 1867/2117 symbols completed. TPL took 0.8s. Estimated remaining: 1m 14s. Rate: 202.2 symbols/min [2025-09-05T19:17:55.845423] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:55.881094] [INFO ] [MAIN ] TPH: Generated 1352 derivative records from 34022 primary records. [2025-09-05T19:17:55.881598] [INFO ] [MAIN ] TPVG: Loaded 12710 primary data records. [2025-09-05T19:17:55.883890] [INFO ] [MAIN ] TPR: Generated 871 derivative records from 25885 primary records. [2025-09-05T19:17:55.967483] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-05T19:17:55.983218] [INFO ] [MAIN ] Derivative Progress: 1868/2117 symbols completed. TPH took 1.0s. Estimated remaining: 1m 14s. Rate: 202.3 symbols/min [2025-09-05T19:17:55.993951] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:56.016326] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-05T19:17:56.018147] [INFO ] [MAIN ] Derivative Progress: 1869/2117 symbols completed. TPR took 1.0s. Estimated remaining: 1m 14s. Rate: 202.4 symbols/min [2025-09-05T19:17:56.035893] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:56.100880] [INFO ] [MAIN ] TPYP: Loaded 3636 primary data records. [2025-09-05T19:17:56.180535] [INFO ] [MAIN ] TPZ: Loaded 3599 primary data records. [2025-09-05T19:17:56.687588] [INFO ] [MAIN ] TPVG: Generated 871 derivative records from 12710 primary records. [2025-09-05T19:17:56.700575] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-05T19:17:56.703820] [INFO ] [MAIN ] Derivative Progress: 1870/2117 symbols completed. TPVG took 0.9s. Estimated remaining: 1m 13s. Rate: 202.2 symbols/min [2025-09-05T19:17:56.710909] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:56.711849] [INFO ] [MAIN ] TPYP: Generated 870 derivative records from 3636 primary records. [2025-09-05T19:17:56.723104] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-05T19:17:56.725020] [INFO ] [MAIN ] Derivative Progress: 1871/2117 symbols completed. TPYP took 0.7s. Estimated remaining: 1m 13s. Rate: 202.3 symbols/min [2025-09-05T19:17:56.725217] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:56.738618] [INFO ] [MAIN ] TPZ: Generated 1351 derivative records from 3599 primary records. [2025-09-05T19:17:56.744832] [INFO ] [MAIN ] TR: Loaded 9948 primary data records. [2025-09-05T19:17:56.811590] [INFO ] [MAIN ] TRAK: Loaded 4627 primary data records. [2025-09-05T19:17:56.865076] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-05T19:17:56.907983] [INFO ] [MAIN ] Derivative Progress: 1872/2117 symbols completed. TPZ took 0.9s. Estimated remaining: 1m 13s. Rate: 202.4 symbols/min [2025-09-05T19:17:56.973993] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:57.301415] [INFO ] [MAIN ] TRC: Loaded 7104 primary data records. [2025-09-05T19:17:57.555875] [INFO ] [MAIN ] TR: Generated 871 derivative records from 9948 primary records. [2025-09-05T19:17:57.563691] [INFO ] [MAIN ] TRAK: Generated 871 derivative records from 4627 primary records. [2025-09-05T19:17:57.578274] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-05T19:17:57.580572] [INFO ] [MAIN ] Derivative Progress: 1873/2117 symbols completed. TRAK took 0.9s. Estimated remaining: 1m 12s. Rate: 202.3 symbols/min [2025-09-05T19:17:57.583253] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-05T19:17:57.584813] [INFO ] [MAIN ] Derivative Progress: 1874/2117 symbols completed. TR took 0.9s. Estimated remaining: 1m 12s. Rate: 202.4 symbols/min [2025-09-05T19:17:57.594308] [INFO ] [MAIN ] TRC: Generated 871 derivative records from 7104 primary records. [2025-09-05T19:17:57.602354] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-05T19:17:57.603996] [INFO ] [MAIN ] Derivative Progress: 1875/2117 symbols completed. TRC took 0.7s. Estimated remaining: 1m 12s. Rate: 202.5 symbols/min [2025-09-05T19:17:57.604738] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:57.604555] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:57.604901] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:57.651130] [INFO ] [MAIN ] TREX: Loaded 24141 primary data records. [2025-09-05T19:17:57.651751] [INFO ] [MAIN ] TRGP: Loaded 24335 primary data records. [2025-09-05T19:17:57.754900] [INFO ] [MAIN ] TRN: Loaded 28256 primary data records. [2025-09-05T19:17:58.434045] [INFO ] [MAIN ] TREX: Generated 871 derivative records from 24141 primary records. [2025-09-05T19:17:58.434719] [INFO ] [MAIN ] TRGP: Generated 871 derivative records from 24335 primary records. [2025-09-05T19:17:58.450518] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-05T19:17:58.452476] [INFO ] [MAIN ] Derivative Progress: 1876/2117 symbols completed. TREX took 0.8s. Estimated remaining: 1m 11s. Rate: 202.3 symbols/min [2025-09-05T19:17:58.452961] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:58.453733] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-05T19:17:58.455695] [INFO ] [MAIN ] Derivative Progress: 1877/2117 symbols completed. TRGP took 0.9s. Estimated remaining: 1m 11s. Rate: 202.4 symbols/min [2025-09-05T19:17:58.458423] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:58.469515] [INFO ] [MAIN ] TRN: Generated 1352 derivative records from 28256 primary records. [2025-09-05T19:17:58.500484] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-05T19:17:58.503005] [INFO ] [MAIN ] Derivative Progress: 1878/2117 symbols completed. TRN took 0.9s. Estimated remaining: 1m 11s. Rate: 202.5 symbols/min [2025-09-05T19:17:58.504202] [INFO ] [MAIN ] TRNO: Loaded 21341 primary data records. [2025-09-05T19:17:58.504401] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:58.615688] [INFO ] [MAIN ] TROX: Loaded 25070 primary data records. [2025-09-05T19:17:58.880907] [INFO ] [MAIN ] TRP: Loaded 25197 primary data records. [2025-09-05T19:17:59.255094] [INFO ] [MAIN ] TRNO: Generated 871 derivative records from 21341 primary records. [2025-09-05T19:17:59.268206] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-05T19:17:59.269541] [INFO ] [MAIN ] Derivative Progress: 1879/2117 symbols completed. TRNO took 0.8s. Estimated remaining: 1m 11s. Rate: 202.3 symbols/min [2025-09-05T19:17:59.276004] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:59.277133] [INFO ] [MAIN ] TROX: Generated 871 derivative records from 25070 primary records. [2025-09-05T19:17:59.288495] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-05T19:17:59.297153] [INFO ] [MAIN ] Derivative Progress: 1880/2117 symbols completed. TROX took 0.8s. Estimated remaining: 1m 10s. Rate: 202.4 symbols/min [2025-09-05T19:17:59.297386] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:59.295399] [INFO ] [MAIN ] TRP: Generated 871 derivative records from 25197 primary records. [2025-09-05T19:17:59.317274] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-05T19:17:59.320108] [INFO ] [MAIN ] Derivative Progress: 1881/2117 symbols completed. TRP took 0.8s. Estimated remaining: 1m 10s. Rate: 202.5 symbols/min [2025-09-05T19:17:59.320559] [INFO ] [MAIN ] TRTX: Loaded 17263 primary data records. [2025-09-05T19:17:59.320886] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:17:59.491043] [INFO ] [MAIN ] TRU: Loaded 24531 primary data records. [2025-09-05T19:17:59.592206] [INFO ] [MAIN ] TRV: Loaded 23374 primary data records. [2025-09-05T19:18:00.140109] [INFO ] [MAIN ] TRTX: Generated 871 derivative records from 17263 primary records. [2025-09-05T19:18:00.149671] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-05T19:18:00.151163] [INFO ] [MAIN ] Derivative Progress: 1882/2117 symbols completed. TRTX took 0.9s. Estimated remaining: 1m 10s. Rate: 202.3 symbols/min [2025-09-05T19:18:00.151471] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:00.161951] [INFO ] [MAIN ] TRU: Generated 871 derivative records from 24531 primary records. [2025-09-05T19:18:00.179374] [INFO ] [MAIN ] TRV: Generated 871 derivative records from 23374 primary records. [2025-09-05T19:18:00.180426] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-05T19:18:00.182389] [INFO ] [MAIN ] Derivative Progress: 1883/2117 symbols completed. TRU took 0.9s. Estimated remaining: 1m 9s. Rate: 202.4 symbols/min [2025-09-05T19:18:00.182961] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:00.198192] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-05T19:18:00.199955] [INFO ] [MAIN ] Derivative Progress: 1884/2117 symbols completed. TRV took 0.9s. Estimated remaining: 1m 9s. Rate: 202.5 symbols/min [2025-09-05T19:18:00.200231] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:00.209673] [INFO ] [MAIN ] TS: Loaded 24900 primary data records. [2025-09-05T19:18:00.249851] [INFO ] [MAIN ] TSI: Loaded 4011 primary data records. [2025-09-05T19:18:00.398616] [INFO ] [MAIN ] TSE: Loaded 14033 primary data records. [2025-09-05T19:18:00.972549] [INFO ] [MAIN ] TS: Generated 871 derivative records from 24900 primary records. [2025-09-05T19:18:00.984314] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-05T19:18:00.986269] [INFO ] [MAIN ] Derivative Progress: 1885/2117 symbols completed. TS took 0.8s. Estimated remaining: 1m 9s. Rate: 202.3 symbols/min [2025-09-05T19:18:00.993340] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:00.994396] [INFO ] [MAIN ] TSI: Generated 870 derivative records from 4011 primary records. [2025-09-05T19:18:01.001457] [INFO ] [MAIN ] TSE: Generated 871 derivative records from 14033 primary records. [2025-09-05T19:18:01.010051] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-05T19:18:01.012005] [INFO ] [MAIN ] Derivative Progress: 1886/2117 symbols completed. TSI took 0.8s. Estimated remaining: 1m 8s. Rate: 202.4 symbols/min [2025-09-05T19:18:01.018203] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:01.028896] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-05T19:18:01.030709] [INFO ] [MAIN ] Derivative Progress: 1887/2117 symbols completed. TSE took 0.8s. Estimated remaining: 1m 8s. Rate: 202.5 symbols/min [2025-09-05T19:18:01.031069] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:01.039680] [INFO ] [MAIN ] TSLX: Loaded 16736 primary data records. [2025-09-05T19:18:01.191126] [INFO ] [MAIN ] TSM: Loaded 26129 primary data records. [2025-09-05T19:18:01.309815] [INFO ] [MAIN ] TSN: Loaded 25761 primary data records. [2025-09-05T19:18:01.803769] [INFO ] [MAIN ] TSLX: Generated 871 derivative records from 16736 primary records. [2025-09-05T19:18:01.821818] [INFO ] [MAIN ] TSM: Generated 871 derivative records from 26129 primary records. [2025-09-05T19:18:01.823847] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-05T19:18:01.825583] [INFO ] [MAIN ] Derivative Progress: 1888/2117 symbols completed. TSLX took 0.8s. Estimated remaining: 1m 8s. Rate: 202.3 symbols/min [2025-09-05T19:18:01.843415] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-05T19:18:01.846297] [INFO ] [MAIN ] Derivative Progress: 1889/2117 symbols completed. TSM took 0.8s. Estimated remaining: 1m 8s. Rate: 202.4 symbols/min [2025-09-05T19:18:01.844571] [INFO ] [MAIN ] TSN: Generated 871 derivative records from 25761 primary records. [2025-09-05T19:18:01.854670] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-05T19:18:01.856319] [INFO ] [MAIN ] Derivative Progress: 1890/2117 symbols completed. TSN took 0.8s. Estimated remaining: 1m 7s. Rate: 202.5 symbols/min [2025-09-05T19:18:01.856838] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:01.856943] [INFO ] [MAIN ] TTAM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:01.857014] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:01.865932] [INFO ] [MAIN ] TSQ: Loaded 6275 primary data records. [2025-09-05T19:18:02.004794] [INFO ] [MAIN ] TTAM: Loaded 14670 primary data records. [2025-09-05T19:18:02.058541] [INFO ] [MAIN ] TT: Loaded 22251 primary data records. [2025-09-05T19:18:02.681038] [INFO ] [MAIN ] TSQ: Generated 871 derivative records from 6275 primary records. [2025-09-05T19:18:02.692003] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-05T19:18:02.693767] [INFO ] [MAIN ] Derivative Progress: 1891/2117 symbols completed. TSQ took 0.8s. Estimated remaining: 1m 7s. Rate: 202.3 symbols/min [2025-09-05T19:18:02.694261] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:02.707496] [INFO ] [MAIN ] TTAM: Generated 871 derivative records from 14670 primary records. [2025-09-05T19:18:02.714694] [INFO ] [MAIN ] TT: Generated 871 derivative records from 22251 primary records. [2025-09-05T19:18:02.745024] [INFO ] [MAIN ] TTAM: Successfully saved derivative data. [2025-09-05T19:18:02.747487] [INFO ] [MAIN ] Derivative Progress: 1892/2117 symbols completed. TTAM took 0.9s. Estimated remaining: 1m 7s. Rate: 202.4 symbols/min [2025-09-05T19:18:02.745357] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-05T19:18:02.747738] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:02.750213] [INFO ] [MAIN ] Derivative Progress: 1893/2117 symbols completed. TT took 0.9s. Estimated remaining: 1m 6s. Rate: 202.5 symbols/min [2025-09-05T19:18:02.750776] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:02.748603] [INFO ] [MAIN ] TTC: Loaded 20154 primary data records. [2025-09-05T19:18:02.973706] [INFO ] [MAIN ] TTI: Loaded 22181 primary data records. [2025-09-05T19:18:02.974949] [INFO ] [MAIN ] TTE: Loaded 24989 primary data records. [2025-09-05T19:18:03.576161] [INFO ] [MAIN ] TTC: Generated 871 derivative records from 20154 primary records. [2025-09-05T19:18:03.587814] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-05T19:18:03.589220] [INFO ] [MAIN ] Derivative Progress: 1894/2117 symbols completed. TTC took 0.9s. Estimated remaining: 1m 6s. Rate: 202.3 symbols/min [2025-09-05T19:18:03.589824] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:03.601936] [INFO ] [MAIN ] TTI: Generated 871 derivative records from 22181 primary records. [2025-09-05T19:18:03.610002] [INFO ] [MAIN ] TTE: Generated 871 derivative records from 24989 primary records. [2025-09-05T19:18:03.617877] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-05T19:18:03.619612] [INFO ] [MAIN ] Derivative Progress: 1895/2117 symbols completed. TTI took 0.9s. Estimated remaining: 1m 6s. Rate: 202.4 symbols/min [2025-09-05T19:18:03.620459] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:03.635770] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-05T19:18:03.637974] [INFO ] [MAIN ] Derivative Progress: 1896/2117 symbols completed. TTE took 0.9s. Estimated remaining: 1m 5s. Rate: 202.5 symbols/min [2025-09-05T19:18:03.638251] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:03.648215] [INFO ] [MAIN ] TU: Loaded 23842 primary data records. [2025-09-05T19:18:03.776087] [INFO ] [MAIN ] TUYA: Loaded 22043 primary data records. [2025-09-05T19:18:03.776858] [INFO ] [MAIN ] TV: Loaded 19625 primary data records. [2025-09-05T19:18:04.407948] [INFO ] [MAIN ] TU: Generated 871 derivative records from 23842 primary records. [2025-09-05T19:18:04.420241] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-05T19:18:04.421607] [INFO ] [MAIN ] Derivative Progress: 1897/2117 symbols completed. TU took 0.8s. Estimated remaining: 1m 5s. Rate: 202.4 symbols/min [2025-09-05T19:18:04.434678] [INFO ] [MAIN ] TUYA: Generated 871 derivative records from 22043 primary records. [2025-09-05T19:18:04.434992] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:04.436375] [INFO ] [MAIN ] TV: Generated 871 derivative records from 19625 primary records. [2025-09-05T19:18:04.445150] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-05T19:18:04.452773] [INFO ] [MAIN ] Derivative Progress: 1898/2117 symbols completed. TUYA took 0.8s. Estimated remaining: 1m 5s. Rate: 202.4 symbols/min [2025-09-05T19:18:04.453202] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:04.456577] [INFO ] [MAIN ] TVC: Loaded 2536 primary data records. [2025-09-05T19:18:04.458254] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-05T19:18:04.471048] [INFO ] [MAIN ] Derivative Progress: 1899/2117 symbols completed. TV took 0.8s. Estimated remaining: 1m 5s. Rate: 202.5 symbols/min [2025-09-05T19:18:04.492416] [INFO ] [MAIN ] TVE: Loaded 1942 primary data records. [2025-09-05T19:18:04.530571] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:05.039048] [INFO ] [MAIN ] TWI: Loaded 25473 primary data records. [2025-09-05T19:18:05.409061] [INFO ] [MAIN ] TVC: Generated 1352 derivative records from 2536 primary records. [2025-09-05T19:18:05.420222] [INFO ] [MAIN ] TVE: Generated 1352 derivative records from 1942 primary records. [2025-09-05T19:18:05.442707] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-05T19:18:05.441265] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-05T19:18:05.445182] [INFO ] [MAIN ] Derivative Progress: 1900/2117 symbols completed. TVC took 1.0s. Estimated remaining: 1m 4s. Rate: 202.3 symbols/min [2025-09-05T19:18:05.447947] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:05.448405] [INFO ] [MAIN ] Derivative Progress: 1901/2117 symbols completed. TVE took 1.0s. Estimated remaining: 1m 4s. Rate: 202.4 symbols/min [2025-09-05T19:18:05.449191] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:05.453695] [INFO ] [MAIN ] TWN: Loaded 2226 primary data records. [2025-09-05T19:18:05.582630] [INFO ] [MAIN ] TWI: Generated 1352 derivative records from 25473 primary records. [2025-09-05T19:18:05.687668] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-05T19:18:05.690821] [INFO ] [MAIN ] Derivative Progress: 1902/2117 symbols completed. TWI took 1.2s. Estimated remaining: 1m 4s. Rate: 202.4 symbols/min [2025-09-05T19:18:05.785181] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:05.810367] [INFO ] [MAIN ] TWLO: Loaded 39705 primary data records. [2025-09-05T19:18:06.008836] [INFO ] [MAIN ] TWO: Loaded 23716 primary data records. [2025-09-05T19:18:06.250877] [INFO ] [MAIN ] TWN: Generated 1352 derivative records from 2226 primary records. [2025-09-05T19:18:06.367277] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-05T19:18:06.369957] [INFO ] [MAIN ] Derivative Progress: 1903/2117 symbols completed. TWN took 0.9s. Estimated remaining: 1m 3s. Rate: 202.3 symbols/min [2025-09-05T19:18:06.387093] [INFO ] [MAIN ] TWLO: Generated 1352 derivative records from 39705 primary records. [2025-09-05T19:18:06.404351] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-05T19:18:06.407718] [INFO ] [MAIN ] Derivative Progress: 1904/2117 symbols completed. TWLO took 1.0s. Estimated remaining: 1m 3s. Rate: 202.4 symbols/min [2025-09-05T19:18:06.415123] [INFO ] [MAIN ] TWO: Generated 871 derivative records from 23716 primary records. [2025-09-05T19:18:06.423581] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-05T19:18:06.425195] [INFO ] [MAIN ] Derivative Progress: 1905/2117 symbols completed. TWO took 0.6s. Estimated remaining: 1m 3s. Rate: 202.5 symbols/min [2025-09-05T19:18:06.425950] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:06.426036] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:06.425782] [INFO ] [MAIN ] TWOD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:06.433267] [INFO ] [MAIN ] TWOD: Loaded 3919 primary data records. [2025-09-05T19:18:06.535295] [INFO ] [MAIN ] TX: Loaded 11449 primary data records. [2025-09-05T19:18:06.660717] [INFO ] [MAIN ] TXNM: Loaded 21100 primary data records. [2025-09-05T19:18:07.232874] [INFO ] [MAIN ] TWOD: Generated 1000 derivative records from 3919 primary records. [2025-09-05T19:18:07.233857] [INFO ] [MAIN ] TX: Generated 871 derivative records from 11449 primary records. [2025-09-05T19:18:07.250541] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-05T19:18:07.252912] [INFO ] [MAIN ] TWOD: Successfully saved derivative data. [2025-09-05T19:18:07.254917] [INFO ] [MAIN ] Derivative Progress: 1906/2117 symbols completed. TX took 0.8s. Estimated remaining: 1m 3s. Rate: 202.3 symbols/min [2025-09-05T19:18:07.255453] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:07.259315] [INFO ] [MAIN ] Derivative Progress: 1907/2117 symbols completed. TWOD took 0.8s. Estimated remaining: 1m 2s. Rate: 202.4 symbols/min [2025-09-05T19:18:07.260325] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:07.268615] [INFO ] [MAIN ] TXNM: Generated 871 derivative records from 21100 primary records. [2025-09-05T19:18:07.284178] [INFO ] [MAIN ] TXO: Loaded 10183 primary data records. [2025-09-05T19:18:07.284980] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-05T19:18:07.307224] [INFO ] [MAIN ] Derivative Progress: 1908/2117 symbols completed. TXNM took 0.9s. Estimated remaining: 1m 2s. Rate: 202.5 symbols/min [2025-09-05T19:18:07.333579] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:07.485942] [INFO ] [MAIN ] TY: Loaded 5783 primary data records. [2025-09-05T19:18:07.576393] [INFO ] [MAIN ] TXT: Loaded 37353 primary data records. [2025-09-05T19:18:08.176177] [INFO ] [MAIN ] TXO: Generated 871 derivative records from 10183 primary records. [2025-09-05T19:18:08.187128] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-05T19:18:08.188625] [INFO ] [MAIN ] Derivative Progress: 1909/2117 symbols completed. TXO took 0.9s. Estimated remaining: 1m 2s. Rate: 202.3 symbols/min [2025-09-05T19:18:08.189153] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:08.210585] [INFO ] [MAIN ] TY: Generated 1352 derivative records from 5783 primary records. [2025-09-05T19:18:08.210970] [INFO ] [MAIN ] TYG: Loaded 6977 primary data records. [2025-09-05T19:18:08.307042] [INFO ] [MAIN ] TXT: Generated 1352 derivative records from 37353 primary records. [2025-09-05T19:18:08.341218] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-05T19:18:08.361979] [INFO ] [MAIN ] Derivative Progress: 1910/2117 symbols completed. TY took 1.0s. Estimated remaining: 1m 1s. Rate: 202.3 symbols/min [2025-09-05T19:18:08.388577] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:08.481898] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-05T19:18:08.484590] [INFO ] [MAIN ] Derivative Progress: 1911/2117 symbols completed. TXT took 1.2s. Estimated remaining: 1m 1s. Rate: 202.4 symbols/min [2025-09-05T19:18:08.484962] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:08.497784] [INFO ] [MAIN ] TYL: Loaded 10543 primary data records. [2025-09-05T19:18:08.687990] [INFO ] [MAIN ] TYG: Generated 871 derivative records from 6977 primary records. [2025-09-05T19:18:08.795353] [INFO ] [MAIN ] U: Loaded 40539 primary data records. [2025-09-05T19:18:08.797939] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-05T19:18:08.799742] [INFO ] [MAIN ] Derivative Progress: 1912/2117 symbols completed. TYG took 0.6s. Estimated remaining: 1m 1s. Rate: 202.4 symbols/min [2025-09-05T19:18:08.843943] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:09.092463] [INFO ] [MAIN ] TYL: Generated 871 derivative records from 10543 primary records. [2025-09-05T19:18:09.117527] [INFO ] [MAIN ] UA: Loaded 37616 primary data records. [2025-09-05T19:18:09.117661] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-05T19:18:09.119450] [INFO ] [MAIN ] Derivative Progress: 1913/2117 symbols completed. TYL took 0.7s. Estimated remaining: 1m 0s. Rate: 202.4 symbols/min [2025-09-05T19:18:09.132126] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:09.353145] [INFO ] [MAIN ] U: Generated 1352 derivative records from 40539 primary records. [2025-09-05T19:18:09.466763] [INFO ] [MAIN ] UAA: Loaded 25864 primary data records. [2025-09-05T19:18:09.515822] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-05T19:18:09.530963] [INFO ] [MAIN ] Derivative Progress: 1914/2117 symbols completed. U took 1.0s. Estimated remaining: 1m 0s. Rate: 202.3 symbols/min [2025-09-05T19:18:09.577338] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:09.715997] [INFO ] [MAIN ] UAN: Loaded 4210 primary data records. [2025-09-05T19:18:09.911675] [INFO ] [MAIN ] UA: Generated 1352 derivative records from 37616 primary records. [2025-09-05T19:18:10.014759] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-05T19:18:10.017419] [INFO ] [MAIN ] Derivative Progress: 1915/2117 symbols completed. UA took 1.2s. Estimated remaining: 59.9s. Rate: 202.3 symbols/min [2025-09-05T19:18:10.018726] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:10.030670] [INFO ] [MAIN ] UAA: Generated 871 derivative records from 25864 primary records. [2025-09-05T19:18:10.040189] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-05T19:18:10.041719] [INFO ] [MAIN ] Derivative Progress: 1916/2117 symbols completed. UAA took 0.9s. Estimated remaining: 59.6s. Rate: 202.4 symbols/min [2025-09-05T19:18:10.042125] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:10.065914] [INFO ] [MAIN ] UBER: Loaded 26116 primary data records. [2025-09-05T19:18:10.076447] [INFO ] [MAIN ] UAN: Generated 1352 derivative records from 4210 primary records. [2025-09-05T19:18:10.212216] [INFO ] [MAIN ] UBS: Loaded 25124 primary data records. [2025-09-05T19:18:10.212307] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-05T19:18:10.236073] [INFO ] [MAIN ] Derivative Progress: 1917/2117 symbols completed. UAN took 0.7s. Estimated remaining: 59.3s. Rate: 202.4 symbols/min [2025-09-05T19:18:10.268093] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:10.660303] [INFO ] [MAIN ] UCB: Loaded 18092 primary data records. [2025-09-05T19:18:10.863900] [INFO ] [MAIN ] UBER: Generated 871 derivative records from 26116 primary records. [2025-09-05T19:18:10.941732] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-05T19:18:10.951218] [INFO ] [MAIN ] UBS: Generated 871 derivative records from 25124 primary records. [2025-09-05T19:18:10.952785] [INFO ] [MAIN ] Derivative Progress: 1918/2117 symbols completed. UBER took 0.9s. Estimated remaining: 59.0s. Rate: 202.2 symbols/min [2025-09-05T19:18:10.964246] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-05T19:18:10.966012] [INFO ] [MAIN ] Derivative Progress: 1919/2117 symbols completed. UBS took 0.9s. Estimated remaining: 58.7s. Rate: 202.3 symbols/min [2025-09-05T19:18:10.977882] [INFO ] [MAIN ] UCB: Generated 871 derivative records from 18092 primary records. [2025-09-05T19:18:10.986616] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-05T19:18:10.988373] [INFO ] [MAIN ] Derivative Progress: 1920/2117 symbols completed. UCB took 0.7s. Estimated remaining: 58.4s. Rate: 202.4 symbols/min [2025-09-05T19:18:10.988913] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:10.989135] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:10.989075] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:10.996059] [INFO ] [MAIN ] UFI: Loaded 3006 primary data records. [2025-09-05T19:18:11.162894] [INFO ] [MAIN ] UE: Loaded 21075 primary data records. [2025-09-05T19:18:11.209060] [INFO ] [MAIN ] UDR: Loaded 25191 primary data records. [2025-09-05T19:18:11.754790] [INFO ] [MAIN ] UFI: Generated 871 derivative records from 3006 primary records. [2025-09-05T19:18:11.765758] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-05T19:18:11.767492] [INFO ] [MAIN ] Derivative Progress: 1921/2117 symbols completed. UFI took 0.8s. Estimated remaining: 58.1s. Rate: 202.3 symbols/min [2025-09-05T19:18:11.768078] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:11.775483] [INFO ] [MAIN ] UDR: Generated 871 derivative records from 25191 primary records. [2025-09-05T19:18:11.792424] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-05T19:18:11.790820] [INFO ] [MAIN ] UE: Generated 871 derivative records from 21075 primary records. [2025-09-05T19:18:11.794203] [INFO ] [MAIN ] Derivative Progress: 1922/2117 symbols completed. UDR took 0.8s. Estimated remaining: 57.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:11.795116] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:11.803831] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-05T19:18:11.805834] [INFO ] [MAIN ] Derivative Progress: 1923/2117 symbols completed. UE took 0.8s. Estimated remaining: 57.5s. Rate: 202.5 symbols/min [2025-09-05T19:18:11.806402] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:11.830520] [INFO ] [MAIN ] UHAL: Loaded 8340 primary data records. [2025-09-05T19:18:11.942015] [INFO ] [MAIN ] UGP: Loaded 20652 primary data records. [2025-09-05T19:18:11.954092] [INFO ] [MAIN ] UGI: Loaded 38017 primary data records. [2025-09-05T19:18:12.624744] [INFO ] [MAIN ] UHAL: Generated 871 derivative records from 8340 primary records. [2025-09-05T19:18:12.626256] [INFO ] [MAIN ] UGP: Generated 871 derivative records from 20652 primary records. [2025-09-05T19:18:12.643223] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-05T19:18:12.644741] [INFO ] [MAIN ] Derivative Progress: 1924/2117 symbols completed. UHAL took 0.8s. Estimated remaining: 57.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:12.645661] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-05T19:18:12.647575] [INFO ] [MAIN ] Derivative Progress: 1925/2117 symbols completed. UGP took 0.9s. Estimated remaining: 56.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:12.647748] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:12.648432] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:12.664920] [INFO ] [MAIN ] UGI: Generated 1352 derivative records from 38017 primary records. [2025-09-05T19:18:12.678712] [INFO ] [MAIN ] UHT: Loaded 7299 primary data records. [2025-09-05T19:18:12.702550] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-05T19:18:12.752714] [INFO ] [MAIN ] Derivative Progress: 1926/2117 symbols completed. UGI took 1.0s. Estimated remaining: 56.6s. Rate: 202.4 symbols/min [2025-09-05T19:18:12.798165] [INFO ] [MAIN ] UHS: Loaded 19766 primary data records. [2025-09-05T19:18:12.794365] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:13.073692] [INFO ] [MAIN ] UI: Loaded 6598 primary data records. [2025-09-05T19:18:13.544285] [INFO ] [MAIN ] UHT: Generated 1352 derivative records from 7299 primary records. [2025-09-05T19:18:13.553165] [INFO ] [MAIN ] UHS: Generated 871 derivative records from 19766 primary records. [2025-09-05T19:18:13.584782] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-05T19:18:13.584277] [INFO ] [MAIN ] UI: Generated 871 derivative records from 6598 primary records. [2025-09-05T19:18:13.586865] [INFO ] [MAIN ] Derivative Progress: 1927/2117 symbols completed. UHS took 0.9s. Estimated remaining: 56.4s. Rate: 202.3 symbols/min [2025-09-05T19:18:13.588191] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-05T19:18:13.596654] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:13.596782] [INFO ] [MAIN ] Derivative Progress: 1928/2117 symbols completed. UHT took 0.9s. Estimated remaining: 56.0s. Rate: 202.4 symbols/min [2025-09-05T19:18:13.598310] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:13.599173] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-05T19:18:13.601141] [INFO ] [MAIN ] Derivative Progress: 1929/2117 symbols completed. UI took 0.8s. Estimated remaining: 55.7s. Rate: 202.5 symbols/min [2025-09-05T19:18:13.601836] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:13.640748] [INFO ] [MAIN ] UIS: Loaded 28184 primary data records. [2025-09-05T19:18:13.788364] [INFO ] [MAIN ] ULS: Loaded 29903 primary data records. [2025-09-05T19:18:13.813615] [INFO ] [MAIN ] UL: Loaded 39926 primary data records. [2025-09-05T19:18:14.559109] [INFO ] [MAIN ] UIS: Generated 1352 derivative records from 28184 primary records. [2025-09-05T19:18:14.564236] [INFO ] [MAIN ] ULS: Generated 1352 derivative records from 29903 primary records. [2025-09-05T19:18:14.588219] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-05T19:18:14.592212] [INFO ] [MAIN ] Derivative Progress: 1930/2117 symbols completed. ULS took 1.0s. Estimated remaining: 55.5s. Rate: 202.2 symbols/min [2025-09-05T19:18:14.593042] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:14.593229] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-05T19:18:14.595341] [INFO ] [MAIN ] Derivative Progress: 1931/2117 symbols completed. UIS took 1.0s. Estimated remaining: 55.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:14.596034] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:14.606806] [INFO ] [MAIN ] UL: Generated 1352 derivative records from 39926 primary records. [2025-09-05T19:18:14.620136] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-05T19:18:14.622819] [INFO ] [MAIN ] Derivative Progress: 1932/2117 symbols completed. UL took 1.0s. Estimated remaining: 54.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:14.623074] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:14.647325] [INFO ] [MAIN ] UMH: Loaded 15884 primary data records. [2025-09-05T19:18:14.725863] [INFO ] [MAIN ] UNF: Loaded 5479 primary data records. [2025-09-05T19:18:14.833118] [INFO ] [MAIN ] UMC: Loaded 39682 primary data records. [2025-09-05T19:18:15.436618] [INFO ] [MAIN ] UMH: Generated 871 derivative records from 15884 primary records. [2025-09-05T19:18:15.437506] [INFO ] [MAIN ] UNF: Generated 871 derivative records from 5479 primary records. [2025-09-05T19:18:15.453565] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-05T19:18:15.456159] [INFO ] [MAIN ] Derivative Progress: 1933/2117 symbols completed. UNF took 0.8s. Estimated remaining: 54.6s. Rate: 202.2 symbols/min [2025-09-05T19:18:15.456665] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-05T19:18:15.458049] [INFO ] [MAIN ] Derivative Progress: 1934/2117 symbols completed. UMH took 0.9s. Estimated remaining: 54.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:15.471295] [INFO ] [MAIN ] UMC: Generated 1352 derivative records from 39682 primary records. [2025-09-05T19:18:15.482716] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-05T19:18:15.485729] [INFO ] [MAIN ] Derivative Progress: 1935/2117 symbols completed. UMC took 0.9s. Estimated remaining: 53.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:15.486389] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:15.486341] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:15.486765] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:15.549891] [INFO ] [MAIN ] UNM: Loaded 23394 primary data records. [2025-09-05T19:18:15.549245] [INFO ] [MAIN ] UNFI: Loaded 31549 primary data records. [2025-09-05T19:18:15.719330] [INFO ] [MAIN ] UNH: Loaded 40559 primary data records. [2025-09-05T19:18:16.363389] [INFO ] [MAIN ] UNM: Generated 871 derivative records from 23394 primary records. [2025-09-05T19:18:16.373518] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-05T19:18:16.380394] [INFO ] [MAIN ] Derivative Progress: 1936/2117 symbols completed. UNM took 0.9s. Estimated remaining: 53.7s. Rate: 202.2 symbols/min [2025-09-05T19:18:16.384980] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:16.384914] [INFO ] [MAIN ] UNFI: Generated 1352 derivative records from 31549 primary records. [2025-09-05T19:18:16.399530] [INFO ] [MAIN ] UNMA: Loaded 1881 primary data records. [2025-09-05T19:18:16.446090] [INFO ] [MAIN ] UNH: Generated 1352 derivative records from 40559 primary records. [2025-09-05T19:18:16.520075] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-05T19:18:16.533006] [INFO ] [MAIN ] Derivative Progress: 1937/2117 symbols completed. UNFI took 1.0s. Estimated remaining: 53.4s. Rate: 202.3 symbols/min [2025-09-05T19:18:16.549004] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-05T19:18:16.551489] [INFO ] [MAIN ] Derivative Progress: 1938/2117 symbols completed. UNH took 1.1s. Estimated remaining: 53.1s. Rate: 202.4 symbols/min [2025-09-05T19:18:16.556671] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:16.556888] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:16.708138] [INFO ] [MAIN ] UP: Loaded 20775 primary data records. [2025-09-05T19:18:16.709157] [INFO ] [MAIN ] UNMA: Generated 871 derivative records from 1881 primary records. [2025-09-05T19:18:16.825891] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-05T19:18:16.826500] [INFO ] [MAIN ] UPS: Loaded 26042 primary data records. [2025-09-05T19:18:16.827735] [INFO ] [MAIN ] Derivative Progress: 1939/2117 symbols completed. UNMA took 0.4s. Estimated remaining: 52.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:16.828013] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:17.072842] [INFO ] [MAIN ] URI: Loaded 16604 primary data records. [2025-09-05T19:18:17.447092] [INFO ] [MAIN ] UP: Generated 871 derivative records from 20775 primary records. [2025-09-05T19:18:17.462776] [INFO ] [MAIN ] UPS: Generated 871 derivative records from 26042 primary records. [2025-09-05T19:18:17.469575] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-05T19:18:17.475593] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-05T19:18:17.473257] [INFO ] [MAIN ] Derivative Progress: 1940/2117 symbols completed. UP took 0.9s. Estimated remaining: 52.5s. Rate: 202.2 symbols/min [2025-09-05T19:18:17.477237] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:17.478620] [INFO ] [MAIN ] Derivative Progress: 1941/2117 symbols completed. UPS took 0.9s. Estimated remaining: 52.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:17.479428] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:17.487538] [INFO ] [MAIN ] URI: Generated 871 derivative records from 16604 primary records. [2025-09-05T19:18:17.503383] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-05T19:18:17.505233] [INFO ] [MAIN ] Derivative Progress: 1942/2117 symbols completed. URI took 0.7s. Estimated remaining: 51.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:17.502962] [INFO ] [MAIN ] USAC: Loaded 9347 primary data records. [2025-09-05T19:18:17.521946] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:17.621230] [INFO ] [MAIN ] USA: Loaded 17405 primary data records. [2025-09-05T19:18:18.016089] [INFO ] [MAIN ] USB: Loaded 40428 primary data records. [2025-09-05T19:18:18.366061] [INFO ] [MAIN ] USAC: Generated 871 derivative records from 9347 primary records. [2025-09-05T19:18:18.377782] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-05T19:18:18.379768] [INFO ] [MAIN ] Derivative Progress: 1943/2117 symbols completed. USAC took 0.9s. Estimated remaining: 51.6s. Rate: 202.2 symbols/min [2025-09-05T19:18:18.380017] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:18.388175] [INFO ] [MAIN ] USA: Generated 871 derivative records from 17405 primary records. [2025-09-05T19:18:18.398454] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-05T19:18:18.399943] [INFO ] [MAIN ] Derivative Progress: 1944/2117 symbols completed. USA took 0.9s. Estimated remaining: 51.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:18.400138] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:18.425384] [INFO ] [MAIN ] USB: Generated 1352 derivative records from 40428 primary records. [2025-09-05T19:18:18.431804] [INFO ] [MAIN ] USNA: Loaded 13482 primary data records. [2025-09-05T19:18:18.473830] [INFO ] [MAIN ] USFD: Loaded 24784 primary data records. [2025-09-05T19:18:18.498659] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-05T19:18:18.531050] [INFO ] [MAIN ] Derivative Progress: 1945/2117 symbols completed. USB took 1.0s. Estimated remaining: 51.0s. Rate: 202.4 symbols/min [2025-09-05T19:18:18.580096] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:18.802267] [INFO ] [MAIN ] USPH: Loaded 8800 primary data records. [2025-09-05T19:18:19.268035] [INFO ] [MAIN ] USNA: Generated 1352 derivative records from 13482 primary records. [2025-09-05T19:18:19.274948] [INFO ] [MAIN ] USFD: Generated 871 derivative records from 24784 primary records. [2025-09-05T19:18:19.304820] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-05T19:18:19.305529] [INFO ] [MAIN ] USPH: Generated 871 derivative records from 8800 primary records. [2025-09-05T19:18:19.307590] [INFO ] [MAIN ] Derivative Progress: 1946/2117 symbols completed. USFD took 0.9s. Estimated remaining: 50.7s. Rate: 202.2 symbols/min [2025-09-05T19:18:19.308021] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:19.316820] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-05T19:18:19.319203] [INFO ] [MAIN ] Derivative Progress: 1947/2117 symbols completed. USNA took 0.9s. Estimated remaining: 50.4s. Rate: 202.3 symbols/min [2025-09-05T19:18:19.319785] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:19.320133] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-05T19:18:19.322025] [INFO ] [MAIN ] Derivative Progress: 1948/2117 symbols completed. USPH took 0.8s. Estimated remaining: 50.1s. Rate: 202.4 symbols/min [2025-09-05T19:18:19.331162] [INFO ] [MAIN ] UTF: Loaded 12423 primary data records. [2025-09-05T19:18:19.448711] [INFO ] [MAIN ] UTI: Loaded 18927 primary data records. [2025-09-05T19:18:19.812944] [INFO ] [MAIN ] UTF: Generated 871 derivative records from 12423 primary records. [2025-09-05T19:18:19.829003] [INFO ] [MAIN ] UTI: Generated 871 derivative records from 18927 primary records. [2025-09-05T19:18:19.830042] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-05T19:18:19.831327] [INFO ] [MAIN ] Derivative Progress: 1949/2117 symbols completed. UTF took 0.5s. Estimated remaining: 49.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:19.838725] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-05T19:18:19.840180] [INFO ] [MAIN ] Derivative Progress: 1950/2117 symbols completed. UTI took 0.5s. Estimated remaining: 49.5s. Rate: 202.5 symbols/min [2025-09-05T19:18:19.840941] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:19.840746] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:19.840836] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:19.853718] [INFO ] [MAIN ] UTL: Loaded 5742 primary data records. [2025-09-05T19:18:19.940920] [INFO ] [MAIN ] UVE: Loaded 11273 primary data records. [2025-09-05T19:18:20.245809] [INFO ] [MAIN ] UTZ: Loaded 33987 primary data records. [2025-09-05T19:18:20.636684] [INFO ] [MAIN ] UTL: Generated 871 derivative records from 5742 primary records. [2025-09-05T19:18:20.648120] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-05T19:18:20.649401] [INFO ] [MAIN ] Derivative Progress: 1951/2117 symbols completed. UTL took 0.8s. Estimated remaining: 49.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:20.649619] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:20.656751] [INFO ] [MAIN ] UVE: Generated 871 derivative records from 11273 primary records. [2025-09-05T19:18:20.666467] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-05T19:18:20.668115] [INFO ] [MAIN ] Derivative Progress: 1952/2117 symbols completed. UVE took 0.8s. Estimated remaining: 48.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:20.668308] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:20.688390] [INFO ] [MAIN ] UTZ: Generated 1352 derivative records from 33987 primary records. [2025-09-05T19:18:20.688794] [INFO ] [MAIN ] UVV: Loaded 11677 primary data records. [2025-09-05T19:18:20.837637] [INFO ] [MAIN ] UWMC: Loaded 25725 primary data records. [2025-09-05T19:18:20.923145] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-05T19:18:21.003564] [INFO ] [MAIN ] Derivative Progress: 1953/2117 symbols completed. UTZ took 1.2s. Estimated remaining: 48.6s. Rate: 202.4 symbols/min [2025-09-05T19:18:21.029809] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:21.083341] [INFO ] [MAIN ] UZD: Loaded 3357 primary data records. [2025-09-05T19:18:21.467501] [INFO ] [MAIN ] UVV: Generated 871 derivative records from 11677 primary records. [2025-09-05T19:18:21.479925] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-05T19:18:21.481540] [INFO ] [MAIN ] Derivative Progress: 1954/2117 symbols completed. UVV took 0.8s. Estimated remaining: 48.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:21.481771] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:21.498432] [INFO ] [MAIN ] UWMC: Generated 871 derivative records from 25725 primary records. [2025-09-05T19:18:21.498738] [INFO ] [MAIN ] UZE: Loaded 4010 primary data records. [2025-09-05T19:18:21.616608] [INFO ] [MAIN ] UZD: Generated 871 derivative records from 3357 primary records. [2025-09-05T19:18:21.620915] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-05T19:18:21.651306] [INFO ] [MAIN ] Derivative Progress: 1955/2117 symbols completed. UWMC took 1.0s. Estimated remaining: 48.0s. Rate: 202.3 symbols/min [2025-09-05T19:18:21.657069] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:21.764062] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-05T19:18:21.767249] [INFO ] [MAIN ] Derivative Progress: 1956/2117 symbols completed. UZD took 0.7s. Estimated remaining: 47.7s. Rate: 202.4 symbols/min [2025-09-05T19:18:21.767930] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:21.775242] [INFO ] [MAIN ] UZF: Loaded 4823 primary data records. [2025-09-05T19:18:22.066216] [INFO ] [MAIN ] UZE: Generated 871 derivative records from 4010 primary records. [2025-09-05T19:18:22.067571] [INFO ] [MAIN ] V: Loaded 26080 primary data records. [2025-09-05T19:18:22.166998] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-05T19:18:22.178526] [INFO ] [MAIN ] Derivative Progress: 1957/2117 symbols completed. UZE took 0.7s. Estimated remaining: 47.4s. Rate: 202.4 symbols/min [2025-09-05T19:18:22.185056] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:22.323452] [INFO ] [MAIN ] VAC: Loaded 15793 primary data records. [2025-09-05T19:18:22.345347] [INFO ] [MAIN ] UZF: Generated 1352 derivative records from 4823 primary records. [2025-09-05T19:18:22.468807] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-05T19:18:22.490440] [INFO ] [MAIN ] Derivative Progress: 1958/2117 symbols completed. UZF took 0.8s. Estimated remaining: 47.1s. Rate: 202.4 symbols/min [2025-09-05T19:18:22.578090] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:22.587348] [INFO ] [MAIN ] V: Generated 871 derivative records from 26080 primary records. [2025-09-05T19:18:22.598569] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-05T19:18:22.606088] [INFO ] [MAIN ] Derivative Progress: 1959/2117 symbols completed. V took 0.8s. Estimated remaining: 46.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:22.607171] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:22.619439] [INFO ] [MAIN ] VAL: Loaded 24155 primary data records. [2025-09-05T19:18:22.626420] [INFO ] [MAIN ] VAC: Generated 871 derivative records from 15793 primary records. [2025-09-05T19:18:22.749565] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-05T19:18:22.777928] [INFO ] [MAIN ] Derivative Progress: 1960/2117 symbols completed. VAC took 0.6s. Estimated remaining: 46.5s. Rate: 202.5 symbols/min [2025-09-05T19:18:22.778122] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:22.771419] [INFO ] [MAIN ] VALE: Loaded 26014 primary data records. [2025-09-05T19:18:22.982691] [INFO ] [MAIN ] VATE: Loaded 2047 primary data records. [2025-09-05T19:18:23.359368] [INFO ] [MAIN ] VAL: Generated 871 derivative records from 24155 primary records. [2025-09-05T19:18:23.376995] [INFO ] [MAIN ] VALE: Generated 871 derivative records from 26014 primary records. [2025-09-05T19:18:23.378062] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-05T19:18:23.385326] [INFO ] [MAIN ] Derivative Progress: 1961/2117 symbols completed. VAL took 0.9s. Estimated remaining: 46.3s. Rate: 202.4 symbols/min [2025-09-05T19:18:23.388151] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:23.397965] [INFO ] [MAIN ] VATE: Generated 871 derivative records from 2047 primary records. [2025-09-05T19:18:23.400567] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-05T19:18:23.409838] [INFO ] [MAIN ] VBF: Loaded 3781 primary data records. [2025-09-05T19:18:23.405947] [INFO ] [MAIN ] Derivative Progress: 1962/2117 symbols completed. VALE took 0.8s. Estimated remaining: 45.9s. Rate: 202.5 symbols/min [2025-09-05T19:18:23.446663] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:23.466114] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-05T19:18:23.476496] [INFO ] [MAIN ] Derivative Progress: 1963/2117 symbols completed. VATE took 0.7s. Estimated remaining: 45.6s. Rate: 202.5 symbols/min [2025-09-05T19:18:23.546209] [INFO ] [MAIN ] VCV: Loaded 7120 primary data records. [2025-09-05T19:18:23.931473] [INFO ] [MAIN ] VBF: Generated 871 derivative records from 3781 primary records. [2025-09-05T19:18:23.942490] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-05T19:18:23.949981] [INFO ] [MAIN ] Derivative Progress: 1964/2117 symbols completed. VBF took 0.6s. Estimated remaining: 45.3s. Rate: 202.5 symbols/min [2025-09-05T19:18:23.950987] [INFO ] [MAIN ] VCV: Generated 871 derivative records from 7120 primary records. [2025-09-05T19:18:23.958711] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-05T19:18:23.960170] [INFO ] [MAIN ] Derivative Progress: 1965/2117 symbols completed. VCV took 0.5s. Estimated remaining: 45.0s. Rate: 202.6 symbols/min [2025-09-05T19:18:23.960861] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:23.960926] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:23.961048] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:23.969025] [INFO ] [MAIN ] VEL: Loaded 5858 primary data records. [2025-09-05T19:18:24.095016] [INFO ] [MAIN ] VET: Loaded 20765 primary data records. [2025-09-05T19:18:24.162921] [INFO ] [MAIN ] VEEV: Loaded 22840 primary data records. [2025-09-05T19:18:24.702004] [INFO ] [MAIN ] VEL: Generated 870 derivative records from 5858 primary records. [2025-09-05T19:18:24.713293] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-05T19:18:24.714800] [INFO ] [MAIN ] Derivative Progress: 1966/2117 symbols completed. VEL took 0.8s. Estimated remaining: 44.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:24.715016] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:24.722727] [INFO ] [MAIN ] VEEV: Generated 871 derivative records from 22840 primary records. [2025-09-05T19:18:24.738565] [INFO ] [MAIN ] VET: Generated 871 derivative records from 20765 primary records. [2025-09-05T19:18:24.744710] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-05T19:18:24.746290] [INFO ] [MAIN ] Derivative Progress: 1967/2117 symbols completed. VEEV took 0.8s. Estimated remaining: 44.4s. Rate: 202.5 symbols/min [2025-09-05T19:18:24.748049] [INFO ] [MAIN ] VG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:24.757497] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-05T19:18:24.759198] [INFO ] [MAIN ] Derivative Progress: 1968/2117 symbols completed. VET took 0.8s. Estimated remaining: 44.1s. Rate: 202.6 symbols/min [2025-09-05T19:18:24.759416] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:24.763855] [INFO ] [MAIN ] VGI: Loaded 2588 primary data records. [2025-09-05T19:18:24.879692] [INFO ] [MAIN ] VFC: Loaded 25943 primary data records. [2025-09-05T19:18:25.111085] [INFO ] [MAIN ] VG: Loaded 25863 primary data records. [2025-09-05T19:18:25.493726] [INFO ] [MAIN ] VGI: Generated 871 derivative records from 2588 primary records. [2025-09-05T19:18:25.510813] [INFO ] [MAIN ] VFC: Generated 871 derivative records from 25943 primary records. [2025-09-05T19:18:25.512275] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-05T19:18:25.519542] [INFO ] [MAIN ] Derivative Progress: 1969/2117 symbols completed. VGI took 0.8s. Estimated remaining: 43.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:25.520876] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:25.521563] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-05T19:18:25.523139] [INFO ] [MAIN ] Derivative Progress: 1970/2117 symbols completed. VFC took 0.8s. Estimated remaining: 43.5s. Rate: 202.5 symbols/min [2025-09-05T19:18:25.523377] [INFO ] [MAIN ] VHC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:25.528913] [INFO ] [MAIN ] VHC: Loaded 1677 primary data records. [2025-09-05T19:18:25.580850] [INFO ] [MAIN ] VG: Generated 871 derivative records from 25863 primary records. [2025-09-05T19:18:25.605869] [INFO ] [MAIN ] VGM: Loaded 9639 primary data records. [2025-09-05T19:18:25.707342] [INFO ] [MAIN ] VG: Successfully saved derivative data. [2025-09-05T19:18:25.729032] [INFO ] [MAIN ] Derivative Progress: 1971/2117 symbols completed. VG took 1.0s. Estimated remaining: 43.2s. Rate: 202.6 symbols/min [2025-09-05T19:18:25.781474] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:25.925814] [INFO ] [MAIN ] VHI: Loaded 1451 primary data records. [2025-09-05T19:18:26.312996] [INFO ] [MAIN ] VHC: Generated 870 derivative records from 1677 primary records. [2025-09-05T19:18:26.326687] [INFO ] [MAIN ] VGM: Generated 871 derivative records from 9639 primary records. [2025-09-05T19:18:26.329435] [INFO ] [MAIN ] VHC: Successfully saved derivative data. [2025-09-05T19:18:26.337250] [INFO ] [MAIN ] Derivative Progress: 1972/2117 symbols completed. VHC took 0.8s. Estimated remaining: 43.0s. Rate: 202.5 symbols/min [2025-09-05T19:18:26.338722] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:26.342259] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-05T19:18:26.350327] [INFO ] [MAIN ] Derivative Progress: 1973/2117 symbols completed. VGM took 0.8s. Estimated remaining: 42.7s. Rate: 202.6 symbols/min [2025-09-05T19:18:26.351130] [INFO ] [MAIN ] VHI: Generated 871 derivative records from 1451 primary records. [2025-09-05T19:18:26.351456] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:26.360301] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-05T19:18:26.362008] [INFO ] [MAIN ] Derivative Progress: 1974/2117 symbols completed. VHI took 0.6s. Estimated remaining: 42.3s. Rate: 202.7 symbols/min [2025-09-05T19:18:26.362221] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:26.391096] [INFO ] [MAIN ] VICI: Loaded 25977 primary data records. [2025-09-05T19:18:26.469002] [INFO ] [MAIN ] VIK: Loaded 25563 primary data records. [2025-09-05T19:18:26.623242] [INFO ] [MAIN ] VIPS: Loaded 24374 primary data records. [2025-09-05T19:18:27.139031] [INFO ] [MAIN ] VICI: Generated 871 derivative records from 25977 primary records. [2025-09-05T19:18:27.156272] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-05T19:18:27.155899] [INFO ] [MAIN ] VIK: Generated 870 derivative records from 25563 primary records. [2025-09-05T19:18:27.157529] [INFO ] [MAIN ] Derivative Progress: 1975/2117 symbols completed. VICI took 0.8s. Estimated remaining: 42.1s. Rate: 202.5 symbols/min [2025-09-05T19:18:27.158442] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:27.175603] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-05T19:18:27.177220] [INFO ] [MAIN ] Derivative Progress: 1976/2117 symbols completed. VIK took 0.8s. Estimated remaining: 41.8s. Rate: 202.6 symbols/min [2025-09-05T19:18:27.175521] [INFO ] [MAIN ] VIPS: Generated 871 derivative records from 24374 primary records. [2025-09-05T19:18:27.177406] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:27.187388] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-05T19:18:27.189193] [INFO ] [MAIN ] Derivative Progress: 1977/2117 symbols completed. VIPS took 0.8s. Estimated remaining: 41.4s. Rate: 202.7 symbols/min [2025-09-05T19:18:27.189560] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:27.217532] [INFO ] [MAIN ] VIST: Loaded 21810 primary data records. [2025-09-05T19:18:27.346076] [INFO ] [MAIN ] VIRT: Loaded 35093 primary data records. [2025-09-05T19:18:27.362943] [INFO ] [MAIN ] VIV: Loaded 22476 primary data records. [2025-09-05T19:18:28.009888] [INFO ] [MAIN ] VIST: Generated 871 derivative records from 21810 primary records. [2025-09-05T19:18:28.022104] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-05T19:18:28.023853] [INFO ] [MAIN ] Derivative Progress: 1978/2117 symbols completed. VIST took 0.8s. Estimated remaining: 41.2s. Rate: 202.5 symbols/min [2025-09-05T19:18:28.034082] [INFO ] [MAIN ] VIV: Generated 871 derivative records from 22476 primary records. [2025-09-05T19:18:28.054217] [INFO ] [MAIN ] VIRT: Generated 1352 derivative records from 35093 primary records. [2025-09-05T19:18:28.064183] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-05T19:18:28.068601] [INFO ] [MAIN ] Derivative Progress: 1979/2117 symbols completed. VIV took 0.9s. Estimated remaining: 40.9s. Rate: 202.6 symbols/min [2025-09-05T19:18:28.071469] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-05T19:18:28.074035] [INFO ] [MAIN ] Derivative Progress: 1980/2117 symbols completed. VIRT took 0.9s. Estimated remaining: 40.6s. Rate: 202.7 symbols/min [2025-09-05T19:18:28.074510] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:28.074834] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:28.074755] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:28.091629] [INFO ] [MAIN ] VKQ: Loaded 8926 primary data records. [2025-09-05T19:18:28.209776] [INFO ] [MAIN ] VLN: Loaded 15637 primary data records. [2025-09-05T19:18:28.334565] [INFO ] [MAIN ] VLO: Loaded 25650 primary data records. [2025-09-05T19:18:28.853956] [INFO ] [MAIN ] VKQ: Generated 871 derivative records from 8926 primary records. [2025-09-05T19:18:28.864312] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-05T19:18:28.866666] [INFO ] [MAIN ] Derivative Progress: 1981/2117 symbols completed. VKQ took 0.8s. Estimated remaining: 40.3s. Rate: 202.5 symbols/min [2025-09-05T19:18:28.867531] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:28.877093] [INFO ] [MAIN ] VLN: Generated 871 derivative records from 15637 primary records. [2025-09-05T19:18:28.889488] [INFO ] [MAIN ] VLO: Generated 871 derivative records from 25650 primary records. [2025-09-05T19:18:28.900804] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-05T19:18:28.902892] [INFO ] [MAIN ] Derivative Progress: 1982/2117 symbols completed. VLN took 0.8s. Estimated remaining: 40.0s. Rate: 202.6 symbols/min [2025-09-05T19:18:28.903360] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:28.913734] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-05T19:18:28.916203] [INFO ] [MAIN ] Derivative Progress: 1983/2117 symbols completed. VLO took 0.8s. Estimated remaining: 39.7s. Rate: 202.7 symbols/min [2025-09-05T19:18:28.916658] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:28.919000] [INFO ] [MAIN ] VLT: Loaded 1915 primary data records. [2025-09-05T19:18:29.033427] [INFO ] [MAIN ] VLRS: Loaded 30498 primary data records. [2025-09-05T19:18:29.341277] [INFO ] [MAIN ] VLTO: Loaded 34441 primary data records. [2025-09-05T19:18:29.771381] [INFO ] [MAIN ] VLT: Generated 871 derivative records from 1915 primary records. [2025-09-05T19:18:29.783304] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-05T19:18:29.784700] [INFO ] [MAIN ] Derivative Progress: 1984/2117 symbols completed. VLT took 0.9s. Estimated remaining: 39.4s. Rate: 202.5 symbols/min [2025-09-05T19:18:29.786000] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:29.800888] [INFO ] [MAIN ] VLRS: Generated 1352 derivative records from 30498 primary records. [2025-09-05T19:18:29.835717] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-05T19:18:29.840241] [INFO ] [MAIN ] Derivative Progress: 1985/2117 symbols completed. VLRS took 1.0s. Estimated remaining: 39.1s. Rate: 202.6 symbols/min [2025-09-05T19:18:29.837800] [INFO ] [MAIN ] VLTO: Generated 1352 derivative records from 34441 primary records. [2025-09-05T19:18:29.840523] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:29.842030] [INFO ] [MAIN ] VMC: Loaded 20550 primary data records. [2025-09-05T19:18:29.936421] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-05T19:18:29.964537] [INFO ] [MAIN ] VMI: Loaded 11464 primary data records. [2025-09-05T19:18:29.956930] [INFO ] [MAIN ] Derivative Progress: 1986/2117 symbols completed. VLTO took 1.0s. Estimated remaining: 38.8s. Rate: 202.6 symbols/min [2025-09-05T19:18:30.068421] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:30.359779] [INFO ] [MAIN ] VMO: Loaded 10010 primary data records. [2025-09-05T19:18:30.602246] [INFO ] [MAIN ] VMC: Generated 871 derivative records from 20550 primary records. [2025-09-05T19:18:30.615824] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-05T19:18:30.626605] [INFO ] [MAIN ] Derivative Progress: 1987/2117 symbols completed. VMC took 0.8s. Estimated remaining: 38.5s. Rate: 202.5 symbols/min [2025-09-05T19:18:30.627371] [INFO ] [MAIN ] VMI: Generated 1351 derivative records from 11464 primary records. [2025-09-05T19:18:30.627801] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:30.644028] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-05T19:18:30.648717] [INFO ] [MAIN ] Derivative Progress: 1988/2117 symbols completed. VMI took 0.8s. Estimated remaining: 38.2s. Rate: 202.6 symbols/min [2025-09-05T19:18:30.646304] [INFO ] [MAIN ] VNCE: Loaded 3726 primary data records. [2025-09-05T19:18:30.675900] [INFO ] [MAIN ] VMO: Generated 871 derivative records from 10010 primary records. [2025-09-05T19:18:30.686009] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:30.764351] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-05T19:18:30.766042] [INFO ] [MAIN ] Derivative Progress: 1989/2117 symbols completed. VMO took 0.8s. Estimated remaining: 37.9s. Rate: 202.7 symbols/min [2025-09-05T19:18:30.766624] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:30.961800] [INFO ] [MAIN ] VNO: Loaded 36856 primary data records. [2025-09-05T19:18:31.086902] [INFO ] [MAIN ] VNT: Loaded 33167 primary data records. [2025-09-05T19:18:31.277073] [INFO ] [MAIN ] VNCE: Generated 1352 derivative records from 3726 primary records. [2025-09-05T19:18:31.464906] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-05T19:18:31.602857] [INFO ] [MAIN ] Derivative Progress: 1990/2117 symbols completed. VNCE took 1.0s. Estimated remaining: 37.6s. Rate: 202.5 symbols/min [2025-09-05T19:18:31.603853] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:31.614105] [INFO ] [MAIN ] VOC: Loaded 4551 primary data records. [2025-09-05T19:18:31.803021] [INFO ] [MAIN ] VNO: Generated 1352 derivative records from 36856 primary records. [2025-09-05T19:18:31.884396] [INFO ] [MAIN ] VNT: Generated 1352 derivative records from 33167 primary records. [2025-09-05T19:18:31.883636] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-05T19:18:31.886893] [INFO ] [MAIN ] Derivative Progress: 1991/2117 symbols completed. VNO took 1.2s. Estimated remaining: 37.3s. Rate: 202.5 symbols/min [2025-09-05T19:18:31.887780] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:31.901209] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-05T19:18:31.903705] [INFO ] [MAIN ] Derivative Progress: 1992/2117 symbols completed. VNT took 1.1s. Estimated remaining: 37.0s. Rate: 202.6 symbols/min [2025-09-05T19:18:31.904007] [INFO ] [MAIN ] VOYG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:31.913791] [INFO ] [MAIN ] VOC: Generated 871 derivative records from 4551 primary records. [2025-09-05T19:18:31.927934] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-05T19:18:31.940692] [INFO ] [MAIN ] Derivative Progress: 1993/2117 symbols completed. VOC took 0.3s. Estimated remaining: 36.7s. Rate: 202.7 symbols/min [2025-09-05T19:18:31.941571] [INFO ] [MAIN ] VOYA: Loaded 20215 primary data records. [2025-09-05T19:18:32.049560] [INFO ] [MAIN ] VOYG: Loaded 19916 primary data records. [2025-09-05T19:18:32.422380] [INFO ] [MAIN ] VOYA: Generated 871 derivative records from 20215 primary records. [2025-09-05T19:18:32.432364] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-05T19:18:32.433803] [INFO ] [MAIN ] Derivative Progress: 1994/2117 symbols completed. VOYA took 0.5s. Estimated remaining: 36.4s. Rate: 202.6 symbols/min [2025-09-05T19:18:32.440402] [INFO ] [MAIN ] VOYG: Generated 772 derivative records from 19916 primary records. [2025-09-05T19:18:32.447963] [INFO ] [MAIN ] VOYG: Successfully saved derivative data. [2025-09-05T19:18:32.449365] [INFO ] [MAIN ] Derivative Progress: 1995/2117 symbols completed. VOYG took 0.5s. Estimated remaining: 36.1s. Rate: 202.7 symbols/min [2025-09-05T19:18:32.449830] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:32.450047] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:32.449974] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:32.454612] [INFO ] [MAIN ] VPV: Loaded 2147 primary data records. [2025-09-05T19:18:32.556841] [INFO ] [MAIN ] VPG: Loaded 7744 primary data records. [2025-09-05T19:18:32.787108] [INFO ] [MAIN ] VRE: Loaded 25856 primary data records. [2025-09-05T19:18:33.290143] [INFO ] [MAIN ] VPV: Generated 871 derivative records from 2147 primary records. [2025-09-05T19:18:33.302149] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-05T19:18:33.304495] [INFO ] [MAIN ] Derivative Progress: 1996/2117 symbols completed. VPV took 0.9s. Estimated remaining: 35.8s. Rate: 202.5 symbols/min [2025-09-05T19:18:33.304910] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:33.312445] [INFO ] [MAIN ] VPG: Generated 871 derivative records from 7744 primary records. [2025-09-05T19:18:33.322202] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-05T19:18:33.323921] [INFO ] [MAIN ] Derivative Progress: 1997/2117 symbols completed. VPG took 0.9s. Estimated remaining: 35.5s. Rate: 202.6 symbols/min [2025-09-05T19:18:33.324229] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:33.339579] [INFO ] [MAIN ] VRE: Generated 1352 derivative records from 25856 primary records. [2025-09-05T19:18:33.343903] [INFO ] [MAIN ] VRTS: Loaded 5792 primary data records. [2025-09-05T19:18:33.477583] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-05T19:18:33.486131] [INFO ] [MAIN ] Derivative Progress: 1998/2117 symbols completed. VRE took 1.0s. Estimated remaining: 35.2s. Rate: 202.7 symbols/min [2025-09-05T19:18:33.550309] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:33.550255] [INFO ] [MAIN ] VRT: Loaded 40494 primary data records. [2025-09-05T19:18:33.930188] [INFO ] [MAIN ] VSCO: Loaded 25520 primary data records. [2025-09-05T19:18:34.070417] [INFO ] [MAIN ] VRTS: Generated 871 derivative records from 5792 primary records. [2025-09-05T19:18:34.231261] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-05T19:18:34.232892] [INFO ] [MAIN ] Derivative Progress: 1999/2117 symbols completed. VRTS took 0.9s. Estimated remaining: 35.0s. Rate: 202.5 symbols/min [2025-09-05T19:18:34.233212] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:34.247892] [INFO ] [MAIN ] VRT: Generated 1352 derivative records from 40494 primary records. [2025-09-05T19:18:34.277196] [INFO ] [MAIN ] VSCO: Generated 871 derivative records from 25520 primary records. [2025-09-05T19:18:34.277292] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-05T19:18:34.291079] [INFO ] [MAIN ] VSH: Loaded 23252 primary data records. [2025-09-05T19:18:34.289314] [INFO ] [MAIN ] Derivative Progress: 2000/2117 symbols completed. VRT took 1.0s. Estimated remaining: 34.7s. Rate: 202.6 symbols/min [2025-09-05T19:18:34.309904] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:34.362308] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-05T19:18:34.395860] [INFO ] [MAIN ] Derivative Progress: 2001/2117 symbols completed. VSCO took 0.9s. Estimated remaining: 34.3s. Rate: 202.6 symbols/min [2025-09-05T19:18:34.414927] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:34.608705] [INFO ] [MAIN ] VSTS: Loaded 36818 primary data records. [2025-09-05T19:18:34.608141] [INFO ] [MAIN ] VSH: Generated 871 derivative records from 23252 primary records. [2025-09-05T19:18:34.631526] [INFO ] [MAIN ] VST: Loaded 40468 primary data records. [2025-09-05T19:18:34.805879] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-05T19:18:34.840602] [INFO ] [MAIN ] Derivative Progress: 2002/2117 symbols completed. VSH took 0.6s. Estimated remaining: 34.1s. Rate: 202.6 symbols/min [2025-09-05T19:18:34.907832] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:35.193862] [INFO ] [MAIN ] VTEX: Loaded 32518 primary data records. [2025-09-05T19:18:35.194984] [INFO ] [MAIN ] VSTS: Generated 1351 derivative records from 36818 primary records. [2025-09-05T19:18:35.283217] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-05T19:18:35.296465] [INFO ] [MAIN ] Derivative Progress: 2003/2117 symbols completed. VSTS took 0.9s. Estimated remaining: 33.8s. Rate: 202.5 symbols/min [2025-09-05T19:18:35.310005] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:35.395187] [INFO ] [MAIN ] VST: Generated 1352 derivative records from 40468 primary records. [2025-09-05T19:18:35.505397] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-05T19:18:35.508622] [INFO ] [MAIN ] Derivative Progress: 2004/2117 symbols completed. VST took 1.2s. Estimated remaining: 33.5s. Rate: 202.6 symbols/min [2025-09-05T19:18:35.509413] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:35.522015] [INFO ] [MAIN ] VTLE: Loaded 23730 primary data records. [2025-09-05T19:18:35.622621] [INFO ] [MAIN ] VTMX: Loaded 13343 primary data records. [2025-09-05T19:18:35.803369] [INFO ] [MAIN ] VTEX: Generated 1352 derivative records from 32518 primary records. [2025-09-05T19:18:35.980039] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-05T19:18:36.078159] [INFO ] [MAIN ] Derivative Progress: 2005/2117 symbols completed. VTEX took 1.2s. Estimated remaining: 33.2s. Rate: 202.5 symbols/min [2025-09-05T19:18:36.078592] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:36.090161] [INFO ] [MAIN ] VTN: Loaded 4985 primary data records. [2025-09-05T19:18:36.182158] [INFO ] [MAIN ] VTLE: Generated 871 derivative records from 23730 primary records. [2025-09-05T19:18:36.220334] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-05T19:18:36.243817] [INFO ] [MAIN ] Derivative Progress: 2006/2117 symbols completed. VTLE took 0.9s. Estimated remaining: 32.9s. Rate: 202.5 symbols/min [2025-09-05T19:18:36.258572] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:36.420372] [INFO ] [MAIN ] VTMX: Generated 1352 derivative records from 13343 primary records. [2025-09-05T19:18:36.453811] [INFO ] [MAIN ] VTOL: Loaded 9567 primary data records. [2025-09-05T19:18:36.457849] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-05T19:18:36.497549] [INFO ] [MAIN ] Derivative Progress: 2007/2117 symbols completed. VTMX took 1.0s. Estimated remaining: 32.6s. Rate: 202.5 symbols/min [2025-09-05T19:18:36.517065] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:36.745829] [INFO ] [MAIN ] VTN: Generated 1352 derivative records from 4985 primary records. [2025-09-05T19:18:36.758844] [INFO ] [MAIN ] VTR: Loaded 25522 primary data records. [2025-09-05T19:18:36.912019] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-05T19:18:36.920936] [INFO ] [MAIN ] Derivative Progress: 2008/2117 symbols completed. VTN took 0.8s. Estimated remaining: 32.3s. Rate: 202.5 symbols/min [2025-09-05T19:18:36.991947] [INFO ] [MAIN ] VTOL: Generated 871 derivative records from 9567 primary records. [2025-09-05T19:18:37.123156] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-05T19:18:37.125808] [INFO ] [MAIN ] Derivative Progress: 2009/2117 symbols completed. VTOL took 0.9s. Estimated remaining: 32.0s. Rate: 202.5 symbols/min [2025-09-05T19:18:37.142088] [INFO ] [MAIN ] VTR: Generated 871 derivative records from 25522 primary records. [2025-09-05T19:18:37.152010] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-05T19:18:37.154001] [INFO ] [MAIN ] Derivative Progress: 2010/2117 symbols completed. VTR took 0.6s. Estimated remaining: 31.7s. Rate: 202.6 symbols/min [2025-09-05T19:18:37.155222] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:37.155373] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:37.154852] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:37.197236] [INFO ] [MAIN ] VTS: Loaded 14372 primary data records. [2025-09-05T19:18:37.239213] [INFO ] [MAIN ] VVR: Loaded 21894 primary data records. [2025-09-05T19:18:37.480245] [INFO ] [MAIN ] VVV: Loaded 37910 primary data records. [2025-09-05T19:18:38.284717] [INFO ] [MAIN ] VTS: Generated 871 derivative records from 14372 primary records. [2025-09-05T19:18:38.295698] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-05T19:18:38.297017] [INFO ] [MAIN ] Derivative Progress: 2011/2117 symbols completed. VTS took 1.1s. Estimated remaining: 31.4s. Rate: 202.3 symbols/min [2025-09-05T19:18:38.306584] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:38.308114] [INFO ] [MAIN ] VVR: Generated 1351 derivative records from 21894 primary records. [2025-09-05T19:18:38.330683] [INFO ] [MAIN ] VVV: Generated 1352 derivative records from 37910 primary records. [2025-09-05T19:18:38.351235] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-05T19:18:38.354804] [INFO ] [MAIN ] Derivative Progress: 2012/2117 symbols completed. VVR took 1.2s. Estimated remaining: 31.1s. Rate: 202.4 symbols/min [2025-09-05T19:18:38.352262] [INFO ] [MAIN ] VVX: Loaded 11784 primary data records. [2025-09-05T19:18:38.360636] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:38.421284] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-05T19:18:38.435879] [INFO ] [MAIN ] Derivative Progress: 2013/2117 symbols completed. VVV took 1.3s. Estimated remaining: 30.8s. Rate: 202.5 symbols/min [2025-09-05T19:18:38.463089] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:38.607296] [INFO ] [MAIN ] VYX: Loaded 23475 primary data records. [2025-09-05T19:18:38.876626] [INFO ] [MAIN ] VZ: Loaded 40531 primary data records. [2025-09-05T19:18:38.989686] [INFO ] [MAIN ] VVX: Generated 871 derivative records from 11784 primary records. [2025-09-05T19:18:39.163544] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-05T19:18:39.165083] [INFO ] [MAIN ] Derivative Progress: 2014/2117 symbols completed. VVX took 0.9s. Estimated remaining: 30.5s. Rate: 202.3 symbols/min [2025-09-05T19:18:39.165436] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:39.176754] [INFO ] [MAIN ] VYX: Generated 871 derivative records from 23475 primary records. [2025-09-05T19:18:39.188103] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-05T19:18:39.197517] [INFO ] [MAIN ] Derivative Progress: 2015/2117 symbols completed. VYX took 0.8s. Estimated remaining: 30.2s. Rate: 202.4 symbols/min [2025-09-05T19:18:39.197963] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:39.211893] [INFO ] [MAIN ] W: Loaded 25905 primary data records. [2025-09-05T19:18:39.234559] [INFO ] [MAIN ] VZ: Generated 1352 derivative records from 40531 primary records. [2025-09-05T19:18:39.384353] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-05T19:18:39.420551] [INFO ] [MAIN ] Derivative Progress: 2016/2117 symbols completed. VZ took 1.0s. Estimated remaining: 29.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:39.449254] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:39.446009] [INFO ] [MAIN ] WAB: Loaded 33065 primary data records. [2025-09-05T19:18:39.846065] [INFO ] [MAIN ] WAL: Loaded 33654 primary data records. [2025-09-05T19:18:39.904634] [INFO ] [MAIN ] W: Generated 871 derivative records from 25905 primary records. [2025-09-05T19:18:40.032302] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-05T19:18:40.049962] [INFO ] [MAIN ] Derivative Progress: 2017/2117 symbols completed. W took 0.9s. Estimated remaining: 29.7s. Rate: 202.3 symbols/min [2025-09-05T19:18:40.053023] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:40.171774] [INFO ] [MAIN ] WAB: Generated 1352 derivative records from 33065 primary records. [2025-09-05T19:18:40.180987] [INFO ] [MAIN ] WAT: Loaded 17500 primary data records. [2025-09-05T19:18:40.205433] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-05T19:18:40.207796] [INFO ] [MAIN ] Derivative Progress: 2018/2117 symbols completed. WAB took 1.0s. Estimated remaining: 29.4s. Rate: 202.4 symbols/min [2025-09-05T19:18:40.218483] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:40.385045] [INFO ] [MAIN ] WAL: Generated 1352 derivative records from 33654 primary records. [2025-09-05T19:18:40.478007] [INFO ] [MAIN ] WBS: Loaded 23642 primary data records. [2025-09-05T19:18:40.548304] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-05T19:18:40.564837] [INFO ] [MAIN ] Derivative Progress: 2019/2117 symbols completed. WAL took 1.1s. Estimated remaining: 29.1s. Rate: 202.4 symbols/min [2025-09-05T19:18:40.576835] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:40.653865] [INFO ] [MAIN ] WBX: Loaded 4383 primary data records. [2025-09-05T19:18:40.925592] [INFO ] [MAIN ] WAT: Generated 871 derivative records from 17500 primary records. [2025-09-05T19:18:40.993053] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-05T19:18:40.995435] [INFO ] [MAIN ] Derivative Progress: 2020/2117 symbols completed. WAT took 0.9s. Estimated remaining: 28.8s. Rate: 202.3 symbols/min [2025-09-05T19:18:40.997052] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:41.004907] [INFO ] [MAIN ] WBS: Generated 871 derivative records from 23642 primary records. [2025-09-05T19:18:41.013814] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-05T19:18:41.015293] [INFO ] [MAIN ] Derivative Progress: 2021/2117 symbols completed. WBS took 0.8s. Estimated remaining: 28.5s. Rate: 202.4 symbols/min [2025-09-05T19:18:41.015575] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:41.030056] [INFO ] [MAIN ] WBX: Generated 871 derivative records from 4383 primary records. [2025-09-05T19:18:41.045011] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-05T19:18:41.048462] [INFO ] [MAIN ] Derivative Progress: 2022/2117 symbols completed. WBX took 0.5s. Estimated remaining: 28.1s. Rate: 202.5 symbols/min [2025-09-05T19:18:41.046794] [INFO ] [MAIN ] WCC: Loaded 18498 primary data records. [2025-09-05T19:18:41.082532] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:41.201420] [INFO ] [MAIN ] WCN: Loaded 22901 primary data records. [2025-09-05T19:18:41.301280] [INFO ] [MAIN ] WD: Loaded 17741 primary data records. [2025-09-05T19:18:41.856669] [INFO ] [MAIN ] WCC: Generated 871 derivative records from 18498 primary records. [2025-09-05T19:18:41.868572] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-05T19:18:41.870274] [INFO ] [MAIN ] Derivative Progress: 2023/2117 symbols completed. WCC took 0.9s. Estimated remaining: 27.9s. Rate: 202.3 symbols/min [2025-09-05T19:18:41.884357] [INFO ] [MAIN ] WCN: Generated 871 derivative records from 22901 primary records. [2025-09-05T19:18:41.897541] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-05T19:18:41.899699] [INFO ] [MAIN ] Derivative Progress: 2024/2117 symbols completed. WCN took 0.9s. Estimated remaining: 27.6s. Rate: 202.4 symbols/min [2025-09-05T19:18:41.912896] [INFO ] [MAIN ] WD: Generated 1352 derivative records from 17741 primary records. [2025-09-05T19:18:41.925410] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-05T19:18:41.928057] [INFO ] [MAIN ] Derivative Progress: 2025/2117 symbols completed. WD took 0.9s. Estimated remaining: 27.3s. Rate: 202.5 symbols/min [2025-09-05T19:18:41.928989] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:41.928750] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:41.928935] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:41.949110] [INFO ] [MAIN ] WDI: Loaded 9970 primary data records. [2025-09-05T19:18:41.960999] [INFO ] [MAIN ] WDH: Loaded 11285 primary data records. [2025-09-05T19:18:42.175979] [INFO ] [MAIN ] WDS: Loaded 32342 primary data records. [2025-09-05T19:18:42.841026] [INFO ] [MAIN ] WDI: Generated 871 derivative records from 9970 primary records. [2025-09-05T19:18:42.852799] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-05T19:18:42.854740] [INFO ] [MAIN ] Derivative Progress: 2026/2117 symbols completed. WDI took 0.9s. Estimated remaining: 27.0s. Rate: 202.3 symbols/min [2025-09-05T19:18:42.857291] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:42.869704] [INFO ] [MAIN ] WDH: Generated 1352 derivative records from 11285 primary records. [2025-09-05T19:18:42.885884] [INFO ] [MAIN ] WEA: Loaded 6016 primary data records. [2025-09-05T19:18:42.903189] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-05T19:18:42.927068] [INFO ] [MAIN ] Derivative Progress: 2027/2117 symbols completed. WDH took 1.0s. Estimated remaining: 26.7s. Rate: 202.4 symbols/min [2025-09-05T19:18:42.972736] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:42.991667] [INFO ] [MAIN ] WDS: Generated 1352 derivative records from 32342 primary records. [2025-09-05T19:18:43.216424] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-05T19:18:43.219056] [INFO ] [MAIN ] Derivative Progress: 2028/2117 symbols completed. WDS took 1.3s. Estimated remaining: 26.4s. Rate: 202.4 symbols/min [2025-09-05T19:18:43.220322] [INFO ] [MAIN ] WEAV: Loaded 20212 primary data records. [2025-09-05T19:18:43.219484] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:43.512070] [INFO ] [MAIN ] WEA: Generated 1352 derivative records from 6016 primary records. [2025-09-05T19:18:43.527576] [INFO ] [MAIN ] WEC: Loaded 39290 primary data records. [2025-09-05T19:18:43.602245] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-05T19:18:43.611768] [INFO ] [MAIN ] Derivative Progress: 2029/2117 symbols completed. WEA took 0.8s. Estimated remaining: 26.1s. Rate: 202.3 symbols/min [2025-09-05T19:18:43.628302] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:43.647733] [INFO ] [MAIN ] WEAV: Generated 871 derivative records from 20212 primary records. [2025-09-05T19:18:43.835560] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-05T19:18:43.837222] [INFO ] [MAIN ] Derivative Progress: 2030/2117 symbols completed. WEAV took 0.9s. Estimated remaining: 25.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:43.837513] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:43.851365] [INFO ] [MAIN ] WELL: Loaded 25162 primary data records. [2025-09-05T19:18:44.074471] [INFO ] [MAIN ] WES: Loaded 36179 primary data records. [2025-09-05T19:18:44.256927] [INFO ] [MAIN ] WEC: Generated 1352 derivative records from 39290 primary records. [2025-09-05T19:18:44.434079] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-05T19:18:44.442815] [INFO ] [MAIN ] Derivative Progress: 2031/2117 symbols completed. WEC took 1.2s. Estimated remaining: 25.5s. Rate: 202.3 symbols/min [2025-09-05T19:18:44.443399] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:44.455161] [INFO ] [MAIN ] WELL: Generated 871 derivative records from 25162 primary records. [2025-09-05T19:18:44.466200] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-05T19:18:44.475596] [INFO ] [MAIN ] Derivative Progress: 2032/2117 symbols completed. WELL took 0.8s. Estimated remaining: 25.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:44.475839] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:44.495406] [INFO ] [MAIN ] WF: Loaded 8448 primary data records. [2025-09-05T19:18:44.496277] [INFO ] [MAIN ] WEX: Loaded 25319 primary data records. [2025-09-05T19:18:44.579421] [INFO ] [MAIN ] WES: Generated 1352 derivative records from 36179 primary records. [2025-09-05T19:18:44.747462] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-05T19:18:44.764929] [INFO ] [MAIN ] Derivative Progress: 2033/2117 symbols completed. WES took 0.9s. Estimated remaining: 24.9s. Rate: 202.3 symbols/min [2025-09-05T19:18:44.806080] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:45.128331] [INFO ] [MAIN ] WFC: Loaded 26060 primary data records. [2025-09-05T19:18:45.172717] [INFO ] [MAIN ] WEX: Generated 1352 derivative records from 25319 primary records. [2025-09-05T19:18:45.276493] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-05T19:18:45.289181] [INFO ] [MAIN ] Derivative Progress: 2034/2117 symbols completed. WEX took 0.8s. Estimated remaining: 24.6s. Rate: 202.3 symbols/min [2025-09-05T19:18:45.290253] [INFO ] [MAIN ] WF: Generated 1352 derivative records from 8448 primary records. [2025-09-05T19:18:45.301009] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:45.436711] [INFO ] [MAIN ] WFG: Loaded 12228 primary data records. [2025-09-05T19:18:45.438365] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-05T19:18:45.477082] [INFO ] [MAIN ] Derivative Progress: 2035/2117 symbols completed. WF took 1.0s. Estimated remaining: 24.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:45.524489] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:45.701041] [INFO ] [MAIN ] WGO: Loaded 18662 primary data records. [2025-09-05T19:18:45.741047] [INFO ] [MAIN ] WFC: Generated 871 derivative records from 26060 primary records. [2025-09-05T19:18:45.823855] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-05T19:18:45.840948] [INFO ] [MAIN ] Derivative Progress: 2036/2117 symbols completed. WFC took 1.0s. Estimated remaining: 24.0s. Rate: 202.3 symbols/min [2025-09-05T19:18:45.846687] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:45.969159] [INFO ] [MAIN ] WFG: Generated 871 derivative records from 12228 primary records. [2025-09-05T19:18:45.992244] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-05T19:18:45.994920] [INFO ] [MAIN ] Derivative Progress: 2037/2117 symbols completed. WFG took 0.7s. Estimated remaining: 23.7s. Rate: 202.3 symbols/min [2025-09-05T19:18:45.995222] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:45.996466] [INFO ] [MAIN ] WH: Loaded 21952 primary data records. [2025-09-05T19:18:46.135445] [INFO ] [MAIN ] WGO: Generated 871 derivative records from 18662 primary records. [2025-09-05T19:18:46.170109] [INFO ] [MAIN ] WHD: Loaded 18801 primary data records. [2025-09-05T19:18:46.269028] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-05T19:18:46.309123] [INFO ] [MAIN ] Derivative Progress: 2038/2117 symbols completed. WGO took 0.8s. Estimated remaining: 23.4s. Rate: 202.3 symbols/min [2025-09-05T19:18:46.547680] [INFO ] [MAIN ] WH: Generated 871 derivative records from 21952 primary records. [2025-09-05T19:18:46.557395] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-05T19:18:46.559964] [INFO ] [MAIN ] Derivative Progress: 2039/2117 symbols completed. WH took 0.7s. Estimated remaining: 23.1s. Rate: 202.3 symbols/min [2025-09-05T19:18:46.567315] [INFO ] [MAIN ] WHD: Generated 871 derivative records from 18801 primary records. [2025-09-05T19:18:46.575315] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-05T19:18:46.576728] [INFO ] [MAIN ] Derivative Progress: 2040/2117 symbols completed. WHD took 0.6s. Estimated remaining: 22.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:46.577205] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:46.577455] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:46.577603] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:46.584520] [INFO ] [MAIN ] WIA: Loaded 3610 primary data records. [2025-09-05T19:18:46.661160] [INFO ] [MAIN ] WHG: Loaded 1793 primary data records. [2025-09-05T19:18:46.838758] [INFO ] [MAIN ] WHR: Loaded 23731 primary data records. [2025-09-05T19:18:47.414573] [INFO ] [MAIN ] WHG: Generated 871 derivative records from 1793 primary records. [2025-09-05T19:18:47.415509] [INFO ] [MAIN ] WIA: Generated 1352 derivative records from 3610 primary records. [2025-09-05T19:18:47.436289] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-05T19:18:47.438554] [INFO ] [MAIN ] Derivative Progress: 2041/2117 symbols completed. WHG took 0.9s. Estimated remaining: 22.5s. Rate: 202.2 symbols/min [2025-09-05T19:18:47.444752] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:47.444928] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-05T19:18:47.447084] [INFO ] [MAIN ] Derivative Progress: 2042/2117 symbols completed. WIA took 0.9s. Estimated remaining: 22.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:47.448022] [INFO ] [MAIN ] WHR: Generated 871 derivative records from 23731 primary records. [2025-09-05T19:18:47.448477] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:47.457493] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-05T19:18:47.460534] [INFO ] [MAIN ] Derivative Progress: 2043/2117 symbols completed. WHR took 0.9s. Estimated remaining: 21.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:47.460879] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:47.464658] [INFO ] [MAIN ] WINN: Loaded 5056 primary data records. [2025-09-05T19:18:47.601237] [INFO ] [MAIN ] WIW: Loaded 10034 primary data records. [2025-09-05T19:18:47.800581] [INFO ] [MAIN ] WIT: Loaded 25494 primary data records. [2025-09-05T19:18:48.235194] [INFO ] [MAIN ] WINN: Generated 870 derivative records from 5056 primary records. [2025-09-05T19:18:48.299811] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-05T19:18:48.301666] [INFO ] [MAIN ] Derivative Progress: 2044/2117 symbols completed. WINN took 0.9s. Estimated remaining: 21.7s. Rate: 202.3 symbols/min [2025-09-05T19:18:48.303186] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:48.316491] [INFO ] [MAIN ] WIW: Generated 871 derivative records from 10034 primary records. [2025-09-05T19:18:48.332562] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-05T19:18:48.334374] [INFO ] [MAIN ] Derivative Progress: 2045/2117 symbols completed. WIW took 0.9s. Estimated remaining: 21.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:48.335122] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:48.342282] [INFO ] [MAIN ] WIT: Generated 871 derivative records from 25494 primary records. [2025-09-05T19:18:48.354972] [INFO ] [MAIN ] WK: Loaded 17603 primary data records. [2025-09-05T19:18:48.445548] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-05T19:18:48.469360] [INFO ] [MAIN ] Derivative Progress: 2046/2117 symbols completed. WIT took 1.0s. Estimated remaining: 21.0s. Rate: 202.4 symbols/min [2025-09-05T19:18:48.476076] [INFO ] [MAIN ] WKC: Loaded 16469 primary data records. [2025-09-05T19:18:48.486611] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:48.840097] [INFO ] [MAIN ] WLK: Loaded 22676 primary data records. [2025-09-05T19:18:49.105047] [INFO ] [MAIN ] WK: Generated 871 derivative records from 17603 primary records. [2025-09-05T19:18:49.178902] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-05T19:18:49.180853] [INFO ] [MAIN ] Derivative Progress: 2047/2117 symbols completed. WK took 0.9s. Estimated remaining: 20.8s. Rate: 202.3 symbols/min [2025-09-05T19:18:49.181539] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:49.190426] [INFO ] [MAIN ] WLKP: Loaded 3265 primary data records. [2025-09-05T19:18:49.228557] [INFO ] [MAIN ] WKC: Generated 871 derivative records from 16469 primary records. [2025-09-05T19:18:49.308625] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-05T19:18:49.315671] [INFO ] [MAIN ] Derivative Progress: 2048/2117 symbols completed. WKC took 1.0s. Estimated remaining: 20.5s. Rate: 202.3 symbols/min [2025-09-05T19:18:49.390512] [INFO ] [MAIN ] WLTG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:49.373076] [INFO ] [MAIN ] WLK: Generated 871 derivative records from 22676 primary records. [2025-09-05T19:18:49.456423] [INFO ] [MAIN ] WLTG: Loaded 629 primary data records. [2025-09-05T19:18:49.564479] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-05T19:18:49.578515] [INFO ] [MAIN ] Derivative Progress: 2049/2117 symbols completed. WLK took 1.1s. Estimated remaining: 20.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:49.628384] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:49.723419] [INFO ] [MAIN ] WLKP: Generated 871 derivative records from 3265 primary records. [2025-09-05T19:18:49.739781] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-05T19:18:49.741591] [INFO ] [MAIN ] Derivative Progress: 2050/2117 symbols completed. WLKP took 0.6s. Estimated remaining: 19.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:49.741823] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:49.750692] [INFO ] [MAIN ] WLY: Loaded 22747 primary data records. [2025-09-05T19:18:49.910282] [INFO ] [MAIN ] WLTG: Generated 870 derivative records from 629 primary records. [2025-09-05T19:18:50.087238] [INFO ] [MAIN ] WM: Loaded 24592 primary data records. [2025-09-05T19:18:50.151767] [INFO ] [MAIN ] WLTG: Successfully saved derivative data. [2025-09-05T19:18:50.174750] [INFO ] [MAIN ] Derivative Progress: 2051/2117 symbols completed. WLTG took 0.8s. Estimated remaining: 19.6s. Rate: 202.3 symbols/min [2025-09-05T19:18:50.192035] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:50.363924] [INFO ] [MAIN ] WLY: Generated 1352 derivative records from 22747 primary records. [2025-09-05T19:18:50.375517] [INFO ] [MAIN ] WMB: Loaded 25989 primary data records. [2025-09-05T19:18:50.505920] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-05T19:18:50.514101] [INFO ] [MAIN ] Derivative Progress: 2052/2117 symbols completed. WLY took 0.9s. Estimated remaining: 19.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:50.505099] [INFO ] [MAIN ] WM: Generated 871 derivative records from 24592 primary records. [2025-09-05T19:18:50.549528] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:50.656016] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-05T19:18:50.658211] [INFO ] [MAIN ] Derivative Progress: 2053/2117 symbols completed. WM took 0.9s. Estimated remaining: 19.0s. Rate: 202.4 symbols/min [2025-09-05T19:18:50.662544] [INFO ] [MAIN ] WMK: Loaded 6311 primary data records. [2025-09-05T19:18:50.910414] [INFO ] [MAIN ] WMB: Generated 871 derivative records from 25989 primary records. [2025-09-05T19:18:50.920309] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-05T19:18:50.922370] [INFO ] [MAIN ] Derivative Progress: 2054/2117 symbols completed. WMB took 0.7s. Estimated remaining: 18.7s. Rate: 202.4 symbols/min [2025-09-05T19:18:50.934135] [INFO ] [MAIN ] WMK: Generated 871 derivative records from 6311 primary records. [2025-09-05T19:18:50.942145] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-05T19:18:50.944630] [INFO ] [MAIN ] Derivative Progress: 2055/2117 symbols completed. WMK took 0.4s. Estimated remaining: 18.4s. Rate: 202.5 symbols/min [2025-09-05T19:18:50.945181] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:50.945495] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:50.945669] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:50.979468] [INFO ] [MAIN ] WNC: Loaded 18486 primary data records. [2025-09-05T19:18:51.077137] [INFO ] [MAIN ] WMT: Loaded 26110 primary data records. [2025-09-05T19:18:51.087925] [INFO ] [MAIN ] WMS: Loaded 29699 primary data records. [2025-09-05T19:18:51.800828] [INFO ] [MAIN ] WNC: Generated 871 derivative records from 18486 primary records. [2025-09-05T19:18:51.811546] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-05T19:18:51.813226] [INFO ] [MAIN ] Derivative Progress: 2056/2117 symbols completed. WNC took 0.9s. Estimated remaining: 18.1s. Rate: 202.3 symbols/min [2025-09-05T19:18:51.815600] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:51.824898] [INFO ] [MAIN ] WMT: Generated 871 derivative records from 26110 primary records. [2025-09-05T19:18:51.836087] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-05T19:18:51.838171] [INFO ] [MAIN ] Derivative Progress: 2057/2117 symbols completed. WMT took 0.9s. Estimated remaining: 17.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:51.838550] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:51.855285] [INFO ] [MAIN ] WMS: Generated 1352 derivative records from 29699 primary records. [2025-09-05T19:18:51.869031] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-05T19:18:51.878274] [INFO ] [MAIN ] Derivative Progress: 2058/2117 symbols completed. WMS took 0.9s. Estimated remaining: 17.5s. Rate: 202.4 symbols/min [2025-09-05T19:18:51.878703] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:51.879289] [INFO ] [MAIN ] WNS: Loaded 20274 primary data records. [2025-09-05T19:18:52.003334] [INFO ] [MAIN ] WOLF: Loaded 25901 primary data records. [2025-09-05T19:18:52.161199] [INFO ] [MAIN ] WOR: Loaded 17418 primary data records. [2025-09-05T19:18:52.728935] [INFO ] [MAIN ] WNS: Generated 871 derivative records from 20274 primary records. [2025-09-05T19:18:52.741336] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-05T19:18:52.742807] [INFO ] [MAIN ] Derivative Progress: 2059/2117 symbols completed. WNS took 0.9s. Estimated remaining: 17.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:52.743278] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:52.754625] [INFO ] [MAIN ] WOLF: Generated 871 derivative records from 25901 primary records. [2025-09-05T19:18:52.781295] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-05T19:18:52.782899] [INFO ] [MAIN ] Derivative Progress: 2060/2117 symbols completed. WOLF took 0.9s. Estimated remaining: 16.9s. Rate: 202.3 symbols/min [2025-09-05T19:18:52.781173] [INFO ] [MAIN ] WOR: Generated 1352 derivative records from 17418 primary records. [2025-09-05T19:18:52.783196] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:52.802732] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-05T19:18:52.806413] [INFO ] [MAIN ] Derivative Progress: 2061/2117 symbols completed. WOR took 0.9s. Estimated remaining: 16.6s. Rate: 202.4 symbols/min [2025-09-05T19:18:52.806835] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:52.807381] [INFO ] [MAIN ] WOW: Loaded 21980 primary data records. [2025-09-05T19:18:52.953863] [INFO ] [MAIN ] WPC: Loaded 23347 primary data records. [2025-09-05T19:18:53.184716] [INFO ] [MAIN ] WPM: Loaded 25392 primary data records. [2025-09-05T19:18:53.608504] [INFO ] [MAIN ] WOW: Generated 1352 derivative records from 21980 primary records. [2025-09-05T19:18:53.626204] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-05T19:18:53.628527] [INFO ] [MAIN ] Derivative Progress: 2062/2117 symbols completed. WOW took 0.9s. Estimated remaining: 16.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:53.629066] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:53.638571] [INFO ] [MAIN ] WPC: Generated 871 derivative records from 23347 primary records. [2025-09-05T19:18:53.647068] [INFO ] [MAIN ] WPM: Generated 871 derivative records from 25392 primary records. [2025-09-05T19:18:53.655847] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-05T19:18:53.661942] [INFO ] [MAIN ] Derivative Progress: 2063/2117 symbols completed. WPC took 0.9s. Estimated remaining: 16.0s. Rate: 202.3 symbols/min [2025-09-05T19:18:53.668460] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:53.671490] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-05T19:18:53.673134] [INFO ] [MAIN ] Derivative Progress: 2064/2117 symbols completed. WPM took 0.9s. Estimated remaining: 15.7s. Rate: 202.4 symbols/min [2025-09-05T19:18:53.679456] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:53.680156] [INFO ] [MAIN ] WPP: Loaded 17253 primary data records. [2025-09-05T19:18:53.947694] [INFO ] [MAIN ] WRBY: Loaded 24169 primary data records. [2025-09-05T19:18:53.949018] [INFO ] [MAIN ] WRB: Loaded 24390 primary data records. [2025-09-05T19:18:54.432837] [INFO ] [MAIN ] WPP: Generated 871 derivative records from 17253 primary records. [2025-09-05T19:18:54.445698] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-05T19:18:54.447445] [INFO ] [MAIN ] Derivative Progress: 2065/2117 symbols completed. WPP took 0.8s. Estimated remaining: 15.4s. Rate: 202.3 symbols/min [2025-09-05T19:18:54.447742] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:54.460967] [INFO ] [MAIN ] WRBY: Generated 871 derivative records from 24169 primary records. [2025-09-05T19:18:54.474236] [INFO ] [MAIN ] WRB: Generated 871 derivative records from 24390 primary records. [2025-09-05T19:18:54.497946] [INFO ] [MAIN ] WS: Loaded 17279 primary data records. [2025-09-05T19:18:54.512604] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-05T19:18:54.512680] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-05T19:18:54.540339] [INFO ] [MAIN ] Derivative Progress: 2066/2117 symbols completed. WRBY took 0.9s. Estimated remaining: 15.1s. Rate: 202.3 symbols/min [2025-09-05T19:18:54.568735] [INFO ] [MAIN ] Derivative Progress: 2067/2117 symbols completed. WRB took 0.9s. Estimated remaining: 14.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:54.562185] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:54.582995] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:54.803036] [INFO ] [MAIN ] WSO: Loaded 18278 primary data records. [2025-09-05T19:18:54.919930] [INFO ] [MAIN ] WSM: Loaded 23992 primary data records. [2025-09-05T19:18:55.437195] [INFO ] [MAIN ] WS: Generated 1352 derivative records from 17279 primary records. [2025-09-05T19:18:55.455613] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-05T19:18:55.458802] [INFO ] [MAIN ] Derivative Progress: 2068/2117 symbols completed. WS took 1.0s. Estimated remaining: 14.5s. Rate: 202.2 symbols/min [2025-09-05T19:18:55.474209] [INFO ] [MAIN ] WSM: Generated 871 derivative records from 23992 primary records. [2025-09-05T19:18:55.485480] [INFO ] [MAIN ] WSO: Generated 1352 derivative records from 18278 primary records. [2025-09-05T19:18:55.503131] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-05T19:18:55.506010] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-05T19:18:55.507760] [INFO ] [MAIN ] Derivative Progress: 2069/2117 symbols completed. WSM took 0.9s. Estimated remaining: 14.2s. Rate: 202.3 symbols/min [2025-09-05T19:18:55.510340] [INFO ] [MAIN ] Derivative Progress: 2070/2117 symbols completed. WSO took 0.9s. Estimated remaining: 13.9s. Rate: 202.4 symbols/min [2025-09-05T19:18:55.511032] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:55.511109] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:55.511239] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:55.531816] [INFO ] [MAIN ] WSR: Loaded 10638 primary data records. [2025-09-05T19:18:55.626920] [INFO ] [MAIN ] WST: Loaded 17230 primary data records. [2025-09-05T19:18:55.755453] [INFO ] [MAIN ] WT: Loaded 23849 primary data records. [2025-09-05T19:18:56.304061] [INFO ] [MAIN ] WSR: Generated 871 derivative records from 10638 primary records. [2025-09-05T19:18:56.312798] [INFO ] [MAIN ] WST: Generated 871 derivative records from 17230 primary records. [2025-09-05T19:18:56.321694] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-05T19:18:56.323364] [INFO ] [MAIN ] Derivative Progress: 2071/2117 symbols completed. WSR took 0.8s. Estimated remaining: 13.6s. Rate: 202.3 symbols/min [2025-09-05T19:18:56.330030] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:56.338315] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-05T19:18:56.340430] [INFO ] [MAIN ] Derivative Progress: 2072/2117 symbols completed. WST took 0.8s. Estimated remaining: 13.3s. Rate: 202.3 symbols/min [2025-09-05T19:18:56.340905] [INFO ] [MAIN ] WTM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:56.348615] [INFO ] [MAIN ] WT: Generated 871 derivative records from 23849 primary records. [2025-09-05T19:18:56.366308] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-05T19:18:56.365026] [INFO ] [MAIN ] WTM: Loaded 900 primary data records. [2025-09-05T19:18:56.368222] [INFO ] [MAIN ] Derivative Progress: 2073/2117 symbols completed. WT took 0.9s. Estimated remaining: 13.0s. Rate: 202.4 symbols/min [2025-09-05T19:18:56.388819] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:56.480598] [INFO ] [MAIN ] WTI: Loaded 21400 primary data records. [2025-09-05T19:18:56.740318] [INFO ] [MAIN ] WTRG: Loaded 24863 primary data records. [2025-09-05T19:18:57.141888] [INFO ] [MAIN ] WTM: Generated 870 derivative records from 900 primary records. [2025-09-05T19:18:57.155344] [INFO ] [MAIN ] WTM: Successfully saved derivative data. [2025-09-05T19:18:57.163468] [INFO ] [MAIN ] Derivative Progress: 2074/2117 symbols completed. WTM took 0.8s. Estimated remaining: 12.8s. Rate: 202.3 symbols/min [2025-09-05T19:18:57.164324] [INFO ] [MAIN ] WTI: Generated 871 derivative records from 21400 primary records. [2025-09-05T19:18:57.165628] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:57.175956] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-05T19:18:57.184067] [INFO ] [MAIN ] Derivative Progress: 2075/2117 symbols completed. WTI took 0.9s. Estimated remaining: 12.5s. Rate: 202.4 symbols/min [2025-09-05T19:18:57.185097] [INFO ] [MAIN ] WTRG: Generated 871 derivative records from 24863 primary records. [2025-09-05T19:18:57.185230] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:57.197525] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-05T19:18:57.199228] [INFO ] [MAIN ] Derivative Progress: 2076/2117 symbols completed. WTRG took 0.8s. Estimated remaining: 12.2s. Rate: 202.5 symbols/min [2025-09-05T19:18:57.199582] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:57.204597] [INFO ] [MAIN ] WTS: Loaded 8697 primary data records. [2025-09-05T19:18:57.342762] [INFO ] [MAIN ] WTTR: Loaded 20895 primary data records. [2025-09-05T19:18:57.442106] [INFO ] [MAIN ] WU: Loaded 25905 primary data records. [2025-09-05T19:18:57.983453] [INFO ] [MAIN ] WTS: Generated 871 derivative records from 8697 primary records. [2025-09-05T19:18:57.998587] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-05T19:18:58.000425] [INFO ] [MAIN ] Derivative Progress: 2077/2117 symbols completed. WTS took 0.8s. Estimated remaining: 11.9s. Rate: 202.3 symbols/min [2025-09-05T19:18:58.001083] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:58.015496] [INFO ] [MAIN ] WU: Generated 871 derivative records from 25905 primary records. [2025-09-05T19:18:58.023872] [INFO ] [MAIN ] WTTR: Generated 871 derivative records from 20895 primary records. [2025-09-05T19:18:58.031585] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-05T19:18:58.034281] [INFO ] [MAIN ] Derivative Progress: 2078/2117 symbols completed. WU took 0.8s. Estimated remaining: 11.6s. Rate: 202.4 symbols/min [2025-09-05T19:18:58.040827] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:58.049441] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-05T19:18:58.051835] [INFO ] [MAIN ] Derivative Progress: 2079/2117 symbols completed. WTTR took 0.9s. Estimated remaining: 11.3s. Rate: 202.5 symbols/min [2025-09-05T19:18:58.059191] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:58.061209] [INFO ] [MAIN ] WWW: Loaded 23754 primary data records. [2025-09-05T19:18:58.265847] [INFO ] [MAIN ] WY: Loaded 25733 primary data records. [2025-09-05T19:18:58.269824] [INFO ] [MAIN ] XFLT: Loaded 14617 primary data records. [2025-09-05T19:18:58.847081] [INFO ] [MAIN ] WWW: Generated 871 derivative records from 23754 primary records. [2025-09-05T19:18:58.859139] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-05T19:18:58.860875] [INFO ] [MAIN ] Derivative Progress: 2080/2117 symbols completed. WWW took 0.9s. Estimated remaining: 11.0s. Rate: 202.3 symbols/min [2025-09-05T19:18:58.861253] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:58.874423] [INFO ] [MAIN ] WY: Generated 871 derivative records from 25733 primary records. [2025-09-05T19:18:58.883799] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-05T19:18:58.895266] [INFO ] [MAIN ] Derivative Progress: 2081/2117 symbols completed. WY took 0.9s. Estimated remaining: 10.7s. Rate: 202.4 symbols/min [2025-09-05T19:18:58.895486] [INFO ] [MAIN ] XIFR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:58.905597] [INFO ] [MAIN ] XFLT: Generated 871 derivative records from 14617 primary records. [2025-09-05T19:18:58.923325] [INFO ] [MAIN ] XHR: Loaded 33346 primary data records. [2025-09-05T19:18:58.999745] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-05T19:18:59.024152] [INFO ] [MAIN ] Derivative Progress: 2082/2117 symbols completed. XFLT took 1.0s. Estimated remaining: 10.4s. Rate: 202.4 symbols/min [2025-09-05T19:18:59.038300] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:59.041920] [INFO ] [MAIN ] XIFR: Loaded 21393 primary data records. [2025-09-05T19:18:59.459723] [INFO ] [MAIN ] XOM: Loaded 26103 primary data records. [2025-09-05T19:18:59.709182] [INFO ] [MAIN ] XHR: Generated 1352 derivative records from 33346 primary records. [2025-09-05T19:18:59.725384] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-05T19:18:59.733757] [INFO ] [MAIN ] XIFR: Generated 871 derivative records from 21393 primary records. [2025-09-05T19:18:59.735892] [INFO ] [MAIN ] Derivative Progress: 2083/2117 symbols completed. XHR took 0.9s. Estimated remaining: 10.1s. Rate: 202.3 symbols/min [2025-09-05T19:18:59.745284] [INFO ] [MAIN ] XIFR: Successfully saved derivative data. [2025-09-05T19:18:59.746998] [INFO ] [MAIN ] Derivative Progress: 2084/2117 symbols completed. XIFR took 0.9s. Estimated remaining: 9.8s. Rate: 202.4 symbols/min [2025-09-05T19:18:59.756037] [INFO ] [MAIN ] XOM: Generated 871 derivative records from 26103 primary records. [2025-09-05T19:18:59.764549] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-05T19:18:59.766178] [INFO ] [MAIN ] Derivative Progress: 2085/2117 symbols completed. XOM took 0.7s. Estimated remaining: 9.5s. Rate: 202.5 symbols/min [2025-09-05T19:18:59.766817] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:59.766750] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:59.766716] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:18:59.788415] [INFO ] [MAIN ] XPER: Loaded 14206 primary data records. [2025-09-05T19:18:59.929736] [INFO ] [MAIN ] XPEV: Loaded 25984 primary data records. [2025-09-05T19:18:59.924373] [INFO ] [MAIN ] XPO: Loaded 22722 primary data records. [2025-09-05T19:19:00.576309] [INFO ] [MAIN ] XPER: Generated 871 derivative records from 14206 primary records. [2025-09-05T19:19:00.589408] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-05T19:19:00.591072] [INFO ] [MAIN ] Derivative Progress: 2086/2117 symbols completed. XPER took 0.8s. Estimated remaining: 9.2s. Rate: 202.3 symbols/min [2025-09-05T19:19:00.592007] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:00.604930] [INFO ] [MAIN ] XPO: Generated 871 derivative records from 22722 primary records. [2025-09-05T19:19:00.621195] [INFO ] [MAIN ] XPEV: Generated 871 derivative records from 25984 primary records. [2025-09-05T19:19:00.627893] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-05T19:19:00.630194] [INFO ] [MAIN ] Derivative Progress: 2087/2117 symbols completed. XPO took 0.9s. Estimated remaining: 8.9s. Rate: 202.4 symbols/min [2025-09-05T19:19:00.630449] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:00.646495] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-05T19:19:00.648233] [INFO ] [MAIN ] Derivative Progress: 2088/2117 symbols completed. XPEV took 0.9s. Estimated remaining: 8.6s. Rate: 202.5 symbols/min [2025-09-05T19:19:00.649033] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:00.649143] [INFO ] [MAIN ] XPOF: Loaded 18409 primary data records. [2025-09-05T19:19:00.783666] [INFO ] [MAIN ] XPRO: Loaded 22209 primary data records. [2025-09-05T19:19:00.880802] [INFO ] [MAIN ] XYF: Loaded 15993 primary data records. [2025-09-05T19:19:01.491475] [INFO ] [MAIN ] XPOF: Generated 871 derivative records from 18409 primary records. [2025-09-05T19:19:01.511799] [INFO ] [MAIN ] XPRO: Generated 871 derivative records from 22209 primary records. [2025-09-05T19:19:01.528746] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-05T19:19:01.533453] [INFO ] [MAIN ] Derivative Progress: 2089/2117 symbols completed. XPOF took 0.9s. Estimated remaining: 8.3s. Rate: 202.3 symbols/min [2025-09-05T19:19:01.535144] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-05T19:19:01.535048] [INFO ] [MAIN ] XYF: Generated 871 derivative records from 15993 primary records. [2025-09-05T19:19:01.537302] [INFO ] [MAIN ] Derivative Progress: 2090/2117 symbols completed. XPRO took 0.9s. Estimated remaining: 8.0s. Rate: 202.4 symbols/min [2025-09-05T19:19:01.537455] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:01.539042] [INFO ] [MAIN ] XYZ: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:01.548998] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-05T19:19:01.551089] [INFO ] [MAIN ] Derivative Progress: 2091/2117 symbols completed. XYF took 0.9s. Estimated remaining: 7.7s. Rate: 202.5 symbols/min [2025-09-05T19:19:01.551512] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:01.592917] [INFO ] [MAIN ] XYL: Loaded 22327 primary data records. [2025-09-05T19:19:01.593488] [INFO ] [MAIN ] XYZ: Loaded 26066 primary data records. [2025-09-05T19:19:01.737083] [INFO ] [MAIN ] YALA: Loaded 17468 primary data records. [2025-09-05T19:19:02.415248] [INFO ] [MAIN ] XYL: Generated 871 derivative records from 22327 primary records. [2025-09-05T19:19:02.423795] [INFO ] [MAIN ] XYZ: Generated 871 derivative records from 26066 primary records. [2025-09-05T19:19:02.448841] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-05T19:19:02.451696] [INFO ] [MAIN ] Derivative Progress: 2092/2117 symbols completed. XYL took 0.9s. Estimated remaining: 7.4s. Rate: 202.3 symbols/min [2025-09-05T19:19:02.450375] [INFO ] [MAIN ] YALA: Generated 871 derivative records from 17468 primary records. [2025-09-05T19:19:02.450473] [INFO ] [MAIN ] XYZ: Successfully saved derivative data. [2025-09-05T19:19:02.453607] [INFO ] [MAIN ] Derivative Progress: 2093/2117 symbols completed. XYZ took 0.9s. Estimated remaining: 7.1s. Rate: 202.4 symbols/min [2025-09-05T19:19:02.451925] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:02.453979] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:02.463487] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-05T19:19:02.465157] [INFO ] [MAIN ] Derivative Progress: 2094/2117 symbols completed. YALA took 0.9s. Estimated remaining: 6.8s. Rate: 202.5 symbols/min [2025-09-05T19:19:02.465402] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:02.497499] [INFO ] [MAIN ] YELP: Loaded 22057 primary data records. [2025-09-05T19:19:02.497049] [INFO ] [MAIN ] YEXT: Loaded 21184 primary data records. [2025-09-05T19:19:02.761275] [INFO ] [MAIN ] YMM: Loaded 25404 primary data records. [2025-09-05T19:19:03.277597] [INFO ] [MAIN ] YELP: Generated 871 derivative records from 22057 primary records. [2025-09-05T19:19:03.291099] [INFO ] [MAIN ] YEXT: Generated 871 derivative records from 21184 primary records. [2025-09-05T19:19:03.301730] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-05T19:19:03.304904] [INFO ] [MAIN ] Derivative Progress: 2095/2117 symbols completed. YELP took 0.9s. Estimated remaining: 6.5s. Rate: 202.3 symbols/min [2025-09-05T19:19:03.305354] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:03.308558] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-05T19:19:03.310452] [INFO ] [MAIN ] Derivative Progress: 2096/2117 symbols completed. YEXT took 0.9s. Estimated remaining: 6.2s. Rate: 202.4 symbols/min [2025-09-05T19:19:03.317086] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:03.318041] [INFO ] [MAIN ] YMM: Generated 871 derivative records from 25404 primary records. [2025-09-05T19:19:03.328472] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-05T19:19:03.330338] [INFO ] [MAIN ] Derivative Progress: 2097/2117 symbols completed. YMM took 0.9s. Estimated remaining: 5.9s. Rate: 202.5 symbols/min [2025-09-05T19:19:03.330612] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:03.348522] [INFO ] [MAIN ] YRD: Loaded 5227 primary data records. [2025-09-05T19:19:03.443981] [INFO ] [MAIN ] YPF: Loaded 23823 primary data records. [2025-09-05T19:19:03.533846] [INFO ] [MAIN ] YOU: Loaded 37378 primary data records. [2025-09-05T19:19:04.213847] [INFO ] [MAIN ] YRD: Generated 871 derivative records from 5227 primary records. [2025-09-05T19:19:04.233384] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-05T19:19:04.236433] [INFO ] [MAIN ] Derivative Progress: 2098/2117 symbols completed. YRD took 0.9s. Estimated remaining: 5.6s. Rate: 202.3 symbols/min [2025-09-05T19:19:04.235068] [INFO ] [MAIN ] YPF: Generated 871 derivative records from 23823 primary records. [2025-09-05T19:19:04.247968] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-05T19:19:04.249753] [INFO ] [MAIN ] Derivative Progress: 2099/2117 symbols completed. YPF took 0.9s. Estimated remaining: 5.3s. Rate: 202.4 symbols/min [2025-09-05T19:19:04.259852] [INFO ] [MAIN ] YOU: Generated 1352 derivative records from 37378 primary records. [2025-09-05T19:19:04.272687] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-05T19:19:04.275256] [INFO ] [MAIN ] Derivative Progress: 2100/2117 symbols completed. YOU took 1.0s. Estimated remaining: 5.0s. Rate: 202.5 symbols/min [2025-09-05T19:19:04.275964] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:04.275916] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:04.275879] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:04.307718] [INFO ] [MAIN ] YSG: Loaded 15709 primary data records. [2025-09-05T19:19:04.399486] [INFO ] [MAIN ] YUM: Loaded 24590 primary data records. [2025-09-05T19:19:04.469256] [INFO ] [MAIN ] YUMC: Loaded 25364 primary data records. [2025-09-05T19:19:05.075744] [INFO ] [MAIN ] YSG: Generated 871 derivative records from 15709 primary records. [2025-09-05T19:19:05.096011] [INFO ] [MAIN ] YUMC: Generated 871 derivative records from 25364 primary records. [2025-09-05T19:19:05.103875] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-05T19:19:05.104729] [INFO ] [MAIN ] YUM: Generated 871 derivative records from 24590 primary records. [2025-09-05T19:19:05.110098] [INFO ] [MAIN ] Derivative Progress: 2101/2117 symbols completed. YSG took 0.8s. Estimated remaining: 4.7s. Rate: 202.3 symbols/min [2025-09-05T19:19:05.112513] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:05.122801] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-05T19:19:05.124996] [INFO ] [MAIN ] Derivative Progress: 2102/2117 symbols completed. YUMC took 0.8s. Estimated remaining: 4.4s. Rate: 202.4 symbols/min [2025-09-05T19:19:05.125276] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-05T19:19:05.125473] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:05.127180] [INFO ] [MAIN ] Derivative Progress: 2103/2117 symbols completed. YUM took 0.9s. Estimated remaining: 4.1s. Rate: 202.5 symbols/min [2025-09-05T19:19:05.127841] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:05.149666] [INFO ] [MAIN ] ZEPP: Loaded 12110 primary data records. [2025-09-05T19:19:05.277633] [INFO ] [MAIN ] ZBH: Loaded 24652 primary data records. [2025-09-05T19:19:05.277474] [INFO ] [MAIN ] ZETA: Loaded 26034 primary data records. [2025-09-05T19:19:05.892886] [INFO ] [MAIN ] ZEPP: Generated 871 derivative records from 12110 primary records. [2025-09-05T19:19:05.914218] [INFO ] [MAIN ] ZBH: Generated 871 derivative records from 24652 primary records. [2025-09-05T19:19:05.914891] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-05T19:19:05.916356] [INFO ] [MAIN ] Derivative Progress: 2104/2117 symbols completed. ZEPP took 0.8s. Estimated remaining: 3.9s. Rate: 202.3 symbols/min [2025-09-05T19:19:05.923843] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:05.929411] [INFO ] [MAIN ] ZETA: Generated 871 derivative records from 26034 primary records. [2025-09-05T19:19:05.938381] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-05T19:19:05.941533] [INFO ] [MAIN ] Derivative Progress: 2105/2117 symbols completed. ZBH took 0.8s. Estimated remaining: 3.6s. Rate: 202.4 symbols/min [2025-09-05T19:19:05.942266] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:05.945278] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-05T19:19:05.947125] [INFO ] [MAIN ] Derivative Progress: 2106/2117 symbols completed. ZETA took 0.8s. Estimated remaining: 3.3s. Rate: 202.5 symbols/min [2025-09-05T19:19:05.947383] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:05.961776] [INFO ] [MAIN ] ZH: Loaded 12292 primary data records. [2025-09-05T19:19:06.054400] [INFO ] [MAIN ] ZGN: Loaded 19602 primary data records. [2025-09-05T19:19:06.262529] [INFO ] [MAIN ] ZIM: Loaded 25935 primary data records. [2025-09-05T19:19:06.747188] [INFO ] [MAIN ] ZH: Generated 871 derivative records from 12292 primary records. [2025-09-05T19:19:06.759934] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-05T19:19:06.761409] [INFO ] [MAIN ] Derivative Progress: 2107/2117 symbols completed. ZH took 0.8s. Estimated remaining: 3.0s. Rate: 202.3 symbols/min [2025-09-05T19:19:06.768124] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:06.769622] [INFO ] [MAIN ] ZGN: Generated 871 derivative records from 19602 primary records. [2025-09-05T19:19:06.788280] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-05T19:19:06.788208] [INFO ] [MAIN ] ZIM: Generated 871 derivative records from 25935 primary records. [2025-09-05T19:19:06.790590] [INFO ] [MAIN ] Derivative Progress: 2108/2117 symbols completed. ZGN took 0.9s. Estimated remaining: 2.7s. Rate: 202.4 symbols/min [2025-09-05T19:19:06.790919] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:06.804843] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-05T19:19:06.806510] [INFO ] [MAIN ] Derivative Progress: 2109/2117 symbols completed. ZIM took 0.9s. Estimated remaining: 2.4s. Rate: 202.5 symbols/min [2025-09-05T19:19:06.806808] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:06.817391] [INFO ] [MAIN ] ZIP: Loaded 20966 primary data records. [2025-09-05T19:19:06.820111] [INFO ] [MAIN ] ZKH: Loaded 4565 primary data records. [2025-09-05T19:19:07.031935] [INFO ] [MAIN ] ZK: Loaded 17195 primary data records. [2025-09-05T19:19:07.555421] [INFO ] [MAIN ] ZKH: Generated 871 derivative records from 4565 primary records. [2025-09-05T19:19:07.565053] [INFO ] [MAIN ] ZIP: Generated 871 derivative records from 20966 primary records. [2025-09-05T19:19:07.578412] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-05T19:19:07.579761] [INFO ] [MAIN ] Derivative Progress: 2110/2117 symbols completed. ZKH took 0.8s. Estimated remaining: 2.1s. Rate: 202.4 symbols/min [2025-09-05T19:19:07.581546] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:07.589966] [INFO ] [MAIN ] ZK: Generated 871 derivative records from 17195 primary records. [2025-09-05T19:19:07.596415] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-05T19:19:07.599722] [INFO ] [MAIN ] Derivative Progress: 2111/2117 symbols completed. ZIP took 0.8s. Estimated remaining: 1.8s. Rate: 202.4 symbols/min [2025-09-05T19:19:07.600667] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:07.603925] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-05T19:19:07.606264] [INFO ] [MAIN ] Derivative Progress: 2112/2117 symbols completed. ZK took 0.8s. Estimated remaining: 1.5s. Rate: 202.5 symbols/min [2025-09-05T19:19:07.606582] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:07.615331] [INFO ] [MAIN ] ZTR: Loaded 9062 primary data records. [2025-09-05T19:19:07.756210] [INFO ] [MAIN ] ZTO: Loaded 23800 primary data records. [2025-09-05T19:19:07.908451] [INFO ] [MAIN ] ZTS: Loaded 25715 primary data records. [2025-09-05T19:19:08.367562] [INFO ] [MAIN ] ZTR: Generated 871 derivative records from 9062 primary records. [2025-09-05T19:19:08.385662] [INFO ] [MAIN ] ZTO: Generated 871 derivative records from 23800 primary records. [2025-09-05T19:19:08.393885] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-05T19:19:08.395717] [INFO ] [MAIN ] Derivative Progress: 2113/2117 symbols completed. ZTR took 0.8s. Estimated remaining: 1.2s. Rate: 202.4 symbols/min [2025-09-05T19:19:08.397802] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-05T19:19:08.400713] [INFO ] [MAIN ] Derivative Progress: 2114/2117 symbols completed. ZTO took 0.8s. Estimated remaining: 0.9s. Rate: 202.5 symbols/min [2025-09-05T19:19:08.408148] [INFO ] [MAIN ] ZTS: Generated 871 derivative records from 25715 primary records. [2025-09-05T19:19:08.416826] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-05T19:19:08.418492] [INFO ] [MAIN ] Derivative Progress: 2115/2117 symbols completed. ZTS took 0.8s. Estimated remaining: 0.6s. Rate: 202.6 symbols/min [2025-09-05T19:19:08.418857] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:08.418905] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-05T19:19:08.449161] [INFO ] [MAIN ] ZVIA: Loaded 18182 primary data records. [2025-09-05T19:19:08.450547] [INFO ] [MAIN ] ZWS: Loaded 20073 primary data records. [2025-09-05T19:19:08.954798] [INFO ] [MAIN ] ZVIA: Generated 871 derivative records from 18182 primary records. [2025-09-05T19:19:08.969017] [INFO ] [MAIN ] ZWS: Generated 871 derivative records from 20073 primary records. [2025-09-05T19:19:08.977977] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-05T19:19:08.980200] [INFO ] [MAIN ] Derivative Progress: 2116/2117 symbols completed. ZVIA took 0.6s. Estimated remaining: 0.3s. Rate: 202.5 symbols/min [2025-09-05T19:19:08.981048] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-05T19:19:08.982661] [INFO ] [MAIN ] Derivative Progress: 2117/2117 symbols completed. ZWS took 0.6s. Estimated remaining: 0.0s. Rate: 202.6 symbols/min [2025-09-05T19:19:08.987364] [INFO ] [MAIN ] Parallel derivative generation completed in 10m 27s [2025-09-05T19:19:08.987446] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2117/2117 symbols) [2025-09-05T19:19:09.731952] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-05T19:19:09.732139] [INFO ] [STATE ] Last completion updated: 2025-09-05T19:19:09.732044